ETL Tool

Hi
I want to put my data into database from text files and text files are not in proper format. How can i do this? I have heard about ETL tools . Can anybody tell me which is the best tool for ETL and can be free downloadable? and how they are used? Actually i am new to databases and do not know too much about... So please help me
Thanks
Divine

Hello, Divine!
Perhaps, you could take a look at Apatar, which is an ETL toolset basically. And it is totally free, being distributed under open source license.
It enables Oracle connectivity to a variety of databases (MySQL, PostgreSQL, MS SQL, MS Access, Sybase, etc.), flat files (.TXT, .CSV), applications (SugarCRM, SalesForce.com, Goldmine CRM), XML (local and web-based), FTP, Webdav, Buzzsaw, Amazon S3 hosting, RSS feeds, and so on.
Probably, something will suit you.
There are pre-created ETL jobs for Oracle at http://www.apatarforge.org/files/search-for-datamaps-12.html
For more information, or to download a copy of Apatar, try http://www.apatar.com
Hope, this tool would help you.
Alex Khizhnyak
Apatar Evangelist

Similar Messages

Working on ETL tools interoperability using Common Warehouse Model (CWM)

Hi All,
Its just a piece of information and not a question.
I have been working on proving the ETL tools interoperability using Common Warehouse Metamodel(CWM), an OMG standard. The whole concept is to take out the metadata from an ETL tool say OWB and put it into CWM Metadata Repository and this metadata can be used for building the same project in any other tool say Informatica or may be in the same ETL tool.
The main thing in this process is to map each ETL tool with the CWM concepts and then using Model to Model Tranformations(Technologies like Xtend) one can set up a communication between different ETL tools.
Till now I have worked with OWB only. I, with my team, have extracted all information from an OWB project (which has medium level of complexity like two oracle modules(schemas) and few tables, views and mappings with various operators) and put it in CWM repository and extracted it back from CWM MDR to OWB itself. We haven't worked with any other ETL tool because of the unavailablity of any other ETL tool with us. We will be working with Pentaho kettle in near future and try to prove the whole process as two way communication.
The whole process can be described in steps as below :
1. Creation of a manual OWB Ecore model(model representaion in Eclipse Modelling Framework) which gives all dependencies and reletionships in OWB objects like Project,OracleModule etc.
2. Creation of CWM ecore model from Rational Rose mdl which has been provided by OMG on their site.
3. Generation of Java code(Gen Model) from the above mentioned ecore model(It is needed to create an object from OWB).
4. Extraction of project from OWB using public views which has been exposed by OWB itself. You can refer to [http://download.oracle.com/docs/cd/B31080_01/doc/owb.102/b28225/toc.htm|http://download.oracle.com/docs/cd/B31080_01/doc/owb.102/b28225/toc.htm] link for OWB public views and other APIs.
5. (Actually Step 4 is a part of this step only )Writing a Java code which has JDBC connection for accessing OWB public views and Ecore model as imported java files(Step 3 has been done for this part only). This java code will return an OWB project object(instance of the Ecore model) which will be used in further steps.
6. Writing an Xtend code to do a model to model tranformation from OWB to CWM.
7. Writing an Open Architecture Workflow to combine all the steps in one step which will take the output of java code(step 5) and put it into Xtend Code(step 6) and then will take the output of Xtend code and give it to the XMIWriter(an OAW component) to write an XMI which is actually a CWM Ecore Model instance.
8. Saving above XMI(CWM model instance) to the CWM MDR using Hibernate and Teneo.
In the same way we can extract metadata from CWM MDR and put it into OWB. But the only problem with OWB is that we cannot persist OWB object in OWB repositories as OWB tables are very cryptic and tough to understand. So for that we have used TCL scripts(OMB Plus scripts) to create a project in OWB using OWB ecore instance. You can refer to the above oracle documentation link for TCL scripts.
Let me know if I can assist you if you are working on the same.
You can mail me for any queries. My email id is [email protected].
Thanks,
Deepak

Hi
1. Why do we need to install another standalone HTTP server in a separate home? Where do we use that server?
DA: The separate HTTP server is for the Workflow Monitor, which is not necessary (it has some use cases mind you).
2. To make the OWB work correctly while using ETL features, do we always need to run Workflow Configuration Assistant, because I wasn't able to generate code from OWB editor after building a mapping while Workflow Configuration Assistant wasn't running.
DA: Not necessary, what error did you get? Mappings can be designed, deployed and executed without Workflow. Workflow can be used for orchestrating the the mappings (ie .running a bunch of them in a specific order with others tasks).
3. Whenever I try to save my work in OWB, I get an error , message : Preference.properties (Access is denied). Though it saves my work but I don't understand why I am getting this error. It looks like OWB is trying to access some Property from the Preferences (Tools menu) but can't access.
DA: It sounds like the directory where you have installed OWB does not have permissions for the OS user you are executing it. Is the install user different from the execution user? Either run using the installed user, or change the permissions of the directories (grant the executing user write permissions under all directories under owb).
4. I also get error while closing the Mapping Editor :-
DA. same issue as 3.
Cheers
David

Can We use FDM as ETL tool between SQL and Oracle

I want to use FDM as ETL tool between SQL and Oracle. Can it be possible. I didn,t found any target adapter for oracle database.My source system is SQL and Target system is Oracle database.
Rahul
Edited by: user12190125 on Nov 9, 2009 4:23 AM

Rahul,
I believe this is possible to do, but not an easy one and there are a few considerations:
How much data are you processing? FDM has a lot of features which support the business process. While this is great for users and audit trail etc. it slows down performance if you want to process a lot of data. It also depends on the type of mappings you use (Like mappings are slower than explicit mappings).
How familiar are you with VBScript? There is no explicit target adapter for Oracle, but there is a data mart adapter which can be used for anything. You have to implement everything yourself though, mainly the Export and Load actions. In there you will also have to handle the the connections to the MSSQL and Oracle databases.
Check the data mart adapter and see if you feel comfortable with defining the vb code in there. There are reasons for and against this approach. ODI would probably be the better choice unless you really need to have FDM's process support.
Regards,
Matt

Scope for data warehousing ETL Tool

Hi all
can anybody explain scope for data warehousing ETL Tool
for oracle developer in future this is ok or..
regards
Message was edited by:
174313

What exactly is your question?
The scope of using an ETL tool would be setting up and maintaining datawarehouses and building ETL processes to populate these datawarehouses.
A tool is generally preferred over hand coding because tools allow better maintenance, shorter development cycles etc.
Oracle has a pretty good ETL tool, called Oracle Warehouse Builder. It's not the best tool available, but if you compare price/ functionality I would say in most cases it will do.
If your question is if it's a wise pick to master OWB or any ETL tool my answer would be a clear YES! Datawarehouses and BI are becoming more important every day, their use gets broader everyday.
If your question is if an investment in OWB is a wise investment for the future I would answer a clear YES again. It's increddilbe to see what progress Oracle made with the tool, coming from a 'laughing stock' postition, regarded completely immature good for nothing tool, to where they are now, with 10.2. Regarded as one of the leaders by Gartner.
Oracle has recognized (a long while ago) that ETL is the bread and butter of the future and invests in a good quality tool for accomplishing this.
I hope this answes your question, if not, please try to specify more clearly.
Regards,
Toin.

Data Warehouse and ETL tools for data verification ?

Data Warehouse and ETL tools for data verification ?
How need to to data verification using ETL tool ? Also how to relate this thing to datawaehouse ?
Thanks in Advance

Hi Shyamal Kumar,
1) BW it self facilitates to do the ETL (Extraction Transformation Loading) steps:
     example:
                 Extraction - from SAP or other data bases
                 Transformation - using transfer rules, Updates rules
                 Loading - Loading into ODS, Cube, master data
2) Typically used ETL tools in the industry are:
     a)   datastage from Ascential (owned by IBM)
     b)   Informatica
     c)   Mercator
Regards, BB

Is SAP BODS the best ETL tool for a complex BI Environment

Hi All
We are in the process of rationilising our BI / Analytics environment.
We currently have SAP ECC6 as our ERP system, SAP BW as our Warehouse and BO for WEB and Dashboard fron ends. In additon we have a small instance of COGNOS which is largely fed with flat file loads but some Oracle and ECC6 data.
In addition we are evaluating Big data solutions with Teradata the current lead.
We are in danger of having multiple ETL tools associated with the main BI applications and so we are comparing SAP BODS with IBM Datastage with a view to slecting one of them as our only ETL tool.
Does anyone have any compatability information for SAP BODS with Cognos and Teradata? The main function required would be extracting from ECC6 into SAP BW, Cognos and Teradata.
Thanks
Jerry

Hi Jerry,
Cognos is a presentation tool so no worries as far integration is concerned.
As far teradata is concerned, kindly see the following doc:
http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/30a4caa2-ce7f-2e10-5291-c484df6be4af?QuickLink=index&overridelayout=true&51591147160102
Best Regards
Certified SAP Data Services Consultant

Is it possible to use EBS as a ETL tool ?

Is it possible to use EBS as a ETL tool ?

Hi,
Are you referring to "Extract, Transform, Load"? It is possible to download/upload the data from/to Oracle Apps and there are many APIs and tools (provided by Oracle or 3rd party) which should be helpful -- Please see these links for details:
Oracle Integration Repository
http://irep.oracle.com
3rd Party/ISV Generic Installation Advice
3rd Party/ISV Generic Installation Advice
Note: 951604.1 - Implementing Oracle EBS Service on a Separate Instance
However, you still need to use such tools with caution (make sure it is supported) as you do not want to end up with referential integrity issues and data corruption problems.
Regards,
Hussein

Business Objects Rapid Marts with third-party ETL tool

Hi,
I understand BO Rapid Marts are natively developed by BO Data Integrator. Can we use any other ETL tool in combination with BO Rapid Marts?

Hi,
the Rapid Marts are designed to work with the BusinessObjects Data Services.
Ingo

Upload file in to km folder using ETL tools

Hi Experts,
I have requirement, to upload html file in to km repository using some ETL tool. Is it possible? If not...
How i can bring a file from a different server in to portal km repository?
Regards
Baby

Hi all,
I am closing this question... since i got a better way to proceed...
In our portal we have a file system mountpoint (etc). We are able to FTP html files in to this folder through ETL scheduling...
I think this is better way, also have discussion with some of my friends... any comments..
Regards
Baby
Edited by: Baby on May 25, 2009 4:11 PM

Low-Cost data migration and ETL tools

Hi, Im building a database for my company. We are a rather small size book company with a lot of references and still growing.
We have a Mysql database here and are trying to find some good tools to use it at its best. Basically we are just starting up the database after dealing with Excel: we had a size problemu2026 So im trying to find a program that will allow us to do two different things: the migration of our data from the old system to the new one and a specialized software to perform ETL (Extract, transform and load) on our database.
About the price of the tools, if we were one year ago, the accounting department would have been pretty relaxed about this. But today, we have some budget restrictions and therefore need a low cost tool. So could you give me some advice on a good data migration and etl tool for a low cost?
Thanks for your help.

Hi,
Some companies have budget problems and are having to reduce their cost of operation.
Have you ever heard of open source tools? They can do the job easily and less expensive than proprietary solutions that cost a lot of money.
You can have a look at a good ETL open source program called Talend Open Studio: it is user-friendly but also has advanced features intended for technical users (java debugger, code injectionu2026). It can perform data migration and ETL as you wrote in your first post.
The website is [here|http://www.talend.com/solutions-data-integration/data-migration.php] to download the open source program. They have a forum and documentation you can read. Tell us what you think about the software.
For an ETL benchmark: [ETL Benchmark|http://blogs.sun.com/aja/entry/talend_s_new_data_processing]

Need help on ETL Tool research .

Hi,
I am conducting a survey as a part of the research I am doing on ETL tools. It will be very helpful if you can fill up all the details.If you are too busy,I will request you to fill up atleast the ones with **) marks pls.
# Your Name -
# Your E-Mail ID -
# Company Name with URL -
# Your Client for the ETL project -
**) The Name of the ETL Tool Vendor with URL -
# Any particular reason to select that tool -
# Maintenance fee of the tool -
# Number of licences used by your company -
# The peak volume handled in a day in ( in MB ) -
**) The total number of files handled in a day -
**) The total number of programs/interfaces -
# The scheduling done by ETL Scheduler of vendor (Y/N) -
# Used the OS Scheduler for scheduling (Y/N) -
# Used the database jobs(Y/N) -
**) Used external program(Y/N) -
**) If so the technologies used for the program & a brief description with features of the scheduler
Once filled pls mail me at [email protected]
(ranjeesh007 at yahoo dot com)
with thanks in advance
Ranjeesh

Ranjeesh,
If it only was that simple to get such information, most analyst firms and industry publications would be out of business.
Nikolai Rochnik

ETL tool in Oracle 9i/10g

hi all,
we use DTS to extract data in SQL server. can you please suggest me what ETL tool is there in Oracle9i/10g to do the same purpose????
thanks & regards,
Priyatosh

Oracle Warehouse Builder
Home made PL/SQL Procedures
You can also have a look in Transportable Tablespace Feature (I do not know your requirments)
You can trasport data between database usingdatabase links
You can also use SQL*Loader for Loadingdata into Oracle
To load data from flat files also external tables can be helpful
But for building ETL logic like DTS packages allows to do, I think the best choice would be Oracle Warehouse Builder.
Best Regards
Krystian Zieja / mob

Real time ETL tool

I wanted to know if Oracle has a ETL tool? and if so is it possible to get real time Data extraction form our application for our Datawharehouse ( not incremental)
null

Oracle's Extract Transform and Load(ETL) tool is known as Oracle Warehouse Builder(OWB). The ETL process is primarily incremental.
TCL('tickle')scripts can be registered with Oracle Enterprise Manager. These are used to schedule and run initial and incremental loader jobs.
null

Oracle ETL Tool

Hi,
I have some data in Oracle table, which contains a column 'address'. I want to extract the values in this 'address' , transform the values, and then load it into another oracle table. During transformation, I want to standardize the values in the 'address' column.
For example, there are following values in this column:
House Number 2
H.No. 334
HNO 345
H Number 35
House Num 52
I want that during transformation, I replace all the variations of House Number values in address column to like following:
House Number 2
House Number 334
House Number 345
House Number 35
House Number 52
Please guide me as which Oracle ETL tool should I use.
regards

you can use Oracle Warehouse Builder to implement such funcitonality.
Cheers
Nawneet

ETL tools and training

Hi all,
We are in the process of getting an ETL program. We need it to perform some basic extract, transform and load jobs.
But we want to get an open source tool with good training.
Our team is mainly business oriented, with some computer knowledge. We would like to have someone come to our company and explain to all the team how to operate the tool.
I can operate the tool on my own, but I am not experienced enough to show other people how to operate the software.
So would someone know which open source companies offer ETL tools with good training and how much time would it take?
Thanks.

Open source software companies, such as Talend, offer training to their users.
You are able to get a full training in three days on an open source ETL tool. Talend gives an on-site extensive training to their customers.
A roadshow also goes through many cities in the US and in Europe to discover the software. It is a free 3 hour long training.
Go look at the training page: http://www.talend.com/services/training.php

ETL Tool

Similar Messages

Maybe you are looking for