How ETL (mappings) is done in Warehouse Builder ??

Hi All,
I am new to warehouse builder and was wondering if there is tutorials or video tutorials on how mapping works in warehouse Builder.
I need to use this builder to map different tables from different schemas.
example:
schema_1 schema_2
table1 -----> maps to ------> table2
col1 -----------------> col1
col2 ---------------> col2
col3 --------------> col3
Anything to get me started would be great.
Thanks for the help.
Edited by: Rooney on May 21, 2012 12:36 PM
Edited by: Rooney on May 21, 2012 12:37 PM

Hi,
Here are some videos:
- http://www.youtube.com/watch?v=BUHGSr10gJs
- http://www.youtube.com/watch?v=Y_V1Lurzwbc
The better approach is to read the User's Guide http://docs.oracle.com/cd/B28359_01/owb.111/b31278.pdf
Mina

Similar Messages

How scaler query works in warehouse builder

suppose i have two tables. 1 is salary, the other is overtime. Salary is given by each employee but few of them are given overtime. i solve this in SQL like this
" SELECT S.EMPLOYEECODE,S.DEPTCODE,S.DESIGID,S.GROSSPAY,
(SELECT O.AMOUNT
FROM OVERTIME_CALCULATION O
WHERE O.EMPLOYEECODE = S.EMPLOYEECODE
AND O.OVERTIME_DATE = S.SALDATE) OVERTIME
FROM YTOD_SAL S, EMPLOYEES E
WHERE S.EMPLOYEECODE = 'D2194'
AND E.EMPLOYEECODE = S.EMPLOYEECODE "
how can i solve this in warehouse builder,
plz help me...
thanks in advance

Yes. Everybody has right. your query is an outer join.
This SQL (which is approximately yours)
select t.*, (select c1 from t2 where t2.key1 = t.key1) c1,
(select c2 from t3 where t3.key1 = t.key2) c2
from tis the same that :
select t.*, t2.c1, t3.c3
from t, t2, t3
where t.key1 = t2.key1 (+)
and t.key2 = t3.key2 (+)Thus transform your query in an outer join and use a joiner operator.
Just a question. What is scaler query ?
Success
Nico
http://gerardnico.com

Oracle Warehouse Builder 10g installation issues

Hi All,
I have downloaded the OWB 10g, from the site. I have Oracle 10g (Release 2) database server installed on the machine.
When I start installing Oracle Warehouse Builder 10g, it just does the client installation and I am not able to find out were should I search for the OWB server installation?
Even I have checked by installing the same but I just have Repository Assistant , Design Center and Repository Browser available on the machine. I could not find the Runtime Assistant & Control Center to work on?
Can somebody help me out with these issues?
Thanks in advance.
Regards,
Anand

Hi...
There is an explanations..from the FAQ itself :
How do I download and install Warehouse Builder Client versus Warehouse Builder Server?
Warehouse Builder is a single install image that contains both Client and Server components, which are installed at the same time as part of the installation process. If the deployment target database is on the same machine as Warehouse Builder Client UI, there is one single installation process. If the deployment target database is on a separate machine, the install process has to be run twice, repeating the exact same install process on the client machine (to run the Warehouse Builder Design client) and the deployment target machine. Normally when installing the repository, either locally or remotely, the OWB software needs to be already present on the machine. However, it is possible to skip or defer the step of installing on the target deployment machine. This is referred to as a “Remote Target Configuration”. More information on this can be found in the Installation Guide, Chapter 2, “Remote Target”.
hope this helps...
Davis

How to register user in Warehouse Builder

Hi All,
I have installed OWB 11g in my machine. I have created repository owner user in OLAP schema. In my process flows few flows are related to "OLAP instance" and few flows are related to "OLTP instance". Now I want to register my OLTP user present in OLTP instance, but when I start the wizard for registering user I get only OLAP instance users.
Please let me know how can I register my OLTP user of OLTP instance.
Is there any way to register database user manually in warehouse builder i.e. without using register user wizard?
Thanks
VishalS

Hi,
create the users as repos-owner in the design center or grant the roles to an existing db user. Don't make them to TARGET users!
Then selct the project, right mouse-click opens the context menue, select configuration, select the security tab and revoke all permissions except read from this users.
Regards,
Detlef

Warehouse Builder - Workflow - How to integrate both?

Hi All
I have installed Oracle Workflow Server in a SUN machine; and the Oracle
Workflow Client (Builder) in a WIN2000 machine.
In the SUN machine, I already had installed Oracle9i and OMS (Oracle
Management Server) version 9.2.0.1.0.
In the WINDOWS 2000 machine, I already had installed the Oracle9i
Client and the OWB (Oracle Warehouse Builder) version 9.0.3.35.0. Workflow Builder
was installed together with Oracle Client components.
I have a OWB (Oracle Warehouse Builder) project, and I deploy and schedule JOBS in OEM.
Now I need Oracle Workflow in order to better ordering, manage and schedule that jobs.
I'm reading the following documentation:
Oracle Workflow Guide (Release 2.6.2)
http://www.csis.gvsu.edu/GeneralInfo/Oracle/workflow.920/a95265.pdf
But I think Oracle Workflow is very complex to learn quickly.
My OWB Project has several mappings that load tables in a Data Warehouse.
When I deploy these mappings one by one, in OEM, I can execute them in OEM
and they work well.
But when I use the Workflow Deployment Wizard, I create a new Workflow
Project (Item type and Process).
But I can't Launch this process. I go to Launch Process in Workflow page
(http://<my_machine>:<port>/pls/<WorkDAD>/) but when I iniciate the project,
it stops in the OWB Standard Begin Function. It does not go ahead.
Well, when I use the Workflow Deployment Wizard inside OWB, it generates jobs that can
be viewed inside OEM (Oracle Enterprise Manager) too. But when I submit
these jobs, I can't get success too.
Can somebody help me? May you guide me in order to solve my problem, or send me some
documents or links about workflow, and it's integration with OWB and OEM?
Best regards
Adriano Sastre Vieira
Especialista em Sistemas
Inatel Competence Center
+55 35 3471 9335
[email protected]

Mark, I've already made the steps you suggested.
As it did not works yet, I will explain step by step what I've made, and the versions of the softwares:
In my Win2000 machine (development) I have installed:
- OWB version "9.0.3.33.0" and updated it to "9.0.3.35.0". (in a Oracle9iDS ORACLE_HOME).
- the OEM version "9.2.0.1.0" and Oracle Workflow Builder version "2.6.1.5.2" (in a Oracle9i ORACLE_HOME), both were installed with Oracle9i Client. Here maybe an error is the OWF Builder version, is there an newer version of it?
In a SUN SOLARIS machine (the server) we have installed:
- OMS version "9.2.0.1.0".
- OWF Server version "2.6.2" (installed with Oracle "9.0.2.1").
- Apache HTTP Server version "1.3" (also installed with Oracle "9.0.2.1").
- The repository for OWB, OEM and OWF (both 3 are different schemas in one database), and the target Warehouse (another database) are installed in this machine (SUN) too.
Well, working in my OWB project I can normaly deploy my tables, views and mappings in the target warehouse.
I can also run these jobs (generated by OWB) and they populate the Warehouse tables. It is exactly what I need, but now I need to schedule and order these jobs in workflow, you know.
When I run the Workflow Deployment Wizard (in OWB), in the "connect information for the Workflow Server" screen, I fill in with the "owf_mgr" username and its password. In the next screen I choose one or more mappings.
Next, suppose I fill in the Workflow Item Type as WIT_DW and the Workflow Process as WP_DW.
And in the last screen, I check the option "Deploy the Workflow Process into OEM".
It generates 4 jobs in OEM:
- WIT_DW_OWB_STD_BEGIN
- WIT_DW_OWB_STD_END
- WIT_DW_OWB_STD_ERROR
- WIT_DW_WP_DW
Next, I go to the Oracle Workflow Builder, open the project I've created (in the Database), make the flow, and save the project.
Next, I come back to the OEM and Submit the "WIT_DW_WP_DW" job, but it does not work. So, there's something wrong yet.
About the Workflow Queue Listener:
- Together with OWB 9.0.33.3.0 installation, there's the directory "extras\wfql_unix". I copied this directory contents inside "$ORACLE_HOME" in SUN.
- Inside OWB, in the Warehouse Module, in the "Configuration Properties DATA_WAREHOUSE" screen, I filled in the "Run
Time Directories > Queue Listener Directory" field with "/disk1/oracle/owb/bin/solaris". (It's the local where the workflowqlsnr.sh is located). And in the field "Queue Listener Host" I put the name of the SUN machine.
- But I can't run the workflowqlsnr.sh with success. Some java errors occurs. Is there anything to do or configure yet?
More questions (Please I'd very glad if you could help me):
- Is there some thing I need to configure in the Workflow Manager page?
(http://[machine]:[port]/servlets/em/oam/wfm/wfmLogin$tns_address=)
E.g., change or add Background Engine / Agent Listener / Queue Propagation / Purge.
- Is there some thing I need to configure in the Workflow home page?
(http://[machine]:[port]/pls/[WorkDAD]/wfa_html.home)
- How do I erase the Workflow Items Type in the Workflow Home Page? I runned the "workflowqclr.sh" but it didn't erase.
Thanks again
Adriano Sastre Vieira
Especialista em Sistemas
Inatel Competence Center
+55 35 3471 9335
[email protected]
You wrote:
Adriano,
In order to manage the dependencies between the mappings using Oracle Workflow you have to do the following:
- Deploy your mappings (PL/SQL into the database; ABAP to the SAP machine; SQL loader on to the target database's file system).
- Register all mappings in OEM (that is, using the tcl scripts and the OEM register button).
- Run the Workflow deployment wizard to create the process steps in Oracle Workflow. At the end of the wizard, you can choose to create Workflow jobs to invoke the process flow.
- Use Workflow Builder to build the actual process flow (so far you have only created the process steps). Save the process.
- Either use OEM to submit the process or use the workflowqlsnr.sh to invoke the workflow queue listener manually. In order to use OEM, make sure you have set the Workflow Queue listener path correctly in the configuration of the target module.
Then... figgers crossed... it should work.
Hope this helps,
Mark.

How to run a unix script from oracle warehouse Builder

Hi,
can any one share the information about, running the unix script or scripts using oracle warehouse builder.
Regards,
Ak

One way is define a workflow. Inside the workflow you put
1)an external process that "points to" the shell script and then
2)put the mapping
The external process must have the "COMMAND" parameter set to the name of the shell script. If the script has parameters you must put them in the "PARAMETERS LIST" separated by "?" (for example, ?par1?par2).
The path where OWB executes the external process I think is the ORACLE_HOME of the OWB.
f you don't use workflow, you can try with this more complex solution. I tried with 9i and OWB 9.2 and it's working well.
You create an autonomous procedure (within a package or not) :
CREATE PROCEDURE Extract_Email_List
DECLARE
PRAGMA AUTONOMOUS_TRANSACTION;
And use the sys.shell script that you need your dba/unix admin to install first of all, with a call like that.
sys.shell('sh ' || txt_dir_name || '/send_email_marketing.sh ' || txt_dir_name || ' ' || email_addr );
Then you import your procedure into OWB and use it in your mapping with the "pre-mapping" icon (you can set parameters for your proc with constants if you want).
To implement sys.shell, go to metalink and find "Note:168065.1" - "How to call a UNIX shell script from PL/SQL".
Once it's done once, it's not so bad. But I would still recommend the workflow approach also..
I hope this helps.

How to perform auto update in staging database using warehouse builder ?

Hi ,
here our client requirement is?
our client want to transfer data from their production database to staging database using warehouse builder.and also what ever the update occur in production database
that must be reflected in staging database.
here we are transfering data from product-db to staging using etl(maping--insert/update operator )
it is transfering fine.but it is not automaticaly updating in staging db with new update in production database?
can any body give me the details how to achive it.
Thanks & regards,
k azamtulla khan.

Hi,
firstly there are two threads for the same issue from youself(excluding this one) which is a waste of others time so kindly refrain from doing so and use one thread.
OWB: how can automatic updation perform in staging database using OWB
OWB: how to use insert/update table operator for target table
secondly, with regards to the options , here are some options:
1. Use trigger for update.
2. Use materialized view(refresh on commit)
3. Use oracle advance queing mechanism (OAQ) for queing the recent inserted/updated records.
Kindly close other threads and maintain just one thread.
Regards
Message was edited by: Rado
user647181

Who says Oracle Warehouse Builder is a leader in ETL?

... the analyst firm Gartner does!
Oracle Warehouse Builder moved into the leader quadrant in Gartner's ETL Magic Quadrant published on September 8, 2004. Please see today's press release from Oracle http://biz.yahoo.com/prnews/040916/sfth048_1.html
What does it mean for the technical users of OWB like you: data warehouse developers, architects, data analysts, DBAs?
It means that you've made a wise career decision to become skilled in the product with rapidly growing customer base and market recognition.
Nikolai Rochnik

If it were me, I'd use an 'Expression' operator in the mapping and write a CASE statement. You could also write a public or private transformation that takes the varchar2 parameter in and outputs the number you want and plug that into your mapping.
Which route you go depends on how often you need to do this. One time, just write an expression. Reuse? Then make a transformation.
- D

Warehouse Builder - Repository - How extract ?

Sorry for my broken english, but i need your help.
I must write about Warehouse Builder Repository.(Describe).
My Teacher say, that i must import repository to designer and than i will see scheme (and then describe all elements).
But how do that ?
Maybe you have some information about Warehouse Builder Repository ?
Thanks for help.

Thanks for answer.
I begining with Oracle, and sorry if my questions are maybe stupid ;)
1. I must download Database 10g + designer 10g + OWB 10g - and this is all ? Or maybe also Oracle Developer
Suite 10g ?
Please give me direct link to this software, becouse today i download a lot of this software, but the is so many version that i don't now, what is good.
2. To write about Warehouse Builder Repository.(Describe) i must load some exmaple warehouse ? i think, that no ?
Thanks.
Message was edited by:
user593152

A bug in the warehouse builder regarding mappings of dimensions

Hi there
I do not know if this is the right place to submit a possible bug. Anyways - here goes.
Warehouse builder client: 10.1.0.2.0
Warehouse builder repository: 10.1.0.1.0
I'm creating a dimension, having one level attributes property as a varchar2(30). Thus it has a length of 30. Now, later on I decide this was an error. I update the property to a number, deploys, and reconcile the dimension inbound in the mapping. From now on, it will give an error, since it remembers the length. And a number has a size, not a length. If I remove the dimension from the mapping, and inserts it again, the error still occurs.
By the way, I am able to reproduce this.
Anyone who has experienced this, and can blame the stupid user (me) or classify this as a bug?
Yours
Kim Andersen

Hi Igor
The "error" is actually a "warning":
Warning: VLD-1004: Column length of ASD_ASDASD is longer than the target column length.
where ASD_ASDASD is the dimension property, which I altered. It is annoying, though, to have warnings on the list, that aren't needed. And I also spent considerable time thinking that was the error in a mapping, whereas it was a stupid mistake made by me somewhere else :)
If it's a registered bug, do I get to win some branded Oracle candy?! :)
Yours
Kim

How to Install oracle warehouse builder repository

OS Enterprise linux for oracle
database 11G
I have installed oracle warehouse builder 11G .
Pls tell about any link to install Repository in linux environment.

go to <ORACLE_HOME>/owb/unifiedrepos
directory
then run the following order
sqlplus "/ as sysdba" @clean_owbsys.sql
sqlplus "/ as sysdba" @cat_owb.sql SYSAUX
sqlplus "/ as sysdba" @unlock_owbsys.sql
sqlplus "/ as sysdba" @reset_owbcc_home <DB_ORACLE_HOME>
IF OWB has been installed with Oracle11g DB installation.
Then from design center itself you can configure the workspace.
Most cases this will resolve your issue.

How to learn Oracle Warehouse Builder

Hi,
I want to learn OWB. Please help me or suggest some good tutorials on it. I have read OWB documentation from oracle website.
Please also suggest some interview questions on OWB.
Thanks
kamal

The tutorial are here:
https://apex.oracle.com/pls/apex/f?p=44785:2:5134446483796491::NO
Product: choose a database version (11g for instance) and as child product warehouse builder.
Cheers
Nico

Working on ETL tools interoperability using Common Warehouse Model (CWM)

Hi All,
Its just a piece of information and not a question.
I have been working on proving the ETL tools interoperability using Common Warehouse Metamodel(CWM), an OMG standard. The whole concept is to take out the metadata from an ETL tool say OWB and put it into CWM Metadata Repository and this metadata can be used for building the same project in any other tool say Informatica or may be in the same ETL tool.
The main thing in this process is to map each ETL tool with the CWM concepts and then using Model to Model Tranformations(Technologies like Xtend) one can set up a communication between different ETL tools.
Till now I have worked with OWB only. I, with my team, have extracted all information from an OWB project (which has medium level of complexity like two oracle modules(schemas) and few tables, views and mappings with various operators) and put it in CWM repository and extracted it back from CWM MDR to OWB itself. We haven't worked with any other ETL tool because of the unavailablity of any other ETL tool with us. We will be working with Pentaho kettle in near future and try to prove the whole process as two way communication.
The whole process can be described in steps as below :
1. Creation of a manual OWB Ecore model(model representaion in Eclipse Modelling Framework) which gives all dependencies and reletionships in OWB objects like Project,OracleModule etc.
2. Creation of CWM ecore model from Rational Rose mdl which has been provided by OMG on their site.
3. Generation of Java code(Gen Model) from the above mentioned ecore model(It is needed to create an object from OWB).
4. Extraction of project from OWB using public views which has been exposed by OWB itself. You can refer to [http://download.oracle.com/docs/cd/B31080_01/doc/owb.102/b28225/toc.htm|http://download.oracle.com/docs/cd/B31080_01/doc/owb.102/b28225/toc.htm] link for OWB public views and other APIs.
5. (Actually Step 4 is a part of this step only )Writing a Java code which has JDBC connection for accessing OWB public views and Ecore model as imported java files(Step 3 has been done for this part only). This java code will return an OWB project object(instance of the Ecore model) which will be used in further steps.
6. Writing an Xtend code to do a model to model tranformation from OWB to CWM.
7. Writing an Open Architecture Workflow to combine all the steps in one step which will take the output of java code(step 5) and put it into Xtend Code(step 6) and then will take the output of Xtend code and give it to the XMIWriter(an OAW component) to write an XMI which is actually a CWM Ecore Model instance.
8. Saving above XMI(CWM model instance) to the CWM MDR using Hibernate and Teneo.
In the same way we can extract metadata from CWM MDR and put it into OWB. But the only problem with OWB is that we cannot persist OWB object in OWB repositories as OWB tables are very cryptic and tough to understand. So for that we have used TCL scripts(OMB Plus scripts) to create a project in OWB using OWB ecore instance. You can refer to the above oracle documentation link for TCL scripts.
Let me know if I can assist you if you are working on the same.
You can mail me for any queries. My email id is [email protected].
Thanks,
Deepak

Hi
1. Why do we need to install another standalone HTTP server in a separate home? Where do we use that server?
DA: The separate HTTP server is for the Workflow Monitor, which is not necessary (it has some use cases mind you).
2. To make the OWB work correctly while using ETL features, do we always need to run Workflow Configuration Assistant, because I wasn't able to generate code from OWB editor after building a mapping while Workflow Configuration Assistant wasn't running.
DA: Not necessary, what error did you get? Mappings can be designed, deployed and executed without Workflow. Workflow can be used for orchestrating the the mappings (ie .running a bunch of them in a specific order with others tasks).
3. Whenever I try to save my work in OWB, I get an error , message : Preference.properties (Access is denied). Though it saves my work but I don't understand why I am getting this error. It looks like OWB is trying to access some Property from the Preferences (Tools menu) but can't access.
DA: It sounds like the directory where you have installed OWB does not have permissions for the OS user you are executing it. Is the install user different from the execution user? Either run using the installed user, or change the permissions of the directories (grant the executing user write permissions under all directories under owb).
4. I also get error while closing the Mapping Editor :-
DA. same issue as 3.
Cheers
David

Scheduling in Warehouse Builder

Hi all,
There is an urgent requirement for scheduling in warehouse builder in my project. Can any one provide me the doucument for the scheduling processes in warehouse builder.

Hi
There's 2 ways I've done this:
1 Use the scheduler in OWB - you need to license the Enterprise ETL option but then it's just a case of reading the manual and setting it up. You will need to have Oracle Workflow installed which is a bit more
involved but there's lots of posts about that elsewhere on the forum.
2 Use DBMS_SCHEDULER to run your processes or mappings. Read this blog at Rittman Mead: [http://www.rittmanmead.com/2005/04/28/scheduling-an-owb-90492101-mapping-or-process-flow-using-dbms_job/]
Set up the function and then call it via a pl/sql block which can be scheduled. Very quick to get set up and doesn't need a license.
Hope that's enough to get you started
Pete

Confuse about Configuring Oracle Warehouse Builder

newbie here... i am abit confuse on how to configure the Oracle Warehouse builder...
I have 2 database... 1 source and 1 new one...
I understand that i have to install the Runtime Repository in the database computer and the Target Schema through the client's computer...
so all this while... i am just confuse about what to install into the source database and what to install into the new database...
Please help...

Location is a logical entity in your OWB design that can be either a database schema, a flat file location, an SAP application location etc. Once you complete your design and are ready to deploy the design into the runtime environment, you will have to 'register' the locations by providing the physical details of your location to OWB (user name/password, database, hostname etc.).
I am a bit confused by your configuration - are the source and the target in two separate schemas or in the same schema? Your posts are somewhat contradictory.
If they are in two different schemas, you should:
1. Create a source module pointing to a source schema (you can then import data object structures from the source schema - i.e. you don't have to create source tables manually in OWB, but you can import them into the module automatically). This module will have a source location (for example SRC_LOC).
2. Create a target module where all your target objects will be (i.e. where the data will be loaded). This module will have a different location (TGT_LOC). In your target module you will also create the mappings.
3. When deploying, you will register SRC_LOC with the physical details of your source schema, while the target location will be registered with the physical details of the target schema. The code generated by OWB during deployment will make sure that the data is extracted from the source schema and inserted into the target schema (either by generating and using DB links or by qualifying the schemas in the extraction queries if source and target are in the same database instance).
On the other hand, if both source and target objects are in the same db schema, you can have all your objects in the same target module and you will only have to register the location of this target module when deploying (LOC_TGT).
That said, there can be a variety of reasons why there is no data in the target after you run the extract mapping that have nothing to do with locations, such as logical errors in the mapping (an inappropriate filter or a wrong join), insufficient privileges etc. I suggest you take a look in the runtime audit browser that should contain the error messages relative to your mapping.
Regards:
Igor

How ETL (mappings) is done in Warehouse Builder ??

Similar Messages

Maybe you are looking for