OWB ETL programming
hi
I 've created my mappings in oracle warehouse builder... now i need to program this mappings to update my information repository every day...
my question is... how can i do this? how can i execute my mappings every day ... to update my information... (in automatic mode)
and my second question is.... in the mapping properties... how can i update my information... the default action in the creation of a mapping is insert (data)... if i change it to update... change all the table or review only the changes for every registry....and if the table has rows deleted... the mapping delete them too??
I read OWB user guide ... the section of oracle workflow but i don´t know if i need this or something else...
I really appreciate your help
Thanks Alex
I created owf_mgr user in the workflow instalation...and I can connect me to OEM...
In fact i granted EXECUTE ANY PROCEDURE privilege for this user... for deployment...
I finally can install middle tier components for work flow... i read workflow monitor is configured with the workflow installation but i dont know how view the logs errors.
How i said: i created and process in owb and the deplyment was correct; i created a job with the follow script in OEM;
declare
ret number;
begin
ret:=runtime_owner.wb_rt_api_exec.run_task('LOC_OWF', 'PROCESS', 'PROC_MAPEO','','',1);
end;
The job was created without problem, and by default was executed in the creation moment... but the job doesnt do anything.
My process has 2 mappings, and mappings work fine then i create my process with owb and finally i crated my job for update everyday my tables...
It seems all works fine but my tables don´t have data...
Any ideas where can i review my logs errors?
I really need to finish with this...
Thanks
Mensaje editado por:
Oscar Ramirez
Mensaje editado por:
Oscar Ramirez
Similar Messages
-
Hi marcos,
Can you send me the OWB ETL Design Document on My email address [email protected]
It would be very helpful.
Best Regards,
AjazCan someone stop this post, every ETL document is specific to business requirement,logic and rules and it cannot be generic so i don't see any point in having this post.
Dear Administrator,
Can you please monitor and close off these kind of posts as they are not helping anybody but are more likely to be misleading. -
System description
1. Oracle BI Standard Edition One (OWB 10.2 + Oracle Std. Ed. One 10.1)
2. Windows Server 2003 R2
3. Oracle 9.2 (External server)
Problem description
We have a database Oracle 9.2 as a source database module in our Oracle Warehouse Builder repository.
Also we have as a target database, the Oracle Standard Ed. One database.
We have defined a ETL mapping on our repository in which we have mapped some columns from a table of the
source module (oracle 9.2) to a table on our repository. One of these columns has the type VARCHAR2(60).
The same type is defined on the target table in our target module in the repository.
After validating and deploying the mapping, we obtain a critical error when we are trying to execute the
mapping, the problem is that the length of the VARCHAR2(60) mapping on the source database is 60 bytes
but when the OWB tries to transfer the data, it thinks that is 60 characters and has only 60 bytes of space,
so the 60 characters do not fit in the target column.
Possible solution
We have found the parameter NLS_LENGTH_SEMANTICS which allows you to specify the length of a column
datatype in terms of CHARacters rather than in terms of BYTEs.
Question
Is it possible to alter the parameter NLS_LENGTH_SEMANTICS or there is another workaround to solve this
issue without changing the DDL on the target module or increasing the target data type to 120 bytes?
Thanks in advanceHello and thanks for the answer, my problem is that I don't want neither truncate my information nor increase the column map length in order to read the whole information. I would like to have a mapping and forget that maybe the information does not fit... But because the source database and target database are not the same, they have different settings, the problem is still there.
Any other solution that not imply losing information?
Thanks again. -
Deployment of OWB-ETL? How did you do it?
Hi folks,
I'm considering the deployment of a large set of Mappings in OWB that are part of the population of a Data Warehouse.
I see that the the Process Flow/Oracle Workflow is one suggestion for developing and deploying the framework for bringing these various Mappings under one logical unit.
However I'm begining to wonder if the investment in the skills and training and effort required to implement the process flows in Oracle Workflow are worth it.
I want to take a poll and also find out what people who implemented medium to large ETL using OWB have to say about this.
a) What tool did you use to logically bind together the various mappings in your Warehouse.
b) If you did create process flows, were you able to implement it with Oracle Workflow, and if so whats the stability of that system?
c) If you did indeed create a Process Flow, have you tried running or implemented that workflow (XPDL file) in any of the other commercially available or Open Source workflow engines out there? If so please detail your experience.
Thanks,
SridharI have done a nuance of this with one SFDC instance partitioned with multiple Record Types (a virtual new instance) The record type kept the contact from being visible to multiple business units and allowed for 'intentional' duplicates.
We had at one time 5 different BUs with possible contact overlap.
I have also implemented a single Eloqua instance with 2 BUs and 2 CRMs. The logic for lead flow was the big challenge. We turned off the native Activity write to the CRM systems and instead used the contact activity overview link. Though not ideal, it solved for a ton of failed API calls where the contact/lead ID did not exist in Eloqua.
Every situation is unique, there are no easy answers for this scenario.
I am happy to get on the phone with you to talk more.
Nathan -
The mis-mapping problem when upgrading OWB from 11.1 to 11.2.0.2.
Hi all,
Our OWB ETL program was developed initially on OWB 11.1 platform.
Then after upgrading it from 11.1 to 11.2.0.2, several mappings are mismatched in the deployment PL/SQL package as below:
CREATE OR REPLACE PACKAGE BODY "MAP_PRODUCT_LIFE_CRT" AS
CURSOR "T_T_PRODUCT_LIFE_c" IS
SELECT
/* T_PRODUCT_LIFE.T_T_PRODUCT_LIFE.INOUTGRP1 */
"T_T_PRODUCT_LIFE"."INS_TYPE" "ORGAN_ID$1",
"T_T_PRODUCT_LIFE"."START_DATE" "HOSPITAL_TYPE$1",
"T_T_PRODUCT_LIFE"."END_DATE" "UNIT_FLAG$1",
"T_T_PRODUCT_LIFE"."LIFE_RATE" "INS_TYPE",
You can see that the field mapping is wrong! We have about 100 mappings, but only some of them go wrong.
We have tried the Metadata Loader and Repository Assistant for the upgrading, but the results are the same.
We have released all OWB patches on 11.2.0.2, but the results are the same.
Please help on it!Hi David,
Besides the mega patch 10185523, we also have applied other tens of patches, e.g. 10225308, 11671955, 11705023, 1768535, etc.
Now we find that the wrong field mapping just appears in the row-based part of the mapping package. So if the set-based mode works well for the mapping execution, no error will happen. That's why we just found the problems in several mappings.
And one thing is even worse. In the patched OWB 11.2.0.2 env., we tried creating totally new mapping. The result is the same: the wrong field mapping still appears in the row-based part of the mapping package.
So this problem seems not related to the upgrading.
Regards. -
Hi friends,
<li> can i know the etl steps involved in owb. if so can you provide the etl steps now.
<li> And also there is any diagram for owb, Covering owb etl process from source to target(including BI components) too. (like available for infomatica in a diagrammatical manner) like how it is taking data from source and how it is performing etl process and how it is transforming it to data warehouse and how BI components utilizing it.
Thanks
Regards,
Saro.
Your Answers will be marked.Hi Saro,
OWB does not enforce some specific steps on you. You define your datawarehouse architecure according to your needs. OWB perfectly support you to
+ extract the data from the source systems or files
+ load into the database (staging)
+ process the data within the database, e.g. loading it from the staging area into the core (normalized or star schema)
+ load it into OLAP cubes
+ design and monitor the overall process using process flows
Regards,
Carsten. -
so. i worked with oem (olap area). i created some measures and all. i created de user inteface with jdeveloper and bi beans 10g.
now i want to test owb.
what is the diference between them? owb is only for olap? which one is better? can i use jdev&bi beans with owb?
please help! i need some directions....
tnxAs far as I know OWB and ODI fall under the same licence now (at least in UK), so if you're licenced to use OWB + ETL options you're probably licenced to use ODI. Check with your friendly Oracle Account Manager :¬)
Why are you thinking about moving to ODI, what limitations have you come across with OWB? A better upgrade path may be to OWB 11gR2 now that it supports (ODI) knowledge modules and has better integration with OBIEE (if use use that).
If you search this forum and the ODI forum you'll find a number of posts on the subject, I posted a similar question a few months back after which we decided to stick with OWB. Oracle have stated they will provide a migration path to a single product in the future.
Si -
Steps to create SCD1 and SCD2 in OWB
Hi experts ,
PLesae tell me the steps to create SCD1 and SCD2 in OWB.
Thanks and regards
SunilSunil,
This forum meant for Oracle BI Suite Enterprise Edition and not for OWB ETL tool.
But if you want steps of creating SCD2 specify your email id I will send you the doc for SCD implementation.
Regards,
Amrita -
Need help regarding training on OWB from Oracle corp
Hi All,
I have 5years of exp in Oracle admin/Dev platform. Now I wanted to move on to warehouse, something new and different . So could you guys help me out how I would get a training on this. I inquired regarding Owb training program from Oracle corp, according to them its all elearing .So I am not interested on that . I am searching for classroom based training .
Now I am based on Pune,India. I am open to Mumbai,Hyderabad,Bangalore in india. I am ready to move and attend classroom training on this . So could someone help me on that ?I took the OWB 5-day live virtual class and found it as good or better than being in a classroom. It basically entailed installing a vpn connection to the Oracle training system and launching the virtual desktop to do lab activities; the course materials were provided electronically before the class began (pdf), and the instructor presented the materials and demo'ed the topics via a webex-style presentation. The only drawback was the audio portion was via telephone; from my location (US) it was a toll free call, but use of a headset or speakerphone was mandatory to avoid permanent neck injury; hopefully they will get the audio online with the LVC or at least provide it as an option for those who have audio capability (mic & speakers) on the computer.
-
Hi all,
We are in the process of getting an ETL program. We need it to perform some basic extract, transform and load jobs.
But we want to get an open source tool with good training.
Our team is mainly business oriented, with some computer knowledge. We would like to have someone come to our company and explain to all the team how to operate the tool.
I can operate the tool on my own, but I am not experienced enough to show other people how to operate the software.
So would someone know which open source companies offer ETL tools with good training and how much time would it take?
Thanks.Open source software companies, such as Talend, offer training to their users.
You are able to get a full training in three days on an open source ETL tool. Talend gives an on-site extensive training to their customers.
A roadshow also goes through many cities in the US and in Europe to discover the software. It is a free 3 hour long training.
Go look at the training page: http://www.talend.com/services/training.php -
OWB: how can automatic updation perform in staging database using OWB
I am using OWB-etl to fetch data from source database and store to staging db.
in target table operator i am using insert operation.
it is inserting data fien.
but my requirement is target database must be automatically updated with what ever modification made to source data base.
can u pls help me how to achive this ?
Thanks alot ...
k azamtulla khanHi,
why do you want to do this using OWB, is it not easier to create a before/after insert/update trigger on source table so that your target table is updated automatically. You can benefit by using owb in scenarios where you need to transform and load data and then schedule this process and for the rest of it i would recommend using triggers for row level activities such as update. -
Hi ,
I have OWB11gR2 with OWBSYS access.
I want to check the time taken by the OWB ETL in our company.
This ETL has many process flows and mappings.
Please can some onw give me the query ?
Also a pdf guide link for reference will also help.
Regards,
SHello
You can find the log in the runtime tables in the OWBSYS repository
SELECT * FROM OWBSYS.OWB$WB_RT_AUDIT; -
Hi all,
We are currently using OWB10g at our company and are considering the benefits of switching over to ODI.(Cost will also be a deciding factor). I need some suggestions from people who have used both OWB and ODI-could you compare what is better in ODI and what is not etc?
Thanks.As far as I know OWB and ODI fall under the same licence now (at least in UK), so if you're licenced to use OWB + ETL options you're probably licenced to use ODI. Check with your friendly Oracle Account Manager :¬)
Why are you thinking about moving to ODI, what limitations have you come across with OWB? A better upgrade path may be to OWB 11gR2 now that it supports (ODI) knowledge modules and has better integration with OBIEE (if use use that).
If you search this forum and the ODI forum you'll find a number of posts on the subject, I posted a similar question a few months back after which we decided to stick with OWB. Oracle have stated they will provide a migration path to a single product in the future.
Si -
SCHEDULING & MONITORING PROGRAMS (TO PROCESS 100 TO 5000 FILES A DAY)
We have the end to end set of programs for scheduling & monitoring any ETL programs. In big enterprises , the system to system data access always happens through ascii files. if there are systems which needs to recieve/load files & produce handoff files periodically and if the number of files handled in day are quite large (eg:atleast
100 to 5000 files ) you can make use of our programs.The features of the scheduler are
The ETL Program Scheduling
- Incoming files are grouped together ( eg: system_name + country + branch combination , Not necessary ), Similarly outgoing files as well.
- Files will get loaded only when the whole set is recieved
- More priority can be given to certain sets depending upon the need
- Loading set to Loading set dependency (very rare cases)
- Output set to loading set dependency (The output set will be generated when all(if any) dependent loading sets are loaded.
- Order of execution of files in a set (for both loading / output )
- Statistical information about everyday's loading files (Recived time , Start time & End time of a particular file on anyday)
- 5 Parrellel queues for loading and 5 for output generation ( Multi threading )
- Output files are automatically ftp'd if required
- Esay query mechanism to know which set failed , Which file/program failed in
- Status of execution of any file by ETL program from multiple sources ( Database , File Location in diff. directories , From log files )
.. and more
- Dynamic renaming of files & execution
Monitoring Program
- For the Data centre / Back office processing people
- For a incoming set, when crossed the deadline time, this monitor log shows the contact details
- When anything gets errord out the monitor log gives the set & contact details
- Holiday maintenance for any group can be maintained.
End of day programs
- To take care of purging & archiving of files, database & logfiles etc.
Tested with 2 ETL tools ( Constellar hub from DataMirror & Oraclewarehouse builder) and this scheduler is live in an International bank (confidential) in 3 regions (Asia Pacific , Europe & North America) "PROCESSING 1000+ FILES A DAY" at each of the 3 regional data centres for the last 10 years ( constellar ) .
Technology Specifications
Operating System > HP Unix
Database > Oracle
Software > Couple of Unix shell scripts & Pro*C code
IF INTERESTED PLS MAIL ME BACK AT [email protected] (i.e; ranjeesh007 at yahoo dot com)
WITH YOUR REQUIREMENT DETAILS
Cheers
Ranjeesh K Ramakrishnan
Mumbai
0091-98216 41777Hi,
Sounds like you have a cache problem, it could be a file corruption. I would first suggest you to clear out everything in the cache directory and do a re-sync and see if issue persists.
Also, please check on your server or OneDrive to see the total amount of data that being stored. Check if you have any large files stored, like videos.
More reference about Office Document Cache settings:
http://office.microsoft.com/en-us/word-help/office-document-cache-settings-HA010388664.aspx
Hope this helps.
Thanks,
Ethan Hua CHN
TechNet Community Support -
We are developing ETL Programs to load data from Staging tables in oracle to Target tables. We are just developing PL/SQL program but wont to use warehouse builder for this and even wont to trace rows and columns in target schema as from which source table and columns it have arrived, Basically wont to keep track of target data as from which table and column it have arrived from source as there could be multiple source for a target but business rule define the priority to insert the appropriate data in target, and latter point of time wont to know as from which source table and column have this arrived.
Any one can suggest me if OWB can help me in this case and if yes how, which document and from where should I read about it.
Thanks in advance and I can be reached in Delhi at 0091- 9818405549.
Cheers
Devpal SinghOWB has a feature named lineage analysis that can help you trace the data lineage. It also has a data flow debugger that can help you debug data flow problems by showing you step-by-step how data flows and is trasformed within a mapping (ETL procedure).
For details, you should take a look the OWB user's guide (http://download-west.oracle.com/docs/html/B10996_01/toc.htm), in particular http://download-west.oracle.com/docs/html/B10996_01/17metabr.htm#1098816 for the lineage and impact analysis and http://download-west.oracle.com/docs/html/B10996_01/07debug.htm#1004903 for the debugger.
Regards:
Igor
Maybe you are looking for
-
I was uploading stuff. Then my ibook shut off/froze. I restarted it and then my ipod had the 'do not disconnect' on it. I reset it, 'select+menu' .according to the support info, I wasn't supposed to lose files, I lost some and now itunes doesn't reco
-
How well does Aperture 2.1 work with Adobe Photoelements 6?
I am currently working with Aperture 2.1. I understand from the Apple one-to-one trainers that I would get improved editing if I installed Adobe Photoelements 6. Yet, when I had Adobe Phototoelements 5 on my Leopard, it crashed iPhoto and iPhoto cras
-
Product cost v/s Production Order cost
Hi all Guru's, Can any one help me in understanding difference between product cost and production order cost in SAP. Will give full marks for helpful answer. Thanks, Abhishek Edited by: ABHISHEK AGRAWAL on Jan 29, 2008 9:46 A
-
How can I tell whether there is a Trojan on my Mac? I downloaded two file that looked legit but I think they were not. They originated in theory from eFax . I am on OS X 10.6.8
-
dear all, when i execute : declare result boolean ; begin result:=DBMS_REPAIR.ONLINE_INDEX_CLEAN(dbms_repair.all_index_id,dbms_repair.lock_wait); end ; i get error: ERROR at line 4: ORA-06550: line 4, column 21: PLS-00302: component 'ONLINE_INDEX_CLE