CDC in OWB 11.2

Hi guys,
2 question regarding setting up Change Data Capture (CDC).
1. In OWB 11.2, is using CT Mapping the only way to perform CDC?
2. Is CCA (Control Ctr Agent) required if I am in all Oracle Environment (CT mappings)? (Source: Ora 10.1, Target 11.2)
I would like to avoid using CCA if it's not needed.
Thank you.

Hi
As well as the CDC template mapping, there are a bunch of options for CDC including anything from Streams to replicate environments (also OWB supports trickle feed maps for AQs in 11gR2), or you can use your own replication technology such as Oracle Golden gate and simply work off of the replicated tables.
If you are in an all Oracle environment, code template mappings are not essential, proof being all previous releases did not have them - they do bring a lot of alternatives to the table which let you do more and faster than before.
Cheers
David

Similar Messages

CDC and OWB 10g R2 installation error

Hi,
We are using CDC (Autolog) and OWB 10g R2 for the warehouse. We have CDC installed and up and running on the database. I then try to install the OWB 10g R2 repository using OMBPlus and it fails with this error message:
OWB repository installtion failed. The Warehouse Builder repository owner instal
lation failed on user OWBRO.
java.sql.SQLException: ORA-00604: error occurred at recursive SQL level 1
ORA-29549: class SOME.SYSTEM CLASS has changed, Java session state cleared
ORA-06512: at "SYS.DBMS_CDC_IPUBLISH", line 12
ORA-06512: at line 5
I cannot find any documentation related to this. Has anyone attempted this and has this worked?
Thanks
K

I figured out that the OWBRT_SYS had been created incorrectly. When I dropped the user and recreated the repository, this problem disappeared.

CDC in OWB 11gR1

I want to use CDC feature in OWB 11gR1 to capture all the changes in database, do I need to change any parameters in source database or install something? My source database is Oracle 10gR3.
Thanks.

Hi
For OWB 10gR2 and 11gR1 for example check out the article here:
http://www.rittmanmead.com/2006/04/14/asynchronous-hotlog-distributed-change-data-capture-and-owb-paris/
In OWB 11gR2 there is a framework that can be used to do this OOTB:
http://blogs.oracle.com/warehousebuilder/2009/12/owb_11gr2_change_data_capture_web_services.html
http://www.rittmanmead.com/2009/10/10/changed-data-capture-and-owb11gr2/
Cheers
David

Problem in Oracle CDC Create Subscription option

Hi All,
I am facing a problem setting up CDC in test environment after cloning from DEV. We are using Oracle 11g and OWB 11g2 versions.
For setting up CDC through OWB client, when we started start CDC, job throws runtime error saying error mapping function at DBMS Subscribe. I also tried to create CDC setup through scrips. My initial CDC setup is done, but when I start to create subscription, it throughs the same error as I encountered in OWB Start CDC. Not sure if it is some error with DB configuration or Package itself.
Here is the relevant details.
SELECT * FROM CHANGE_SETS;
PR10TEST HOTLOG_SOURCE 19-OCT-13      Y 19-OCT-13
So, Change Set does exist along with Change Source as HOTLOG_SOURCE which is active. Now I want to create subscription as shown below. Command is run from Publisher schema
BEGIN
DBMS_CDC_SUBSCRIBE.CREATE_SUBSCRIPTION(
      change_set_name => 'PR10TEST',
      description => 'Common subscription ',
      subscription_name => 'PR10TESTNew'
END;
Error starting at line 74 in command:
BEGIN
DBMS_CDC_SUBSCRIBE.CREATE_SUBSCRIPTION(
      change_set_name => 'PR10TEST',
      description => 'Common subscription ',
      subscription_name => 'PR10TESTNew'
END;
Error report:
ORA-06521: PL/SQL: Error mapping function
ORA-06512: at "SYS.DBMS_CDC_ISUBSCRIBE", line 104
ORA-06512: at "SYS.DBMS_CDC_SUBSCRIBE", line 120
ORA-06512: at line 2
06521. 00000 - "PL/SQL: Error mapping function"
*Cause:    An error was detected by PL/SQL trying to map the mentioned
           function dynamically.
*Action:   Check the stacked error (if any) for more details.
I am stuck up here. I even tried to recompile CDC package but no luck.
Please provide your inputs. Thanks in advance.

Perhaps the CDC Healthcheck script from Metalink/MyOracleSupport can be of help:
Change Data Capture CDC Healthcheck. (Doc ID 983443.1)
Script gathers information about the CDC setup to help manage/troubleshoot CDC.

Hang in Mapping editor Canvas in OWB 10G r2

For the second time I have problem with the mapping editor. All objects and mappings are invisible. The background color is grey, and it's not possible to drag new objects into the canvas. The only workaround I have found, is a full new installation of the clientsoftware.
Any idees why this happens, and possible workarounds ?

I raised a Tar on metalink for this issue, here is the reply I got:
This is what I received from Development:
The real-time feature was pulled from OWB 10gR2 and this also included the
AQ import which was in 10.1, I think they must have been
tightly coupled. The workaround involves coding; the pre-Paris solution
basically created a temporary table where messages were staged and this
queue table used for the map; the map had pre/post map triggers for
initializing/finalizing the queue. To use it effectively it would be best to
create some scripts that generate the appropriate SQL scripts for the
supporting map queue table and also the PLSQL procedures representing the
pre/post map triggers. Similar manual coding is applicable for using CDC
within OWB for OWB 10gR2.
These features are planned for a future release.
Implementation of this work-around is something you can do or Oracle Consulting can do. Support
cannot assist in developing a solution for this.
------------------------------------------------------------------------------

Error in implementation of cdc

Hi experts,
plz help me to resolve the below issue in OWB 11gr2.
error in deploying the template mapping while implementing cdc on simple oracle database table. can anyone post the right steps to implement the cdc in OWB.
Thanks & Regards
jitendra.

Hi experts,
plz help me to resolve the below issue in OWB 11gr2.
error in deploying the template mapping while implementing cdc on simple oracle database table. can anyone post the right steps to implement the cdc in OWB.
Thanks & Regards
jitendra.

OWB Methodology for Tracking Rows processed by Mappings

Hi
Is there a recommended OWB methodology that I can implement in my project to keep track of records processed by OWB mappings?
For example, my table, ABC, has the following rows :
DATE, CLIENT, AMOUNT
1/1/2008, 123, 5000
2/1/2008, 345, 6000
3/1/2008, 999, 1000
The mapping processes these records and copies them into the target table, XYZ.
How can I tell if these records in ABC have already been loaded into XYZ? Is there some kind of tag mechanism available that will indicate this so as to prevent duplication in future loads or reprocessing in event of mapping failure? Or do I need to build this in manually?
Any ideas will be appreciated.
Thanks
Kind Regards
Greg

Hi,
Check the following links for CDC and CDC in OWB:
Re: How to implement CDC in OWB?
http://www.rittmanmead.com/2006/04/14/asynchronous-hotlog-distributed-change-data-capture-and-owb-paris/
http://www.oracle.com/technology/oramag/oracle/03-nov/o63tech_bi.html
Regards,

OWB 10g R2 with Advanced Queues

All,
We are currently using 9.2.0.2.8 and make extensive use of Advance Queues in many of our mappings (we've put a lot of effort in to get this to work "real time"). We are now looking to upgrade from 9.2.0.2.8 to 10.2.0.2 - we've upgraded the mappings ok and the queues are there ok.
Going forward it looks like AQ has been removed as a source for new mappings in OWB 10g R2. Can anyone shed any light on this - will it be included a future patch or is there a work around?
I've looked at the OpenWorld presentations and making OWB process data "near real time" seems to be a big new feature.
Thanks
Craig

I raised a Tar on metalink for this issue, here is the reply I got:
This is what I received from Development:
The real-time feature was pulled from OWB 10gR2 and this also included the
AQ import which was in 10.1, I think they must have been
tightly coupled. The workaround involves coding; the pre-Paris solution
basically created a temporary table where messages were staged and this
queue table used for the map; the map had pre/post map triggers for
initializing/finalizing the queue. To use it effectively it would be best to
create some scripts that generate the appropriate SQL scripts for the
supporting map queue table and also the PLSQL procedures representing the
pre/post map triggers. Similar manual coding is applicable for using CDC
within OWB for OWB 10gR2.
These features are planned for a future release.
Implementation of this work-around is something you can do or Oracle Consulting can do. Support
cannot assist in developing a solution for this.
------------------------------------------------------------------------------

Extracting - Transformating OWB [10R2]

Hi, just wanna ask u guys :
1. Do we implement CDC in OWB or in Oracle Database ?
2. How to connect CDC result with the transformation process in mapping editor OWB?
Thanks, i really appreciate who reply this...
Regards,
Davis

Hi davis
1. We can implement CDC in OWB . However, you can also do it using pl/sql objects in oracle database.Procedures/packages/functions, are what ultimately created when you create a mapping. OWB makes ur life easy by offering a IDE for developng tht procedures/packages/functions. It is very difficult to create those pl/sql objects manually.
2. SRC --> [Transformations] --> CDC Mechanism --> [Transformations ] --> Target Load.
We connect the outgroup of a an operator after the CDC mechanism into the target table operator.
Hope this helps you.
Regards
Vibhuti

OWB 11.2 CDC Web Service problem

We are running OWB 11.2 on a Win x64 2008 database server and using XP clients
Using the new ODI based method for configuring CDC we have created a cdc enabled Oracle module, and this is working as expected. The next step is to try to run "Extend", "Lock subscriber", "Purge" etc from our process flows. To accomplish this we have tried the following:
- right click on the CDC module and create the web service for the module under "default_app_server" (the OWB agent)
- Deploy the web service
- Include the web service in a process flow to extend and lock subscriber
- Deploy the process flow
When trying to execute this process flow it fails with:
javax.xml.soap.SOAPException: javax.xml.soap.SOAPException: Message send failed: Connection refused: connect
I get the same error if I try to execute the web service directly by right clicking it in the OWB client.
There does not seem to be a problem with the web service itself. I have tried to execute it both from the "test page" on the OC4J server, and a simple BPEL process I created in Oracle SOA suite, and in both cases the service works as long as I supply the credentials for basic authentication
I have tried creating a URI location to supply the credentials, and I have also tried to register a the web service as an external service under "Globals Navigator" so I'm running out of things to try...
Any help would be greatly appreciated
Thanks,
Roald

As Guenther mentioned it sounds like you have not defined the work schema. It can be just the same as the schema, but generally advised to have a different one since this will be where temporary work tables will be created.
It should (at least) be in the description that the work schema must be granted the SELECT ANY TABLE privilege for this template/KM.
Cheers
David

How to run insert/update/delete from CDC Change table to target using OWB

I am planning to set up CDC and publish CDC change table as source data into to OWB. I have come across where I am confused how to apply changes from CDC change table to target database using OWB. For i.e. change tables is containing information like
operation$, cscn$,commit_timestamp$,xidusn$,....,list of column name
D,12323223,8/28/2008 1:44:32PM,24,.....,list of column value that have to be deleted from target
UO,12323224,8/28/2008 1:45:23PM,24,.....,list of column value that have to be updated in target.
Please advice or give me some hint. Thank you.

Hi,
you can wait for 11gR2 with CDC integration or build most of the code outside the owb. To use CDC you must do this things (http://www.oracle.com/technology/oramag/oracle/03-nov/o63tech_bi.html):
1. Identify the source tables.
2. Set up a publisher.
3. Create change tables.
4. Set up a subscriber.
5. Subscribe to the source tables, and activate the subscription.
6. Set up the CDC window.
7. Prepare a subscriber view.
8. Access data from the change tables.
9. Drop the subscriber view, and purge the CDC window.
10. Repeat steps 6 through 9 to see new data.
You can do only a few of this inside owb, most of it must be done outside.
Regards,
Detlef

OWB CDC error!!!!!!

Hi,
I am new to data warehousing, i am following the following document for CDC,
http://www.rittmanmead.com/2009/10/10/changed-data-capture-and-owb11gr2/
I am using OWB 11g r2,
Unlike in the document, my source and target both are the same oracle 10.2 database, when i right-click on the oracle Server source database module, select Change Data Capture and click on " Start", i get error message
Deploy failed. Error the password for the default remote agent is not set. Please set the password for the default agent.can someone kindly exlpain what how to set default remote agent.
regards,
Edited by: user10243788 on Jun 8, 2010 4:20 AM

Hi David, i am following the following document for CDC,
http://www.rittmanmead.com/2009/10/10/changed-data-capture-and-owb11gr2/
I am using OWB 11g r2,
Unlike in the document, my source and target both are the same oracle 11.2 database, when i right-click on the oracle Server source database module, select Change Data Capture and click on " Start", i get error message
Deploy failed. Error Error reading application-client descriptor: Error communicating with server: Connection refused: connect; nested exception is:
     javax.naming.CommunicationException: Connection refused: connect [Root exception is java.net.ConnectException: Connection refused: connect]Error communicating with server: Connection refused: connect; nested exception is:
     javax.naming.CommunicationException: Connection refused: connect [Root exception is java.net.ConnectException: Connection refused: connect]Connection refused: connect; nested exception is:
     javax.naming.CommunicationException: Connection refused: connect [Root exception is java.net.ConnectException: Connection refused: connect]Connection refused: connectConnection refused: connect
Can you please help me to complete the task
-Dinesh

OWB R1 and Asynchronous CDC

Can I use OWB R1 with Oracle's asynchronous Change Data Capture feature to provide a real-time data warehousing solution?

Hi Davis
There is a general cookbook on CDC here:
http://www.oracle.com/technology/products/bi/db/10g/pdf/twp_cdc_cookbook_0206.pdf
And a useful OWB/CDC illustration here:
http://www.rittmanmead.com/2006/04/14/asynchronous-hotlog-distributed-change-data-capture-and-owb-paris/
The setup is very much administrative and an expert would be very useful to cover the cookbook for OWB and CDC.
Cheers
David

How to use incremental data load in OWB? can CDC be used?

hi,
i am using oracle 10g relese 2 and OWB 10g relese 1
i want know how can i implement incremental data load in OWB?
is it having such implicit feature in OWB tool like informatica?
can i use CDC concept for this/ is it viable and compatible with my envoirnment?
what could be other possible ways?

Hi ,
As such the current version of OWB does not provide the functionality to directly use CDC feature available. You have to come up with your own strategy for incremental loading. Like, try to use the Update Dates if available on your source systems or use CDC packages to pick the changed data from your source systems.
rgds
mahesh

Using OWB mappings with Oracle CDC/Streams and LCRs

Hi,
Has anyone worked with Oracle Streams and OWB? We're looking to leverage Streams to update our data warehouse using Streams to apply changes from the transactional/source DB. At some point we seem to remember hearing that OWB could leverage Streams, perhaps even using the Logical Change Records (LCRs) from Streams as input to mappings?
Any thoughts much appreciated.
Thanks,
Jim Carter

Hi Jim,
We've built a fairly complex solution based on streams. We wanted to break up the various components into separate entities so that any network failure or individual component failure wouldn't cause issues for the other components. So, here goes:
1) The OLTP source database is streaming LCR's to our Datawarehouse where we keep an operational copy of production, updated daily from those streams. This allows for various operational reports to be run/rerun in a given day with the end-of-yesterday picture without impacting the performance on the source system.
2) Our apply process on the datamart side actually updates TWO copies of data. It does a default apply to our operational copy of production, and each of those tables have triggers that put a second copy of the data into daily partitioned tables. So, yesterday's partitions has only the data that was actually changed yesterday. After the default apply, we walk the Oracle dependency tree to fill in all of the supporting information so that yesterday's partition includes all the data needed to run our ETL queries for that day.
Example: Suppose yesterday an address for a customer was updated. Streams only knows about the change to the address record, so the automated process would only put that address record into the daily partition. The dependency walk fills in the associated customer, date of birth, etc. data into that partition so that the partition holds all of the related data to that address record for updates without having to query against the complete tables. By the same token, a change to some other customer info will backfill in the adress record for this customer too.
Now, our ETL queries run against views created against these partitoned tables so that they are only looking at the data for that day (the view s_address joins from our control tables to the partitiond address table so that we are only seeing one day's address records). This means that the ETL is running agains the minimal subset of data required to update dimensions and create facts. It also means that, for example, if there is a problem with the ETL we can suspend running ETL while we fix a problem, and the streaming process will just go on filling partitions until we are ready to re-launch ETL and catch up - one day at a time. We also back up the data mart after each load so that, if we discover an error in ETL logic and need to rebuild we can restore the datamart to a given day and then reprocess the daily partitions in order very simply.
We have added control fields in those partitioned tables that show which record was inserted/updated/or deleted in production, and which was added by the dependency walk so, if neccessary, our ETL can determine which data elements were the ones that changed. As we do daily updates to the data mart as our finest grain, this process may update a given record in a given partition multiple times so that the status of this record at the end of the day in that daily partition shows the final version of that record for the day. So, for example, if you add an address record an then update it on the same day the partition for that day will show the final updated version of the record, and the control field will show this to be a new inserted record for the day.
This satisfies our business requirements. Yours may be different.
We have a set of control tables which manage what partition is being loaded from streams, and which have been loaded via ETL to the datamart. The only limitation is that, of course, the ETL load can only go as far as the last partition completely loaded and closed from streams. And we manage the sizing of this staging system by pruning partitions.
Now, this process IS complex, and requires a fair chunk of storage, but it provides us with the local daily static copy of the OLTP system for running operational reports against without impacting production, and a guaranteed minimal subset of the OLTP system for speedy ETL runs.
As for referencing LCRs themselves, we did not go that route due to the dependency issues (one single LTR will almost never include all of the dependant data from which to update a dimension record or build a fact record, so we would have had to constantly link each one with the full data set to get all of that other info).
Anyway - just thought our approach might give you some ideas as you work out your own approach.
Cheers,
Mike

CDC in OWB 11.2

Similar Messages

Maybe you are looking for