Is it possible ?Change data capture from VSAM , DB2 , SQL Server to Oracle

Dear Professionals ,
We plan to build a warehouse project.Source systems are
* VSAM files in zOS
* SQL Server
* DB2
Warehouse database is Oracle .
Every night the changes in the source systems will be applied to Oracle warehouse DB.
But only the changes will be applied . Exporting VSAM files to flat file and load to oracle and find the data differences in Oracle is not accepted. Or moving the entire tables to oracle and finding the changes in oracle is not accepted.Only the changes will pass through the network .
Is "Oracle Connect" and "VSAM adaptor" capable of this ?
Is there a solution for SQL Server and DB2 change data capture ?
Is it Possible ? If possible is it a headache or a simple install and forget process?
Thank you
Bunyamin..

Bunyamin,
I do not know about VSAM, but I heard/read that Oracle Data Integrator is able to do change data capture on several databases. It uses the source database mechanism to do CDC. So maybe give it a try at the fusion middleware forum where ODI is being discussed

Similar Messages

Date Migration from IBM DB2/400 V4R3M0 to Oracle 11.2G

Dear ALL<
We have a requirement for Date Migration from IBM DB2/400 V4R3M0 to Oracle 11.2g. Can you guys please share your experiences with similar activities done in the past ? We do not have environment at present to try out with Oracle Migration workbench.
http://www.oracle.com/technetwork/topics/index-095746.html
You experiece sharing will really help ...!!
Regards,
VKMP
Edited by: 909016 on Jan 31, 2013 5:52 AM

Hi VKMP,
As well as reading the documentation thoroughly the following note available in My Oracle Support may be useful -
Problem To Migrate Table With Table Type P From DB/AS400 With OMWB (Doc ID 466271.1)
as OMWB does not support migrating physical files.
Regards,
Mike

Tell me how to format a date retrieved from a MS SQL Server 2000 database?

Tell me how to format a date retrieved from an MS SQL Server 2000 database for various uses in my JSP page?

Or if you want to use JSTL instead of a scriptlet see:
http://forum.java.sun.com/thread.jspa?threadID=676754&tstart=0

Change data capture from DRM to Target system

Hi All,
I have a situation where client wants Hyperion DRM to be single source of truth and pass Hierarchy information from DRM to subscribing target systems. There are 3 target systems and the database is MS SQL server.
Now in the export profile ,I am using database export where I have mapped the DRM node/properties to target table's columns. For the initial load it is a new record in the database and the data flows as it is a 1:1 mapping, however if few of the property value changes and I wan to update only the corresponding columns what will the architecture for push the change data in to target.
Can we achieve this without have any staging tables and capture the change data ?
Do need to use ODI ?
Does DRM has any work around without putting extra effort hrs by building CDC tables ?
I will really appreciate your suggestions and comments on this......

Thanks for the quick reply. However I was trying to resolve the Change data capture in Hierarcy through as" Database Table" but it seems when we choose the DEVICE option as database in the target tab of export it can only export or insert new records into the tables but cannot update and existing record.
PLease correct me if my understnding is wrong ?????

Data transfer from sybase to sql server

Hi ,
we are pulling data from sybase to sql server using ssis pacakges.
a column of type bit in sybase is transferred as int in sql server.
but because of that the value of sybase column as 1 is transfered as -1 in sql server till now .
suddenly the value is now coming as 1 in sql server.
can anybody tell me what could be going wrong here ?
please help
thanks in advance

If its a bit field in sybase the corresponding datatype should be bit itself in SQLServer. Bit is boolean based data having values as only 0 and 1 (and NULL also if columns in nullable). int datatype can hold any integer data so they both are not same.
Also a bit value of -1 is invalid and makes no sense
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Error : Data load from relation source (SQL Server 2005) to Essbase Cube

Hi All,
I am looking help from you. I am trying to load data from SQLServer 2005 table to Essbase Cube using IKM SQL to Hyperion Essbase (Metadata) Modules.
I am getting below error. Let me know if i am missing some things.
org.apache.bsf.BSFException: exception from Jython:
Traceback (innermost last):
File "<string>", line 61, in ?
com.hyperion.odi.essbase.ODIEssbaseException: Invalid value specified [RULES_FILE] for Load option [null]
 at com.hyperion.odi.essbase.ODIEssbaseMetaWriter.validateLoadOptions(Unknown Source)
 at com.hyperion.odi.essbase.AbstractEssbaseWriter.beginLoad(Unknown Source)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
 at java.lang.reflect.Method.invoke(Unknown Source)
 at org.python.core.PyReflectedFunction.__call__(PyReflectedFunction.java)
 at org.python.core.PyMethod.__call__(PyMethod.java)
 at org.python.core.PyObject.__call__(PyObject.java)
 at org.python.core.PyInstance.invoke(PyInstance.java)
 at org.python.pycode._pyx3.f$0(<string>:61)
 at org.python.pycode._pyx3.call_function(<string>)
 at org.python.core.PyTableCode.call(PyTableCode.java)
 at org.python.core.PyCode.call(PyCode.java)
 at org.python.core.Py.runCode(Py.java)
 at org.python.core.Py.exec(Py.java)
 at org.python.util.PythonInterpreter.exec(PythonInterpreter.java)
 at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:144)
 at com.sunopsis.dwg.codeinterpretor.k.a(k.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSqlI.treatTaskTrt(SnpSessTaskSqlI.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
 at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
 at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
 at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
 at com.sunopsis.dwg.cmd.e.i(e.java)
 at com.sunopsis.dwg.cmd.g.y(g.java)
 at com.sunopsis.dwg.cmd.e.run(e.java)
 at java.lang.Thread.run(Unknown Source)
com.hyperion.odi.essbase.ODIEssbaseException: com.hyperion.odi.essbase.ODIEssbaseException: Invalid value specified [RULES_FILE] for Load option [null]
 at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:146)
 at com.sunopsis.dwg.codeinterpretor.k.a(k.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSqlI.treatTaskTrt(SnpSessTaskSqlI.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
 at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
 at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
 at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
 at com.sunopsis.dwg.cmd.e.i(e.java)
 at com.sunopsis.dwg.cmd.g.y(g.java)
 at com.sunopsis.dwg.cmd.e.run(e.java)
 at java.lang.Thread.run(Unknown Source)

ODI Step: Prepare for Loading Step:
from java.util import HashMap
from java.lang import Boolean
from java.lang import Integer
from com.hyperion.odi.common import ODIConstants
from com.hyperion.odi.connection import HypAppConnectionFactory
# Target planning connection properties
serverName = "HCDCD-HYPDB01"
userName = "admin"
password = "<@=snpRef.getInfo("DEST_PASS") @>"
application = "BUDGET01"
database = "PLAN1"
portStr = "1423"
srvportParts = serverName.split(':',2)
srvStr = srvportParts[0]
if(len(srvportParts) > 1):
portStr = srvportParts[1]
# Put the connection properites and initialize the essbase loader
targetProps = HashMap()
targetProps.put(ODIConstants.SERVER,srvStr)
targetProps.put(ODIConstants.PORT,portStr)
targetProps.put(ODIConstants.USER,userName)
targetProps.put(ODIConstants.PASSWORD,password)
targetProps.put(ODIConstants.APPLICATION_NAME,application)
targetProps.put(ODIConstants.DATABASE_NAME,database)
targetProps.put(ODIConstants.WRITER_TYPE,ODIConstants.DATA_WRITER)
print "Initalizing the essbase wrapper and connecting"
pWriter = HypAppConnectionFactory.getAppWriter(HypAppConnectionFactory.APP_ESSBASE, targetProps);
tableName = "BUDGET01_PLAN1"
rulesFile = r"ActLd"
ruleSeparator = "Tab"
clearDatabase = "None"
calcScript = r""
maxErrors = 1
logErrors = 1
errFileName = r"E:\OraHome_ODI\Error\Budget01Plan1.err"
logEnabled = 1
logFileName = r"E:\OraHome_ODI\Error\Budget01Plan1.log"
errColDelimiter = r","
errRowDelimiter = r"\r\n"
errTextDelimiter = r"'"
logHeader = 1
commitInterval = 1000
calcOnly = 0
preMaxlScript = r""
postMaxlScript = r""
abortOnPreMaxlError = 1
# set the load options
loadOptions = HashMap()
loadOptions.put(ODIConstants.CLEAR_DATABASE, clearDatabase)
loadOptions.put(ODIConstants.CALCULATION_SCRIPT, calcScript)
loadOptions.put(ODIConstants.RULES_FILE, rulesFile)
loadOptions.put(ODIConstants.LOG_ENABLED, Boolean(logEnabled))
loadOptions.put(ODIConstants.LOG_FILE_NAME, logFileName)
loadOptions.put(ODIConstants.MAXIMUM_ERRORS_ALLOWED, Integer(maxErrors))
loadOptions.put(ODIConstants.LOG_ERRORS, Boolean(logErrors))
loadOptions.put(ODIConstants.ERROR_LOG_FILENAME, errFileName)
loadOptions.put(ODIConstants.RULE_SEPARATOR, ruleSeparator)
loadOptions.put(ODIConstants.ERR_COL_DELIMITER, errColDelimiter)
loadOptions.put(ODIConstants.ERR_ROW_DELIMITER, errRowDelimiter)
loadOptions.put(ODIConstants.ERR_TEXT_DELIMITER, errTextDelimiter)
loadOptions.put(ODIConstants.ERR_LOG_HEADER_ROW, Boolean(logHeader))
loadOptions.put(ODIConstants.COMMIT_INTERVAL, Integer(commitInterval))
loadOptions.put(ODIConstants.RUN_CALC_SCRIPT_ONLY,Boolean(calcOnly))
loadOptions.put(ODIConstants.PRE_LOAD_MAXL_SCRIPT,preMaxlScript)
loadOptions.put(ODIConstants.POST_LOAD_MAXL_SCRIPT,postMaxlScript)
loadOptions.put(ODIConstants.ABORT_ON_PRE_MAXL_ERROR,Boolean(abortOnPreMaxlError))
#call begin load
pWriter.beginLoad(loadOptions)
Execution step from opartor:
Read rows: 0
Insert/Delete/updat rows: 0
ODI Step: Load Data Into Essbase
from com.hyperion.odi.common import ODIConstants
from com.hyperion.odi.connection import HypAppConnectionFactory
from java.lang import Class
from java.lang import Boolean
from java.sql import *
from java.util import HashMap
# Get the select statement on the staging area:
sql= """select C1_ACCOUNT "Account",C3_TIMEPERIOD "TimePeriod",C4_LOBS "LOBs",C5_TREATY "Treaty",C6_SCENARIO "Scenario",C7_VERSION "Version",C8_CURRENCY "Currency",C9_YEAR "Year",C10_DEPARTMENT "Department",C11_ENTITY "Entity",C2_DIVLOC "DivLoc",C12_DATA "Data" from OdiMapping.dbo.C$_0BUDGET01_PLAN1Data where (1=1) """
srcCx = odiRef.getJDBCConnection("SRC")
stmt = srcCx.createStatement()
srcFetchSize=30
stmt.setFetchSize(srcFetchSize)
rs = stmt.executeQuery(sql)
#load the data
stats = pWriter.loadData(rs)
#close the database result set, connection
rs.close()
stmt.close()
ODI Step: Report Statistics
org.apache.bsf.BSFException: exception from Jython:
Traceback (innermost last):
File "<string>", line 2, in ?
Essbase Writer Load Summary:
 Number of rows successfully processed: 1
 Number of rows rejected: 0
 at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:146)
 at com.sunopsis.dwg.codeinterpretor.k.a(k.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSqlI.treatTaskTrt(SnpSessTaskSqlI.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
 at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
 at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
 at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
 at com.sunopsis.dwg.cmd.e.i(e.java)
 at com.sunopsis.dwg.cmd.h.y(h.java)
 at com.sunopsis.dwg.cmd.e.run(e.java)
 at java.lang.Thread.run(Unknown Source)
Where am i doing wronge for data load in Essbase? How I will find correct information to load data into Essbase?

Change Data Capture feature

hi,
If anyone have implement Change data capture (CDC) feature which is available in Oracle 9i.
If yes pls reply to me, i have an doubt on this....

Hi,
Thanks for ur reply...
I received an error while creating the change table ..
ORA-29540: class oracle/CDC/PublishApi does not exist
ORA-06512: at "SYS.DBMS_CDC_PUBLISH", line 298
Canu pls help me to fix this..
by,
Nagaa

Can you help me about change data captures in 10.2.0.3

Hi,
I made research about Change Data Capture and I try to implement it between two databases for two small tables in 10g release 2.MY CDC implementation uses archive logs to replicate data.
Change Data Capture Mode Asynchronous autolog archive mode..It works correctly( except for ddl).Now I have some questions about CDC implementation for large tables.
I have one senario to implement but I do not find exactly how can I do it correctly.
I have one table (name test) that consists of 100 000 000 rows , everyday 1 000 000 transections occurs on this table and I archive the old
data more than one year manually.This table is in the source db.I want to replicate this table by using Change Data Capture to other stage database.
There are some questions about my senario in the following.
1.How can I make the first load operations? (test table has 100 000 000 rows in the source db)
2.In CDC, it uses change table (name test_ch) it consists of extra rows related to opearations for stage table.But, I need the orjinal table (name test) for applicaton works in stage database.How can I move the data from change table (test_ch) to orjinal table (name test) in stage database? (I don't prefer to use view for test table)
3.How can I remove some data from change table(name test_ch) in stage db?It cause problem or not?
4.There is a way to replicate ddl operations between two database?
5. How can I find the last applied log on stage db in CDC?How can I find archive gap between source db and stage db?
6.How can I make the maintanence of change tables in stage db?

Asynchronous CDC uses Streams to generate the change records. Basically, it is a pre-packaged DML Handler that converts the changes into inserts into the change table. You indicated that you want the changes to be written to the original table, which is the default behavior of Streams replication. That is why I recommended that you use Streams directly.

Yes, it is possible to capture changes from a production redo/archive log at another database. This capability is called "downstream" capture in the Streams manuals. You can configure this capability using the MAINTAIN_* procedures in DBMS_STREAMS_ADM package (where * is one of TABLES, SCHEMAS, or GLOBAL depending on the granularity of change capture).

A couple of tips for using these procedures for downstream capture:
 1) Don't forget to set up log shipping to the downstream capture database. Log shipping is setup exactly the same way for Streams as for Data Guard. Instructions can be found in the Streams Replication Administrator's Guide. This configuration has probably already been done as part of your initial CDC setup.
 2) Run the command at the database that will perform the downstream capture. This database can also be the destination (or target) database where the changes are to be applied.
 3) Explicitly define the parameters capture_queue_name and apply_queue_name to be the same queue name. Example:
 capture_queue_name=>'STRMADMIN.STREAMS_QUEUE'
 apply_queue_name=>'STRMADMIN.STREAMS_QUEUE'

Change Data Capture HELP URGENT

I have read all the Oracle Documentation for Change Data Capture, however I have been unable to find some specific things, the first one being: is it possible for another Oracle DB to be a subscriber to the changes published in CDC? If so, how can this be done?
I have several databases that are going to be changing constantly and I need to integrate all those changes to one specific target DB how can I set up my target DB to gather the changes published from all the other databases? is it even possible? can it be done automatically? or do I have to create a separate interface (like a java based application) to gather those changes in some way from the subscriber views enqueue them, process them ,and then apply them to my target DB?
Some help will be appreciated a lot!
Thanks.
Angel M.

You won't get help if you put URGENT in your subject.
Everyone here donates their time and offers help on a purely voluntary, goodwill basis.
If you want something answered urgently, you visit metalink and ask your support questions of the Oracle support staff whom you pay to provide you with a service of which you can quite legitimately make service-level demands.
Otherwise, you wait your turn here and don't try to jump the queue by claiming urgency and priority you aren't paying for.

Change Data Capture for XML

We have an XML file being created every week on the mainframe. This file is loaded to Oracle Database. Initially we were performing a refresh of a table, due to business reasons, we need to load only the changes from this XML file to our stage database.
Then, the changes incorporated to the stage needs to be applied to our warehouse database.
Is this possible? We cannot implement Change Data Capture on the Mainframe side.

>
they are not oracle DBs anyway
>
Then why are you posting in an Oracle forum and using Oracle terms like 'change data capture'?
>
3. don't want to serialize my inserts because since I am not sure I can keep up with the insert rate
>
That doesn't even make any sense. Oracle can generate sequence numbers faster than you can use them. Just put a trigger on the tables.
You need to provide an example and explain how the data gets into a DB and how it gets out.

Capture Changes from Sql Server using Oracle Streams - Destination Oracle

Is it possible to capture changes made to tables in Sql Server database and propagate the changes to Oracle Database using Oracle Streams and Heterogeneous Gateway. I see plenty of information about pushing data from Oracle to Sql server, but I haven't been able to find much information about going the other way. Currently we are using sql server 2005 replication to accomplish this. We are looking into the possibility of replacing it with streams.

the brief understanding i have is that there is nothing out of the tin that Oracle provides to stream between SQL Server and Oracle. The senario is documented in Oracle docs however and says you need to implement the SQL Server side to grabe changes and submit to Oracle stream queues.
i'm sure i've seen third parties who sell software to do this.
If you know otherwise please let me know. Also wasn;t aware one could push from SQL Server to Oracle. Is this something only avail in SQL Server 2005 or does 200 also have it? How are you doing this?
Cheers

Change Data Capture How to Tell which you are running Sync or Asyn

Hi ,
I am taking over a new system that has change data capture running, but Im really confused how this is running. Most of the CDC is set up using Sync(triggers), but I have about 5 tables that DO NOT have system generated triggers on them. I know Streams is NOT running/configured. I know Capture is not running/configured (because nothing in DBA_CAPTURE table). I can tell that these 5 tables are still getting updated in the change table schema. I can not figure out how the 5 tables that DO NOT have triggers on them are updating the change data set tables.
I had thought the the 5 tables, must be configured with HOTLOG, but when I look at the CHANGE_SETS table they all (including these 5 tables) are set to CHANGE SOURCE NAME = SYNC SOUCE. I would expected that to be HOTLOG_SOURCE. So I "assume" they aren't set up using Asnc. hot log mode. So maybe the other Async modes are used, but not pushed to another database? Is that possible?
Any other ideas on how to figure out how the CDC is set up for these 5 tables?
thanks for your help.

Thanks for the reply, but I think I must have not stated the problem clearly. I dont WANT to set the source I want to figure out how this CDC is working. I see ALL the sources are currently set to SYNC_SOURCE. Almost all of the tables are set up with system triggers on them, but 5 dont have system triggers, yet the source says SYNC_SOURCE. I did validate that the change tables are getting updated for these tables. my question is how are they getting updated? I "assume" since they dont have system triggers ont eh table they aren't synchoronus cdc (like the other tables are). yet the source says SYNC_SOURCE. What am I missing? How can I tell if the redo log is populating those changes tables? Im pretty sure it is (Becuase there aren't triggers or jobs running), but Im curious if there is a way to tell for sure.
Thanks,

Using Change Data Capture in SSIS - how to handle schema changes

I was asked to consider change data capture for a database recently. I can see that from the database perspective, its quite nice. When I considered how I'd do this in SSIS, it seemed pretty obvious that I might have a problem, but I wanted to
confirm here.
The database in question changes the schema about once per month in production. We have a lot of controls in our environment, so everytime a tables schema is changed, I'd have to do a formal change request to deal with a change to my code
base, in this case my SSIS package; it can be a lot of work. If I wanted to track the data changes for inserts, update and deletes using an SSIS package to send the data changes to the destination tables, would I have to change my SSIS package
with every schema change, or is there a way to keep the exact same SSIS package with CDC without having to change it every month?
Thanks,
Keith

Hi Keith,
What is your exact requirement?
If you want to capture the object_created, object_deleted or object_altered informations, you can try using
Extended events .
As mentioned in your OP:
"If I wanted to track the data changes for inserts, update and deletes using an SSIS package to send the data changes to the destination tables, would I have to change my SSIS package with
every schema change, or is there a way to keep the exact same SSIS package with CDC without having to change it every month?"
If you want the databases in two different environments to be in sync, then take periodic
backup and apply(restore) on the another destination DB.
(or)
you can also try with
SQL Server replication if it is really needed.
As I understand from your description, if you want the table data & schema to be in sync in two different database:
then create job [script that will drop the destination DB table & create the copy of source DB table ] as per your requirement:
--CREATE DATABASE db1
--CREATE DATABASE db2
USE db1
GO
CREATE TABLE tbl(Id INT)
USE db2
GO
IF EXISTS (SELECT * FROM SYS.OBJECTS WHERE name = 'tb1' and TYPE = 'u')
DROP TABLE dbo.tb1
SELECT * INTO db2.dbo.tb1 FROM db1.dbo.tbl
SELECT * FROM dbo.tb1
--DROP DATABASE db1,db2
sathya - www.allaboutmssql.com ** Mark as answered if my post solved your problem and Vote as helpful if my post was useful **.

CDC (Change Data Capture) with 2 Tables

Hello,
i want to use the change data capture for the typical Data Warehousing progress (bring the new or updatet table from source to the staging area)
So i have implemented a mapping with to tables. The source table is S_Account, the target or staging table is W_Account_DS.
I have connected/mapped the tables and in the next step i goes into property inspector of W_ACCOUNT_DS into the Area Change Data Capture --> Change Data Capture Filter and put into the follow expression Builder
Select *
from S_Acccount
where INOUTGRP1.LAST_UPD_DT = CURRENT_DATE (<-- Validation Succesful)
and the next Step i make Enabeled is true in the Change Data Capture Area. So i think it should ready for one test case.
I set in SQL Developer with an update statement the LAST_UPD_DT at 28.03.2012 in this case he should not update/insert anything, right? But he insert the full table.
I set in SQL Developer with an update statement the LAST_UPD_DT by 2 Columms to 28.03.2012 in this case he should update he should update the full table - 2 columns with the date 28.03.2012, right?
So what make i wrong or have i forgotten anything? (must set keys by the tables? I think not! If yes why?)
Must i set anything properties else? Why doesnt´work it?
I look forward for your replies :)

Setting up CDC is a fairly complex process with different options. Setting just the filter in OWB is only a very small part.
There is a blog post below on how to use code templates to do CDC which gives some insight;
http://www.rittmanmead.com/2009/10/changed-data-capture-and-owb11gr2/
Plus and older one illustrating how to use Oracle logs;
http://www.rittmanmead.com/2006/04/asynchronous-hotlog-distributed-change-data-capture-and-owb-paris/
Cheers
David

Upgrade of Database with Oracle Change Data Capture

Hello,
We are upgrading and moving our database to a different server.
The move is from 10G R1 database on Solaris to 11G R2 on Linux.
Our database uses Oracle Change Data Capture.
What is the best way to perform this migration? Unlike in the approach below, ideally, it would be without any manual steps to drop and recreate CDC subscriptions, change tables, etc.
Thanks.
Considerations for Exporting and Importing Change Data Capture Objects
http://docs.oracle.com/cd/B13789_01/server.101/b10736/cdc.htm#i1027532
Starting in Oracle Databse 10g, Oracle Data Pump is the supported export and import utility for Change Data Capture. Change Data Capture change sources, change sets, change tables, and subscriptions are exported and imported by the Oracle Data Pump expdp and impdp commands with the following restrictions:
After a Data Pump full database import operation completes for a database containing AutoLog Change Data Capture objects, the following steps must be performed to restore these objects:
1. The publisher must manually drop the change tables with the SQL DROP TABLE command. This is needed because the tables are imported without the accompanying Change Data Capture metadata.
2. The publisher must re-create the AutoLog change sources, change sets, and change tables using the appropriate DBMS_CDC_PUBLISH procedures.
3. Subscribers must re-create their subscriptions to the AutoLog change sets.

Hello,
I opened SR with Oracle Support, they are suggesting to perform full database import/export
Change Data Capture change sources, change sets, change tables, and subscriptions are exported and imported by the Oracle Data Pump expdp and impdp commands with the following restrictions.
Change Data Capture objects are exported and imported only as part of full database export and import operations (those in which the expdp and impdb commands specify the FULL=y parameter). Schema-level import and export operations include some underlying objects (for example, the table underlying a change table), but not the Change Data Capture metadata needed for change data capture to occur."
CDC has different implementation methods:
You may use the below query to determine-
select SOURCE_NAME, SOURCE_DESCRIPTION, CREATED, SOURCE_TYPE, SOURCE_DATABASE, SOURCE_ENABLED from change_sources;
– Synchronous CDC: with this implementation method you capture changes
synchronously on the source database into change tables. This method uses
internal database triggers to enable CDC. Capturing the change is part of the
original transaction that introduces the change thus impacting the performance
of the transaction.
– Asynchronous Autolog CDC: this implementation method requires a staging
database separate from the source database. Asynchronous Autolog CDC uses
the database's redo transport services to transport redo log information from
the source database to the staging database1. Changes are captured at the
staging database. The impact to the source system is minimal, but there is some
latency between the original transaction and the change being captured.
As suggested in the document-
Change Data Capture objects are exported and imported only as part of full database export and import operations (those in which the expdp and impdb commands specify the FULL=y parameter). Schema-level import and export
operations include some underlying objects (for example, the table underlying a change table), but not the Change Data Capture metadata needed for change data capture to occur.
■ AutoLog change sources, change sets, and change tables are not supported.
Starting in Oracle Database 10g, Oracle Data Pump is the supported export and import utility for Change Data Capture.
Re-Creating AutoLog Change Data Capture Objects After an Import Operation
http://docs.oracle.com/cd/B19306_01/server.102/b14223/cdc.htm#i1027532
After a Data Pump full database import operation completes for a database containing AutoLog Change Data Capture objects, the following steps must be performed to restore these objects:
a. The publisher must manually drop the database objects underlying AutoLog Change Data Capture objects.
b. The publisher must re-create the AutoLog change sources, change sets, and change tables using the appropriate DBMS_CDC_PUBLISH procedures.
c. Subscribers must re-create their subscriptions to the AutoLog change sets.

Is it possible ?Change data capture from VSAM , DB2 , SQL Server to Oracle

Similar Messages

Maybe you are looking for