Can CDC (Change Data Capture) Can be used for Audit / Trail Purposes

Hi,
My question is bit subjective in nature. I playing around with CDC to implement a Database Auditing solution and it's seems to be working fine. However my question is for experts and for those who have already used CDC for this purpose. Is it feasible to
use it for Data Auditing? Has anybody successfully used it? Any important considerations or configurations you have worked out e.g. CDC cleanup time etc
I will highly appreciate any feed back.
Thanks,
Ali
Saadat

Refer this link...I hope this link will answer all your questions
http://blogs.technet.com/b/josebda/archive/2009/03/24/sql-server-2008-change-tracking-ct-and-change-data-capture-cdc.aspx
-Prashanth

Similar Messages

Error While enahling CDC(Change data capture) on Table.

I am enabling Change data capture (CDC) on SQL server 2012 Enterprise edition(11.0.2100.60)
. I am able to enable it on Database level with below SQL, but failed to enable on Table level.
Use DatabaseName
GO
Exec sys.sp_cdc_enable_db
GO
EXEC sys.sp_cdc_enable_table @source_schema = N'dbo',
@source_name = N'TableName', @role_name = NULL
GO
Got Error like,
'msg 22832, Level 16, State 1, Procedure sp_cdc_enable_table_internal, Line 623
Could not update the metadata that indicates table [dbo].[TableName] is enabled for Change Data Capture.
The failure occurred when executing the command '[sys].[sp_cdc_add_job] @job_type = N'capture''.
The error returned was 22836: 'Could not update the metadata for database DatabaseName to indicate that a Change Data Capture job has been added.
The failure occurred when executing the command 'sp_add_jobstep_internal'.
The error returned was 14234: 'The specified '@server' is invalid (valid values are returned by sp_helpserver).'.
Use the action and error to determine the cause of the failure and resubmit the request.'.
Use the action and error to determine the cause of the failure and resubmit the request.'
Would anyone help me to out of this?
Thanks in advance..!!

Related thread:
http://social.technet.microsoft.com/Forums/sqlserver/en-US/fa0c2a52-63b5-4a39-9f35-fe6f0eb21d1d/change-data-capture-on-table?forum=sqldatawarehousing
Make sure SQL Server Agent is running.
Kalman Toth Database & OLAP Architect
SQL Server 2014 Design & Programming
New Book / Kindle: Exam 70-461 Bootcamp: Querying Microsoft SQL Server 2012

CDC (Change Data Capture) with 2 Tables

Hello,
i want to use the change data capture for the typical Data Warehousing progress (bring the new or updatet table from source to the staging area)
So i have implemented a mapping with to tables. The source table is S_Account, the target or staging table is W_Account_DS.
I have connected/mapped the tables and in the next step i goes into property inspector of W_ACCOUNT_DS into the Area Change Data Capture --> Change Data Capture Filter and put into the follow expression Builder
Select *
from S_Acccount
where INOUTGRP1.LAST_UPD_DT = CURRENT_DATE (<-- Validation Succesful)
and the next Step i make Enabeled is true in the Change Data Capture Area. So i think it should ready for one test case.
I set in SQL Developer with an update statement the LAST_UPD_DT at 28.03.2012 in this case he should not update/insert anything, right? But he insert the full table.
I set in SQL Developer with an update statement the LAST_UPD_DT by 2 Columms to 28.03.2012 in this case he should update he should update the full table - 2 columns with the date 28.03.2012, right?
So what make i wrong or have i forgotten anything? (must set keys by the tables? I think not! If yes why?)
Must i set anything properties else? Why doesnt´work it?
I look forward for your replies :)

Setting up CDC is a fairly complex process with different options. Setting just the filter in OWB is only a very small part.
There is a blog post below on how to use code templates to do CDC which gives some insight;
http://www.rittmanmead.com/2009/10/changed-data-capture-and-owb11gr2/
Plus and older one illustrating how to use Oracle logs;
http://www.rittmanmead.com/2006/04/asynchronous-hotlog-distributed-change-data-capture-and-owb-paris/
Cheers
David

How can I change the phone number I used for for Apple ID?

Hi
I had 2 iphones with 2 different phone numbers and 2 different apple id.
now i switched the phone numbers - but on the apple id i have the old number i no longer use.
What can I do so i'll have the correct phone number?

Go into your settings>phone tap on the phone number and input the new number.

JDE World - Integration methods, Change Data Capture

Can anyone let me know how I can know real time data changes in JD Edwards World tables.
1. Are there any tables in JDE World or DB2 where I can find change data capture information?
2. How about using DB2 triggers on the JDE World tables?
3. Or is there any other method that I can do this?
thanks in advance
Message was edited by:
Tricks

What backend database are you using, what tools do you intend to use to get at the data? With an Oracle backend there may be a variety of options.
By 'real time' do you mean immediately or within 5 minutes, 30 minutes ?

Query on Change Data Capture

Hi,
A small clarification on oracle CDC(change data capture),if the CDC is down for 6 hours due to some issues how do I capture all the source transactions into CDC views during this window?
Just doing a purge and restarting the CDC Subscriber would solve the above scenario?
Thanks

Oracle CDC is all about capturing changes in DB tables and the changes are stored in special Oracle tables. There are two modes of CDC operation: asynchronous (based on Java) or synchronous (based on DB triggers, more performance overhead).
Check
http://docs.oracle.com/cd/B13789_01/server.101/b10736/cdc.htm#i1025409
http://docs.oracle.com/cd/E14571_01/integrate.1111/e12643/data_capture.htm

How to use CHANGEDOCU functions for audit trail?

Hi,
I have a report screen that requires audit trails on the changes made to the data dic fields on the screen.
Which CHANGEDOCU functions should I use for audit trail? And where should I implement the functions? In the 'save' subrountine that I create?
Any samples? Thanks.

Hi Kian,
           You should wtite the change docu functions in the "SAVE" subroutine. The following changedocu functions should be used. I am attaching an example if it below.
CALL FUNCTION 'CHANGEDOCUMENT_OPEN'
    EXPORTING
      OBJECTCLASS             = 'ZSCHEMES'
      OBJECTID                = OBJECTID
      PLANNED_CHANGE_NUMBER   = PLANNED_CHANGE_NUMBER
      PLANNED_OR_REAL_CHANGES = PLANNED_OR_REAL_CHANGES
    EXCEPTIONS
      SEQUENCE_INVALID        = 1
      OTHERS                  = 2.
CASE SY-SUBRC.
    WHEN 0.                                   "OK.
    WHEN 1. MESSAGE A600 WITH 'SEQUENCE INVALID'.
    WHEN 2. MESSAGE A600 WITH 'OPEN ERROR'.
ENDCASE.
IF UPD_ZIRD_P_SCHEMES NE SPACE.
    CALL FUNCTION 'CHANGEDOCUMENT_SINGLE_CASE'
      EXPORTING
        TABLENAME              = 'ZIRD_P_SCHEMES'
        WORKAREA_OLD           = O_ZIRD_P_SCHEMES
        WORKAREA_NEW           = N_ZIRD_P_SCHEMES
        CHANGE_INDICATOR       = UPD_ZIRD_P_SCHEMES
        DOCU_DELETE            = 'X'
      EXCEPTIONS
        NAMETAB_ERROR          = 1
        OPEN_MISSING           = 2
        POSITION_INSERT_FAILED = 3
        OTHERS                 = 4.
    CASE SY-SUBRC.
      WHEN 0.                                "OK.
      WHEN 1. MESSAGE A600 WITH 'NAMETAB-ERROR'.
      WHEN 2. MESSAGE A600 WITH 'OPEN MISSING'.
      WHEN 3. MESSAGE A600 WITH 'INSERT ERROR'.
      WHEN 4. MESSAGE A600 WITH 'SINGLE ERROR'.
    ENDCASE.
ENDIF.
CALL FUNCTION 'CHANGEDOCUMENT_CLOSE'
    EXPORTING
      OBJECTCLASS             = 'ZSCHEMES'
      OBJECTID                = OBJECTID
      DATE_OF_CHANGE          = UDATE
      TIME_OF_CHANGE          = UTIME
      TCODE                   = TCODE
      USERNAME                = USERNAME
      OBJECT_CHANGE_INDICATOR = OBJECT_CHANGE_INDICATOR
      NO_CHANGE_POINTERS      = NO_CHANGE_POINTERS
    EXCEPTIONS
      HEADER_INSERT_FAILED    = 1
      OBJECT_INVALID          = 2
      OPEN_MISSING            = 3
      NO_POSITION_INSERTED    = 4
      OTHERS                  = 5.
CASE SY-SUBRC.
    WHEN 0.                                   "OK.
    WHEN 1. MESSAGE A600 WITH 'INSERT HEADER FAILED'.
    WHEN 2. MESSAGE A600 WITH 'OBJECT INVALID'.
    WHEN 3. MESSAGE A600 WITH 'OPEN MISSING'.
   WHEN 4. MESSAGE A600 WITH 'NO_POSITION_INSERTED'.
do not abort, if positions are not inserted!!!
    WHEN 5. MESSAGE A600 WITH 'CLOSE ERROR'.
ENDCASE.
Reward me points if you found it useful.
Thanks
Abhishek Raj.

Can you help me about change data captures in 10.2.0.3

Hi,
I made research about Change Data Capture and I try to implement it between two databases for two small tables in 10g release 2.MY CDC implementation uses archive logs to replicate data.
Change Data Capture Mode Asynchronous autolog archive mode..It works correctly( except for ddl).Now I have some questions about CDC implementation for large tables.
I have one senario to implement but I do not find exactly how can I do it correctly.
I have one table (name test) that consists of 100 000 000 rows , everyday 1 000 000 transections occurs on this table and I archive the old
data more than one year manually.This table is in the source db.I want to replicate this table by using Change Data Capture to other stage database.
There are some questions about my senario in the following.
1.How can I make the first load operations? (test table has 100 000 000 rows in the source db)
2.In CDC, it uses change table (name test_ch) it consists of extra rows related to opearations for stage table.But, I need the orjinal table (name test) for applicaton works in stage database.How can I move the data from change table (test_ch) to orjinal table (name test) in stage database? (I don't prefer to use view for test table)
3.How can I remove some data from change table(name test_ch) in stage db?It cause problem or not?
4.There is a way to replicate ddl operations between two database?
5. How can I find the last applied log on stage db in CDC?How can I find archive gap between source db and stage db?
6.How can I make the maintanence of change tables in stage db?

Asynchronous CDC uses Streams to generate the change records. Basically, it is a pre-packaged DML Handler that converts the changes into inserts into the change table. You indicated that you want the changes to be written to the original table, which is the default behavior of Streams replication. That is why I recommended that you use Streams directly.

Yes, it is possible to capture changes from a production redo/archive log at another database. This capability is called "downstream" capture in the Streams manuals. You can configure this capability using the MAINTAIN_* procedures in DBMS_STREAMS_ADM package (where * is one of TABLES, SCHEMAS, or GLOBAL depending on the granularity of change capture).

A couple of tips for using these procedures for downstream capture:
 1) Don't forget to set up log shipping to the downstream capture database. Log shipping is setup exactly the same way for Streams as for Data Guard. Instructions can be found in the Streams Replication Administrator's Guide. This configuration has probably already been done as part of your initial CDC setup.
 2) Run the command at the database that will perform the downstream capture. This database can also be the destination (or target) database where the changes are to be applied.
 3) Explicitly define the parameters capture_queue_name and apply_queue_name to be the same queue name. Example:
 capture_queue_name=>'STRMADMIN.STREAMS_QUEUE'
 apply_queue_name=>'STRMADMIN.STREAMS_QUEUE'

How can you change data on a SQL 2012 application database that uses availability groups from BizTalk server?

If you use the WCF-SQL adapter it is recommend that you set UseAmbientTransaction to true if you are changing data. I think this requires MSDTC to be enabled on the SQL server that you are changing the data on. (http://msdn.microsoft.com/en-us/library/dd787981.aspx)
I think that Availability groups does not support MSDTC. (http://msdn.microsoft.com/en-us/library/ms366279.aspx).
How can you change data on a SQL 2012 application database that uses availability groups from BizTalk server?

Hi,
Yes, Availability groups doesn't support MSDTC. Please refer to the similar discusison which maybe helpfull:
http://dba.stackexchange.com/questions/47108/alwayson-ag-dtc-with-failover
http://stackoverflow.com/questions/17179221/msdtc-in-always-on-availability-groups

Using Change Data Capture in SSIS - how to handle schema changes

I was asked to consider change data capture for a database recently. I can see that from the database perspective, its quite nice. When I considered how I'd do this in SSIS, it seemed pretty obvious that I might have a problem, but I wanted to
confirm here.
The database in question changes the schema about once per month in production. We have a lot of controls in our environment, so everytime a tables schema is changed, I'd have to do a formal change request to deal with a change to my code
base, in this case my SSIS package; it can be a lot of work. If I wanted to track the data changes for inserts, update and deletes using an SSIS package to send the data changes to the destination tables, would I have to change my SSIS package
with every schema change, or is there a way to keep the exact same SSIS package with CDC without having to change it every month?
Thanks,
Keith

Hi Keith,
What is your exact requirement?
If you want to capture the object_created, object_deleted or object_altered informations, you can try using
Extended events .
As mentioned in your OP:
"If I wanted to track the data changes for inserts, update and deletes using an SSIS package to send the data changes to the destination tables, would I have to change my SSIS package with
every schema change, or is there a way to keep the exact same SSIS package with CDC without having to change it every month?"
If you want the databases in two different environments to be in sync, then take periodic
backup and apply(restore) on the another destination DB.
(or)
you can also try with
SQL Server replication if it is really needed.
As I understand from your description, if you want the table data & schema to be in sync in two different database:
then create job [script that will drop the destination DB table & create the copy of source DB table ] as per your requirement:
--CREATE DATABASE db1
--CREATE DATABASE db2
USE db1
GO
CREATE TABLE tbl(Id INT)
USE db2
GO
IF EXISTS (SELECT * FROM SYS.OBJECTS WHERE name = 'tb1' and TYPE = 'u')
DROP TABLE dbo.tb1
SELECT * INTO db2.dbo.tb1 FROM db1.dbo.tbl
SELECT * FROM dbo.tb1
--DROP DATABASE db1,db2
sathya - www.allaboutmssql.com ** Mark as answered if my post solved your problem and Vote as helpful if my post was useful **.

Change Data Capture (CDC) - Best Approach

Hi,
I am new to BODI and currently trying to design a change data capture approach.
In other ETL tools i have used, the last session run timestamp is stored as a parameter and can be called within a mapping. So the mapping updates this parameter everytime it runs. Therefore when implementing CDC the load_date on the table has to be compared to this parameter.
Is there a similar concept in BODI?
I appreciate your help.
Thanks
Azeem

Yes, there is such a concept, you have to build it yourself. e.g. https://wiki.sdn.sap.com:443/wiki/display/BOBJ/Inititialize-End+Script
When you use a CDC enabled datastore however, the database wants to keep track of the data read, that's part of their CDC API. So it is not DI is querying all changes since yesterday, it is a "select * from CDC table" and the database returns just the rows since the last read. Push vs. Pull.

Changed Data Capture (CDC) when view as a Source

Hello All,
We implemented Changed Data Capture (CDC) by taking table as a source and we used to JKM Oracle Simple KM and it is working fine. But, we need to implement CDC by taking View as a source. Included Primary key at ODI Level for this view as CDC requires this on the source.
As we cannot create triggers on views and also while creating journal view prefixed with JV${table_name}, getting the following errror:
"1446 : 72000 : java.sql.SQLException: ORA-01446: cannot select ROWID from view with DISTINCT, GROUP BY, etc."
How can we achieve CDC if our source is a view?
Any suggestions..
Thanks,
-Vency

Hi,
Its not issue of a "lock" so no luck..
Its definitely the issue with the view..
I also got the real error as:
ORA-012024:Cannot select FOR UPDATE from view with DISTINCT,GROUP by etc..
Wonder why this is the error, as my view does not have DISTINCT,GROUP By etc..
Also checked
select * from USER_UPDATABLE_COLUMNS ;
and found that none of the columns are updateable..
So how to make these updateable and get my form work?

Can not change data in Input Ready Query

All,
I have created an input ready query on an aggreagation level which has one transactional cube underlying it however, after run the query I am unable to change data in the cells even though I get a warning message saying query is ready for input
Note:
1. The underlying realtime cube is in "Planning Mode:Loading not allowed" state in rsa1
2. I tried including all characteristics so that the record can be uniquely identified at that aggregation level).
3. I am not using any characteristic restrictions
4. I have not set any data slices
5. I have set the property for Planning "Start query in Change Mode"
6. I have set the 'Key Figure' Planning Properties to "Can be changed Manually or via Planning Functions" for the key figures
7. I do not have currency/unit in row/column.
8. There are any locks occurring
Any pointers welcome.
Thanks,
Milind

Hi Milind,
Was wondering how was your problem solved. I get the same message when I run the query in web from query designer and in bex analyzer the cells are not updated with the changes that I make.
I am hitting my head against the wall to figure what could be the problem as my plan query is simply based on aggregation level created directlty upon the real time info cube.
Have cross checked all the points that you mentioned in this post but I cells do not change.
There should be some way around to solve this problem.
Thanks

Can't use Find My Friends on iPhone due to Apple ID not being verified. Can't do this as I can't access my .mac email any longer and I can not change the primary e-mail address for my Apple ID!

Can't use Find My Friends on iPhone due to Apple ID not being verified.
Can't do this as I can't access my .mac email any longer and I can not change the primary e-mail address for my Apple ID!
So my options are:
Create a new Apple ID, use that and lose all the apps I've purhcased with it (a fairly substantial amount)
Somehow Migrate these purchases over to a new Apple ID
Apple let me change the primary ID for the account
Anyone else ran into this before?
I've tried accessing the mail through a mail application using the correct server information, and trying both the old 6 character password and the one I had to change it too after they updated the security guidelines - neither work.
Help would be greatly appreciated as I can see more services down the line not working without the address being verified!

To change the iCloud ID you have to go to Settings>iCloud, tap Delete Account, provide the password for the old ID when prompted to turn off Find My iDevice, then sign back in with the ID you wish to use. When you do this you may find that the password for your old ID isn't accepted. If this should happen, and if your old ID is an earlier version of your current ID, you need to temporarily recreate your old ID by going to https://appleid.apple.com, click Manage my Apple ID and sign in with your current iCloud ID. Click edit next to the primary email account, change it back to your old email address and save the change. Then edit the name of the account to change it back to your old email address. You should not need to verify the old email address. You can now use your current password to turn off Find My iDevice on your device, even though it prompts you for the password for your old account ID. Then save any photo stream photos that you wish to keep to your camera roll. When finished go to Settings>iCloud, tap Delete Account and choose Delete from My iDevice when prompted (your iCloud data will still be in iCloud). Next, go back to https://appleid.apple.com and change your primary email address and iCloud ID name back to the way it was. Now you can go to Settings>iCloud and sign in with your current iCloud ID and password.

Sapcar returns error "can't change date of file"

I am preparing to apply SPS12 to my ERP6.0 system.
when I run sapcar -xvf "*.?ar", I get the following error:
"can't change date of file EPS/in/CSN01120061532_0026976.ATT
invalid argument."
note: I am using the latest sapcar version 7.00 running under the local&domain admin account.
Did anyone run into this problem before?

We have the same error
processing archive /sapcd/sap/ECC6/JCE_Policy_Files/90000115.CAR...
x Changelog.txt
can't change date of file Changelog.txt
Invalid argument
How did you fix it ?
Regards,
Madhan

Can CDC (Change Data Capture) Can be used for Audit / Trail Purposes

Similar Messages

Maybe you are looking for