Change capture ... working backwards!

Hi everyone,
We are currently putting together a reporting system where we will cover data over a number of time-periods (mostly monthly). Once we are in production, we would like to use CDC (Change Data Capture) so that we 'grab' only the changed data (delta) which will speed things up and will reduce our stored data volumes.
However, now, at the start of the project we will be loading data from a number of backed-up sources.
Here, we would like to start with the current period/month, i.e. May 2008, and progressively load earlier 'snapshots' of the data. So it would also be better if we could load only the changed data. For example records which are the same in May as they were in April would not be loaded but all those which had changed in some way would.
We could certainly put together the SQL to do this (i.e. comparing each field and looking for differences) but that seems to be very cumbersome. So here I would like to ask if there are any database or table attributes that I can use?
Idea for us would be if Oracle/the table/the record stores a 'record changed' date which we could use to decide whether a particular record need to be loaded or not.
Some of the archived sources, which we will be loading are oracle-backups so I am wondering whether such 'dumps' also store a data for when the record ways las
Any thoughts / tips would be gratefully received.
Thanks,
Alan Searle
Bonn

We're using MINUS queries to see what changed in our application. SQL is comparing the values for us. We have dynamic SQL in a procedure to build the MINUS query since the source/destination tables are structured similar to one one another building the query from ALL_COLUMNS.
One downside to using SQL is that on some of the larger tables we may run out of resources during some execution in our smaller development environment eventually

Similar Messages

HR Analytics Change capture logic

Hi All
My customer currently has a custom built warehouse and is using obiee as the reporting tool.
I am busy implementing 7.9.6.2 apps for them from their EBS 12.1.1 instance.
They have a burning issue which is that in their source system, the users do not always capture the fields required for their compliance reports, so their headcounts are not correct, then the users correct the data and the BI headcounts historically are not correct.
I have suggested that this problem must be dealt with in the source system, but they want to find out if the pre built apps will offer any relief.
The question is how does the BAW change capture work surrounding this scenario?
I have said that from what I have experienced the change capture works with the refresh dates in the DAC and that any changes will be picked up by the last updated date and an update will be effected to change the data.
This is unless there is SCD type logic built in where the snapshots will reflect the history as it was and perhaps only the aggregates will be effected.
I have been checking the employee headcount in the rpd and following the process back to the SDE_ORA_PersistedStage_WorkforceEvent_HeadCount_Full where the data is extracted from the source and there is a lot of headcount logic built in but I cannot work out for sure how the net changes will be handled.
Is there anyone who has had experience with HR Head count snapshots and aggregations being affected by back dated source system changes?
Regards
Nick

Hi Tarik
Thanks for the info, I have generated the flex field and configured the csv's, I am stuck at this stage with the similar issue to the 'Error in SDE_ORA_AbsenceEvent_Full workflow' post in this forum and have an sr logged on metalink so I cannot actually test the behaviour.
The customer wants to know what will the result be if they backdate a change specifically around headcount and compliance fields in the source system when the pre built hr etl's run. They want to know if it will update the warehouse and how will the snapshot tables be effected.
I followed from source to target on headcount as a metric;
on a high level this is what I understand about the process:(corrections welcome)
SDE_ORA_PersistedStage_WorkforceEvent_HeadCount_Full loads W_ORA_WEVT_HDC_PS (stores a history of headcount)
Then SDE_ORA_WorkforceEventFact_Hdcnt loads W_WRKFC_EVT_FS
then
SIL_WorkforceEventFact loads W_WRKFC_EVT_F with the update strategy in Upd W Wrkfc evt f ins upd identifies from comparing the etl proc wid & data source num whether there will be an insert update or delete.
If there is a change it inserts a new record and marks the old one as delete with the soft delete logic.
The the rpd looks at alias's of w_wrkfc_evt_f with joins to ago keys for history and to current for up to date records.
So assuming the changes do not fall out side of the dac's prune days, and the 'back dated' change is picked up in the etl by the OLTP ' last updated time stamp' being later then the etl refresh date, will the behaviour be that the records are updated but the snapshots remain unchanged and therefore reflect the incorrect data?
For example. A person joins the organization in Jan, but there current system report does not reflect him because the record does not have the mandatory fields correctly filled out and he falls into an exeception report. In Feb the data is not corrected but in March the HR team correct the data and back date the change in their system to January.
How will this affect the headcount in the BAW? How would the BAW handle this scenario? Is the question from the client ( assuming the ootb values are correct and in use.)
I have said I think the dac will pick up the last upd, load the tables above and update the total so it is showing correctly, looking back at the snapshot should refelct the correct data because the BAW will have picked up the join 'Event' off PER_ALL_ASSIGNMENTS_F unlike their bespoke system which uses per all people f.
If there are any HR gurus out there who can confirm my expectations or offer any comments I would appreciate it.
Many thanks
Nick

All default routing value has to be changed, while changed the work center in production order

Dear friends,
our client they want to change the work center in production order.according to production version work center also they are changed.so while change the WC,all the default value has be changed as per routing what we maintained in routing.At present we have to enter the manually change the W.C as well as set up time and operation time enter manually.Any other option to do the automatically capture value from routing while change in Work center in production order.pl help me on this.
Thanks&Regards
Sabhapathy R

Hi Rahul,
Thanks for reply. I am maintained in diff value maintained routing , Ex :First routing i have work center 'X' value maintained as a setup time in 15 Min's and operation time 10 Min's
second work center 'Y' I have maintained as set up time 10 Min's and operation time 30 Min's,
Now I want to change the work center in production order as a 'Y' so whatever value maintained in routing , it has to be changed automatically (10 min's and 30 Min's), but system will not change only old value only picked (15Min's AND 10 Min's).
Now I think you get to know what the client requirement, kindly do the need full.
Regards,
Sabhapathy R

Capture worked now it's out of sync

As a new FCP user, I am capturing my a/v from a Cannon 2R50MC. Source tape is recorded as 12 bit and the capture preset is edited (see details below), I am capturing to my internal and copying them to external after capture. It I don't I get a timecode break error message and it aborts.
The project I am working on has almost 200 source tapes and I captured my first 12 with out much of a glitch.
On tape 13 my audio and video are out of sync. It does not drift out of sync, it is out of sync from the first frame.
I tried a couple things and then decided to clean the tape heads of the camcorder (using it for playback, it is same camcorder that recorded the source) and it captured tape 13 in sync. On to tape 14 and out of sync again. I changed the device control preset from firewire ntsc to firewire ntsc basic, cleaned the tape head and 14 was in sync. On to tape 15 and out of sync again. I tried unchecking User Pref sync audio capture and capture preset of mix 4 channels instead of 1st 2 channels. These things have not helped.
At the end of the captures that are not in sync I get an Analyzing DV Audio window that stays open and working quite a while "Validating Audio Data."
I have tried capturing 10 min at a time and the first capture was in sync and the second capture of 10 min is out of sync.
I did try capturing a very early tape in the series (probably the least valuable to the project) and it worked in sync. Now I am noticing that the later tapes were taped using a wireless mic and the earlier audio was from the camcorder's built in mic. Could this be the problem? This does not explain the first 12 captures working as they were recorded with the wireless mic.
My A/V settings are:
Seq preset: DV NTSC 48 kHz
Cap preset: DV NTSC 32 kHz (copied and edited from DV NTSC 48 kHz) (Device: DV Audio, Input: First 2 channels, Format 32.000 kHz 16 bit 2 chan)
Device Control: FireWire NTSC
Video Playback: Apple FireWire NTSC (720 x 480)
Audio Playback: FireWire DV (also tested default with no better results.
Does anyone have a reason/solution to why it was working and now isn't?
What about work arounds. Can I resync the tapes and then reliably make clips and edit the video with those clips?
ALSO:
The camcorder window says: 12 bit and Stereo1, should there be a stereo capture setting, I believe I'm capturing in mono?
I typed a lot of this up and posted yesterday but no solutions yet, sorry bout posting twice, I'm desperate for a solution, running out of time, ya'know all the usual constraints.
Thanks ahead of time. T.

It works I don't know why...
I'm not complaining but maybe someone out there can explain it to me.
I am capturing through this procedure:
I test a one minute clip (arbitrary time length). I get an Analyzing DV Audio window that is Validating Audio Data. I cancel out of that window (if I don't cancel out of the window and view the clip when it's done it is out of sync.) I do a second clip using the same in and out points and do not get the Analyzing DV Audio window and the test clip is sync. I then set up a full tape capture (up to an hour) using in and out points. It captures in sync.
I was thinking it was working because I was starting the in point well into the beginning of the tape 45 sec to 1 min, but through more tests I've been able to capture using an in point of 10 sec. into the tape.
Just curious if this has happened to anyone else or why it might work.
If it's voodoo PLEASE don't break the spell.
Happy New Year, T

DAC: Change capture sql problem.

Hi,
DAC 10g, SEBL_VERT_80
This is for vanilla code. When I right Click S_OPTY-> Select Change Capture Scripts->Generate Change capture SQL -> Incremental
I am getting the
Select * from Dual
It suppose to generate all truncate image table and create view script right. Whats wrong with the Configuration
Please help.
Suresh

Thanks Srini,
Sorry we have patched all our environments with following patch.
Dac Build AN 10.1.3.4.1.patch.20110427.0538, Build date: April 27 2011.
If i have to apply the new patch. i have to do it in all environments.
Its working in all other environments except one having problem.
Anyway I have re-installed DAC and it fixed the problem. I dont know what caused this problem.
Its shame that i have to re-install it, this is not recommended, this is not best practice.
Regards
Suresh
Edited by: slella on 04-Mar-2013 08:26

Using DAC for implementation of two change capture views on same base table

Hello
We have a need to create 2 views (V_INS_CLAIM & V1_INS_CLAIM) on a single table (S_INS_CLAIM) using DAC & Image tables.
The V_INS_CLAIM will be used to load ODS on a hourly basis and
The V1_INS_CLAIM will be used to load DataMart on a daily basis.
For this purpose, we propose using the following approach:
1) Create 2 separate containers - one for ODS and one for Datamart.
2) Use a separate image table suffix (for the same table) on each container e.g.
- Use image suffix 51 on S_INS_CLAIM for the ODS container (will result in image tables having suffix 51)
- Use image suffix 61 on S_INS_CLAIM for the Datamart container (will result in image tables having suffix 61)
3) In the ODS container, the change capture process would create a view V_INS_CLAIM using
the base table S_INS_CLAIM and the I/R/D tables using image suffix 51
For this folder the 'Drop and Create Change Capture Views Always' flag will be set to True
All views for this container will be created with the prefix "V_"
4) For the Datamart container, we propose to set the flag 'Drop and Create Change Capture Views Always' to False.
This would ensure that DAC never drops/creates the view (assuming that the view was already created by the ODS container)
For creating the change capture views, we propose to create the views using sql procedures.
All views for this container will be created with the prefix "V1_"
The above procedure would ensure that we have distinct views created for each target (ODS & Datamart), which are refreshed at different intervals.
Alternatively, instead of creating 2 views with different names in the SIEBEL schema,
we could create 2 schemas - one for ODS and the other for Datamart and create the change capture
views separately in each schema (using separate I/R/D image tables - as mentioned above).
Please let me know which of the above 2 approaches would work and supported by DAC and which would be the better option ?
Thanks

1.) Wrong forum. Go here: Business Intelligence Applications
2.) Soft delete or hard delete? Sound to me like you want to get rid of teh records. I.e. deleting history.
3.) Normal upsert mapping swon't do, you'll need delete mappings (depending on #2)

Changing operations work center during creation of PM order

Hi all,
I am looking for BADI or EXIT in order to change operationS work center which created from maintenance calls.
Does anyone know such possibility?
Assaf

Assaf,
Have a look at BADI IWO1_TL_INTEGRATION2.
Also see [OSS Note 925072|https://websmp130.sap-ag.de/sap(bD1lbiZjPTAwMQ==)/bc/bsp/spn/sapnotes/index2.htm?numm=925072]
Which system are you running?
PeteA

I currently have iPhoto 8.1.2 on my macbook pro and am trying to update to the latest version. I have had to work backward, but I can only get back to 9.1, which will not install because it says I need at least 9.0 to install it. Is 9.0 available?

I currently have iPhoto 8.1.2 on my macbook pro and am trying to update to the latest version. I have had to work backward, but I can only get back to 9.1, which will not install because it says I need at least 9.0 to install it. Is 9.0 available? Will I need to go back even further? Thanks

Upgrading from iPhoto 8 to iPhoto 9 requires a purchase. There are two ways to get to iPhoto 9:
1 - purchase a copy of the iLife 11 disk from a 3rd party retailer like Amazon.com or eBay.com.
2 - if your MBP meets the requirements upgrade you system for free to Mavericks. Then you can purchase the latest iPhoto version, 9.5.1, from the App Store.
OT

How can I add/change art work to albums where the art work isn't available at iTunes?

How can I add/change art work to albums where the art work isn't available at iTunes?

Go to google and search for the artwork. When you find it, save it to your computer. Right click the album and select get info. Drag the image you saved to the empty box for album art.

Automatic change of Work Center during Confirmation.

Happy New Year to all!
Just want to ask if anyone of you encountered the scenario during confirmation in which the backflushed work center was changed. The user claims that they did not do any changes during confirmation nor did they change manually the order itself. The confirmation happened last December and they only noticed it this month when they were checking the reports.
I did not configure their system so that they can change the Work Center during confirmation. By default, the work center is grayed out during confirmation.
Hope to hear from some of you soon!
Thanks and regards,
jLmendoza
Edited by: John Luis Mendoza on Jan 4, 2011 3:15 AM

Dear
If your production order operations are re-scheuled and dispatched after Capacity Avalaiblity check in cm21/cm22/cm31 etc , then during the dispatch of operation , you have option to change Work Cnetre , time , date based on the selection option in Startgy profile (CM31/CM21-Enter the WORK CENTRE /Order ) and check wether work centre is changed.
One more option may be in Order Change in CO02-Operation Overview -Operation -Work centre -Here user may change the Work Centre .
If you have Order Change management active then you can trace the same .
Refer : Production order change history
Otherwise , there is not such confirguration in SPRO where work centre can be changed automatrically during confirmaiton because it will grade out based on the ste of confirmaiton default screen in OP00.
Hope it clarifies
Regards
JH

Changing default Work Center during CATS time entry

Hi Folks,
I am hoping someone here can throw some expert advice.
Currently during time entry in CATS, we have Work Center coming in from the Work Order. Its getting defaulted without any option to change it. Business here has a need to change it. I have llooked into the CATS profile to see if there is a place that enable the WC to be defaulted.
In Transaction CAC1, there is a section that shows what fields are being defaulted during CAT2 time entry. However I do not see the Work Center as one of the option there.
Can any one help?
In short, where do we disable the defaulting of the WC from the Word Order during time entry?
Thanks in advance.

Hi,
Adding to what Kapil said; if the work centre is a grayed out in time shet screen then you can go to CAC2 transaction and make it editable. By this way users will be able to change the work centre on screen.
Regards
Sreekanth

Problem with change capture

HI,
we've a problem with the Change Capture in the DAC's Execution Plan.
We've cretead a new data model but we want to reuse the image table and the Change Capture process, so we've perfomed the following step:
1) create the mapping SDE e SIL for the new tables of datamodel in Informatica Power Center
2) register these mapping in the DAC
3) create a subject areas and associate these tasks to this
4) create execution plan including "change capture" and "change capture sync"
5) execute our "execution plan"
the problem is the following:
from the Execute -> Current Run Tab -> task
we can see that execution time of change capture is 0
from the Execute -> Current Run Tab -> task details
there aren't any change capture details
So, our image table are empty.
Do you have any idea?
Thanks in advance,
Antonello.

HI Antonello,
I am also having the same issue like you. I have created a new execution plan in DAC 101341 and ran it. It seems like the task Change Capture For Siebel OLTP completed in 0 seconds and there are no details for that particular task. Can you please let me know if you have resolved this issue? Your help is much appreciated.
Thanks
Ravi

Change Capture For Siebel OLTP task in DAC running for more than 10 hours

whole etl load used to complete in 2 hours (as on now siebel data having sample data). since last Friday Change Capture For Siebel OLTP task in DAC execution plan running for more than 10 hours. I am not able to trouble shoot the problem because no log for this task
what could be the reason for this problem? how can I fix that problem?
Appreciate your help
Thanks
Jay.

Which ETL is it that is taking the longest (is it an SDE, SIL, PLP?). I have seen someOracle vanilla ETLs coded in a way that is very ineffective. Check the DAC and Informatica logs and find out which mapping it is and where the delay is (e.g. SQL, write to DB..etc).

Change in Work item Text for Approval Workflow WS14000133

Hi,
I need to change the work item text for Shopping Cart Approval Workflow WS14000133.
I have created an Attribute in Business Object BUS2121 and called the same attribute in work item text.
In PFTC -> Redefine Work item text - > and i have defined the work item text as well called the attribute from the container.
what the problem over here is - when I am passing the attribute in the work item text in the task, I am unable to see the work item text with the Dynamic Attribute but I am able to see the work item alone (not with the Dynamic attribut)
But when i debug the workflow from SWI1 then i can see the dynamic attribute in the Container of the workflow but nt in the approver's inbox in portal..
Can you please tell me - that why is this a strange behaviour that i can see the Dynamic attributed created initially in the workflow container of the Business Object but nt in the Approvers inbox either in Backend nor in the front end...
Thanks,

Hi,
Maybe this SAP note/KBA will help :
1470761 - How to change the text of the SRM approval links in inbox or UWL
Kind regards,
Siobhan

Webcam capture works fine in JMFStudio, not in Eclipse

Hi all,
I search the forum, but can't find any answer !
I'm trying to capture a webcam using JMF Performance Pack on XP64.
I can read the webcam in JMFStudio, but when using some code to do it, for instance in eclipse, it says :
java.io.IOException: Could not connect to capture deviceI tried with several code, some snippets found on this forum, some found on other, but the problem is always the same.
My webcam is well detected in the DeviceManager list.
What should be done to capture a video in my own class, knowing that this capture works well in JMF Studio ?
Thanks in advance,
PsyKo

For some reason your codes might me trying to connect to the wrong device.
Go to JMF - > JMF Registry -> Capture Devices and check the "name" of your webcam. For example, it could be something like "vfw:Creative WebCam NX (VFW):0"
Then, go to the code you are using and add the device "manually".
I dont know if that�s the problem, but you can try it.

Working Backwards - is the image in any Indesign Documents?

Hi guys
Here at my place of work IT are continually trying to keep the amount of data on our network as low as possible.
To do this they produce a large files report and a duplicate files report.
Using indesign and packaging files as we do, we are quite often culprits of the large files or more often than not duplicate files.
Because it isn't just us that has access to our images etc we feel we have to package our documents because of the risk of a file being moved or deleted and therefore losing its link to indesign.
My question is this: If we have an image, a jpg for example, is there a way of seeing any indesign files that that is linked to? This way, if we have a large image file, we can see if it is connected to any of our indesign files and then if not, reduce / delete it without the fear of affecting any documents.
Thanks
Si

The other way around, yes, you can find links to InDesign files through
Bridge. This way, no.
Bob
SimonLaughton <mailto:[email protected]>
Thursday, December 13, 2012 10:44 AM
>
Working Backwards - is the image in any Indesign Documents?
created by SimonLaughton
<http://forums.adobe.com/people/SimonLaughton> in /InDesign/ - View
the full discussion <http://forums.adobe.com/message/4918461#4918461

Change capture ... working backwards!

Similar Messages

Maybe you are looking for