Partial Commit in ODI

Question

Can ODI does partial commit of large batch of data neglecting erroneous ones. If so how to achieve this? This would be very helpful especiall in a batch transaction where instead of rolling back entire batch due to erroneous records atleast the correct records can be commited to target

Answer 1

Hi,
Adding some more points,
As per i suggested eariler you can use CKM for capturing the error records. Using CKM is also a permanent solution for the data flow.
Below is the steps for CKM processings,
1. In your target data store declare a constraint (right click on the constraints, say INSERT CONDITION)
2. Lets assume that you need to capture records in a field which is not a number ie.,rather than numeric values. Then in the condion window select Sunopsis condition and in the Where box REGEXP_LIKE(<col_name>, '^[[:digit:]]*$'). It will pull all such records to E$ table.
3. Add this data store in your target and say FLOW_CONTROL to YES and RECYCLE_ERROR to YES in the Control tab of your interface select the CKM and constraints.
Your error records will be moved to E$ table and in the second run once you correct the error records in E$ table those records will again move to target table (recycle error).
Please explore the below link for more information on REGEXP.
http://www.oracle.com/technology/oramag/webcolumns/2003/techarticles/rischert_regexp_pt1.html
All the best.
Thanks,
Guru