Data Services job rolling back Inserts but not Deletes or Updates

I have a fairly simple CDC job that I'm trying to put together. My source table has a record type code of "I" for Inserts, "D" for deletes, "UB" for Update Before and "UP" for Update After. I use a Map_CDC_Operation transform to update the destination table based on those codes.
I am not using the Transaction Control feature (because it just throws an error when I use it)
My issue is as follows.
Let's say I have a set of 10,000 Insert records in my source table. Record number 4000 happens to be a duplicate of record number 1. The job will process the records in order starting with record 1 and begin happily inserting records into the destination table. Once it gets to record 4000 however it runs into a duplicate key issue and then my try/catch block catches the error and the dataflow will exit. All records that were inserted prior to the error will be rolled back in the destination.
But the same is not true for updates or deletes. If I have 10000 deletes and 1 insert in the middle that happens to be an insert of a duplicate key, any deletes processed before the insert will not be rolled back. This is also the case for updates.
And again, I am not using Transaction Control, so I'm not sure why the Inserts are being rolled back, but more curiously Updates and Deletes are not being rolled back. I'm not sure why there isn't a consistent result regardless of type of operation. Does anyone know what's going on here or  what I'm doing wrong/what my misconception may be?
Environment information: both source and destination are SQL Server 2008 databases and the Data Services version we use is 14.1.1.460.
If you require more information, please let me know.

Hi Michael,
Thanks for your reply. Here are all the options on my source table:
My Rows per commit on the table is 10,000.
Delete data table before loading is not checked.
Column comparison - Compare by name
Number of loaders - 1
Use overflow file - No
Use input keys - Yes
Update key columns - No
Auto correct load - No
Include in transaction - No
The rest were set to Not Applicable.
How can I see the size of the commits for each opcode? If they are in fact different from my Rows per commit (10,000) that may solve my issue.
I'm new to Data Services so I'm not sure how I would implement my own transaction control logic using a control column and script. Is there a guide somewhere I can follow?
I can also try using the Auto correct load feature.  I'm guessing "upsert" was a typo for insert? Where is that option?
Thank you very much!
Riley

Similar Messages

  • Data services job failes while insert data into SQL server from Linux

    SAP data services (data quality) server is running on LInux server and Windows. Data services jobs which uses the ODBC driver to connect to SQL server is failing after selecting few thousand records with following reason as per data services log on Linux server. We can run the same data services job from Windows server, the only difference here is it is using SQL server drivers provided by microsoft. So the possible errors provided below, out of which #1 and #4 may not be the reason of job failure. DBA checked on other errors and confirmed that transaction log size is unlimited and system has space.
    Why the same job runs from Windows server and fails from Linux ? It is because the ODBC drivers from windows and Linux works in different way? OR there is conflict in the data services job with ODBC driver.
    ===== Error Log ===================
    8/25/2009 11:51:51 AM Execution of <Regular Load Operations> for target <DQ_PARSE_INFO> failed. Possible causes: (1) Error in the SQL syntax;
    (2)6902 3954215840 RUN-051005 8/25/2009 11:51:51 AM Database connection is broken; (3) Database related errors such as transaction log is full, etc.; (4) The user defined in the
    6902 3954215840 RUN-051005 8/25/2009 11:51:51 AM datastore has insufficient privileges to execute the SQL. If the error is for preload or postload operation, or if it is for
    ===== Error Log ===================

    this is another method
    http://www.mssqltips.com/sqlservertip/2484/import-data-from-microsoft-access-to-sql-server/
    Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

  • Data Services job server crashed and won't start backup

    Hello,
    I was running some jobs on data services 4.2 sp3  windows server 2012R2 and they all failed and the job server went down. None of the jobs that failed had an trace file or error log in the management console. Now i am unable to open data services designer or data services server manager, when I try to open them nothing happens. Also the SAP Data services job service cannot be started. The job server was running fine for a few weeks before this. This has happened twice already today the first  time the only way i was able to fix it was run the repair on the dataservices install. Can someone please help me what know what is causing this and how it can be fixed.

    Hi Tyler,
    It was Windows specific issue please refer the below link & KBA
    How To Fix Windows Service Error 1053
    http://windows-exe-errors.com/how-to-fix-windows-service-error-1053/
    1986247 - Error "Windows could not start the BusinessObjects Data Services service on local computer" occurs in Data Services 4.1
    https://service.sap.com/sap/support/notes/1986247
    1992260 - Error: Windows could not start the SAP Data Services service on local computer, after upgrading SAP data services and deleting job servers SAP Data Services 4.2
    https://service.sap.com/sap/support/notes/1992260
    Hope this will help!!!!
    Thanks,
    Daya

  • 2 different iphones have the same Apple ID, how can I change the apple ID on one of them but not delete the other iphone's data and media?

    2 different iphones have the same Apple ID, how can I change the apple ID on one of them but not delete the other iphone's data and media?

    You don't have to do anything with the first iPod that you don't use anymore. If you are planning on keeping it, put in a drawer in your house and forget about it.
    You don't need a second account to use with the new iPod. I use one Appl e ID and iTunes library for two iPods, and two iPad. I have different content on all four devices. You can select exactly what you want to sync to each device and it can be different content on all devices.

  • Data source was activated and replicated but not showing up in RSA7.

    Hello,
    Data source was activated and replicated but not showing up in RSA7.  At what point does the data source appear in the Delta Queue?
    Thanks

    Hi,
    for LO,LIS,generic,FI data sources, delta records come from delta queue.
    if u run the INIT in BW whether it may be success or not delta queue will be maintained in RSA7. and u can check the records in RSA7 or smq2.
    when the init request goes to R/3 then it will maintains delta queue in RSA7.
    assign points if it helps,
    thanks,
    pavan.

  • HT1937 my cellular data connection works in one location but not in another

    Why does my iPhone's data connection work at other places but not at work?
    It works sometimes.

    Good question to ask your cell phone provider.. Maybe the material the building is made of is blocking the cellular data signal.

  • Issue while using views in Data services Jobs

    Hi,
    In Data Services Job, i am trying to pull data from a view to a table. The view is pointing to the table which is in other database.
    The problem is when i import the source view into data services and view the data, i found one row having wrong data. The values in that row are wrong/corrupted while the same row in the source table is having correct values
    I queried the view from TOAD for that record. The values are valid.
    The data is coming wrong only in Data services. Any row in that table gets corrupted, there is no specific row.
    Hence while running the jobs i am getting errors.
    Any idea what can be the reason of getting corrupted data in view while same view when queried from TOAD gives correct values?

    hi,
    There is a possibility of unsupported data type by data service, please share the data service version,  database type and data type of column which got corrupted.
    Regards,
    M Ramesh

  • Hi, i am from UAE. I buy iphone 4 yesterday but i cant able to activate. when i insert iphoone to itunes informing sim inserted but not appears to be supported. what can i do pplz help...........

    Hi, i am from UAE. I buy iphone 4 yesterday but i cant able to activate. when i insert iphoone to itunes informing sim inserted but not appears to be supported. what can i do pplz help...........

    From where did you buy the iphone?
    What country?
    What store?
    An Apple store? Official Apple reseller?
    Why do you think it is unlocked?

  • I would like to set job trigger on Data Service job.

    Hi Expert,
    I would like to know that how to set job trigger on Data Service job because now our system has been set job separate for get data from FI Module , HR Module and other. I want to execute job follow below.
    Start --> FI job run --> FI job finished --> trigger --> HR job run --> HR job finished --> trigger --> Other etc.
    Or if you have any idea. Please advise me.
    Thank you for your advise.

    Hi,
    You can do this from Data Service management console, follow the below steps to create and execute
    batch (.BAT) file
    Select Batch > repository.
    Click the Batch Job Configuration tab.
    For the batch job to configure, click the Export Execution Command link.
      4. On the Export Execution Command page, enter the desired options for the batch job command file that you want the Administrator to create(Extension will be added automatically:  .sh for UNIX , .bat for Windows)
      5. Click Export.
          Batch file for the job will be created under <DS_COMMON_DIR>\log directory.
    6. Create a New DS Jobs in Data service designer and write the script to execute your  batch file as below
    Hope this will be helpful for your requirement .
    Regards
    M Ramesh

  • How to use time capsule for wireless back-up but not internet?

    Hello,
    I have a tower and recently a laptop at work. The tower is connected to our local network with an ethernet cable and the laptop with wireless. So, the internet connection is fine for both.
    I was hoping to use my time capsule to do time machine backups on my laptop. Do you have any advice on how to configure this? I do not want to use the time capsule to extend my Internet, as I believe my work I.T. would prefer to handle all access to their  network.
    Perhaps there is some documentation about doing this that you could point me to? I have not been able to find it.
    Thank you for your help.

    Your original question was How to use Time Capsule for wireless back-up but not Internet?
    There is no reason for you to connect the tower....or anything else...using Ethernet if your goal remains that same as you stated.
    If you are asking if you can backup the Tower using Ethernet, and not wireless, then you can connect the tower to one of the LAN <-> ports on the Time Capsule....not the WAN port.
    Yes, it appears to work without plugging into my tower.
    Correct, it will work.
    I just have to select the network that it created. Of course, I have no access to the Internet while this is happening and it can not auto backup, unless I am on that wireless signal.
    As I stated, that is the downside to trying to back up without an Internet connection.  You have to establish another network...and backup over that network.
    If you are asking if you can stay connected to the work network while also backing up to your non-Internet "private" network, that is not possible.

  • Hi where can I find my all iPhone back up, but not on iTunes , but in the folders

    Hi where can I find my all iPhone back up, but not on iTunes , but in the folders

    ~/Library/Application Support/MobileSync/Backup/
    Where the "~" (tilde) represents your Home directory
    /Users/username/Library/Application Support/MobileSync/Backup/
    Note these backups are not in human readable form.

  • I m using iPad mini, mistakly I clicked on restore factory now it require apple id and password which I inserted but not get success I really do not know any other apple id to restore its settings. I used .

    I m using iPad mini, mistakly I clicked on restore factory now it require apple id and password which I inserted but not get success I really do not know any other apple id to restore its settingsI used last time.
    < Personal Information Edited By Host >

    It sounds like this iPad was purchased second hand.  If so, you will need to contact the original owner, otherwise your iPad will remain Activation Locked.
    Find My iPhone Activation Lock - Apple Support

  • Input to data service job

    Hi Experts,
    Is it possible to provide input to data service job from BW while runtime.

    Hi,
    you can follow the steps below to execute a BODS Job from BW.
    Goto BW, create infopackage for respective datasource and fill the "3rd party selection" details as below.
            Repository    : BODS repository name
            JobServer     : BODS running jobserver name
            JobName     : BODS job name
    Save and Execute infopackage.It will trigger BODS job which will load the data into BW datasource.
    Add this infopackage into process chain and schedule it.
    Now for passing the values into the job you can try as follows:-
    You need to add Global Variables to your Job.
    Then, if you refresh the 3rd party selections, you'll see your variables after Advanced_Parameters.

  • I want to Hide Back option but Not Save option when using transaction iview

    Hi,
    Sap Guru's
    I am new in Sap EP.... I am using Transaction iviews in the portal....  I want to Hide Back option but not the Save Option of transactions....I want to hide it from  potal ...... Is it Possible.....
    I have done settings in  SICF Tcode in ECC system as Following:
    ~Webgui = 1
    ~Webgui_simple_toolbar = 160, 2, 4, 16, 32, 64 and some more values... It is hiding the Back option but also the Save Option....
    I also want to disable commands as Ctlr  + S , shift + F3
    Suggest me some solution so that this can be done from portal instead of ECC systems.....
    Thank's in Advance
    Regards-
    Sumeet Sharma

    Hai,
      Kalyan,
    I have done this problem using SICF but instead of Hiding Back option .. I have allowed a user to run only one transaction using an iview....
    Put following parameter in SICF:
    ~webgui = 1
    ~theme = Sl
    ~SINGLETRANSACTION = 1
    By this configuration user will be able to execute only one transaction i.e  assigned him in his transaction iview.... It's an alternate solution of hiding back......
    when user click front screen back option of an transaction iview he will get message ... Logged off....
    Regards-
    Sumeet Sharma

  • To create a table which allows entries to be added but not deleted?

    Is it possible to create a table (SE11) which allows users to enter data into the table but not delete data from the table?

    If you generate a maintenance dialog for your table you will have to check, if the user tries to delete an entry and just send an error back that this is not allowed,
    You could use e.g. event 03 - 'Before deleting the data displayed' to check if the user tries to delete something.
    If you do not use a standard maintenance dialog but an own screen to maintain the data, just don't offer a delete option to the user.
    However if someone writes a report where he does a delete on that table there is no standard way to prevent that.
    Hope that helps,
    Michael

Maybe you are looking for