Transaction boundaries for an Integration Knowledge Module

Hi All,
We are currently using the SQL Incremental Update IKM to push changes from our source to target database. Our target database is denormalized to extract out data that can change over time into tables that are indexed on load timestamps that come from CDC (so that we can do time based queries on these tables to find changes between polling intervals). We want the ability to run multiple IKMs in one transaction for a parent-child type relationship, so that if we have an error in processing the child, then the parent is rolled back, leaving the target database in a consistent state.
We have tried assigning the one transaction to all of the steps in the the IKM as well as the LKM and CKM so that the load of the data into the ODI work tables is in the same transaction as the commit to the intermediate store. If we tell ODI not to commit until the end of the integration module and there is an error in inserting rows, rather than rolling back, the errors are placed into the E$<table_name> table in the target database and the IKM finishes as normal.
Is is possible to roll back this transaction so that errors aren't placed into these E$ tables? We would rather have human intervention fix the error in the target database and rerun the scenario than fix the error in the target database and then copy values out of these E$ tables. Especially since the E$ tables are emptied on the next run. Any help would be greatly appreciated.
Regards,
Aaron.

If you turn FLOW_CONTROL off, you won't get the data moved into the E$ tables, it will simply try to do the set-wise updates and inserts, if it fails, then the task will fail, causing your rollback.

Similar Messages

  • Reg : Doubts on Knowledge Modules

    hi all,
    Please give brief idea about knowledge modules. please dont give links .
    KNOWLEDGE MODULES
    REVERSE ENGINEERING
    LKM
    CKM
    IKM
    JKM
    SKM
    Thanks a lot in advance ,
    -Chinnu.

    LKM - Loading
    The LKM - Loading Knowledge Modules - load (or extract data) from one data server to another.
    They are named as follows:
    LKM <source server technology> to <target server technology> (<module specificity>)
    JKM - Journalizing
    The JKM - Journalizing Knowledge Modules - setup journalizing on a datastore in a data model.
    They are named as follows:
    JKM <technology to journalize>
    Note: Journalizing uses triggers and views. Therefore technologies that do not support these functions generally do not have an associated JKM.
    IKM - Integration
    The IKM - Integration Knowledge Modules - integrate data in a target data server from a Staging Area. Frequently, the Staging Area and target space are on the same data server. The IKM can manage options such as data insertion (Append), or update (Incremental Update), etc.
    They are named as follows:
    IKM <Staging Area data server technology> to <target data server technology> <option managed in the module> (<module specificity>)
    IKM <Staging Area and target data server technology> <option managed in the module> (<module specificity>)
    Note: The option managed by the module frequently indicate the more complex option supported in this knowledge module. For instance, a module Incremental Update (update) should also be able to manage the option append, which is data insertion, and suppression of data in the target..
    CKM - Check
    The CKM - Check Knowledge Modules - manage the data quality and cleansing, on static data and on data flows.
    They are named as follows:
    CKM <Checked Technology> (<module specificity>)
    RKM - Reverse-engineering
    The RKM - Reverse Knowledge Module - reverse-engineer a data model stored in a given technology. As default, the standard reverse allows to reverse all the information and meta-data in most models. It is required for certain technologies (files for instance) to use a personalized reverse and therefore a RKM. They are named specifically.
    SKM - Services
    SKM (Service Knowledge Modules) are used to generate the code required for creating data services. This code (typically Java) can be automatically compiled and deployed to a web service container.
    You can get more information about various KMs from
    http://www.oracle.com/technology/products/oracle-data-integrator/10.1.3/htdocs/documentation/oracledi_km_reference.pdf
    There is no escape from URL :)

  • Knowledge module usage

    Hi folks
    can you please suggest me what type of loading and integration knowledge modules can i use for my requirement
    source->AS/400
    Target->oracle
    Thanks
    Raj

    If you only need to Append, then use IKM SQL Control Append, if you need to update, then use IKM Oracle Incremental Update. If using the IKM Oracle Incremental update, make sure you use the latest version, and make sure you select the appropriate options ( COMPATIBLE- 0 Oracle 9/10, and DETECTION_STRATEGY)

  • Language used in Knowledge Module

    Hi all,
    Can you please tell me what is the language used in the code for all the knowledge modules
    reagrds,
    Sourav

    Hi Sourav,
    Basically Java.
    odiRef is the class and followed by the method with parameters.
    Example,
    <%=odiRef.getSession("SESS_NAME")%>
    Where,
    odiRef is the class.
    getSession is a method/fuction which accept one parameter "SESS_NAME".
    The <%= and %> is the tag which will be interpreted by Agent and converted in to SQL codes at run time.
    Thanks,
    Guru

  • Knowledge Modules for ODI- Oracle BAM Integration

    Could we please know who develops the Knowledge Modules for ODI- Oracle BAM Integration?
    Is there a separate team that develops these KMs?
    Learnt that ODI development team does not develop these KMs.

    BAM development team is responsible for the BAM ODI KMs.

  • Are there any Oracle OLAP ODI Knowledge Modules for Oracle Olap 11g ?

    Hi guys, wasnt sure where to post this so I put it here and the ODI forum
    Does anybody know when Oracle OLAP Knowledge Modules, will be available for Oracle Olap 11g. It appears that the knowledge modules released with Oracle Data Integrator 10.1.3.5, currently only work with Oracle Olap 10g...
    If there is no timeline, does anybody know of work around to get ODI reverses working on Analytical Workspaces built in Oracle Olap 11g
    Thank you
    Richard
    Edited by: RichardSmith on May 15, 2009 11:51 AM

    Raise a service request with Oracle Support (Metalink) for your system slow issue. May be, they will recommend you the workarounds for the issues which are not yet available for 11g in the form of Patches.
    Regards,
    Sabdar Syed.

  • ODI Knowledge Module for UNION - UNION ALL - INTERSECT Case Study

    All about BI &amp;amp; Data Integration: ODI Knowledge Module for UNION , UNION_ALL, INTERSECT

    Looks like a discussion/post rather than a question. You can uncheck the "Mark this discussion as a question" while creating the post.

  • BAPI Function module for transaction ME32K for change

    Please let me know the name of the BAPI Function module for transaction ME32K for change the contract.

    Hi Krishan,
    I have checked but their is no BAPI called
    BAPI_CONTRACT_CHANGE.
    If I am wrong plz correct me with the procedure to view the above BAPI in SAP System.
    Regards,
    Nitin

  • CDG-01141 ERROR: Module Component Table Usage ...  Table usage ... requires primary key column for referential integrity

    For some strange reason when I modified a form, (commented out some code in a when-window-activated trigger) I now get the following error.
    CDG-01141 ERROR: Module Component Table Usage GR1130A.CUSTOMER.GR_CUSTOMER.GC: Table usage GR_CUSTOMER requires primary key column for referential integrity
    I am sure this is not related to my change, but do not know what may have caused this or how to fix it.
    Anyone seen this error before? been able to fix it?
    Thanks!
    Windows 7
    Oracle Database 10g Enterprise Edition Release 10.2.0.3.0
    Designer Version 6.5.95.4.8

    You know that Developer/Designer 6i is not certified for Windows 7, right? Also, your version is not the latest one, so you can try to install the latest patch set first.
    >Table usage GR_CUSTOMER requires primary key column for referential integrity
    Check if there is a PK in the table definition (not in the database, but in Designer).

  • Provide me the docs for knowledge modules

    Hi All,
    Please provide me the Materials for understanding Knowledge modules.
    I need to understand more on knowledge modules as I am new to ODI tool.

    Hi Sri,
    If this is what you require, please mark the thread as answered and allocate helpful/correct points to close the thread.
    Thanks
    Bos

  • Knowledge modules for siebel CRM

    Hi all,
    can anyone give me the details about downloading knowledge modules for loading data into siebel CRM.
    whether i can download it from the oracle website?..
    i tried but i couldn't get the correct path...
    any suggestions will be helpful.
    Thanks,
    imus

    Hi Bouch,
    Thanks for your response.
    I got the patches(Knowledge modules for siebel CRM) from the metalink.
    I need to know the use of Siebel Knowledge Modules in ODI. I am new to SIEBEL Environment.
    According to me, SIEBEL is an application which access data from a database. So to transfer data to Siebel, we can transfer the data to EIM tables which will be a normal oracle (target) transformation.
    So what is the use of SIEBEL knowledge modules. Definetly there will be some specific in it.
    please suggest me.
    Thanks in Advance,
    imus

  • TRANSACTIONS CODES FOR FI MODULE

    hi
    where to get a list of all transactions codes for FI module.

    Hi ,
    Do check below mentioned link for the lict of all transaction codes in SAP.
    http://www.saptransactioncodes.com/a.html.
    Regards
    honey

  • Migrating the Knowledge Modules

    Hi We are migrating Sunopsis to ODI.We have customised the knowledge modules in our project for specific scenarios. when we are Importing the knowledge modules from Sunopsis how they will behave. What are the primary steps we need to follow when we start working on. Any specifications for this to do. Please give me your inputs. If you have any docs please send ti across to me to [email protected]
    Thanks in Advance for your Inputs.
    Regards,
    Mansur

    Hello Mansur.
    I have done that before and there is no secret. Just follow the Instalation guide steps and any, at times that I did it, there is no problem.
    The KM's from Sunopsis are full compatible.
    An attention point is to Rpository upgrades but it is described at Instalation Guide
    http://www.oracle.com/technology/products/oracle-data-integrator/10.1.3/htdocs/1013_support.html#docs
    Does it help you?

  • Custom IKM Knowledge Modules are not working with Group By Clause

    Hi All,
       I am facing an issue with custom IKM knowledge modules. Those are IKM Sql Incremental Update and IKM Sql Control Append.
    My Scenario is
    1. Created an interface with table on source and temporary datastore with some columns in target.
    2. In the Interface on the target i defined one column as UD1 and other column as UD2  for which group by to be implemented .
    3. Customized  IKM Sql Incremental Update  with " Group by " by making  modification in my IKM Sql Incremental Update
    detail step "Insert flow into I$ table"  i.e., i replaced like this whereever i find this <%=odiRef.getGrpBy()%> API
    Group By
    <%=snpRef.getColList("","[EXPRESSION]","","","UD1")%>,
    <%=snpRef.getColList("","[EXPRESSION]","","","UD2")%>
    Up to UD5.
    . Here in the place of [EXPRESSION] i passed column names for UD1 similarly other column name for [EXPRESSION] of UD2.
    4.Made all the proper mappings and also selected the KM's needed for that interface like CKM Sql ,IKM Sql Incremental Update.
    5. Executed the Interface with global context.
    Error i am getting in this case is :
    Caused By: java.sql.SQLSyntaxErrorException: ORA-00979: not a GROUP BY expression
      at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:462)
      at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:405)
      at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:931)
      at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:481)
      at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:205)
      at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:548)
      at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:217)
      at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:1115)
    Here the columns in the select clause are there in Group By also.
    I did the same scenario using IKM Sql to file append .In that case i am able to do it. But not with the above mentioned KM's. Please let me know if any one know it or tried with this, as it is
    high priority for me.
    Please help me out.
    Thanks,
    keerthi

    Hi Keerthi,
    If your are transfering data from Oracle to Oracle (I means source is oracle Db and target is also oracle DB) then use below KM's and group by will come automatically based on the key values you selected on interface target datastore
    1) CKM Oracle
    2) LKM Oracle to Oracle (DBLINK)
    3) IKM Oracle Incremental Update (MERGE)
    Hope this will helps to resolve your issue
    Regards,
    Phanikanth

  • How to Create Transaction code for a Report

    Hi Gurus,
    I created some reports and I wants those reports
    should be placed in the SAP Menu(initial screen) not
    in the User menu in the form of Transaction codes.
    I would really appreciate if any one can please send the process to create transaction codes for the User reports/Report groups in R/3 and how to add those created Transaction codes to the SAP MENU.
    Thanks in Advance
    Danial

    Try to insert it into the main menu if you must change S000 (there is a function module for everything)? Perhaps SAP protects their menu trees from foreign subnodes in SE43?
    Also note that for report transactions you do not need to give the user transaction code start_report. If you do, then they could enter it directly and potentially start many other reports too. The system will call start_report for submitting the report internally without authorizations for it required (unless start_report is maintained in SE97).
    Regarding DE, this also confuses me sometimes and I noticed that it generally indicates that I am doing something which has an implication for a SAP standard object. Try either hitting the enter button to see what the next screen is, or, choose original language in the previous screen, or, logon in sy-langu = DE and (remember the path if you dont speak German) change it, or, follow JCs advice to create your own menu.

Maybe you are looking for

  • How to log successful logins to a syslog server in NX-OS

    Does anyone know how to do this in NX-OS?  I do it in IOS with the following commands: login on-failure log login on-success log logging x.x.x.x With that I get a syslog message that I can then log to a file to track who has logged into which device

  • How do I transfer projects from one disk to another disk?

    I just installed Windows 7 on a second drive in my computer (XP on the original disk).  My previous projects were all created on the XP disk on PE 2.  I want to move all that work into the Windows 7 environment, and run there from now on with Premier

  • Run macro in PDF form created in LC

    I have created a form in LiveCycle Designer with a text field that can expand to several pages if need be.  It works great.  Now when the person fills it out and emails it back to us, we need to be able to pull all of the comma-delimted text out of t

  • HR - dynamic selections field name and field value in the program

    HI all,    I am using dynamic selections for a HR report. I have created a view with 20 fields and added it to HR report category ___00003(All fields suppressed). I need to check these fields in the program. But i am not able to get the field name an

  • REDISTRIBUTION WORKLOAD REPORT

    Hi  All have you ever extracted this REPORTING WORKLOAD in the redistribution menu. What exactly this report gives to the business usuage? assume that i have connected with BW ? Why BW report shows in SRM box? How to activate this report:- Workload r