Please guide me to write a Knowledge Module(KM) in ODI.

I am using ODI for my Batch Processes.
I am using LKM Oracle SQLLDR for bulk upload. LKM upload flat files data into staging area (C$ Table). After uploading, IKM SQL Control Append transfer data from C$ table to My Oracle Table. IKM transfer data from I$ table to target table after validation using Oracle CKM. It is working fine.
But my business need are different.
My C$ table contains all fields as String data types. But my target table contains some of NUMBER data types fields. In this case IKM stop data transfer due to INVALID Number exception. I want to transfer that record to my custom error log tables using PL SQL statement.
Note: SQL LOADER can generate .bad file if I set all fields of file data store as target data store. But We didn't want to make bad files for these kind of problems.
If any solution is available in ODI then please suggest me. As per my conclusion, I need a IKM who support this kind of functionalities.
Please help me out.

I see two ways:
1 Use ODI built-in checks for Complex Conditions (has alphabetic values)
In this case you at first load data into staging area (as strings), then apply static checks with above said complex conditions to filter out "error" records. And then load data from these tables further.
2 Modify LKM, by adding such kind of logic:
All table fields marked as UserDefined 1 are filtered to have alphabetic characters at loading and are separated into 2 tables, "good" and "bad" one
To achieve this you should duplicate loading steps and apply regexp filtering to them and add another target table step creation with _bad suffix to load errors to.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       

Similar Messages

  • Need help in creating Knowledge module to aggregrate source data.

    Hi Guys,
    I am new to ODI and I am trying to create a Knowledge module. I went through the docs relating to Knowledge modules and APIs, so hopefully did my home work, I still find writing KM to be very challenging for the scenario, I have.
    The following is my scenario.
    I have two tables Employee and Department. Employee is the source and Department is the target. I need to sum salaries of all the employees belonging to a given department. And then insert the data into Department table.
    Structure of the tables is as follows:
    Employee(Source Table name)
    Employee_id
    Salary
    Dept_id
    Department(Target table name)
    id
    total_salary
    Both target and source are on the same server. The user of this KM would drag and drop both source and target tables into interface and then map the columns. In the above case, Dept_id to id and salary to total_salary and then use this IKM. And off-course the user would indicate what columns would be aggregated on and what would be used as group by. One way to tag that, would be to use those UD1,UD2 tags in target column properties. (If there is another way to tag a column to indicate a column to be used for aggregation and a given column to be used in group by during run time in source, please let me know)
    I choose to write IKM for this.
    The challenging part is that I am having hard time figuring out the columns of source table as to what column should be used as group by and what column to be aggregated on. Since the tags are defined on Target columns and not on source columns. So have to figure out the appropriate columns through the mapping at run time.
    The following is what I am planning to write in (Insert new rows ) command. And the part where I need help is how to compose select statement.
    iinsert into <%=odiRef.getTable("L","TARG_NAME","A")%>
    <%=odiRef.getColList("", "[COL_NAME]", ",\n\t", "", "((INS and !TRG) and REW)")%>
    <%=odiRef.getColList(",", "[COL_NAME]", ",\n\t", "", "((INS and TRG) and REW)")%>
    Select
    source.column1,sum(source.column2) from <%=odiRef.getFrom()%> GROUP BY source.column1
    Thanks.

    I did try as per your advise.
    Filter is not making a difference. Irrespective of me adding a filter or not, ODI generates a sql that has GROUP BY , just by looking at SUM(SALARY).
    Coming back to the main issue, this does do what I wanted to do. I was planning on using a custom KM. But I guess, this is as good as custom KM, since the work done in an interface (assuming a custom KM exists) by going through either route is the same, so I can live with this approach.
    Thanks for the help.

  • New to SAP Netweaver...Please guide....

    Hi all
    I have recently joined this network.
    So, not sure wether this is right place to post such a question.
    I am a fresher in IT field. My level of knowledge is limited to core java and JSP, servlets.
    Now I am a member of project team which is working on SAP Netweaver. By now, I have just been able to understand that this has to do something with java. To be more specific I have to work on SAP netweaver Developer studio.....
    I wish to pave a good foundation basic knowledge on this entire technology.
    I just seek guidance on how to approach for this field.
    I am having very basic knowledge about SAP that it is an ERP and have various integrated functional modules. But nothin more than that.
    So, do i need to learn SAP before moving towards Netweaver. If so, then to what extent should I learn SAP and how.
    I came to know about a book SAP Netweaver for dummies. As its name suggest , i thought it would be better option to start. But not sure.
    Please guide me.
    Thanx.

    Hi Saurabh,
    SAP NetWeaver provides an open integration and application platform and permits the integration of the Enterprise Services Architecture. You can unify business processes across technological boundaries, integrate applications for your employees as needed, and access and edit simple information easily and in a structured manner.
    It has many features and components. go thru the following link it would be helpful.
    http://help.sap.com/saphelp_nw04/helpdata/en/start.htm
    It helps you to decide the area which you want to choose.
    hope this helps
    reward points if helpful.
    regards,
    mrudula

  • I want to pursue SAP Career. Please Guide.

    Hi,
    I am looking to shift from Small level ERP to SAP with following experience:
    1. M.COM
    2. 8+ Years in Develoment experience in Clipper, VB, SQL.
    3. 4+ Domain knowledge of Lean Manufacturing, Finance, Sales & Distribution. These experience in Roles of Project Development, Functional Analyst, Business Process study.
    I dont want to start again with ABAP as i did too much coding, but if there is really promising future I would certainly do again.
    I am interested in Functional level.
    As already 38+ year of age, Please guide which Module should i take. Also is the age will be a problem because of new freshers ?
    Guide me .. Thanks
    Z

    solved

  • Can anyone please guide me how to create a table like employe table with 10

    Hi,
    can anyone please guide me how to create a table like employe table with 10colums.
    after that we need to update the colums with personal details......like name1,name2,address,city,zip...etc.
    using the RFC we need to update the personal details coulums (either select query or Insert command)
    if you have any program logic similar to this requirement please share with me...that would br greatly helpfull to me...
    thanks in advance
    srinivas

    Hi....
    We are having one table and now i am going to update that table's fields...
    for that in RFC function module we need to enter the fields in importing parameters (which are mandtory in table)
    and in source code just write like following....
    ( try to under stand that it contains some previous used table nad field and stucture and work area and function module names)
    FUNCTION ZL2C_UPDATE_MYCUSTOMER.
    ""Local Interface:
    *"  IMPORTING
    *"     VALUE(USR_ID) TYPE  USRID
    *"     VALUE(LOGO_ID) TYPE  KUNNR
      DATA ls_mycust TYPE zl2cmy_customer.
      DATA: name1 TYPE name1_gp.
      DATA: sharpoint_url TYPE url.
      ls_mycust-usr_id        = usr_id.
      ls_mycust-logo_id       = logo_id.
      SELECT SINGLE name1 FROM kna1 INTO name1 WHERE kunnr = logo_id.
        ls_mycust-name1       = name1.
        SELECT SINGLE sharpoint_url FROM zl2c_CUSDASHBRD INTO sharpoint_url WHERE logo_id = logo_id.
          ls_mycust-sharpoint_url = sharpoint_url.
          INSERT into zl2cmy_customer values ls_mycust.
          COMMIT WORK.
        ENDFUNCTION.

  • Migrating the Knowledge Modules

    Hi We are migrating Sunopsis to ODI.We have customised the knowledge modules in our project for specific scenarios. when we are Importing the knowledge modules from Sunopsis how they will behave. What are the primary steps we need to follow when we start working on. Any specifications for this to do. Please give me your inputs. If you have any docs please send ti across to me to [email protected]
    Thanks in Advance for your Inputs.
    Regards,
    Mansur

    Hello Mansur.
    I have done that before and there is no secret. Just follow the Instalation guide steps and any, at times that I did it, there is no problem.
    The KM's from Sunopsis are full compatible.
    An attention point is to Rpository upgrades but it is described at Instalation Guide
    http://www.oracle.com/technology/products/oracle-data-integrator/10.1.3/htdocs/1013_support.html#docs
    Does it help you?

  • Custom IKM Knowledge Modules are not working with Group By Clause

    Hi All,
       I am facing an issue with custom IKM knowledge modules. Those are IKM Sql Incremental Update and IKM Sql Control Append.
    My Scenario is
    1. Created an interface with table on source and temporary datastore with some columns in target.
    2. In the Interface on the target i defined one column as UD1 and other column as UD2  for which group by to be implemented .
    3. Customized  IKM Sql Incremental Update  with " Group by " by making  modification in my IKM Sql Incremental Update
    detail step "Insert flow into I$ table"  i.e., i replaced like this whereever i find this <%=odiRef.getGrpBy()%> API
    Group By
    <%=snpRef.getColList("","[EXPRESSION]","","","UD1")%>,
    <%=snpRef.getColList("","[EXPRESSION]","","","UD2")%>
    Up to UD5.
    . Here in the place of [EXPRESSION] i passed column names for UD1 similarly other column name for [EXPRESSION] of UD2.
    4.Made all the proper mappings and also selected the KM's needed for that interface like CKM Sql ,IKM Sql Incremental Update.
    5. Executed the Interface with global context.
    Error i am getting in this case is :
    Caused By: java.sql.SQLSyntaxErrorException: ORA-00979: not a GROUP BY expression
      at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:462)
      at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:405)
      at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:931)
      at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:481)
      at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:205)
      at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:548)
      at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:217)
      at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:1115)
    Here the columns in the select clause are there in Group By also.
    I did the same scenario using IKM Sql to file append .In that case i am able to do it. But not with the above mentioned KM's. Please let me know if any one know it or tried with this, as it is
    high priority for me.
    Please help me out.
    Thanks,
    keerthi

    Hi Keerthi,
    If your are transfering data from Oracle to Oracle (I means source is oracle Db and target is also oracle DB) then use below KM's and group by will come automatically based on the key values you selected on interface target datastore
    1) CKM Oracle
    2) LKM Oracle to Oracle (DBLINK)
    3) IKM Oracle Incremental Update (MERGE)
    Hope this will helps to resolve your issue
    Regards,
    Phanikanth

  • Please guide me how to delete the OLD claimed trip details

    Hi SAP Gurus
    We have corrected the all the cliams by newly created an posted properly today , how ever they are struck now and since they are form old employees (2007-2008) , few are still active / terminated/ retiree staus cant delete them nor make it zero. But appear in our report as pending...
    Please guide me how to delete the old trips.. your support really appreciated..
    Thanks
    Shan

    Hi Shan,
    As per my knowledge, no table should be deleted. Check the below link for more info.
    http://help.sap.com/saphelp_erp60_sp/helpdata/en/73/6bf037f1d6b302e10000009b38f889/frameset.htm
    <<removed>>
    Thanks,
    Praisty
    Edited by: Matt on Jul 26, 2011 3:11 PM

  • HT3777 I have a Window 7 HP laptop. I want to install Snow Leopard on an external hard drive as the memory space on my laptop is very less. I have the original snow leopard disc and I think it's a retail version . Please guide me through the installation.

    I have a Window 7 HP laptop. I want to install Snow Leopard on an external hard drive as the memory space on my laptop is very less. I have the original snow leopard disc and I think it's a retail version . Please guide me through the installation in details. Can you also please let me know about this boot camp.

    You cannot. From a legal standpoint, the license agreement for OS X mandates that you run OS X only on Apple hardware. HP is not (yet) owned by Apple.
    From a technical standpoint, your HP laptop doesn't use EFI, but rather an early predecessor called a BIOS. Apple is the only vendor of consumer computer hardware that uses EFI; other vendors reserve EFI for use in servers.
    Secondly, Apple's operating systems support a rather limited number of configurations of video hardware and mainboard chipsets directly since they need only support those systems that they manufacture. You cannot use Windows software or drivers on OS X, so prior to installation, you would need to write your own hardware drivers for your laptop, create an OS X drive image on a Mac, and then modify that image with your drivers before putting it in the HP.
    It will be simpler (and legal), to simply purchase a used Mac. Apple's online store has refurbished MacBook Airs starting at $850 and Mac Minis for $700. If you go to e-bay or craigslist, you'll find used Macs for considerably less.

  • I installed Windows 7 in my Macbook pro, I can access Windows data in Mac, but I can't copy and delete it. and the same case while i am working in Windows. Could you please guide me if there is any solution, where I could copy/paste/delete my data.

    I installed Windows 7 in my Macbook pro, I can access Windows data in Mac, but I can't copy and delete it. and the same case while i am working in Windows. Could you please guide me if there is any solution, where I could copy/paste/delete my data.

    OS X can natively read NTFS of Windows, but not write to it.
    Windows can't read or write to HFS+ of OSX, and that's a good thing from a security standpoint.
    Ideally if you share files between operating systems you should have a FAT/MSDOS formated USB key or hard drive. (exFAT external drive if any of your files are over 4GB in size) both these formats are universal for OS X or Windows.
    If you install software into Windows and OS X to read each others formats, then you have to pay to update/upgrade it deal with headaches.
    If you swtich between Windows and OS X a lot, don't need full hardware performance for Windows, you may consider installing virtual machine software like VMFusion or Parallels which can take a copy of your Windows in Bootcamp and place it into OS X as a file then run that copy of Windows in a window in OS X like so.
    Advantage here is you run most of your light weight Windows programs like this at the same time as OS X.
    Benefit is you can run just about any Windows or Linux version and OSX server editions (not client versions)
    Bootcamp only allows Windows 7, that's it now.
    You'll also be interested in two fre pieces of software, Carbon Copy Cloner and Winclone on macupdate.com.
    CCC clones OS X partition and Winclone clones the Bootcamp partition. Valuable for you.
    Good Luck

  • Experts please guide me in Sap Abap Hr and in Sap Hr. I have 1 year exp but didn't get job wht to do  ?

    Dear SAP Experts ,
    I Have 1 year exp as an Associate SAP ABAP HR Consultant and i have done MCA but still didn't get any job i am free from 3 months didn't get any call please guide me what to do my abap is not much strong but hr is good . i am so upset tht planing to move in other job profile like SEO or work as HR executive for getting domain knowledge.so plz guide me wht to do and please also tell in ABAP HR which main topics i have to make strong ?
    Thanks
    Regards,
    Vikrant
    <<Moderator Message: How many times are you going to ask the same question?>>
    Message was edited by: kishan P

    Hi Vikrant,
    Since you are more interested towards HR than ABAP, in long term you can think of moving into SAP HCM functional career. And to be able to work as a functional consultant, you need to have good amount of business process knowledge. Considering this you can start working in core HR and gain domain experience and move your career later towards functional area.
    And more over you have ABAP HR experience,this will be very handy when you are a functional consultant.
    Regards,
    Ravi

  • Reg : Doubts on Knowledge Modules

    hi all,
    Please give brief idea about knowledge modules. please dont give links .
    KNOWLEDGE MODULES
    REVERSE ENGINEERING
    LKM
    CKM
    IKM
    JKM
    SKM
    Thanks a lot in advance ,
    -Chinnu.

    LKM - Loading
    The LKM - Loading Knowledge Modules - load (or extract data) from one data server to another.
    They are named as follows:
    LKM <source server technology> to <target server technology> (<module specificity>)
    JKM - Journalizing
    The JKM - Journalizing Knowledge Modules - setup journalizing on a datastore in a data model.
    They are named as follows:
    JKM <technology to journalize>
    Note: Journalizing uses triggers and views. Therefore technologies that do not support these functions generally do not have an associated JKM.
    IKM - Integration
    The IKM - Integration Knowledge Modules - integrate data in a target data server from a Staging Area. Frequently, the Staging Area and target space are on the same data server. The IKM can manage options such as data insertion (Append), or update (Incremental Update), etc.
    They are named as follows:
    IKM <Staging Area data server technology> to <target data server technology> <option managed in the module> (<module specificity>)
    IKM <Staging Area and target data server technology> <option managed in the module> (<module specificity>)
    Note: The option managed by the module frequently indicate the more complex option supported in this knowledge module. For instance, a module Incremental Update (update) should also be able to manage the option append, which is data insertion, and suppression of data in the target..
    CKM - Check
    The CKM - Check Knowledge Modules - manage the data quality and cleansing, on static data and on data flows.
    They are named as follows:
    CKM <Checked Technology> (<module specificity>)
    RKM - Reverse-engineering
    The RKM - Reverse Knowledge Module - reverse-engineer a data model stored in a given technology. As default, the standard reverse allows to reverse all the information and meta-data in most models. It is required for certain technologies (files for instance) to use a personalized reverse and therefore a RKM. They are named specifically.
    SKM - Services
    SKM (Service Knowledge Modules) are used to generate the code required for creating data services. This code (typically Java) can be automatically compiled and deployed to a web service container.
    You can get more information about various KMs from
    http://www.oracle.com/technology/products/oracle-data-integrator/10.1.3/htdocs/documentation/oracledi_km_reference.pdf
    There is no escape from URL :)

  • Problem in Portal Anonymous Login..Please guide

    Hello All,
    Am trying Portal Anonymous Login using EP7 SP9 Sneak Preview.
    Using link for this - http://help.sap.com/saphelp_nw2004s/helpdata/en/1e/e19f58136e654d9709befa464314f2/frameset.htm
    1. Have added 2 users in the UME Property using configtool - anon1,anon2
    2. Created a simple PCD Role and assigned a URL iView to it. Changed it authenticationscheme property to Anonymous.
    3. Assigned this role to Anonymous Users Group.
    Problem:
    1. When I access URL http://rp1677:50100/irj/portal/anonymous, am asked for authentication? Why?
    2. The anonymous user group contains user Guest. When am trying to add users- anon1 & anon2 into this group, I get an error saying - <i>You are not authorized to assign one or more entities. Perform a new assigned entities search to see the correct status</i>
    Am doing this entite process using the administrator login.
    Please guide.
    Awaiting Reply.
    Thanks and Warm Regards,
    Ritu

    Hi,
    There is a step by step guide to implement external facing portal in
    <a href="https://www.sdn.sap.com/irj/sdn/weblogs?blog=/pub/wlg/5894">blog</a>
    Follow all above steps and if you still get error write here again.
    Regards
    Abdul.

  • Knowledge module usage

    Hi folks
    can you please suggest me what type of loading and integration knowledge modules can i use for my requirement
    source->AS/400
    Target->oracle
    Thanks
    Raj

    If you only need to Append, then use IKM SQL Control Append, if you need to update, then use IKM Oracle Incremental Update. If using the IKM Oracle Incremental update, make sure you use the latest version, and make sure you select the appropriate options ( COMPATIBLE- 0 Oracle 9/10, and DETECTION_STRATEGY)

  • Hi,Please guide me how to choose correct career in SAP r/3 technical side?

    Hi, Experts.
    I have 2.8 yrs experience in SAP B1 as a techno functional consultant but recently i am learning abap to move r/3 side. after learning abap can i get a job in ABAP or i need to learn any related CRM technical or ABAP-HR, in this which on is the most demand, please guide me in terms of job and future career or can i learn BI ? it's good for my career but iam thinking after getting few years experience in ABAP  iam planning to move to BI.but job point of i here it's good openings so can i learn now itself BI ?or CRM technical or ABAP-HR ?please guide me how can take good decision on future career point of and  to select good modules in SAP World.
    Regards,
    Kumar.

    Have patience to start reading all from - [Re: Scope in SAP B1] ... you'll have the answer if not have it yet.
    Please close this thread if answered.

Maybe you are looking for

  • Questions on check printing R12

    In R12 , how can we add a new element to the XML file that we are using for the Format Payment Instruction program. Has someone done this before? Is this possible?I am not understanding how to customize the XML file itself, if we need some data thats

  • OO4O 9.2.0.4.8 production release is available

    OO4O 9.2.0.4.8 production release is available for download on OTN. New Features ============ New Features supported for the 32-bit In Process OLE Automation Server: With this release, OO4O provides four new objects that enable developers to access a

  • Extended sytax check read error message

    hi every one, i am working on extended syntax check for the report and in warning i am getting this message to a defiend itab or variable.: "No read access to table ITAB[] ",same messages for string variables too. please let me know how to remove thi

  • BroadXent DSL Router to older AEBS - can't get multiple connections

    Router is "auto detection" half or full bridge mode, direct ethernet cable to older "mushroom" AEBS. For some reason, can only get one wireless connection at a time. Have to shut down connected machine before can get connection to another. Not unusua

  • Why is Firefox 34.0 freezing?

    After Firefox updated to 34.0, it suddenly started freezing up at inopportune times. Not always at the same point, nor at the same web site. I tried Google Chrome on the same sites Firefox would freeze and Chrome worked perfectly as did Internet Expl