ODI CDC using Logminer - how to capture all changes for one PK

Hi,
Let me explain our scenario and challenges we are facing -
*1.     Captures all changes in CDC –*
We are using CDC (LOGMINER) to capture change. Currently current ODI code capture latest change happened during last execution.
Now requirement is to capture all changes happened after last execution cycle.
To achieve this, can you please suggest what changes we need to do in current code.
*2. Performance Improvement* - Current CDC can handle 400 TPS (Transactions per second, here transactions means single record) and we are looking for 2000 TPS
we are expecting 15 million records for INIT load and 7-8 million records on daily basis for CDC
What needs to be done to improve the performance. In case if you need more details to answer this, please let me know.
Oracle database version at source and target - 11g
ODI - 11g
Thanks in advance.
Regards,
Dinesh.

Hi Dinesh,
I have some experience with ODI And Logminer / Streams.
Can you confirm what JKM you are using?.
For your 1st point - the logic to only get the latest update is contained within the JV$ / JV$D view , you can edit the definitions of these views if you want to bring through all transactions - there should be an SCN number in the change table you can order by if you are interested in the order the transactions occurred - I assume you are otherwise your target DB will get out of sync.
As for performance - Have you tweaked the Streams settings ? How many Change sets do you have ?

Similar Messages

  • How to delete all objects for one user from SE80

    Hi all,
    If i want to delete the customer objects defined in the customer space Y or Z from SE80. Object of one user is defined in one package, if i want to delete the pakcage it says, it contain the subobject. So can anybody help me how to delete the customer objects from SE80.
    Your response will be highly rewared.
    Tahnks,
    Salahuddin.

    hi
    good
    i think here you want to delege the development class, if you want to delete the particular development class you have to go for se09 where after selecting the particular development class you can select the delete button.
    thanks
    mrutyun

  • How to capture all the values(occurrence) using Extraction Rules(correlation) in VSTS web test?

    Hi,
      I am using VSTS 2010 for performance testing and have a question about Extraction Rules functionality.  Requirement below.
    Example :
    Server Response
    <a>1</a>
    <a>2</a>
     <a>3</a>
    <a>...</a>
    we need to capture all the values with same left and right boundary. Along with the number of occurrence from the response. We need pass a random value in the
    index where the index value will be between 0 - count of values with same left and right boundary.
    How to find out the count of values with same left and right boundary.

    Thanks for Adrian's help.
    Hi PChav,
    Based on your issue, I think that the Adrian's suggestion is useful for you, so I suggest you could refer the Adrian's suggestion to check your issue.
    In addition, I suggest you could also try the rogeorge's suggestion to create a custom extraction rule to do this.
    Reference:
    https://social.msdn.microsoft.com/Forums/vstudio/en-US/ccff9f7a-d5bc-45d5-80eb-c83f9fc0e103/how-to-capture-all-the-valuesoccurrence-using-extraction-rulescorrelation-in-web-test?forum=vstswebtest
    Hope it help you!
    Best Regards,
    We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
    Click
    HERE to participate the survey.

  • How to print all columns in one page

    Hi,
    Can anybody explain me how to print all columns in one page.we have around 15 to 20 columns for 4 reports and all these reports are build on one multiprovider.we are using BW 3.5.
    Can anyone explain me  how to print ALL COLUMNS IN ONE PAGE  .currently they are getting all columns in 2 to 3 pages. They are using PORTAL to run the reports here.
    Is it possible to do by customizing Webtemplate or by macros in Workbook.Please help me
    Edited by: kotha123 on Oct 11, 2010 5:58 PM

    Hi,
    Your best bet is to use a workbook template or else Excel to pdf option...Thanks

  • How To… Display All Comments for a Planning Package

    Hi,
    I have the How-to guide mentioned in the subject and have now moved onto BI7. Is the guide still applicable in BI7 and how would I go about implementing the above How-to in IP instead of BPS?
    Thanks,
    Ale

    Thanks Marc.
    I will use BW-BPS for the time being as I've seen screenshots of the solution in the how-to. Still need to answer the question here:
    How To. Display All Comments for a Planning Package
    As I have no idea how to achieve the functionality detailed in the thread above.
    Thanks for your time Marc,
    Regards,
    Ale

  • Urgent: How to list all alias for a server throw DNS query?

    Hi
    Is there anyone know how to list all alias for a server by asking the network DNS. Is that possible?
    It doesn't work with InetAddress it return a single result.
    Best regard

    InetAddress will not get you the aliases, but you can certainly find all the different IP addresses for a specific host name using the getAllByName() method.
    You won't be able to get the aliases since those IP addresses (assuming there are more than 1) will all be cached as mapping to the name you passed to the getAllByName() method and you can't clear the map cache until the JVM exits.
    So your best hope is to get a list of IP's and either exit your app and restart with a new mode, or save them to a file for another app to read.

  • How to Upload the Materials for one Plant and then copy the same to all oth

    Hi All,
       I am using Material Types NonStock, Service, Spare Parts and Trading.
       How to Upload the Materials for one Plant and then copy the same to all other plants.
    can anybody give response for this requirement.
    Regards...
    <b></b>

    Hi,
    Using MM01 Only we can upload Plant Details.
    If you want to extend to other plant also, Use MM01 and select Plant view and give new plant details.
    If you want to copy from one plant to another plant after selecting Plant view , next screen you can select From Plant and To Plant Details.
    Reward Points If it helps you.
    Regards,
    Murali K

  • NOT WORKING -How To Display All Comments for a Planning Package

    Hi All,
    I am using How to Document "How To Display All Comments for a Planning Package" to display comments for list of "cost center" against different "fiscal/year" for Key Figure "Budget Amount".
    Below is how the Layout looks like where comments are posted against Cost Center- year combination.
    Cost Center                          2007     2008     2009     2010     2011
    3          2.00     2.00     2.00     2.00     2.00
    4          2.00     2.00     2.00     2.00     2.00
    6          2.00     2.00     2.00     2.00     2.00
    7          2.00     2.00     2.00     2.00     2.00
    This case is very similar to the example given in how to document but after following all the steps correctly in the document and also followings various forum links such as below , I am not able to display the comments for list of Cost Centers.
    "How to...BSP display comments"...problem with row comment
    Below are the issues being faced:
    1) When i save the comments , the icon for comments (indicating that some comments have been entered) is not shown against selection of Cost Center-Year although the comment is saved.Comment are  also visible in BPS0.
    2) On execution "Web interface could not be loaded" - is the message that is shown in the area where BPS application should show all the comments.
    Highly Appreciate any help with issues mentioned above.
    Kind Regards,
    Robin Johri

    Hello Robin,
    1) please check if you set the row/cell selection property correctly for the layout component in the web interface.
    2) the error does not make sense since the comments are displayed in an iframe using a BSP application, not a web interface. Check the URL in the HTML text component.
    Regards,
    Marc
    SAP Techology RIG

  • How to transfer all materials from one plant to other plants?

    How to transfer all materials from one plant to other plants?

    Hi
    To transfer stock in one step  between plants belonging to same company code use movement type "301" and using transaction code "MIGO". IF you like in two step it helps to monitor stock in transit use movement type "303" and "305".
    303 Transfer posting plant to plant in two steps - removal from storage
    305 Transfer posting plant to plant in two steps - placement in storage
    to transfer stock between plants of diffrent company code go for stock transpor order using tcode "me21n"
    hope it helps

  • How to divide all textFrames in one-character-per-textFrame?

    Hello:
    How to divide all textFrames in one-character-per-textFrame?
    Example: the textFrame "Letters" will be divided in 7 textFrames: "L", "e", "t", "t", "e", "r", "s".
    Help, please.

    Hi Paul, try this one
    #target Illustrator
    //  script.name = splitSelectedFramesIntoWords2.0.jsx;
    //  script.description = splits selected texFrames into separate words;
    //  script.required = select point text textFrames before running;
    //  script.parent = CarlosCanto;  // 10/14/11
    //  script.elegant = false;
    var idoc = app.activeDocument;
    var sel = idoc.selection; // get selection
    var selCount = sel.length; // count items
    var tFrames = []; // to hold the textFrames
    for (j=selCount ; j>0 ; j--) // loop thru selection & get textFrames backwards
                        tFrames[j-1] = sel[j-1];
    for (k = 0 ; k<tFrames.length ; k++) // loop thru textFrames
                        var xpos = tFrames[k].position[0]; // get x
                        var ypos = tFrames[k].position[1]; // get y
                        var words = tFrames[k].contents.split(/\s/g); // get all words into an array
                        //$.writeln(words);
                        var space = tFrames[k].duplicate(); // dup to get width of a space
                        space.contents = " ";
                        var sw = space.width;
                        space.contents = words[0]; // replace space with first word
                        var w = space.width;
                        var wordCount = words.length; // count words
                        for (i=1; i<wordCount ; i++) // loop thru words
                                            xpos2 = xpos+w+sw; // next words position = previous word pos+width+space
                                            var iword = space.duplicate(); // duplicate previous word
                                            iword.contents = words[i]; // add next word
                                            iword.position = [xpos2,ypos]; // position the character = original position + new width
                                            w = iword.width; // get words width
                                            xpos = iword.position[0]; // get words position
                        tFrames[k].remove(); // remove textFrame

  • How to delete all mails with one klick?

    It's annoying to delete every single mail.
    How to delete all mails with one klick, like in the paperbasket?
    Thanks

    If the emails have been previously deleted (I.e. in the trash folder), tap Edit at the top of the list. You should see a delete all button at the bottom. If the messages are in a standard folder, they need to be handled one at a time.

  • How to capture the screen for sending the mail

    dear sir,
                      How to capture the screen for sending the mail .. Is there any funtion module or anyother way ? .. How to do this .. Please tell me..
    Regards,
    Kumar

    dear sir,
    s thats my problem ?
    Regards,
    kumar

  • How to capture multiple change in webDynPro(ABAP) Table

    Hi ,
    I would like to know 'How to Capture Multiple Change' of a node . For example , a table is bound to a node and I select Multiple entries in the table . Then, how to capture Multiple entries of the table  . Is there any method ?
    There is a method 'GET_CONTEXT_CHANGE_LOG' of 'if_wd_context' which captures single change of the node .
    Regards
    Sid

    Post this in Webdynpro forum at
    Web Dynpro Java
    have you seen these tutorials.
    https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3133474a-0801-0010-d692-81827814a5a1
    https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/4c70444a-0801-0010-7688-9e4bd844b783
    Regards
    Raja

  • How to capture memory usage for web application

    In OATS openscripts, how to capture memory usage for web application? Does it have the exisitng java method that we can call to get the memory data (e.g. peak bytes, private bytes) consumed by web application?

    JProbe

  • Function Module or table to read all EQUI for one KUNNR

    Hello,
    i need to read all Equipments for one specific KUNNR (endcustomer).
    Is there a function module which could be used?
    Or what is a good select for this?
    Thanks a lot.
    Kind regards
    Manfred

    Hi,
    EQBS table will be getting updated based on the Delivery document or while creating equipment for Material & Serial no combination.
    How you are maintaining End Customer in your Equipment Master?
    You can maintain in Partner Function or Sort Field or through automatic equipment creation.
    Based on that, you have to find the logic.
    Regards,
    Maheswaran.

Maybe you are looking for