Delta updates via Flat Files

Hello Guys,
We need to define the structure of the flat files we'll receive from our ETL team to specify how we'll manage the updates of the records we already loaded into BW.
We'll load those flat files through PSA then into an ODS that will feed an InfoCube. The records can contain new or modified characteristics and/or key figures.
I read a lot of documentation about deltas but I didn't find a clear answer regarding this subject for flat files:
Do we need to specify, for every single record in the flat files, if a record is either a new one, a modified one or a deleted one, or can the ODS figure that out by itself? I guess it can't (at least for the deletion part) so do we have to add an additional field to flag what type of modification (new, modif or delete) a record belongs to?
If we do have to add that information, can I just use ' ' for a new record, 'N' for a modified record and 'D' for a deleted record?
Thank you in advance (and don't worry, I'll reward you).
best regards,
SF

Hi Sebastien.
The answer really depends on what you types of records you are working with.  If your record has a well-defined key (like a document number) and your ETL team gives you after-images of the changed records, you can set your ODS Object up with the same key and use Update Rules set to Overwrite.  Then, the ODS Object change log will automatically provide delta-compatible updates to the InfoCubes.
hope that helps.
ADam

Similar Messages

  • How to Delta Update in Flat Files

    Hi all,
    I would like to know is delta update is supported in flat files ? If yes how does this work ..... is there a SAP white paper or document on this
    Thanks
    Nathan

    Hi......
    Yes Delta upload is supported by Flat files..........In this case........when the delta data records are loaded by flat file......... This delta type is only used is 'F'.......for DataSources for flat file source systems. Flat files are imported to the PSA when you execute the InfoPackage. The staging process then begins.........The delta queue is not used here.
    As Siggi already told in the Following thread......post your flatfile data to an ods object with update mode overwrite. The ods object will do the delta for you then.........
    Delta Upload for Flat File
    Also Check this.......
    SAP NetWeaver 7.0 BI: Data Transfer Process with “Only get Delta Once”
    SAP NetWeaver 7.0 BI: Data Transfer Process (DTP) / The “Normal DTP” ...
    Hope this helps........
    Regards,
    Debjani........
    Edited by: Debjani  Mukherjee on Nov 12, 2008 9:40 AM

  • Delta Update with flat file into infocube

    Hi
    Can any one explain me the steps how to achive the delta update with falt file into infocube?
    Thanks

    There is a documented way of managing a delta but it mostly boils down to how you model the process. SAP says you can add a ROcancel field ( or something similar to it) in the transaction data within the files
    that way when you update the data into the cubes, it would be managed - whether it has to be added or over written,
    therefore the best way to manage this would be to make some changes i the flat file-
    are the flat files being generated by some program? maybe you can add in further to check the updated records -

  • Delta upload for flat file extraction

    Hello everyone,
    Is it possible to initialize delta update for a flat file extraction, If yes please explain how to do that??

    Hi Norton,
    For a Flat file data source, the upload will be always FULL.
    Please refer to following doc:
    http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/a0b3f0e2-832d-2c10-1ca9-d909ca40b54e?QuickLink=index&overridelayout=true&43581033152710   if you need to to extract delta records from Flat file. We can write routine at infopackage level.
    Regards,
    Harish.

  • Delta Upload for Flat File

    Hello Everyone
    i am srikanth. i would like to know wheather do we have a facility for Delta Upload for flat file. If yes can u please give me the steps.
    thanks in advance
    srikanth

    Hi Sabrina...thank you for ur help...i did load the data from cube to ods
    steps.
    1. i generated export data source on the cube
    2. i found the name of the cube with prefix 8<infocube name> in the infosource under DM application component.
    3. there are already communication structure and transfer rules activated but when i am creating update rules for the ods..i am getting the message 0recordmode missing in the infosource.
    4. so i went to infosource and added 0recordmode in communication structure and activated but the transfer rules in yellow colour..there was no object assigned to 0recordmode but still i activated.
    5.again i went to ods and created update rules and activated (tis time i didnt get any message about 0recordmode).
    6.i created infopackage and loaded.
    a)Now my question is without green signal in the transfer rule how data populated into the ods and in your answer you mentioned to create communication structure and transfer rules where in i didnt do anything.
    b) will i b facing any problem if i keep loading the data into the ods from cube (in yellow signal) ..is it a correct procedure..plz correct me..thanks in advance

  • Load of hierarchies from R/3 via flat file: how to generate the flat file?

    Hello,
    I need to build a custom extractor for a hierarchy. The hierarchy exists in R/3, but there's no standard datasource to extract it. I know I can upload it via flat file, but I have a question related to this.
    Does anyone know if there's a program (standard or custom by SAP) or function module in R/3 which allows me to generate that flat file, with the required format by BW?
    I would appreciate very much any help about this topic
    Thanks in advance

    In CO-PA there is a way to generate Hierarchy Extractors (see Note 422175 for more details). With a Custom Program you generate a specific DataSource.
    Hope it helps
    GFV

  • Load of hierarchies from R/3 via flat file: how to generate that flat file?

    Hello,
    I need to build a custom extractor for a hierarchy. The hierarchy exists in R/3, but there's no standard datasource to extract it. I know I can upload it via flat file, but I have a question related to this.
    Does anyone know if there's a program (standard or custom by SAP) or function module in R/3 which allows me to generate that flat file, with the required format by BW?
    I would appreciate very much any help about this topic
    Thanks in advance
    Patricia

    Hi Patricia,
    if there is, I'd love to get hold of it.
    I have only ever managed this by extracting the relevant data into Excel and then doing a long series of VLOOKUPS to establish parent and child ids.
    I have a sample spreadsheet I can send you if you like.
    Regards,
    Mike

  • Upload new contracts via flat file

    Hello.
    When i try create a new contract in SRM via flat file, i have a problem:
    Some data is handled by number partner, but i have (for example) F04 like a purchasing group, or 1000 like location.
    Are there some function that displays the partner number  from a Group of purchase or a user id?
    Regards.

    Hi. Not sure about functions, but table HRT5500 holds the purchasing groups.
    HRP5500 links that to an org unit.
    Once you have the org unit you can get the BP from table HRP1001, OTYPE = O, OBJID = org unit, SCLAS = BP.
    Regards,
    Dave.

  • Data updation from flat file to I.C. via ODS

    Hi,
    I have to load transaction data from 4 tables into 4 ods and these 4 ods data will be loaded to 1 info cube.so please tell me the best method whether to use 4 info sources for 4 ods or can i define all the info objects in one info source and use the same info source for all ods objects.
    Thank you

    Hello GanGa,
    How r u ?
    1st could u tell, the loads are from Flat File or Tables ?
    coz ur Subject and the Message is getting clashed.
    If u use Flat Files, then better go for 4 IS and 1 ODS is enough. Then update the cube.
    If u r going to extract from Tables, then you have to create the Data Source using "Extraction from Views", for this u should have common key fields in all the 4 tables. In BW DataSource to InfoSource mapping should be 1 to 1.
    Best Regards....
    Sankar Kumar
    +91 98403 47141

  • Delta loading throgh flat file in 7.0

    I am loading data from flat file in to cube I am working on 7.0,first I am loading data in to PSA & from PSA to cube using DTP
    Now I want to know whenever we load data for the first time we select the option full update in DTP
    When I am loading the data for the second time even I   can see full update option
    Again in psa if I am loading data from another file then then it fine & from psa to datatargets when I am loading through DTp again my DTP is selecting 2 data packages of PSA first & second one but I wan t only to take the 2nd datapackage i.e delata
    How can  this be done
    Even I have slected the option delta update in DTp

    Hi,
    In BI 7.0 , U can not select a particular request from PSA and update it to DTP.
    Whenever you are trying to laod the data , make sure that You have deleted all requests from PSA.
    If you will not delete the request from PSA, it will take all previouos records and update it to DTP which will give you wrong results.
    Regards
    Nilesh

  • How to update a flat file

    below i gave some sample of data .i need how to get the resultsrc1    ( is a flat file)col1     col2     col3     1         a         b2         c         d3          e          f it is my first day souce target is same as it comes tgt1 (flat file ) col1 col2 col3 1 a b2 c d3 e f  2nd day some more data comes src2col1 col2 col3 4 g h1 i j5 k l so my target   update the existing one and insert the new one tgt1 col1 col2 col3 1 i j2 c d3 e f4 g h5 k l  its is looking like scd1 type logicbut does update stratetgy trns work for it .if not then should I create traget every time .PLZ give any logic  thx in advance

    안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천 안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천안전한놀이터추천%% XAX69,COM %%   스포츠토토 스포츠토토추천

  • Role updation during Flat File Active Sync

    Hi
    I have defined a role which assigns default values to some attributes for a particular resource.
    And this role am assigning it to the user in the Flat File Active Sync form during user creation.
    But the problem is the attribute-values defined in the Role are not getting updated in the user data during the creation process. The next time there is an update, the values get reflected.
    I want this to be reflected during the first creation process itself. Please let me know what changes needs to be done in the following code -
    <Field name='accounts[Lighthouse].roles'>
    <Expansion>
    <filterdup>
    <appendAll>
         <ref>accounts[Lighthouse].roles</ref>
    <s>Initial-Provision-Role</s>
    </appendAll>
    </filterdup>
    </Expansion>
    </Field>
    This is done after assigning the user to the resources.
    Please help asap
    Thanks
    Bushra

    no....what i mean is that instead of using the user forms to set all the values, call a workflow instead. I believe the field in the configuration is called "process workflow" or something like that. this will be called instead of the forms. inside that workflow create a view, or get the existing view...set the new role....refresh the view...then call the create/update/delete user etc.
    a create view is s provisioning task...so you cant call it from a workflow. take the "provisioning task" part out of the header of the create user workflow and it should work just fine.
    this may be much more complicated than what you actually need. Its just the way i would handle it. I dont like using the user forms and always call a workflow instead. gives me much more flexibility
    dana

  • Disable user via flat file resource

    Hi,
    is it possible to disable a user in Sun Identity Manager using a flat file resource? I have tried using a db table resource without success.
    what do I have to do to have this functionality?
    thanks in advance

    I am not sure if understood your question properly;however my thoughts here
    If you need the approval process -workflow then use IP to load flat files and STS (status and tracking system) as workflow concept(manager approving the data).
    For monitoring you can install BI Admin Cockpit .
    All of the aforementioned process can be achived via WEB.
    BI - Admin Cockpit
    Activation of Statistics cube for performance
    http://help.sap.com/saphelp_nw2004s/helpdata/en/43/15c54048035a39e10000000a422035/frameset.htm
    Maintenance of Statistic Properties
    http://help.sap.com/saphelp_nw2004s/helpdata/en/43/e37f8a6df402d3e10000000a1553f7/content.htm
    Note 934848 - Collective note: (FAQ) BI Administration Cockpit
    Note 980569 - Role for BI Administration Cockpit
    Hope it Helps
    Chetan
    @CP..

  • Loading factory calendar via flat file

    Hi,
    I need to create a new non standard factory calendar to help us to schedule loading to our SAP BW system. I need to know if there is any standard programm that load special rules for a calendar or I can´t help creating the entries manually.
    Is there anybody who can help me with this topic?
    Thanks in advance.
    Jorge Porca

    I think you can only use transaction SCAL (if you don't want to use the upload settings from source system function)...
    Here you can define a factory calendar including the relevant public holiday calendar:
    1. Double-click with the mouse on "Execute function", select the option Public holiday calendar and choose the functionDisplay.
    2. In calendar maintenance, select the option "Factory calendar", and choose the function Change.
    3. Choose the function Insert and make the following entries:
    Factory calendar ID and a descriptive short text
    Period of validity (From year, To year)
    Public holiday calendar ID
    Start no. factory date
    Number from which the factory date is incremented for each workday.
    If you do not make an entry, the default value is "0".
    4. Decide which days of the week are meant to be workdays.
    5. Define special rules if necessary (e.g. plant holidays).
    I don't think that a std pgm exists to upload all these info from a flat file...
    Hope it helps!
    Bye,
    Roberto

  • Flat file via JMS - how to (most easy)?

    Hi experts
    My scenaio is R/3 -> XI (technology not decided) -> legacy system (via flat file structure and JMS)
    I would like to find the best way to do this. The receiving system only takes a flat file with 150 char length in each line.
    Until now i have tried to do this using test message to XI and then do a pseudo mapping to a XML structure. This XML is then parsed to a flat file in the JMS adtapter using module localejbs/AF_Modules/MessageTransformBean. This "parsing" is a rather time consuming solution and im not sure it is the best solution.
    I just saw a how to guide explaning how to make a flat file from a IDOC-XML using ABAP mapping. I could use this by just making sure my IDOC segments was 150 char length. The downside of this is that XI is reduced to a IDOX-XML transformer and hides no complexity for the R/3 system.
    What do you think is the rigth way to go? Is there an even better solution?
    Kind regards
    Martin

    The mention HOW TO guide is:
    https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/46759682-0401-0010-1791-bd1972bc0b8a
    And I sould mention I would like to also receive data from the legacy system (wich also sends files with 150 char lines)

Maybe you are looking for

  • Need suggestion(s) for smooth transition to Outlook 2003 from Outlook 2000

    I'm currently syncing my T|X with Outlook 2000 using Hotsync Manager 6.0.1 on Win XP Pro.   I'd like to switch to Outlook 2003.  Firstly, is Hotsync 6.0.1 compatible with Outlook 2003? If so, what would be the most foolproof way of switching as far a

  • IOS 8.3 Music App Artist Sorting

    This is not a new issue with iOS 8.3 but it does seem to have gotten worse with the new update.  I have noticed for a while that there is a problem with the sorting of artists in the iOS music app and I am not sure how to fix it.  I have the same exa

  • Recovering a datafile from backup in different server

    Hi All, I usually take hot backup of datafiles to different server like this because i dont have enough space in same server. I SQL> alter tablespace XXXX begin backup; host scp /bu1/oradaTA/XXXXX/XXXXX [email protected]:/db1dw/oradata/backup/dec2010

  • Memory grows in javaw.exe but not in java.exe process

    Hi, I'm testing some heavy emoticons(most of them are animated). Emoticons are shown in a popmenu, each emoticon is inside a JLabel with borders that are draw on mouse over. These JLabels are in a GridLayout. The test itself consists in pressing repe

  • Access Present Textfield value in Help Text

    Hi I have a Text item and I wanted to access the Value of that text item in the text field property "Help Text". How I refer present focused textfield value in their "Help Text" property. Regards Kiran Akkiraju