BPC 7.5: Delta Load when loading from BI InfoProvider

Hi,
in BPC 7.5 running a package based on Process Chain "CPMB/LOAD_INFOPROVIDER" loads data directly from an SAP BI Infoprovider into an BPC-Cube. According to the options you can choose "Merge Data Values" or "Replace & Clear DataValues"
According to the description the first one "Imports all records, leaving all remaining records in the destination intact", the second one "Clears the data values for any existing records that mirror each entity/category/time combination defined in the source, then imports the source records".
I tried both and both (!!) result in what you would expect of "Replace & Clear". Both firstly create storno-records in the cube and then add the new values.
Is this an error or wanted behaviour? I didn't find any SAP Notes on this topic, but doubt it's right....
Is there any way to achieve an Merge or - even better - a delta load?
Thanks a lot for any input given.
bate

Hi Bate,
It is indeed a bit confusing. I'll translate the BPC-speak for you
Replace & Clear:
1. Look up all CATEGORY/ENTITY/TIME combinations in the incoming data
2. Clear all records in application with the same CATEGORY/ENTITY/TIME combinations that exist in the incoming data records
3. Load incoming data to the cube
Merge:
1. Load incoming data to the cube record-by-record, overwriting existing data.
This means that "Replace & Clear" might clear out existing records in the cube that do not share the full key of incoming records but do share the CATEGORY/ENTITY/TIME dimension values. For example, a records with CATEGORY/ENTITY/TIME/ACCOUNT values of ACTUAL/1000/2010.JAN/ACCT1 would be deleted when loading an incoming record with values ACTUAL/1000/2010.JAN/ACCT2, if you use the "Replace & Clear" method, but would not be deleted if you use the "Merge" method.
There is no option to load data additively, like it is loaded to a BW InfoCube.
Cheers,
Ethan

Similar Messages

Error in delta loading from a planning cube

hi all,
I am using a delta load from one planning cube to another.When the changed records are of a magnitude of 100 then it is successful but when the records are of magnitude of 100000 then it stays yellow with no data records sent and eventually fails.the packet size is 20000.
any help is appreciated.

Hello Ajay,
Have you checked that your Request is closed in the planning cube? FM RSAPO_CLOSE_TRANS_REQUEST will do it
It is a customizing issue to tell the infopackage to end "green" when it has no data.
Transaction Spro ==> SAP Netweaver ==> SAP Business Information Warehouse ==> Automated Processes ==> Monitor Settings ==> Set Traffic Light Color. There you have to set the Traffic light on green if no data is available in the system.
Hope that helps
best regards
Yannick

Delta load from planning area to third party system

Hi All,
Generally we sent full data load from DP planning area to back up cube in BW system..But suppose we are to send delta load from DP planning area to third party BW system, then what changes we need to do on the DP planning area side so that we send all the changed data from livecache. Can this be done in a standard way?
Thanks

Hi Tarun,
It's not possible to extract delta loads from the APO planning areas. The delta loads are only possible with standard BW objects, and planning area is not a BW object.
SAP doesn't provide the functionality to have delta loads when you use export data source based on the planning area.
PS: From backup point of view, anyway having delta load would not make much sense. We take the backup as a snapshot of a particular time, and if restoration is required, based on the request numer or the date of extraction, we restore the relevant data from cube to the planning area.
Thanks - Pawan

Table on delta loads from data mart

Hi,
I am loading data from two DSO's (let's call them A and B) to another DSO (B) in BI 7 with a BW3.5 delta infopackage.
Now I want to know where I can find information on the timestamp or last request from the last delta load from A and B to C.
So in fact I would like to know how the system knows which requests in A en B have not been loaded to C yet at the next delta load.
In which table can I find the information for ODS A and B that is used by the system to define what data in the change log has been loaded or not to ODS C or other targets. (In fact I should have a comparison table in BW as ROOS* in R3)
Thanks in advance!
Kind regards,
Bart

Hi Guys,
Thanks for the answers.
I know how to check everything in the Workbench, but I want to know where the information of the delta is stored technically.
Just for the sake of completeness:
Due to some issues; several successive loads from A and B were correctly loaded into DSO C (the 'new' table), but could not be activated. It is not possible to do a repeat or anything else. I am not going into too much detail, but just take this for granted.
The only way we can 'solve' the problem is to make the system believe that the 3 last loads (activated data) in A and the two last loads in B have not been loaded to C yet. Just deleting the last delta's in C and do a new delta from A and B to C will not work.
Therefore I want to 'manipulate' the table that is being read by a delta load. If I can change the timestamp or request numbers in that table, I can make the system believe that some requests have not been loaded to C yet.
Dirty, but it should work I think. But I am still figuring out what table contains information about the datamart data source (8A and 8B) and the last delta load to the targets.
Hope this is more clear.
Thanks in advance!
Kind regards,
Bart

Process for Flat file delta load from Application server to transactional??

I want to do a flat file extraction in delta loads from application server and that should be loaded into a transactional cubes scheduling a process chain.
Can any one help with ABAP code and step by step process for this?
Thank you
Devi

Hi Devi,
As per your explaination, you want to load a list of files from application server using process chain.
You can do this with below steps.
1) Create a Event and call event to run Process chain multiple times.
2) Put all filenames in a file say, source-File
3) Write a rooting to read filename from Source-File and trigger InfoPackage
4) At the end of the process chain create new customized program which will delete first line from Source-File so that it will take next file in next run as well as delete currently loaded file. Once this is done trigger event again to start process chain again.
Regards,
Ganesh

Delta load from r3 to bw ?

i have one question on the mechanism of data transfer from r3 to bi 7.0. the followings is my concerns:
scenario:
The total numer of data is 1000 rows and these rows are seperated into 10 data package , each package contains 100 rows.
Now bw is trying to recieve these 10 packages from r3 in sequence.
When 5 data packages have been transfer to bi psa. the network is broken and the tranfer is canceled at the 6th data package.
What i want to know is when the network is reconnected ,Does the transfer start from the 6th data package?
How to find out whether its a delta load or a full load if a transfer is scheduled from r3 to bw ? For both CUBE & ODS.
How to find out how many records have been transfered from r3 to bw while the transfer has ended in
the middle ? I mean how to check how many records have been successfully transfered from r3 to cube/ods .Please tell me for ods as well as cube.
Is the continuation of transfer process is same for both ODS & INFOCUBE, if it ends in the middle ?
What is the procedure for full load & Delta load in case of CUBE & ODS ? I mean how to reschedule the transfer.
And if the whole scenario is is in the support, SO I will be handling these issues on the live production server. Am I right ? So in this case my user id should have access to all the production r3 and production bw to do these change status to red and delete the request and reload the request etc., So I should be logging on to the production server and do all the manipulation, Am I right ?
Last doubt, what is repair request and so if the transfer stops in the middle we change the status to red and reload the request again , Is it called repair request ?
What is the difference between repeat delta & repair request & repair delta ? When do we choose these options, In which scenarios ?
How do we schedule a daily load job from r3 to bw without the use of process chains ? I mean daily it should fetch the records from r3 to bw from the SD datasources at 10.00 PM ,how do we do that ?
Please I am having all these doubts and I want you SAP experts to answer them please so that I can clear my doubts in production support . I really appreciate if someone explain me the scenarios here. It will be a really great help if someonce clears these doubts.

Hi......
What i want to know is when the network is reconnected ,Does the transfer start from the 6th data package?
If your connection is broken in between......inspite your load is through PSA...........you have to delete the request from the target(after making the QM status red)............then you have to reload it again............But before repeating the load check the connection is ok or not in SM59........
How to find out whether its a delta load or a full load if a transfer is scheduled from r3 to bw ? For both CUBE & ODS
This you can check in IP scheduler in the Update tab...........whether it is delta or full load.......
or you can also check in IP monitor(You can go here through RSMO..........IP monitor screen will open directly here............or you can also go through RSA1>> Find your IP >> Double click on it >> Click on the monitor icon in the top >> From the you will go to the IP monitor>> the under the Header Tab you can see whether it is a delta or Full update...........
Or you can check the datasource also..........
If it is a generic datasource go to RSO2..........and check...........If it is a standard datasource check it in RSA5...........
How to find out how many records have been transfered from r3 to bw while the transfer has ended in the middle ? I mean how to check how many records have been successfully transfered from r3 to cube/ods .Please tell me for ods as well as cube
Your load cannot be ebded in the middle.........it can failed.............if it fails then you have to delete the request from the target..........and then repeat the load.......
Is the continuation of transfer process is same for both ODS & INFOCUBE, if it ends in the middle
Yes.........
What is the procedure for full load & Delta load in case of CUBE & ODS ? I mean how to reschedule the transfer
If a full or delta load fails after extraction got completed due lock issue or SID issue.....etc..........and if you load is through PSA.............then just delete the request from the target without making the QM status red.......and reconstruct the request.........no need to repeat the whole load again........
But if you r load is not through PSA..........then make the QM status red........delete the request from the target........and repeat the load...........
And if the whole scenario is is in the support, SO I will be handling these issues on the live production server. Am I right ? So in this case my user id should have access to all the production r3 and production bw to do these change status to red and delete the request and reload the request etc., So I should be logging on to the production server and do all the manipulation, Am I right ?
Yes.......
What is repair request and so if the transfer stops in the middle we change the status to red and reload the request again , Is it called repair request or reload request?
Suppose you delta load has failed ............and you have deleted the request from the target without making the QM status red............In this case your data will be lost and your delta mechanism will get corrupted............In this situation.............
1) Delete the init flag........
2) You have to do Full repair..........(After filling the set up table)
3) Init without data transfer to set back the init flag
4) Then Delta upload.............
In case of an ODS............you cannot load Full update and delta upload parrallely..............Your ODS activation will fail...........suppose you want full upload in the ODS..............then you have to go for Full repair............
What is the difference between repeat delta & repair request & repair delta ? When do we choose these options, In which scenarios ?
I think Full repair concept is now clear............
Suppose your delta load fails...........After that you delete the request after making the QM status red............Then system will ask for a repeat delta when you will try to repeat the load...........which means it will pick the same delta records of the failed load..........
How do we schedule a daily load job from r3 to bw without the use of process chains ? I mean daily it should fetch the records from r3 to bw from the SD datasources at 10.00 PM ,how do we do that ?
This you can do via infopackage or infopackage group...........schedule it at the specific time.....
Check these links :
http://help.sap.com/saphelp_nw04/helpdata/en/20/ad673844a7114be10000009b38f842/frameset.htm
Re: Schedule Infopackage for last day of a fiscal period
Hope this helps you.........
Regards,
Debjani...........

Delta Load from SAP R/3 to XI

Hi Experts,
Please let me know your how can I send the following data using IDoc from R/3 to XI :
DELTA LOAD
1.New or changed WBS Elements/Networks (T Code: CJ02, perhaps others)
2.New or changed Orders (T Code: KO02 (internal), IW32 (PM))
3.Transaction Data for capital objects (Not thru XI)
4.New or changed Cost Elements (T Code: KA02, perhaps others)
5.New or changed Cost Centers (T Code: KS02, perhaps others)
Thanks,
Anirban.
Moderator message: please do some research before asking.
Edited by: Thomas Zloch on Mar 21, 2011 10:11 AM

You must see this in WE05 or BD87. Just release the idoc and have a look at we05 or bd87 and limit down the time where to search. in sm58 you can only see the idoc ith the system can not log on to the remote system. Did you check sm58 in the target system? did you check bd87 in the target system?

Issue with delta load from R/3 to BW

Hi frnds,
There is a standarded D.S 2LIS_05_ITEM in R/3. Evereday We extraceted data from R/3 to BW based on this standard Data Source with delta load.There are two fields ZX and ZY in BW ,some times the data haven't extracted for this 2 fields in BW with the delta update.But some times this 2 fields properly extracted in to BW with the same delta update.
Why is it happen like this ? Please give some inputs on this.
Regards,
Satya.

Hello,
if its a standard field then its getting populated in correct way.
if its custom field then you need to analyze the records for which its getting populated and for one which its not.
Quite possible that some cutomization in CMOD results in this behaviour.
Also,check underlying tables to see the correct values.
Regards
Ajeet

Only Delta load from R3 to MDM using MDM_CLNT_EXTR

Hi ,
I need to set up *only delta load * extraction from R3 to MDM using MDM_CLNT_EXTR. I dont want to put Intial load.
Can anyone help me in sorting out this.
BR
Syam

Hi Syam,
The extraction of delta data can be very well done by selecting the distribution mode as D in the transaction MDM_CLNT_EXTR.
But prior to that u need to take initial loads so as to differentiate the changes.
For more information you can refer to the below links.
https://websmp103.sap-ag.de/installmdm
Re: MDM-XI-ERP (customer master data)
https://websmp201.sap-ag.de/~sapidb/011000358700001119492007E
Hope it helps.
Thanks,
Minaz

Issue when doing Delta loads from PSA to DSO using DTP - Pls help Urgent

Hi All,
I have done 3 data loads into PSA and from PSA, iam loading the data into DSO - by splitting that load into 3 using 3 DTPs. (Split that by Fiscal Period).
2 of the DTP loads are extracting the data from 3 PSA requests.
But, one of the DTP load is filtering on ONE PSA request.
So, we are not getting the full data into DSO.
Can some one pls help me why the DTP load is beheaving like this ???
Even though i have not given any filters for Request id, still , for one load its picking up the data by filtering on One Req ID.
Cheers,
Nisha

Hi Jr,
Sorry for late reply.
I think i found the solution, the diff between the DTP's is i ahve ticked " Get request one after another " .
I have changed it now and its working fine.
Thanks,
Nisha

Delta Load from CRM- picking up 0 records

Hi Gurus,
Iam trying to load CRM data into BW ODS using datasource 0crm_quotation_I. This load used to work fine about a month ago in Delta mode. But it started failing and so I ( my colleague deleted all the old requests) did an full repair and then an Init w/o data and when i schedule teh delta iam getting 0 records. Can anyone please throw light on this?/
Also is this could be an issue with Delta queue in CRM?/
Please reply..
DV
null

Hi Rajani,
Hi rajani with Init the process will take long. just for 50000 records it took 3 hrs and if we do init it will load all teh records from CRM and will take plenty of time. so we did a selective full load and used a program to convert them into full repair and thn did an int...
DV
null

Delta load from netezza to sql server

i have 20 million rows in a table and 100 million rows in another table in netezza
Very first time, i got all the rows from netezza to sql server....
Say in a week, we have new rows of data and updated rows in those tables in Netezza,
how would i go about in doing the delta to sql server??
should i use
1) SCD
2) Merge Statement using T-sql
3) Lookup
Not able to decide
we also need to think about performance as well right
Can somebody point me to the right resource
Thanks

So this is what you load, you require to have 2 tables to make the incremental logic on your side
a) Load_Log: Here you would capture the load start time/ End time/ max date(modified date) from the Nettiza tables.
b) As ione suggested load this data to a staging table( this table would be used for comparison against the main table), this step is required as SSIS merge wouldn't be suited for million records, so the comparison is best served in a SP via a merge or classic
UPSERT
Next time the load is run fetch the max date from Load_Log table and pass this as parameter on the source query something like where modified date> param.
if its a weekly load you might want to run it as daily on source or modify the source query to be like modified date between max date and mas date+1 doing some iterations, though best would be to run on daily basis. a million records would be fine to be
processed.
Abhinav http://bishtabhinav.wordpress.com/

Historical Data with it's delta loading from PSA to ODS in 3.x model

Hello ,
I want to load the one year back historical data with it's delta's to ODS object in BW 3.x model .
So can you please give steps to load historical data from PSA table into ODS object(not from the source system).
Thnaks alot
Regards
BI Beginner

Hi
Run the full load IP from PSA to ODS with selections on 0CALDAY(give one year selections)
make this full load as repair full request.In display mode of IP, in menu bar click on scheduler --> select repair full --->check the option and click ok.
now execute the IP.
If you run like this, your init which has between your PSA and ODS will no get disturb.
Regards,
Venkatesh.

Delta loading from ODS to InfoCube

Hai
Im extracting the data from the custom table into ODS and doing full load everytime for loading delta.
how can load the only delta from the ODS to InfoCube. what are the setting for this one
pls let me know
kumar

Hai Ravi...
Load the Data From ODS to InfoCube:
Clck as right Click in the Specified ODS.....
Select the Option " Update ODS Data in Data Target "......
Then You able to load the Data to any type of DataTarget's(either ODS, InfoCube)
removed...
BalajeeKannan

Delta load from ODS to cube failed - Data mismatch

Hi all
We have a scenario where the data flow is like
R/3 table - >dataSrc -- > pSA - >InfoSrc -> ODS ->Cube.
The cube has an additional field called "monthly version"
and since it is a history cube , it is supposed to hold data
snapshots of the all data in current cube for each month .
We are facing the problem that the Data for the current month
is there in the history ODS but not in the cube . In the ODS ->Manage->requests
tab i can see only 1 red request that too with 0 recs.
However ,In the cube -> manage-> reconstruction tab , i can see 2 Red request
with the current month date. Could these red requests be the reason for
data mismatch in ODS and cube .
Please guide as to how can i solve this problem .
thanks all
annie

Hi
Thanks for the reply.
Load to Cube is Delta and goes daily .
Load to ODS is a full on daily basis .
Can you help me how to sort this issue . I have to work directly in production env . so has to be safe and full proof .
Thanks
annie

BPC 7.5: Delta Load when loading from BI InfoProvider

Similar Messages

Maybe you are looking for