How to design data load process chain?

Hello,
I am designing data load process chains for the first time and would like to get some general information on best practicies in that area.
My situation is as follows:
I have 3 source systems (R3 and two for which I use flat files).
How do you suggest, should I define one big chain for all my loading process (I have about 20 InfoSources) or define a few shorter e.g.
1. Master data R3
2. Master data flat file system 1
3. Master data flat file system 2
4. Transaction data R3
5. Transaction data file sys 1
... and execute one after another succesful end?
Could you also suggest me any links or manuals on that topic?
Thank you
Andrzej

Andrzej,
My advise is to make separate chains for master & transaction data (always load in this order!) and afterwards make a 'master chain' where you insert these 2 chains one after the other (so: Start process -> Master data chain -> Transaction data chain).
Regarding the separate chains; paralellize as much as possible (if functionally allowed). Normally, the number of parallel ('vertical') chains equals the nr of CPU's available (check with basis-person).
Hope this provides you with enough info to start off with!
Regards,
Marco

Similar Messages

Loading master data through process chain

Hi Gurus
I am designing the process chain , I know that I have to start by loading master data first for that I am planning to load attribute first and then to load text and then Hierarchy. Is that the right sequence?
Also how can I make sure that once the master data is loaded , the transaction data loading start automatically?
I am planning to put attribute chage run as last process in every master data loading . Is that correct?
Also i would appreciate if you can tell me the very first step I should follow to start my design, I have already identified the master data and transaction data and their respective dependancies.what would be my next step?
Thanks for your help in advance.
Kris

Hi Kris,
Make two seperate Process Chains for Master Data and Transaction Data
For Master Data:
Your sequence is absolutly correct, Identify what all Master Data Objects and make a list of InfoPackages and Start creating Process Chain as
Start --> Attribute --> Text --> Hier --> Attr Change Run
For Transactional Data:
Identify the Data Targets and the Sequence of loading, then create the Process Chain
NOTE: Always Master Data should be loaded before Transaction Data
After Creating different Chains for Master Data and Transaction Data, Make a one Super Chain called Meta Chain where you can put all these process chains,
Meta Chain --> Process Chain 1( Master Data Chain) --> Process Chain 2( Transaction Data)
also check these threads for process chain creation
Re: Process Chain : Master Data
Re: process chains ?
Hope this helps,
Sudhakar.

How to automate the data load process using data load file & task Scheduler

Hi,
I am doing Automated Process to load the data in Hyperion Planning application with the help of data_Load.bat file & Task Scheduler.
I have created Data_Load.bat file but rest of the process i am unable complete.
So could you help me , how to automate the data load process using Data_load.bat file & task Scheduler or what are the rest of the file is require to achieve this.
Thanks

To follow up on your question are you using the maxl scripts for the dataload?
If so I have seen and issue within the batch (ex: load_data.bat) that if you do not have the full maxl script path with a batch when running it through event task scheduler the task will work but the log and/ or error file will not be created. Meaning the batch claims it ran from the task scheduler although it didn't do what you needed it to.
If you are using maxl use this as the batch
"essmsh C:\data\DataLoad.mxl" Or you can also use the full path for the maxl either way works. The only reason I would think that the maxl may then not work is if you do not have the batch updated to call on all the maxl PATH changes or if you need to update your environment variables to correct the essmsh command to work in a command prompt.

How to create document in process chain

Hi,
can u plz tell me how to create document in process chain and wat i need to edit the text for particular info package when document.

Hi Anil,
Goto Tcode:RSPC and select your load data process type where you have to right click on the process chain and select Select create message,there are three types of messages
1>Successful
2>Error
3>Always
If you already created message then go to maintain message
Where you have two buttons
1>is for Edit Document
2>Maintain Recpiants
Goto Edit Document and put your comment and set their mail address in Mail recipiants.
Note there are 2 types of messages you can kept at execution of infopackage process type.
If load is successful send the mesaage to recipients
If load is failed send the message to mail recipt.
It would help you.

Explain: how to include Infospoke in Process Chain where destination is DB

Explain: how to include Infospoke in Process Chain where destination is local machine database [NOT Flatfile]

Hi vijay,
First you create an Infospoke with destination as a DB table in your local BI or BW Machine. Now add this infospoke by going through below steps.
1. Call up the process chain maintenance. Choose This graphic is explained in the accompanying text Process Chain Maintenance from the Administrator Workbench toolbar. The Process Chain Maintenance Planning View screen appears.
2. In the left-hand screen area of the required This graphic is explained in the accompanying text display component, navigate to the process chain in which you want to insert your InfoSpoke. Double-click to select it. The system displays the process chain plan view in the right-hand side of the screen.
If no suitable process chain is available, you need to create a new process chain. You can find additional information under Creating a Process Chain.
3. To insert a process for extraction by means of an InfoSpoke, choose This graphic is explained in the accompanying text Process Types in the left-hand area of the screen. The system now displays the process categories available.
4.In the process category Loading Process and Post Processing, choose the application process type This graphic is explained in the accompanying text Data Export into External Systems.
5.Insert the Data Export into External Systems application type with Drag&Drop into the process chain. The dialog box for inserting a process variant appears.
6.In the Process Variant field, enter the name of the InfoSpoke that you want to include in the process chain, or select it by means of the input help.
Once You have added the infospoke you have to write a program which will fetch the database table that you filled and transfer the data fetched to other legacy system with the help of XI System
For more information on how to infospoke on 3rd party pls find the link below
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/5f12a03d-0401-0010-d9a7-a55552cbe9da
Hope this help
Harish

How can we set a process chain to trigger the nodes w/o manual intervention

SDNers,
We have a Master PC which has the loading & activation of some Hierarchies.Wats happening is some of the hier activations are failing (we got track of the root cause as well) and the nodes below are not getting triggered automatically, eventhough they have been designed to get triggered irrespective of success or failure of this hierarchy activation. The chain prompts for the u2018Status change & trigger the following eventsu2019 opo-up and only when it was said u2018yesu2019, the subsequent node gets triggered in the chain. If this manual intervention was not there, the Chain gets struck at the activation node, whic is running in yellow status for long, though a short dump - error has already been thrown.
My query is how can we set a process chain not to anticipate the manual intervention of chnaging the status & trigger events pop-up

Hi ravi,
i'm not sure abt the query but what i got thru ur qustion is u have to automtaically go to the next load/step even the proceess chain fails in the step......
for that we have the same master meta chains with link of so many local chains...for this even if there are some interventions/fails in between the process chains it never gets stopped....
it goes to the next step and we'll work, analyse and finish the failed load manually....the next day it'll be
fine...
b4 to this make sure that there is no dependency for the previous loads....
And now the solution i found for this is in the process chain design itself.......
while giving the links itself we'll be getting the options as status RED,GREEN and RED(or)GREEN.....now if u got for the third option the event goes to the next step even it is unsuceesful....
rgds,
nkr.

Automate the data load process using task scheduler

Hi,
I am doing Automated Process to load the data in Hyperion Planning application with the help of Task Scheduler.
I have created Data_Load.bat file but rest of the process i am unable complete.
So could you help me , how to automate the data load process using Data_load.bat file & task Scheduler.
Thanks

Thanks for your help.
I have done data loading using Data_load.batch file . the .bat file call to .msh file using this i have followed your steps & automatic data lload is possible.
If you need this then please let me know.
Thanks again.
Edited by: 949936 on Oct 26, 2012 5:46 AM

How can u know the process chain total time, individual time?

Hi guru's
How can u know the process chain total time, individual time?
and what options will available in sm37?
Thanks
prabha reddy

Hi Prabha
Iam not very sure about total time and individual times.
But you can go to tcode rspcm for monitoring the daily process chains. it gives you details like 1. status 2.start date & time 3. Log ID of each process chain.
or you can go to log view of particular individual chain to know how long it has run.
SM37: tcode for simple job selection.
here you check the status of job.
you can select for certain conditions like
1. scheduled
2. released
3. ready
4.active
5. cancelled
Assign points if it was helpful
Revert back if you need further info/
regards
AP

Delete Master Data using Process Chain?

Hi Friends,
How do I delete Master Data using Process Chain?
Thanks,
Pradeep

Hi Bhanu,
I am not sure why we would want to delete MD. But that is the task given to me. I actually know it is not possible. But is there a way to delete MD using chains?
Thanks,
Pradeep

Deletion of changelog data using process chain

Hi All,
I have a requirement where i have to delete the changelog data for particular set of data using process chain.we have an option of deleting the entire data from changelog but how to delete only a particular set of data?????

If you are on BI 7 than,
Choose "Deletion of Requests from the Change Log" from process category Further BI Processes by double-clicking.
Create a new process variant and in the variant maintenance screen select Type of Object as Change Log Table
Under Name of object select DSO name
Specify the requests that need to be deleted by determining the days or dates. You also have the option to specify whether you only want to delete successfully updated requests, and/or only incorrect requests that are no longer updated in an InfoProvider.

Automate Deletion of Infoobject Data in Process Chain

Dear BW Experts,
We refresh our QBI (Testing system) system every 4 months. Hence we have to drop all the data and refresh it again.
I have built a process chain to automate deletion of cubes and DSOs. I am unable to include deletion of Infoobjects (Infosources) in the process chain.
Could you please suggest as to how to do this via process chain (and not manually) since we have more than 20 Infoobjects where data has to be deleted.
Thanks,
Sai
Edited by: Sainath Vadathirthanathan on Aug 13, 2010 10:33 AM

Leavte it blank or enter source object
From help ..Press F1 on that paramter to understand
Reference characteristic
The reference characteristic has the technical properties of a characteristic such as data type and length, as well as the master data (attributes, texts and hierarchies). The characteristic itself also has buinesses semantics. Several characteristics can refer to the same reference characteristic. Such characteristics automatically have the same technical properties and master data.
Example:
The characteristics sender cost center and receiver cost center use the reference characteristic cost center and with it the same values and the same texts.

How can we delete a process chain?

Dear Ones,
By Mistake I have converted an infopackage group into process chain in Quality system. How can we delete a process chain?
Thanks,
Raj

Hi Bhanu,
I've doubt that what is the difference between cancel with core and cancel without core with respect to process chain.
Could you please advice how do we start a process chain daily without using the schedular window for transaction data.
Thanks in advance...
Amarnath.

Optimize the data load process into BPC Cubes on BW

Hello Gurus,
We like to know how to optimize the data load process and our scenario for this is that we have ECC Classic Ledger, and we are looking for the best way to load data into the BW Infocubes from an ECC source.
To complement the question above, from what tables the data must be extracted and then parsed to BW so the consolidation it´s done ? also, is there any other module that has to be considered from other modules like FI or EC-CS for this?
Best Regards,
Rodrigo

Hi Rodrigo,
Have you looked at the BW Business Content extractors available for the classic GL? If not, I suggest you take a look. BW business content provides all the business logic you will normally need to get data out of ECC and into BW for pretty much every ECC application component in existence: [http://help.sap.com/saphelp_nw70/helpdata/en/17/cdfb637ca5436fa07f1fdc0123aaf8/frameset.htm]
Ethan

How to stop the running process chain

How to stop the running process chains or infopackges...just qm status change is enought?

BI - SM 37 - Kill the Job
ECC - SM 50 - Kill the job

Data Load process for 0FI_AR_4 failed

Hi!
I am aobut to implement SAP Best practices scenario "Accounts Receivable Analysis".
When I schedule data load process in Dialog immediately for Transaction Data 0FI_AR_4 and check them in Monitor the the status is yellow:
On the top I can see the following information:
12:33:35 (194 from 0 records)
Request still running
Diagnosis
No errors found. The current process has probably not finished yet.
System Response
The ALE inbox of BI is identical to the ALE outbox of the source system
or
the maximum wait time for this request has not yet been exceeded
or
the background job has not yet finished in the source system.
Current status
No Idocs arrived from the source system.
Question:
which acitons can I do to run the loading process succesfully?

Hi,
The job is still in progress it seems.
You could monitor the job that was created in R/3 (by copying the technical name in the monitor, appending "BI" to is as prefix, and searching for this in SM37 in R/3).
Keep on eye on ST22 as well if this job is taking too long, as you may have gotten a short dump for it already, and this may not have been reported to the monitor yet.
Regards,
De Villiers

How to design data load process chain?

Similar Messages

Maybe you are looking for