Process chain optimization

Dear All,
Our transaction process chains have been running for 2-3 hours longer daily than a few months ago. Users are not able to have data in time.
What are programs or t-codes where we can do a comparison of a process chain on various days.
I am currently working with /ssa/bwt program but since we have about 35 sub chains (some of them huge) within our transaction chain, comparison gets difficult when objects don't run in the same order (in many cases due to failure and correction).
Idocs getting stuck, we are checking. But for a direct one by one step wise comparison on volume of data, any t-code, program?
Regards,
Cleo

Hi Cleo,
make sure you have implemented all the notes/bug fixes from the following 3 'Composite SAP Notes' on your BW Landscape, including any manual steps...
1827854 - Enqueue/Lock during parallel data loads
2096765 - Composite note for hanging Infopackage processes in Process Chains
2093582 - Composite note for hanging DTP processes in Process Chains
This will significantly increase the performance of your process chains and also prevent most of the bugs associated with the failures. You can see which bug-fixes are relevant to your SP Level also.
Please give points if this resolves your problems once you have completed your analysis via transaction ST13,
thanks,
Colm

Similar Messages

Using BPC Process Type Optimize in Process chain

Hi,
BW Process chain fails at BPC Process Type Optimize though Appset, Application, User field values are passed as below.
FIELD NAME        FIELD VALUE
SUSER                    XYZ
SAPPSET                CopyApshell
SAPP                      FINANCE
Please let me know if I am missing any parameters. Is there a better way of executing Optimize as part of process chain.
Thanks in advance.

Bhanu;
they are SEM cubes; and there are several situations sometimes the rollup gets stucks..; for example if some users do the planning in the same cube, or locks.,,etc..we tried to tell all the planner not to do any activities during the daily process chain time. we are doing rollup and compress every day for the sem cubes.

Process Chain in BI7.0

Hi,
What are the steps to create Process Chain in BI
What are the difference between BW 3.5 and BI7.0 PC?
Regards,
Jackie.

Hi Jackie,
Major difference between BW3.5 and BI 7.0 versions
1. In Info sets now you can include Infocubes as well.
2. The Remodeling transaction helps you add new key figure and characteristics and handles historical data as well without much hassle. This is only for info cube.
3. The BI accelerator (for now only for Infocubes) helps in reducing query run time by almost a factor of 10 - 100. This BI accelerator is a separate box and would cost more.
4. The monitoring has been improved with a new portal based cockpit. Which means you would need to have an EP guy in ur project for implementing the portal.
5. Search functionality hass improved!! You can search any object. Not like 3.5
6. Transformations are in and routines are passé! Yes, you can always revert to the old Tcodes.
7. The *Data Warehousing Workbench *replaces the Administrator Workbench.
8. Functional enhancements have been made for the Data Store object:
New type of Data Store object, Enhanced settings for performance optimization of Data Store objects.
9. The transformation replaces the transfer and update rules.
10. New authorization objects have been added
11.*Remodeling *of Info Providers supports you in Information Lifecycle Management.
12 the DataSource: There is a new object concept for the DataSource .
Options for direct access to data have been enhanced.
From BI, remote activation of Data Sources is possible in SAP source systems.
13. There are functional changes to the Persistent Staging Area (PSA).
14. BI supports real-time data acquisition.
15. SAP BW is now known formally as BI (part of NetWeaver 2004s). It implements the Enterprise Data Warehousing (EDW). The new features/ Major differences include:
a) Renamed ODS as Data Store.
b) Inclusion of Write-optimized Data Store which does not have any change log and the requests need no activation
c) Unification of Transfer and Update rules
d) Introduction of "end routine" and "Expert Routine"
e) Push of XML data into BI system (into PSA) without Service API or Delta Queue
f) Introduction of BI accelerator that significantly improves the performance.
g) Load through PSA has become a must. Info Packages are used to load data upto PSA only.
You need to create DTP to update data from PSA to Data Target.
Pls check the following linka also ,it might help u
http://csc-studentweb.lrc.edu/swp/Berg/Articles/NW2004s_what_is_new.ppt
http://help.sap.com/saphelp_nw04s/helpdata/en/a4/1be541f321c717e10000000a155106/content.htm
http://help.sap.com/saphelp_nw2004s/helpdata/en/52/a21f407b402402e10000000a1550b0/conten
Steps to create Prcocess chains in BI:
Check in the following links:
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/30664504-40dd-2a10-3794-db7b4190bef3
http://sap.ittoolbox.com/groups/technical-functional/sap-bw/bi-70-process-chain-and-psa-deletions-1098154
or tcode rspc is for process chains
1.select new from there
2. enter the variant of the process chain
(for start process i.e first one it is immediate always)
3. from lfet hand side of ur processes select the process u want to do,after the start process for eg: load info package.
(give the name of ip and give the variant i.e at wat time u wannt to execute it).
4.likewise drag and drop the processes u wanted to link, one after the other.
5 activate the pc and then schedule it
Pls assign points if it helps u,
Thanks & Regards,
Madhu

Pointers for optimizing system performance (run time) while running DP process chain with parallel processing

Hi Experts,
We are running APO DP process chain with parallel processing in our company, we are experiencing some issues regarding run time of process chain, need your help on below points;
- What are the ways we can optimize process chain run time.
- Special points we need to take care of in case of parallel processing profiles used in process chain.
- Any specific sequence to be followed for different processes in process chain - if there is some best practice followed.
- Any notes suggesting ways to improve system performance for APO version 7 with different enhancement packs 1 and 2.
Any help will be really appreciated.
Regards

HI Neelesh,
There are many ways to optimize performance of the process chains (background jobs) in APO system.
Firstly I would recommend you to identify the pain areas (steps) which are completing with more runtimes. Then each one of the step has got different approaches to decrease the runtime.
Like you may end up with steps like infopackage executions, DTPs, DP mass processing jobs etc which might be running with more runtimes. So now target each one of them differently and find out the ways to optimize. At the same time the approach you follow should be technically possible with basis perspective (system load and utilization) as well.
And coming to parallel processing, you can use parallel processing for different for different jobs. You can further r explore on the same using parallel processing. Like loading an infocube, mass processing, infopackage execution, DTP, TSCOPY etc.
Check the below link for more info
Performance problems in DP mass processing
Let me know if you require further info.
Regards,
Raj

Process chain / DM error in 'Modify dynamically' process

Hello experts,
I try to run the following how to : "move date between applications using Data Manager ..."
Yon can find the pdf here : http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/b0480970-894f-2d10-f9a5-d4b1160be203
I'm looking after someone who used it successfully, on my side after implementing all steps and running the package I get the message "IMMEDIATE RUN: Request to run the package on the server was successful The package is now running"
When I look the log for the process chain, overall status of the process chain is yellow, and steps "modify dynamically" and "clear BPC Tables" are in error.
I can't get any usefull error messages.
Thx....D

Hi Deepak,
We are experiencing a similar issue while trying to Light optimize one Application. The step "Clear BPC Tables" stays in red status, in addition to "Plan mode on" process. The Application Set has three applications, but this issue only happens regarding one of them.
Have you found a solution from SAP to this problem or any workaround?
Regards,
Maximiliano

Process Chain: upload from PSA after activation of another ODS

Hi gurus,
i have a follow problem: for upload of ITM ODS i must before upload the HDR ODS. For the performance optimization of related process chain, the process:
1) upload of HDR ODS from 2LIS_02_HDR
2) upload of ITM ODS from 2LIS_02_ITM (ONLY PSA)
are PARALLEL process.
After activation of HDR ODS and upload of ITM PSA, with AND process, i upload data from ITM PSA to datatarget, but there is an process chain error:
"No ods activation process can be in front of process PSA read and update data target in the chain" !!
Could you help me?
Thanks in advance!
Bye!
Ferdinando

Hi,
Have you tried this format.
1. Upload HDR (PSA Only)
1. Upload ITM (PSA Only)
2. AND
3. Update HDR (PSA to DT)
4. Activate HDR
5. Update ITM (PSA to DT)
6. Activate ITM
With Regards

Error running process chain

Hi,
wehn we run process chain , the result from optimizer log showing error indicator , we check the abap run time using ST22 and discovered the message
DBIF_DSQL2_SQL_ERROR
what the message try to tell us , how to troubleshoot it .?
thanks

Hi AF,
try to look on SAP notes 978417 - Latch Monitor and Table Access Monitor: DBIF_DSQL2_SQL_ERROR. I guess this will solve your problem. It states also here on how you fix the issue.
Let me know if this make sense. Have a nice day!
Regards,
SASJr

Cube Compression & Process Chains

Hello Friends
Few Questions as I am a beginner.
1) What is the entire concept behind Cube Compression. Why is it preferred for Delta uploads and not for full uploads.
2) What do we mean by deleting and creating indexes using process chains.
3) What is meant by the process chain "DB Statistics Refresh"? why do we need it.
Any help is appreciated. Points will be generously assigned.
Thanks and Regards
Rishi

Hello Rishi,
As you may know, an InfoCube consists of fact tables and dimension tables. The fact table hold all key figures and the corresponding dimension keys, the dimension tables refer from dimension keys to InfoObject values.
Now, there is not only one fact table but two - the F table and the E table. The difference from a technical point of view is just one InfoObject: 0REQID, the request number. This InfoObject is missing in the E table. As a result, different records in the F table could be aggregated to one record in the E table if they have the same key and were loaded by different requests.
As you may know, you can delete any request from an InfoCube by selecting the request number. And here is the disadvantage of the E table. As there is no request number you cannot delete a request from this table.
When data is loaded into an InfoCube it is stored in the F table. By compressing the InfoCube records are transmitted into the E table. Because of the disadvantage of the E table it can be defined per InfoCube if and when data has to be transmitted.
More information can be found here: http://help.sap.com/saphelp_nw70/helpdata/en/ca/aa6437e7a4080ee10000009b38f842/frameset.htm
An index is a database mechanism to accelerate the access to single records within a table. In BW indexes are used to increase the reporting speed.
Whenever data in a table is added or deleted - in our case loaded - the index has to be modified. Depending on the amount of changes in the table it could be less time consumpting to delete the index, load without an existing index and to rebuild the index afterwards. This can be done in process chains.
DB Statistics is something special for an Oracle database. As far as I know (I do not work with Oracle) it is used to optimize SQL commands which are needed for BW reports.
I hope that these explanations are helpful.
Kind regards,
Stefan

Process Chain - Delete File from Application Server

Hi Gurus,
Im working with Process chain, and i have a load from a flat file, so my question is :
How can i delete that file from the application server after was loaded ?
THANKS IN ADVANCED !!! I REALLY APRECCIATE YOUR HELP.
Marcos

hi,
I have gone through the forum you have posted for deleting files from application server through process chain.
I have similar reuirement in my project.
Can you please provide me the solution?
Your inputs will be highly appreciated.
Thanks in advance.
Regards,
Lavanya.

Questions on Multiprovider and Process Chain

Hai All,
          I have two questions. One on Multiprovider and the other on Process chain.
1. Multiprovider:
          For example, I have 2 ODSs. ODS1 has Objects ORDER NUMBER, COUNTRY and PRODUCT, ODS2 has objects ORDER NUMBER, DELIVERY STATUS, CREATION DATE.
Now if I make a multiprovider on ODS1 and ODS2, then as ORDER NUMBER is common in both the ODSs, can I make a report like this:
ORDER NUMBER - DELIVERY STATUS, CREATION DATE?
         I have a problem here bacuase its not getting those details from the other ODS even though the ORDER NUMBER(value) is same. Am I making nay mistake or is it a system problem.
I beleive thats how a Multiprovider works.
2. Process chain:
                I have an END connector in my process chain that connects 3 processes and lets the following task start only after the success of all the above 3 processes.
The system is displaying the END connector seperately under each process. But the name and everything else is same. Is this a setting somewhere in the process chain?
Thank you.

Hi,
1. Those fields are in ODS2, you don't need to make a multiprovider.
2. You mean an AND connector. Maybe you need to refresh the screen. if this doesn't work, delete the three and connectors and insert a new one.
Hope this helps.
Regards,
Diego

BPM Process chain takes long time to process

We have BI7, Netweaver 2004s on Oracle and SUN Solaris
There is a process chain (BPM) which pulls data from the CRM system into BW. The scheduled time to run this chain is 0034 hrs. This chain should ideally complete before / around 0830 Hrs. Now the problem is that every alternate day this chain behaves normally and gets completed well before 0830 hrs but every alternate day this chain fails there are almost 40 chains running daily. Some are event triggered (dependent with each other) or some run in parallel. In this, (BPM) process chain, usually there are 5 requests with 3 Delta and 2 full uploads (Master Data). The delta uploads finishes in 30 minutes without any issues with very few record transfers. The first full upload is from 0034 hrs to approximately 0130 hrs and the 2nd upload is from 0130 hrs to 0230 hrs. Now if the 1st upload gets delayed then the people who are initiating these chains, stop the 2nd full upload and continue it after all the process chains are completed. Now this entire BPM process chain sometimes takes 17 -18 hrs to complete!!!!!
No other loads in CRM or BW when these process chains are running
CRM has background jobs to push IDOCS to BW which run every 2 minutes which runs successfully
Yesterday this chain got completed successfully (well within stipulated time) with over 33,00,000 records transferred but sometimes it has failed to transfer even 12,00,000 records!!
Attaching a zip file, please refer the 21 to 26 Analysis screen shot.doc from the zip file
Within the zip file, attaching Normal timings of daily process chains.xls the name explains it.
Also within the zip file refer BPM Infoprovider and data source screen shot.doc please refer this file as the infopackage (page 2) which was used in the process chain is not displayed later on in page number 6 BUT CHAIN GOT SUCESSFULLY COMPLETED
We have analyzed:--
1) The PSA data for BPM process chain for past few days
2) The info providers for BPM process chain for past few days
3) The ODS entries for BPM process chain for past few days
4) The point of failure of BPM process chain for past few days
5) The overall performance of all the process chains for past few days
6) The number of requests in BW for this process chain
7) The load on CRM system for past few days when this process chain ran on BW system
As per our analysis, there are couple of things which can be fixed in the BW system:--
1) The partner agreement (transaction WE20) defined for the partner LS/BP3CLNT475 mentions both message types RSSEND and RSINFO: -- collect IDOCs and pack size = 1 Since the pack size = 1 will generate 1 TRFC call per IDOC, it should be changed to 10 so that less number of TRFCs will be generated thus less overhead for the BW server resulting in the increase in performance
2) In the definition of destination for the concerned RFC in BW (SM59), the Technical Setting tab says the Load balancing option = No. We are planning to make it Yes
But we believe that though these changes will bring some increase in performance, this is not the root cause of the abnormal behavior of this chain as this chain runs successfully on every alternate day with approximately the same amount of load in it.
I was not able to attach the many screen shots or the info which I had gathered during my analysis. Please advice how do I attach these files
Best Regards,

Hi,
Normally index creation or deletion can take long time in case your database statistics are not updated properly, so can check stat after your data loading is completed and index generation is done, Do creation of database statistics.
Then try to recheck ...
Regards,
Satya

Error while activating Process Chains

Hi all,
while activating the Process Chains, i am getting the following error "Job BI_PROCESS_PSAPROCESS could not be scheduled. Termination with returncode 8"
when i double click on the error msg, i got the following help msg: "
Message no. RSPC065
Diagnosis
Program RSPROCESS is to be scheduled as job BI_PROCESS_PSAPROCESS under user ALEREMOTE.
Can any one please show some way to solve this problem? please do this favor, i have been suffering with error for a long time.
Points will be given
Thanks
Ganesh

Hi,
Just analyze the error message that you get while activating the PC, don't give any server name.If you are trying to run process chain using Flat file, it won't work,
and you should have source system R/3 or you have own datasources in BW system itself at that toime you can use PC to extract data. If your source system is Flat ile, it won't work. other wise you should place your flat file in application server, using AL11 tcode.
OSS : 511475
Symptom
You cannot schedule or perform any batch jobs with the BW or source system background user.
The error RSPC 065 occurs in the process chains:"Job could not be scheduled, termination with return code 8"
Other terms
RSPC065
Reason and Prerequisites
The user type is
"CPIC" up to 4.6B
"Communication" as of 4.6C
This user type may not execute or start any batch jobs, irrespective of the user authorizations.
Solution
Set the type of background user to
"Background" up to 4.6B
"System" as of 4.6C
This user type corresponds to the "Communication" type and may also perform background functions.
Through the Customizing, the BW user is automatically created by mistake as a communication user.Depending on your BW system release, you can solve this problem as follows:
BW 2.0B
 Import Support Package 24 for 2.0B (BW2.0B patch24 or SAPKW20B24) into your BW system. The Support Package is available once note 456551 with the short text "SAPBWNews BW 2.0B Support Package 24", which describes this Support Package in more detail, has been released for customers.
BW 2.1C
 Import Support Package 16 for 2.1C (BW2.1C patch16 or SAPKW21C16) into your BW system. The Support Package is available once note 456566 with the short text "SAPBWNews BW 2.1C Support Package 16" has been released for customers.
BW 3.0A
 Import Support Package 8 for 3.0A (BW3.0A patch08 or SAPKW30A08) into your BW system. The Support Package is available once note 452632 with the short text "SAPBWNews BW 3.0A Support Package 08" has been released for customers.

Error while Activating a process chain

Hi,
I have just modified the existing process chain with the new info package for loading into ODS and then delta update into the Info Cube.
when i am clicking on the option schedule and activate.
Its giving error as :
"InfoPackage ZPAK_49RJW545FSO2MB3NF1MIZ9NJ9 is
generated; NOT able to be used as loading variant"
This is a IP, which is used for delta update from ODS to cube.
I have checked the IP, its fine like i can do the delta through this pacakge manually.
Please help, points will be rewarded....

Dear himanshu arora ,
Go and check whether the Info Package exist ,
You can check in Rsa1 and give IP name and find it.
If your IP is not there please create it,
If tehre please check the all parameter associated with it.
Also go through these
Process Chain Errors
/people/mona.kapur/blog/2008/01/14/process-chain-errors
Process chain creation - step by step
/people/juergen.noe/blog/2008/01/11/process-chain-creation--step-by-step
Data Load errors and Process chains
/people/siegfried.szameitat/blog/2005/07/28/data-load-errors--basic-checks
/people/siegfried.szameitat/blog/2006/02/26/restarting-processchains
/people/siegfried.szameitat/blog/2006/02/26/restarting-processchains
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/19683495-0501-0010-4381-b31db6ece1e9
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3507aa90-0201-0010-6891-d7df8c4722f7
http://help.sap.com/saphelp_nw2004s/helpdata/en/8f/c08b3baaa59649e10000000a11402f/frameset.htm
ope the following links will give u a clear idea about process chains and clear ur doubts.
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/library/events/sap-teched-03/using%20process%20chains%20in%20sap%20business%20information%20warehouse
Business Intelligence Old Forum (Read Only Archive)
http://help.sap.com/saphelp_nw2004s/helpdata/en/8f/c08b3baaa59649e10000000a11402f/frameset.htm
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/8da0cd90-0201-0010-2d9a-abab69f10045
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/19683495-0501-0010-4381-b31db6ece1e9
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/36693695-0501-0010-698a-a015c6aac9e1
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/9936e790-0201-0010-f185-89d0377639db
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3507aa90-0201-0010-6891-d7df8c4722f7
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/263de690-0201-0010-bc9f-b65b3e7ba11c
/people/siegfried.szameitat/blog/2006/02/26/restarting-processchains
Siggi's weblogs for data load error and how to restart process chain
/people/siegfried.szameitat/blog/2005/07/28/data-load-errors--basic-checks
/people/siegfried.szameitat/blog/2006/02/26/restarting-processchains
Hope it helps
Regards
Bala

Error while creating a process chain

Hello BI Gurus,
I have activated the Business Content Scenario in Plant Maintenance for Infocube 0PM_C08(Measurement Results).
It provides a datasource -> infocube flow,through DSO with transfer and update rules.(3.X scenario)
I have two questions -
1.When I am trying to create a process chain for this scenario for regular delta loads(Loading from the datasource - > DSO - > infocube),
Start - >Execute InfoPackage->Activate DSO Data ->
Then when i insert the Execute Infopackage for the load step from DSO to Infocube in the process chain and check it, it is giving an error saying "InfoPackage ZPAK_D50AJ26831X6L4IIOTZTSXWAE is generated; NOT able to be used as loading variant ".
I got this infopackage by right clicking on the context menu and going to Additional Functions -> Update 3.x data to Data targets.
Why am I getting this error and how to resolve it, bcos when i load it manually it is working fine?
2.If the error is because I did not use a infopack created by me, then how to create a infopack for loading to the infocube from DSO in BI7, because when i select from the Context Menu for creating infopack, it is taking me to the already generated IP ?
Also instead of using the 3.X mechanisms, if I decide to create a DTP, will the transformation created with it automatically map all the rules in the "Update Rules" for all fields?
Waiting for your guidance.
With Warm Regards,
Vineeth
Edited by: VINEETH SUBRAMANIAN.B on Jan 31, 2009 12:11 PM

Hi,
Check in SDN
Problem with process chain
Re: Updating Data from ODS to IC using Process chains
Indirect Spend Analysis
Thanks
Reddy

Error while copying a process chain.

Hi All,
I get an error message while copying the process chain in Production environment.It says "SAP System has status 'not modifiable'".Choose display object or Cancel.I hope this is because of the config. that there is no option to create anything .
Please confirm.
Regards,
Shailja.

Hi Shailja,
That means that you can not change that type of object on Quality or Productive server.
Go to Administrator Workbench, sub menu Transport Connection, there you will find a button called Object Changeability (with a truck). Click on that and change the types of the concerned objects to 'Every changeable' in your case.
Beware that you must change the status not with a double click but with a right click
also refer the following thread you can find your solution
Error message after process chain transport
Hope this helps
Regards
Karthik
<3rd Reminder for points removed>
Message was edited by:
Moderator

Process chain optimization

Similar Messages

Maybe you are looking for