** Queue Performance in BPM scenarios

Hi friends,
How about the Queue performance when processing lot of messages at the same time ? For example, if 100 files are picked up and processed by BPM (at the same time), all files processed by the queue XBQO$PE_<Task> Ex: XBQO$PE_WS90000041and the result are delivered thru transaction queues ex: XBTOY0_<4 digit queue> .
My doubt is a) Will this slow performance when processing lot of files like 200,300 b) Is it required to increase any queue parameter ?
Kindly clarify, friends.
Kind Regards,
Jeg P.

Hey,
refer to the link for the performance issues.
/people/swen.conrad/blog/2006/12/22/xi-ccbpm-performance-under-perform-or-out-perform
If you think the performance is slow then you can go for multiple Queues.
refer to this link for the configuration of multiple Queues.
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/e0ff0006-3901-2a10-9e97-a71b423da545
reward points if useful.
regards,
Milan

Similar Messages

BPM scenario,message struck in queue.

Hi folks,
I am doing a Simple file to file BPM scenario(NO TRANSFORMATION)...
My scenario executed properly,but in moni i receive a green flag, after i looked it in
LUW -->Display Process, I can see the steps as
Receive1--initialize-send1-UNDEFINEDWork flow completed.
I think there is a problem after send.... can u plz tell me what may be the reason.
Or Am i doing in creating a IP,..... if so can u give me a simple file to file scenario,with detailed steps

Yes i have checked everything,
Status code of IP is 0 in sxi_cache-->IP
and interfaces are assigned properly at right places......
Still the message gt struck in queue...
I have a doubt,that why The Unsefined step is coming after send1....
RECEIVE1>INITIALIZE>SEND1>UNDEFINED-STEP>COMPLETED

Scenario's performance with BPM vs without BPM in PI 7

hello,
Please send me the presentation, blogs describing the performance issues in PI 7
also, the docs differenciating a normal scenario's performance (without BPM) vs the scenario with BPM...
What are the enhancements made to BPM in PI 7 for performance increase?
Regards,
Nikhil.
******Each useful reply will be awarded*******
Edited by: nikhil a on Feb 7, 2008 6:10 AM

BPM Performance: Integration processes are executed on the Integration Server at runtime by the Business Process Engine. Since the Integration Server is the central resource for message exchange, you must ensure that it is not overloaded; otherwise, this can lead to bottlenecks or performance problems.
Resource Consumption
Every step of an integration process uses Integration Server resources.
●      Every message that is sent to the Process Engine is duplicated.
●      Every message that is sent from the Process Engine is duplicated.
●      A work item is created for the process itself and for every step the process contains.
This means that for a process that just receives one message that is sent without being processed further, four messages and three work items are created.
For this reason, you must ensure that you take Integration Server resources into account when you define integration processes.
Resource Consumption of Different Step Types and Transactional Behavior
Different step types consume different amounts of system resources:
●      Step types with high resource consumption:
     ○       Receive step
     ○       Send step
Asynchronous send steps with acknowledgments in particular consume a lot of system resources. In the case of synchronous send steps, consumption depends on the target system.
     ○       Receiver determination
     ○       Transformation step
In transformation steps, resource consumption is dependent on the mapping called. In general, process steps that generate work items internally are relevant for process performance. Transformation steps (either for message split or merge) also include a mapping step and can be quite expensive. This should be taken into consideration during scenario design.
     ○       Block
     ○       Wait step
●      Step types with low resource consumption:
     ○       Control step
     ○       Multiple condition
     ○       Fork
     ○       Loop
     ○       Undefined step
If you design the transactional behavior of an integration process so that the following steps are not performed as separate transactions, you can improve performance significantly:
●      Transformation step
●      Receiver determination
●      Send step (synchronous or asynchronous)
Transactional Behavior of an Integration Process
Use
You can now influence transactional behavior in the definition of an integration process in the process editor. This enables you to improve performance.
Transaction:
A transaction is a sequence of processing steps that are either fully executed, or not executed at all. If the system cannot fully execute a transaction, it rolls back all processing steps within the transaction. This means that the system can return to the state before the transaction was begun.
The transaction control mechanism for integration processes is not a central transaction manager for an entire system landscape. The transaction control mechanism cannot roll back any processing steps outside the Integration Server.
Transaction Boundaries
You have the option of defining the start or end of a block as the boundary of a transaction.
●      In the case of the start of a block, you can define that the system is to start a new transaction.
●      In the case of the end of a block, you can define that the system is to end the transaction being started (COMMIT WORK). The system ends the transaction that is currently open, regardless of whether it has been started or not. For example, if no new transaction was started at the start of the block, the last transaction started is continued instead.
By making appropriate settings for the start and end of a block you can expand transactions. This means that the database needs to be accessed less often, and enables you to improve system performance
Transactional Behavior for Specific Step Types
At runtime, the system normally creates a separate transaction for each step. The transaction then covers this step only. However, you can influence the transactional behavior of particular step types. In the step properties, you can define that the system is not to start a new transaction when the step is executed. The system then executes the step in the transaction that was started at the time of execution. Consequently, no background work item is created for the step and the database does not need to be accessed. In this way you can improve system performance.
You can influence the transactional behavior of the following step types:
●      Send step
You can influence the transactional behavior when sending messages both synchronously and asynchronously, and when sending acknowledgments
     Transformation Step
     Receiver Determination Step
Optimizing Transactional Behavior:
●      Memory requirements
Expanding transactions and executing specific steps without creating a new transaction may increase the burden on the main memory. If the burden on the main memory is too great, you must redefine transactions, or define that a new transaction is to be created for the step concerned.
●      Troubleshooting in the workflow log
The technical view of the workflow log does not show any detailed information for steps for which no work item was created. If an error occurs, the workflow log displays the error information for the last executed step. The following example illustrates this:
A process contains a transformation step that is executed within an expanded transaction. When the transformation step is executed, an error occurs in mapping and the system rolls back the transaction. Since no work item was created for the transformation step, the workflow log does not have an entry for the transformation step. The error information is entered in the last executed step in the workflow log.
EXAMPLE:
For an example of resource consumption, see the BPM scenario described in the XI sizing guide:
The inbound SOAP messages are handed over to the BPE, which triggers a two-step process consisting of message reception and sending. The processed messages are then sent to a receiver by using the SOAP channel; no mapping.
The SAPS value for this scenario, in which 10 kB messages are processed, is 1300 (processing one process instance each second). A simple XI proxy scenario, for example, requires 140 SAPS process-ing one message each second. This gives you an idea of the resource requirements using BPM.
Example:
In the original implementation, two separate JCBC calls were made to retrieve a sales order document header and the line items. This data then was transformed to the IDoc format of the receiving application using a transformation. Then, using a loop step, one IDoc at a time was sent to the backend application. - This sub optimal design resulted in poor performance caused by following design flaws:
                Separate retrieval of header and line items with the JDBC adapter
               Transformation within ccBPM to combine retrieved header and line items
               IDoc back end connection for one document at the time
In the improved version below, both the JDBC call and the transformation were removed from the ccBPM. The retrieval of the source messages is done via a synchronous call with two mappings in the integration engine of XI that generate the required format for the receiving system. Therefore, it is not necessary to add an additional transformation step in the ccBPM. Additionally, the IDoc adapter connecting to the target system is used to handle multiple IDocs inside one XI message. Therefore, it is not necessary to add a loop operation within the ccBPM either. In this particular implementation, the described changes resulted in a 20x performance improvement!
IMP LINKS:
3bf550d4-0201-0010-b2ae-8569d193124e.pdf
43e8e190-0201-0010-3ea1-d6f996cb4124.pdf
70ada5ef-0201-0010-1f8b-c935e444b0ad.pdf
c071d7bb-0601-0010-d6b8-f4e4dc7f1e20.pdf

PI 7.0 BPM scenarios

Hi Experts,
Do we need to do any Post-installation to work on PI 7.0 BPM scenarios? I have creted and activated the business process thro' PI, but I couldn't see those business process in SXI_CACHE.
Please share your suggestions..
Regards
Sara

Business logic is the functionality performed on the data at the communicating systems (sender/receiver).
Intregration logic are the business rules based on which the data is transformed from one format to another and the path through which data should flow
BPM mostly concentrates here on the integration logic.
Regards,
Prateek

Webservice response in BPM scenario

I am doing a BPM scenario where I take data from ERP asynchronously using proxy and send it as a request to a third party synchronous webservice. The webservice gives a response and I am using the response to send it further along to other systems.
Everything works fine if correct messages are sent and received. The problem starts when PI/BPM receives an un-expected response from the webservice. If the webservice sends an unknown error message in the response, the mapping fails and goes into the error queue. (smq2)
And the real problem is every successful message or response after that also goes into the same queue and getting stuck. Why is this happenning? Do we need to monitor and clear the error queues all the time so that subsequent successful messages go through BPM corrrectly?
Do you guys think it is a cache problem or something else?
Thank you.

this is because there is no proper error handling in your BPM.
you need to handle the exceptions in case of mapping or communication failures.
refer : http://help.sap.com/saphelp_nw04/helpdata/en/33/4a773f12f14a18e10000000a114084/frameset.htm

Error in BPM Scenario

hi,
Using a BPM scenario (File->File). In SXMB_MONI the status of the process is showing "Scheduled for Outbound Processing", with a green flag associated with it. How would I go about troubleshooting this error? Have checked SM58 and made sure all the queues are registered and activated. Also no messages show up in SXMB_MONI_BPE. Could you please guide on how to proceed?
regards,
SK

Hi
Have a look at the following links, even though they are not specific to your scenario, they give you some good hints on troubleshooting and where to look.
http://help.sap.com/saphelp_nw04/helpdata/en/29/e0194120ddf223e10000000a155106/content.htm
http://help.sap.com/saphelp_nw04/helpdata/en/49/e3fb40ef74f823e10000000a155106/content.htm
http://help.sap.com/saphelp_nw04/helpdata/en/6a/e6194119d8f323e10000000a155106/content.htm
Sameer

XI File BPM scenario

Hi all,
i have questions regarding the usage of big files with a BPM scenario. The functional requirements are as follows:
1. Pick up large (raw data) file (1MB) from FTP server
2. Drop this file to a second FTP server
3. After the file has been transmitted sucessfully (criticall !), look into a DB and extract information with the help of the filename of the transmitted file and extend the message (in a message mapping)
4. Send this data to ECC and update a custom table
My approach to realise this scenario, would be to perform the DB lookup in a java mapping. Are there any other options?
In addition I am concerned about performance issues, because we will send about 200 files a day (up to 10 at a time) using that interface. Is there a possibility to avoid the integration process?
Kind regards and thanks in advance
Florian

Hi Floarin,
Your requirment can be accomplished with and without BPM.
With BPM:
To improve performance:
you can use the Concepet of Message Packaging For BPE which is best suited for requirment of your kind i.e where you have multiple files coming in in bunch.
you can also define receive of a file on a FTP under a block only as you are not using file content and you need file name only.
Please use JDBC look up only it will improve the Performance to a greate extend.
After JDBC look up you can use that Data to write into ECC
Without BPM:
You can find Modules that can extract file name and pass that file name to JDBC look up and then output of JDBC to ECC.
Even here also you can use Concept of Message Packaging.
To handle Exception you can use Alert
Reward Points if Helpful
Thanks
Sunil Singh

Performance of BPM

Can anyone tell me about some tweaks that can be done in order to enhance the performances of the individual steps of BPM

Hi,
Performance behavior of BPM scenarios is determined by the actual process model and the number of executed process instances of a process.
The following are the determining factors for a particular process:
Number of messages received by a process (influenced by use of correlations)
Number of messages sent by a process
Number of transformations within a process (influenced by processed message sizes)
In general, process steps that generate work items internally are relevant for process performance. Transformation steps (either for message split or merge) also include a mapping step and can be quite expensive. This should be taken into consideration during scenario design.
For an example of resource consumption, see the BPM scenario described in the XI sizing guide:
The inbound SOAP messages are handed over to the BPE, which triggers a two-step process consist-ing of message reception and sending. The processed messages are then sent to a receiver by using the SOAP channel; no mapping.
The SAPS value for this scenario, in which 10 kB messages are processed, is 1300 (processing one process instance each second). A simple XI proxy scenario, for example, requires 140 SAPS process-ing one message each second. This gives you an idea of the resource requirements using BPM.
Check out the TCode SXMB_MONI_BPE for performance and check out this link also /people/swen.conrad/blog/2006/12/22/xi-ccbpm-performance-under-perform-or-out-perform
Refer this thread.
BPM
Regards
Aashish Sinha
PS : Reward Points if Helped

BPM Scenario

Hi,
    I am trying out an BPM scenario for an N:1 mapping,in which i'll be sending N number of 2 different structure of messages.The source file got picked from the Source.The SXMB_MONI describes that the "Message being sent",but i couldn't get at the target.I doubt that my BPM design could have strucked up in the looping and hence the message couldn't be delivered.Can anyone provide some pointer to get it resolved.The BPM design is as mentioned below :
Block
          Deadline
          Exception Handler
                                    Loop1     Recv1     Container1    Loop1
         Fork                                                                                Fork     Transformation(2:1)   Send Stop
                                  Loop2     Recv2      Container2      Loop2
Note : The loop will come out when the deadline time reaches 2 min.

Yes.The Correlation desfined as below
File1 of Abstract type Message Interface
FileList1 of of Abstract type Message Interface(Multiline checked)
File2 of Abstract type Message Interface
FileList2 of of Abstract type Message Interface(Multiline checked)
TargetFile of Abstract type Message Interface

BPM Scenario: Message has error status on outbound side

Hi All,
        I am doing one BPM scenario. In my scenario i am collecting 12 different type of idocs in BPM and bundling these idocs and sending these to the 12 different files.
        If i send 12 idocs from the R/3 then my scenario is working perfectly fine. If i send less than the 12 idocs that time i am getting the error message as "Message has error status on outbound side" with red flag.
           Can you please explain what minght be the problem. I have already checked in SM58,SMQ1 and SMQ2.
Thanks & Regards,
Purushotham

Hi Nutan,
        I hv configured my scenario as follows
1. Start
2. Block ( Deadline and Control step for cancell the process)
   3. Fork(Necessary branches 12)
      4. Loop(12 loops)
          Under loop
          a. Receive Step
          b. Container Operation( For count)
          c. Container Operation(For append)
5. Fork( Necessary branches 12)
    6. Transformation
    7. Send
8 Stop
This is my scenario. In the first Fork step i am checking end condition as total number of idocs is reached then i am sending all the data to the target system. If the idocs are not reaching with in 1 hour then i am cancelling the process.
        Now can you please tell me what is the problem.
Thanks & Regards,
Purushotham

BPM Scenarios not working

Hi All
I have done a simple file_2_file and SOAP_RFC scenario. Both of them are perfectly working fine.
Now I did a simple file_2_file scenario using BPM and this doesn't work. When I go the transaction SXI_CACHE, it shows as "Cache contents are obsolete". Also, in SXMB_MONI, when I see the messages, only sender interface is there and no part of the BPM messages are shown.
I am sure that my BPM configuration is perfect as its a simple example which I implemented from one of blogs.
Do I have make any settings for a BPM scenario to work? Please help.
Thanks,
Vijay

Hi Moorthy,
I already implemented your blog. After activating all the objects, I just tried SXI_CACHE, it says the "Cache contents are obsolete". Also, my previous scenarios doesn't work. Now If I take out the BPM scenario, I mean if I delete the scenario, then the previous scenarios start working fine.
Any solution please?
Thanks,
Vijay

File to RFC with multiple records using BPM Scenario Error...!!!

Hello Guru's,
I have done the File to RFC with multiple records using BPM scenario as per the Materiel available in the sdn.sap. This involves BAPI (BAPI_MATERIEL_AVAILABILITY). I have done exactly the same what is their in the materiel. SXI_CACHE is also giving return value " 0 ". File is getting deleted from the source directory, but no file in target directory. SXMB_MONI is also showing no error (black Flag). BPM is also error free. Checked the interfaces also.
Can any one tell me what mistake would i have done.
Thanks in advance.

Hi,
There is one similar discussion I found,
FTP TO RFC using BPM
Thanks
Swarup

File to RFC to File with BPM Scenario

Hi all,
 I am trying to implement a Sender File ( async ) to RFC (sync ) to Receiver File with a BPM. I using the blog https://www.sdn.sap.com/irj/sdn/weblogs?blog=/pub/wlg/1926. [original link is broken] But it doesnt work. First message FileRequestOut is correct in SXMB-MONI, but the second is showing a error. I checked in SXMB-MONI-BPE and I say in workitem is follow message:
Message Error Workflow
Error handling for work item 000000001714
Work item 000000001714: Object CL_SWF_XI_MSG_BROKER method SEND_SYNCHRON cannot be executed
No reference message specified when sending a response
No reference message specified when sending a response
I configured my BPM scenario in this way:
( Sender File Adapter )
First Step
Receiver Step ( Asynchronous )
Mode: Asynchronous
Receive Message: File Request
( Receiver RFC Adapter )
Second Step
Send Step ( Synchronous )
Mode: Synchronous
Request Message: File Request
Response Message: File Response
Receiver From: Send Context
( Receiver File Adapter )
Third Step
Send Step (Asynchronous )
Mode: Asynchronous
Receive Message: File Response
Receiver From: Send Context
 I have changed it, many times and I can get solve it. About my configuration objects, I think it is ok, because a tested my Interfaces in Configuration Test Tools it was ok. ( Receiver Det. Interface Mapping, etc)
 I have seen in SDN, this error maybe Sencond Step must be Synchronous e Third Step must be Synchronous too. Is it true? In other hand, I have seen, it is possible to use a Async / Sync Brigde.
 Could you help me about this problem?
 Thanks for help
 Best regards
 Fábio Ferri
 Consultant XI/ABAP/Netweaver

Hi ,
 I have seen in SDN, this error maybe Sencond Step must be Synchronous e Third Step must be Synchronous too. Is it true? In other hand, I have seen, it is possible to use a Async / Sync Brigde.
 In BPM did u used as
 Recive Step Async
 Synchronous Send Step
 Send Step is Async
 it is possible to use a Async / Sync Brigde.
 No need to use Asyn Sync Step for this
Assign poins if u found hepful
Best Regards.,
V.Rangarajan

BPM scenario to work

hi
Do we need to add any Parametrs in SXMB_ADM to BPM scenario to work
SV

Hi,
>Do we need to add any Parametrs in SXMB_ADM to BPM scenario to work
NO
Regards
Agasthuri Doss

BPM scenario - How to check it?

Hi Experts,
I couldn't see any difference between in wsdl file which was created for BPM scenario and non-BPM scenario.
How to make sure that the BPM process worked fine? I couldn't get anything for SXMB_MONI_BPE. Am I missed out any steps?
Regards
Sara

Hi,
Refer to the guide: 'How to Monitor Integration Processes' at https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/e7bc3a5a-0501-0010-1095-eb47159e169c.
Regards
Manish

** Queue Performance in BPM scenarios

Similar Messages

Maybe you are looking for