Slow paralel processing (parforeach) in an integration process

Hi all,
I've an integration process with the following steps:
1) Receive a message;
2) Transform: map this message to a multiline message;
3) Block: configured for parforeach mode, it send assynchronously the message n times (each line from the multiline message is a new message).
I'm putting 50 messages in this integration process and the difference between the first and the last message processed is 65 seconds. I have the following questions:
1) Is this process slow in our system or this time is expected?
2) Where can I make this process faster?
Another question is: Is BPM and Integration process the same thing?
Thanks for any help,
Alessandro.
XI 3.0, SP10 in HPUX with much RAM

Hi Frank,
in case you are using QoS EO you will be able to tune partially through the tuning parameters in the integration engine (sxmb_adm), although I think you probably know that. However there are additionally some issues you could consider.
Regarding your question of setting the rfc adapter max connections to 50 I would strongly suggest you NOT to do it. I imagine you will get outofmemmory errors in doing that. Start with a lower number, perhaps 5 is ok, and then you can test, raising this value a bit, but 50 seems to me to be too high. You could also think about tuning in the visual admin, the Messaging system service, that is, SAP XI AF Messaging, parameter "messaging connections", the values for consumers, recvmaxConsumers, call max consumers, rqst max consumers etc. Additionally tune the MaxThreadcount parameter. The tuning guide advises you to set a 300, but you could test other values too.
Be careful, again when doing this tuning, because when trying to have high numbers, as I explained you, you may have memory problems because the heap size runs out. It will not always be good to increase the heap size excesively. Instead, it is much better to add an extra node for this purpose.
I hope this helps you a bit. Regards, Jaime

Similar Messages

  • Help with Integration Processes (ccBPM)

    Please help me to understand Process Container variables and "instance of process". I don't quite have a handle on the concepts. Thanks.
    When a message is sent to an Integration Process and it is a reciever/start message, is a new process instance instantiated to process the message?
    Say another message is sent to the same Integration Proces, is another instance created (ignoring correlating)?
    My last question is whether  the Process Container variables are Process Instance specific?
    Thank you for any help.

    Hi Chris,
    >><i>Please help me to understand Process Container variables and "instance of process"</i>
    For an integration process to be able to process data such as messages or counters correctly, you must first define the data as container elements. <b><i>Container elements are similar to variables in a programming language.</i></b>
    Container elements hold the message interfaces, as the data flow takes place via messages in and out of Integration server (XI), so effectively they are containers that hold data while a Business Process is executing.
    >> <i>When a message is sent to an Integration Process and it is a reciever/start message, is a new process instance instantiated to process the message?</i>
    You use a receive step,to receive a message. By receiving a message, you are transferring the data it brings into the process. <b><i>You can use a receive step to start a process or within a process that is already running</i></b>
    In case of receive step, a new process instance is not instantiated because every receive has a particular message to look for, so there can be many receive steps in a single excuting Business Process.
    Whereas in case of receiver determination step, if you choose <i>parforeach</i>then yes a new process instance is created for each message.
    >><i>Say another message is sent to the same Integration Proces, is another instance created
    (ignoring correlating)?</i>
    No,
    Receive steps arranged one after the other,
    The first message that arrives is assigned to the first receive step, the second message is assigned to the second receive step, and so on. Therefore, the first message is not assigned to all receive steps that are waiting for a message from this message interface.
    If you are using a <i>Fork</i>step, then you can have multiple receive step
    >><i>My last question is whether the Process Container variables are Process Instance specific?</i>
    No, Container variables are not process instance specific, there may be single line or multiline process containers.
    Also, Please go through these links:
    BPM- BPM in practice modeling Business Process:
    https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/library/nw/a-c/bpm251 - bpm in practice modelling business processes.pdf
    BPM from modeling to monitoring,
    https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/library/events/sap-teched-04/bpm from modeling to monitoring.pdf
    I hope this helps, you'll give me points )
    Thanks & Regards,
    Varun Joshi

  • Dynamic configuration in integration process using abap mapping

    Hi everybody,
    i have the following scenario:
    file adapter -> integration process -> file adapter
    The integration process uses an ABAP mapping and sets the filename in dynamic configuration as follows:
    *-- Set Parameter
        clear ls_dyn_record.
        ls_dyn_record-name      = gc_dyn_config_name.
        ls_dyn_record-namespace = gc_dyn_config_ns.
        ls_dyn_record-value     = <new_file_name>
    *-- Write configuration
        ir_dyn_config->add_record( ls_dyn_record ).
    But now the new filename is not reflected in the file adapter (receiver). In the integration monitor (SXMB_MONI) i still find the old filename.
    Whats wrong?
    Elko

    The ABAP mapping is more complex, setting filename in Dyn. Conf. is just one step in mapping.
    If I check the Workflow protocol of the Integration Process, I find the following in the Trace of the ABAP-Mapping:
    The filename has been set to 3233340.SWNF00HW.P10I. The Suffix P10I has been added in the ABAP mapping.
    When I check the subsequent message in SXMB_MONI I find:
    The added suffix is missing in the filename !!
    Elko

  • Split message mapping to integration process

    Hi,
    I faced an error when trying to send a multiple message (after a message split) to an integration process and I would like to know the possibilities to resolve this issue.
    What I want to do (more details below) :
    1. Get an order list from a database
    2. Split the order list in multiple orders (via a multi-mapping)
    3. For each order, create a new integration process instance
    The error I got is:
    Messages in multi message format can be sent to one adapter engine only
    The solutions I thought of:
    - Creating a new integration process / Update the existing integration process in order to execute the message split in the process engine
    - Create a new service (or business system) as a receiver instead of the process that points back to another XI service and set-up the appropriate configuration between the second service and the existing integration process
    My question: is there another solution than the two above?
    Thanks in advance
    Here are the details of what I did:
    1. A JDBC request returns an order list like:
    <resultSet>
       <row>
          <order>[...order 1 details...]</order>
       </row>
       <row>
          <order>[...order 2 details...]</order>
       </row>
    </resultSet>
    2. During interface determination phase, a multi-mapping is executed to produce several orders:
    <order>[...order 1 details...]</order>
    <order>[...order 2 details...]</order>
    3. The target receiver is an integration process who take as initial document only one order ; so, having two orders as a result of the split, I would like XI to create two new instances of my integration process, each receiving exactly one order.
    And there's when the above error occured.

    Hi Alexis
    Creating a new integration process is suggested as your target receiver is your current integration process and along with this splitting and passing data to multiple receiver can be done in integration process.
    Thanks
    Mitesh

  • BPM x Integration Process

    Heya guys,
    longe time no see.
    I'd like to start a conversation on the following subject: how do you understand the difference between business processes and XI's integration processes. This idea was inspired by the recurrent confusion that some clients and some managers make about those (or maybe I'm the confused one).
    In my view, integration processes are such that they shouldn't require any human intervention, and are designed with respect to systems (systems which XI access or systems that access XI). They are important mostly for the IT techs responsible for the systems integration.
    On the other hand, business processes may have human intervention (aprovals, data filling etc) and are designed with respect to the key user whose action will be required in that specific step of the process. They are important for the end users which use the process in a daily basis and also for the managers and directors for analyzing purposes.
    The problems begin when the users want to understand the integration process as if it was a business process. Want to check in which specific step it is at this moment (as if in Guided Procedures or Solution Manager). In my opinion integration processes shouldn't be trackable like business processes simply because it is not what they are intended for. They are similar tools for completely different applications.
    I think SAP has kinda understood that since they are changing XI process naming to integration process instead of BPM. IP is not a BPM, and it shouldn't be.
    Any comments?
    Regards,
    Henrique.

    I completely agree with you Henrique. BPM deals with the integrating people also where as the integration processes doesn't. But in XI, the integration process concept is linked with BPM which is very much confusing.
    Actually most of the things we do in the integration process in XI like, fork,loop, switch etc can be done without using any BPM in webMethods, TIBCO.
    May be in future SAP will come up with more appropriate conventions so that people will not be get confused what exactly is integration process and BPM.

  • Monitor Integration process log in BPM

    Hi
    I am practising the following BPM
    /people/krishna.moorthyp/blog/2005/06/09/walkthrough-with-bpm
    and I wanted to know how to monitor integration process log in BPM.
    To monitor Integration process I logged, into transaction SXMB_MONI_BPE ->Process Selection->Selected corresponding integration process (in Service Field) - and Clicked Execute as suggested in the blog
    But I get the message work item doesn't exist ??
    What do I need to do in this case ??
    Thanks,
    Kiran

    SAKHARDANDE ,
    Go to sxmb_moni-->Monitor for processed xml message --> In the view box there is standard and process. Select Process for checking the messages of BPM.
    Else as in the weblog mentioned go to SXMB_MONI_BPE ->Process Selection->Select corresponding integration process (in Service Field) ->Execute->Select work item. Select your service which you have used in ID.
    If you dont find anything then first see whether you see your message in sxmb_moni  or not? If not then check your file sender communicaiton channel in adapter monitoring.
    Regards,
    ---Satish

  • Not able to transfer Integration Process in ID. Also not seen in SXI_Cache

    Hi Experts,
    I am trying a BPM scenario. I have created all design objects along with Integration Process in IR and saved and activated the same. Issue is : I am not able to transfer the Integration Scenario from IR in ID. I am also not able to see the created integration process in SXI_Cache under Integration Processes node. Can you please suggest some thing related to this issue. Thank you.

    hi,
    >>>I have created all design objects along with Integration Process in IR and saved and activated the same. Issue is : I am not able to transfer the Integration Scenario from IR in ID.
    but in order to use Integration Scenario in ID you need
    to create it in IR first and Integration Process is not the same as
    integration scenario
    you can only transfer Integration Process to ID as an Integration Process
    (under services without party node)
    Regards,
    Michal Krawczyk
    http://www.mypigenie.com - XI/PI FAQ

  • Need info about the integration Process.

    HI ,
    I would like to know about the different components of Integration Process like about the Receiver etc..
    and how do we relate the properties of each component with the container.
    Thanks in advance

    hi Syed
    An integration process is an executable, cross-system process for processing messages. In an integration process you define all the process steps that are to be executed and the parameters relevant for controlling the process.
    You implement integration processes when you want to define, control, and monitor complex integration processes that extend across enterprise and application boundaries. The design and processing of integration processes is also known as cross-component Business Process Management (cross-component BPM, ccBPM).
    http://help.sap.com/saphelp_nw04/helpdata/en/68/6bfd3f9149ca42e10000000a1550b0/frameset.htm
    follow this thread to learn how to define an IP
    http://help.sap.com/saphelp_nw04/helpdata/en/68/6bfd3f9149ca42e10000000a1550b0/frameset.htm
    You use a correlation to assign messages that belong together to the same process instance. A correlation joins messages that have the same value for one or more XML elements. A correlation is therefore a loose coupling of messages: at design time, it enables you to define which message a receive step must wait for, without knowing the message ID
    http://help.sap.com/saphelp_nw04/helpdata/en/68/6bfd3f9149ca42e10000000a1550b0/frameset.htm
    regards
    sandeep
    If helpful reward points

  • What is integration scenario & integration process in IR?

    hi friends
    1).  can any one explain me about Integration scenario and Integration processes in "INTEGRATION REPOSITORY"?
    2).  why we need to use this IS & IP(integration scenario and integration processes?
    3).  what is advantage of using IS & IP(integration scenario and integration processes?
    if you have any related links and documents please refer to me..................
    Thanks in Advance
    chinthapatla.bharat

    Hi Bharat,
    Integration Scenario
    An integration scenario completely models the exchange of
    messages for a collaborative process and provides an overview of the process flow.
    It is overview of your whole integration scenario. In Integration Scenario each Swimlane represents a different business system. Mean you will have number of swimlanes as number of business system involved in your integration. Swimlane contains action. Actions are used for mentioning Inbound and outbound interfaces for the corresponding swimlane(business system).
    Why we are using Integration Scenario?
    We use integration scenario to genearate Integration Directory objects like Receiver Determination, Interface determination, Sender agreeement etc.
    All XI content objects must be assigned to one or more integration scenarios (IS). Delivering XI-Content in the framework of an IS has the following advantages:
    1. The IS provides you with a central point of access for all integration objects. This is necessary for semantic and technical integration and facilitates business-driven development.
    2. The IS helps customers to understand the underlying business scenario of XI content objects.
    3. The IS serves as a kick-start for the configuration of the content at the customer site. The aim is to minimize the configuration effort for the customer.
    Please go through this link for further reference:
    http://help.sap.com/saphelp_nw04/helpdata/en/88/7adb7a030b424b8ef29b99461e52a8/frameset.htm
    http://help.sap.com/saphelp_nw04/helpdata/en/ec/21ee117a909f44a8b69794b9ed6221/frameset.htm
    /people/siva.maranani/blog/2005/08/27/modeling-integration-scenario146s-in-xi - Modeling Integration Scenario in XI
    How Tou2026 Implement a High Volume Process Integration Scenario
    https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/9056c89c-1a2e-2a10-8a99-eae154e74c4e
    Integration Processes
    An integration process is an executable, cross-system process for processing messages. In an integration process you define all the process steps that are to be executed and the parameters relevant for controlling the process.
    You implement integration processes when you want to define, control, and monitor complex integration processes that extend across enterprise and application boundaries. The design and processing of integration processes is also known as cross-component Business Process Management (cross-component BPM, ccBPM).
    the following case,u should consider to use integration process.
    1.Control/Monitor the messages in XI
    2. Collect/Merge the messages in XI
    3. Split the messages in XI
    4. To Multicast an Message
    5. Send an Alert based on the very complex business logic
    6. To integrate with cross component business process
    Please go through this link for further reference:
    http://help.sap.com/saphelp_nw04/helpdata/en/3c/831620a4f1044dba38b370f77835cc/frameset.htm
    http://help.sap.com/saphelp_nw04/helpdata/en/f7/d4653fd1d3b81ae10000000a114084/frameset.htm
    /people/michal.krawczyk2/blog/2005/08/25/xi-sending-a-message-without-the-use-of-an-adapter-not-possible - Testing of integration process
    Some more additional links:
    1. what is integration processes and integration scenario? and the functionality of these??
    /people/siva.maranani/blog/2005/08/27/modeling-integration-scenario146s-in-xi
    /people/venkat.donela/blog/2006/02/17/companion-guide-to-integration-scenario
    http://help.sap.com/saphelp_nw70/helpdata/en/ae/fb72dc1d0fbf4391fba23b7e8a0d55/frameset.htm
    2. what is Actions?
    An action represents a function within an application component that is not subdivided further. Actions subdivide the process flow of an integration scenario.
    The vertical progression of actions from top to bottom corresponds to the logical process flow.
    http://help.sap.com/saphelp_nw70/helpdata/en/ae/fb72dc1d0fbf4391fba23b7e8a0d55/frameset.htm
    3. What is message interfaces in interface objects of IR?
    http://help.sap.com/saphelp_nw70/helpdata/en/ae/fb72dc1d0fbf4391fba23b7e8a0d55/frameset.htm
    4.what is fault message types exactly and functionality?
    /people/shabarish.vijayakumar/blog/2006/11/02/fault-message-types--a-demo-part-1
    Regards,
    Vinod.

  • Difference between Integration Process & Business process in SAP XI

    Hi Friends,
    Good Evening. I am getting  a lot of confusion between Integration process & Business Process. Could you please explain me with good example?
    Thanking you all in Advance.
    Thanks & Regards,
    Nagarjuna.

    Hi,
    The IP and the BPM are not different.
    its explaniation from [help.sap|http://help.sap.com/saphelp_nw04/helpdata/en/3c/831620a4f1044dba38b370f77835cc/content.htm]
    The design and processing of integration processes is also known as cross-component Business Process Management (cross-component BPM, ccBPM).
    At configuration time, you configure the receiver determination for the integration process in the Integration Directory of the Integration Builder.
    At runtime, the Business Process Engine executes the integration processes. The Business Process Engine is part of the Integration Server.
    Cross-component Business Process Management is integrated with the business workflow. An integration process can send messages to a workflow and, conversely, messages from a workflow can be processed in an integration process.
    Thanks
    SaNv...

  • Integration Processes

    Hi,
    Can any body please share some knowledge about how to create an Integration Process in Integration Repository. Any help would be appriciable.
    Thanks,
    Kulwant Singh

    hi
    An integration process is an executable process that you use to control complex cross-system business processes.
    Integration processes are based on the exchange of XML messages. Integration processes provide SAP NetWeaver’s message-based process integration with functions for the stateful processing of messages. They enable you to define control structures, such as loops and parallel processing branches.
    An integration process is an executable, cross-system process for processing messages. In an integration process you define all the process steps that are to be executed and the parameters relevant for controlling the process.
    You implement integration processes when you want to define, control, and monitor complex integration processes that extend across enterprise and application boundaries. The design and processing of integration processes is also known as cross-component Business Process Management (cross-component BPM, ccBPM).
    If u Want full doc give me u r mail id.
    Thanks

  • Serial processing with integration processes

    Hi all,
    I have the following problem. I receive a XML message in a integration process, this xml messages contains serveral business partners. I loop over this business partners wiht a 'ForEach' The messages are sent to a second integration proces. In this integration process a business partner is updated in SAP CRM.
    The problem I have is that several instances are started of this second process and this result in locking issues in SAP CRM. How could I configure XI in this way that only one message is processed.
    I read all queue related documentation, but according the documentation the messages should only be picked up from the queue when it is ready.
    I use only one queue (withoug buffering) Used system is XI with the latest service pack.
    Thank you in advance for your reply.
    Kind regards,
    Pieter Alting

    >  I loop over this business partners wiht a 'ForEach' The messages are sent to a second integration proces. In this integration process a business partner is updated in SAP CRM.
    Do you really need another IP here? May be you should look at avoiding this and check if you are using ParForEach or just ForEach.
    VJ

  • Multiple Queue Assignment for Integration Process - PI 7.11

    Hi,
    I am trying to configure multiple Queues for an Integration Process.
    The Integration Process is straight forward, except for a Asynchronous Request Response pattern with correlation. (A asynch send step - immediately followed by a asynchronous receive step with Correlation)
    I have done the following
    1) In IR set the Queue as Multiple - Content Specific
    2) In SWF_INB_CONF transaction reconfigured Multiple Queues - Content Specific without buffering
    But when I trigger the message, the message is not at all triggering/entering the Integration Process. The error message is BPE Internal Failure.
    But if I reconfigure the IP as One Configurable Queue & "Without Buffering", it is working. But we want multiple queues assigned to this Process.
    Thanks in advance.
    Regards,
    Sudharshan N A

    Bjoern, there are blogs/wikis available which should be searched before a question is asked on forum. The information you need is quite basic one and I will therefore lock this thread.
    Regards,
    Prateek

  • On all my other apple devices my Icloud works. I have tride the hard reset idea, i have tried to delete my i clod account on he iphone, but nothing works. Why is the not an integrated process apple? How do i change my apple id and password to my new

    Why is the update on Icloud setting not an integrated process Apple desingners! On my apple iphone 5, after new ipdate. My icloud on my iphone askes to back up. It still have my old id an password and I cant change it anywhere. I dont have that email account for a year now , and dont have the password of it. All my other devices shows my new apple Id and password. I cant change it at mannege my apple Id because it is the new one. Itune use the new one, but no, not my iphone. So, what do I do now?

    You have to do the following to get your new Apple/iCloud ID signed onto your device:
    1.     Go to Manage your Apple ID and change your Apple ID back to the old email address (do not verify it - this is temporary):
    Apple - My Apple ID
    2.     Go to Settings>iCloud, scroll to the bottom and Delete the iCloud account. Use your current Apple ID password when asked. Follow the prompts to delete the account
    3.     Go back into Manage your Apple ID and change your Apple ID back to your new email address (you may need to verify it again)
    4.     Go back to Settings>iCloud and sign onto iCloud with your new Apple ID. Turn on the options you want sync'd with iCloud, give it a little time to push the info down to your device.
    Cheers,
    GB

  • How to trigger an integration process at a certain time each night.

    I have an integration process to collect messages that I would like to trigger at a specific time each night. I looked at the Wait step in order to do this, but it looks like you can specify a fixed time, or a repeating time.
    If I used 'Wait until Specified time', I could specify the time, but the date is a problem; I cannot fix it as a certain date because it will only work for that date only.
    If I take the date from a field of the message, I'm not sure what will happen since it looks as if the date would be updated each time a message is received to the collective process.
    I could take the date from the first message, and store it as a variable, then use that in the wait step, but since the date is not in the correct format, I would need to use xpath somehow to do that.
    Alternatively I was thinking about  using a wait for event step, and raising the event from a background job, but this only seems to be available in ABAP Workflow directly, not from the Integration Process Editor. Is it permissable to modify the generated ABAP Workflow and add a Wait for Event step to allow this to happen?
    Does anybody have an opinion on the best way to proceed?

    Hi,
    Check these
    Polling based upon availability
    http://help.sap.com/saphelp_nw04/helpdata/en/45/06bd029da31122e10000000a11466f/frameset.htm
    /people/shabarish.vijayakumar/blog/2006/11/26/adapter-scheduling--hail-sp-19-
    REgards
    Seshagiri

Maybe you are looking for