Message Processing through Advanced Adapter Engine

Hi All
I am trying to design a high volume asynchronous interface through AAE .  The scenario is File to ABAP server proxy .
I have few questions about AAE processing with Sender File and Receiver Soap adapter.
1) Suppose if I have 50,000 transaction records in one file Will all go to one queue for processing or many queue processing for processing . if it is  many, is it configurable?
2) Should the single file having 50,000 transaction be split to many messages  and processed in parallel .
I am trying to find out how AAE helps to achieve performance .
Thanks in Advance.

hi,
>>>1) Suppose if I have 50,000 transaction records in one file Will all go to one queue for processing or many queue processing for processing . if it is many, is it configurable?
if you're pushing via AAE (ICO object) only then you can have 50k messages in one file easily
(shound't be more then a few minutes to process in PI) if they are the standard size
Regards,
Michal Krawczyk

Similar Messages

  • Message flow between advanced adapter engine and messaging system for ICO scenarios

    Dear all,
    I'm working on a PI 7.31 AEX box and created an ICO object for one interface with HTTP_AAE2IDoc scenario. The interface works quite well. When I looked in to message log of messages for this interface in PI monitor, I noticed that the internal XI message are put totally 5 times into the send queue and retrieved from send queue. In some steps I only see after retrieving a message from send queue and immediately put it back into send queue. Can someone please kindly explain the message flow between advanced adapter engine and messaging system and what exactly happens after each retrieving a message from send queue?
    Below is an example of message log for one message:
    12/08/2014 09:26:06.472    Information    MP: processing local module localejbs/CallSapAdapter
    12/08/2014 09:26:06.472    Information    Application attempting to send an XI message asynchronously using connection HTTP_AAE_http://sap.com/xi/XI/System
    12/08/2014 09:26:06.478    Information    Trying to put the message into the send queue
    12/08/2014 09:26:06.499    Information    Message successfully put into the queue
    12/08/2014 09:26:06.499    Information    The message was successfully retrieved from the send queue
    12/08/2014 09:26:06.499    Information    The application sent the message asynchronously using connection HTTP_AAE_http://sap.com/xi/XI/System. Returning to application
    12/08/2014 09:26:06.500    Information    HTTP adapter successfully processed interface PlantResponse_Out
    12/08/2014 09:26:06.501    Information    Trying to put the message into the send queue
    12/08/2014 09:26:06.501    Information    Message status set to DLNG
    12/08/2014 09:26:06.513    Information    Message successfully put into the queue
    12/08/2014 09:26:06.513    Information    The message was successfully retrieved from the send queue
    12/08/2014 09:26:06.515    Information    Message status set to DLNG
    12/08/2014 09:26:06.533    Information    Trying to put the message into the send queue
    12/08/2014 09:26:06.548    Information    Message successfully put into the queue
    12/08/2014 09:26:06.548    Information    The message was successfully retrieved from the send queue
    12/08/2014 09:26:06.550    Information    Message status set to DLNG
    12/08/2014 09:26:06.551    Information    Executing Request Mapping "http://styrolution.com/pi/Integration/PlantMaintenance/PlantResponse/PlantResponse_to_Zcol_Basf_Inotif02_Inotif01_Zeupm_Inotif01_Ludwigshafen" (SWCV 085d2320fb3b11e2cc0bf4d50aea8c33)
    12/08/2014 09:26:06.563    Information    Trying to put the message into the send queue
    12/08/2014 09:26:06.571    Information    Message successfully put into the queue
    12/08/2014 09:26:06.571    Information    The message was successfully retrieved from the send queue
    12/08/2014 09:26:06.573    Information    Trying to put the message into the send queue
    12/08/2014 09:26:06.573    Information    Message status set to DLNG
    12/08/2014 09:26:06.580    Information    Message successfully put into the queue
    12/08/2014 09:26:06.580    Information    The message was successfully retrieved from the send queue
    12/08/2014 09:26:06.582    Information    Message status set to DLNG
    12/08/2014 09:26:06.583    Information    Delivering to channel: IDOC_R
    12/08/2014 09:26:06.583    Information    MP: processing local module localejbs/IDocOutboundModuleBean
    12/08/2014 09:26:06.583    Information    XI message received for processing
    12/08/2014 09:26:06.587    Information    Sender Party: Sender Service:SXX Receiver Party: Receiver Service:RXXCLNT200 Communication Channel:IDOC_R
    12/08/2014 09:26:06.588    Information    IDOC metadata repository is RXX
    12/08/2014 09:26:06.589    Information    Control record is not mandatory - control record will be added if not available
    12/08/2014 09:26:06.590    Information    XML Payload parsed to idoc document list with number of idocs: 1
    12/08/2014 09:26:06.595    Information    Sending idoc message to receiver R/3 system with TID XIh{lsRI824UITC0009OalmW
    12/08/2014 09:26:06.813    Information    IDOC message sent to receiver R/3 system
    12/08/2014 09:26:06.817    Information    TID XIh{lsRI824UITC0009OalmW confirmed
    12/08/2014 09:26:06.819    Information    Message was successfully transmitted to endpoint <local> using connection HTTP_AAE_http://sap.com/xi/XI/System
    12/08/2014 09:26:06.821    Information    Message status set to DLVD
    Thanks & regards
    Dingjun

    Hello All,
    Thanks for the prompt responses and with best information, But apart from this,I need how an adapter(File/JDBC) works along
    with AAE in PI 7.1. When does the job of File/JDBC adapter is completed and resumed in a synchronous case. That is,
    File Location --> file adapter -
    > XI(AAE) --> JDBC adapter --> database.
    In file sender, lets suppose we have synchronous settings(Best Effort). Now when File adapter's job is finished and when it
    gets back the response back from XI. Please explain step by step from starting(file adapter polling the location) to getting the response coming back to XI.
    Regards,
    Achari.

  • Getting synchron message data from advanced adapter engine

    Hi,
    we have to get all synchron messages from the advanced adapter engine. Normally all messages with errors must be persisted on data-base. How this will be done? We try to with
    /people/kenny.scott/blog/2009/03/08/pi-71-af-messaging-system-audit-log-persistence).
    But this don´t work :-(.
    What´s about correct messages? How this can be persisted?
    Is there a API or we must implement a Adapter Module?
    Thanks in advance,
    Frank

    Hi,
    if you just want to see the msg and not its audit log, then in PI by transaction SXMB_ADM - integration engine configurtion - configuration data, add a entry for RUNTIME category LOGGING_SYNC parameter and set it to 1...........then you can see your synch msgs in SXMB_MONI transaction in your PI system.
    Regards,
    Rajeev Gupta

  • How to get Payload of SOAP Message in Advance Adapter Engine

    HI All,
    I am wondering if anybody can tell me how to view the Payload of SOAP Sender and Receiver Message in Advance Adapter Engine?
    Does Anybody know how to check mapping payload in Advance Adapter Engine because in ABAP you can see the mapping payload under Request Message Mapping but when you use AAE you can't see the Request Message Mapping Payload.
    I have a SOAP to RFC Scenario in which I can't see the SOAP Sender and RFC Receiver Mapping Payload.
    When I am sending incorrect data to an RFC I am getting this error which is very strange and new to me.
    com.sap.engine.interfaces.messaging.api.exception.MessagingException: Unable to split a synchronous message
    Any comments would be much appreciated.
    Thanks,
    Iqbal

    HI All,
    I have managed to find Michal's Blog which is talking about getting the mapping payload but unfortunately I don't know how to create Adapter Module so I am wondering if somebody can please provide me EAR file so that I will request the Basis guys to deploy the code and hopefully this will solve my query.
    Michal's Blog
    As you all probably know while using local Advanced Adapter Engine (AAE) processing in SAP PI 7.1 the message is logged only once (during processing by sender adapter). This is great in terms of performance but what if we need to check the mapping output? Is there a way do do it somehow? It turns out that we don't have such an option in standard yet. Is there any alternative then?
    It turns out there is - a simplest adapter module there is...
    Local AAE works in such a way that from the sender adapter it executes the receiver adapter so in the outbound message to PI processing you can see the adapter info logs of the receiver adapter and this is what we can use. The idea is to add an adapter module to the receiver adapter which will put the content of the message into the audit log of PI message processing. We can do it by writing a few lines of code:
    PI/XI: target message logging with local AAE not possible ? not anymore...
    *Please upload the file in any free site or <REMOVED BY MODERATOR>
    <READ RULES OF ENGAGEMENT>
    Thanks,
    Edited by: Prateek Raj Srivastava on Jan 6, 2012 9:10 PM

  • Webinar:SAP NetWeaver Process Integration u2013 Advanced Adapter Engine in PI 7

    +Please Note: This webinar is aimed at consultants, Patners and Customers in APJ Region and is scheduled at  2.00 - 3.00 p.m. Singapore Time (UTC +8)+
    Dear valued SAP Experts,
    Next SAP Intelligence Platform & NetWeaver RIG Expert Call Session will take place on Tuesday, September 1. The SAP Intelligence Platform & NetWeaver RIG Expert Call Sessions are designed to support consultants, partners and customers during their implementation projects. The sessions cover all different aspects of SAP NetWeaver and are aimed at experts, thus provide knowledge which is not available via standard training courses. The session duration is typically 60min and includes questions and answers.
    Tuesday, September 1, 2009:
    SAP NetWeaver Process Integration u2013 Advanced Adapter Engine in PI 7.1 EHP1
    Time: 2.00 - 3.00 p.m. Singapore Time (UTC +8)
    This event will feature Charu Goel with the SAP Intelligence Platform & NetWeaver Regional Implementation Group. Charu provides the following abstract:
    With PI 7.1 Enhancement pack 1, we continuously thrive to bring in advancements in AAE. In this APJ expert call, we talk about the much awaited capability of IDOC packaging along with the enhancements in JMS. You will learn about the interaction between the AAE and ABAP stack, new enhancements on the JDBC adapter and overall improvements in the technical adapters available with PI 7.1 EHP1.
    For meeting and Dial-in detail please register [here|http://www.surveymonkey.com/s.aspx?sm=qkBfQCM5FM_2f_2b4O0ihVpFRw_3d_3d]
    Thanks & Best Regards,
    Sarma Sishta

    Hi,
    This was one of the good session...
    Especially the features such as;
    -- TCP/IP connection control with JMS adapters
    -- Empty file Handling
    -- Set the various Attributes for Mail attachments via dynamic configuration (intially only subject line was possible)
    -- Message Prioritization
    -- single IDOC Ack for IDOC Packaging
    -- IDOC packaging
    -- and many more........................
    Even the future indicatioon of IDOC J2EE based adapter will provide new direction to the existion IDOC related scenarios..
    One thing that was changed in IDOC packaging is to control it via Sender Communication channel...intially we were doing it either via ECC system or with t-code "idxpw"
    Its almost in same way...but from J2EE based adapter perceptive IDOC packaging will be available with Java stack...and will no need to depend only ABAp stack for this feature.
    Thanks
    Swarup

  • Configuring Process Integration Scenarios for Advanced Adapter Engine

    Hello @all,
    i've an asynchronous SOAP scenario and would like to configure an integrated configuration for Advanced Adapter Engine using a process integration scenario. In the documentation (Link below) it is described, that you can select local communication using AAE in the model configurator, but I couldn't find any hint. Any idea?
    Documentation:
    http://help.sap.com/saphelp_nw73/helpdata/en/48/ce987b18d3424be10000000a421937/content.htm
    Thanks and kind regards
    Andreas

    Hi,
    Use thse links:
    Advanced Adapter Engine Configuration in PI 7.1
    http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/700058f0-b1a1-2a10-39a8-ab2627b87cfa?QuickLink=index&overridelayout=true&47047071760975
    Sreeni.

  • Using Advanced Adapter Engine in PI 7.1 to design a ABAP proxy scenario

    Hi
       We are currently on XI 3.0 and have a scenario in production that is as follows
    R3 --> EOIO (QOS ) --> XI ---> SQL DB A, SQL DB B, SQL DB C ( split in XI , message from R3 in EOIO sequence routed to three different sql servers ). We use this scenario to push master data change messages from R3 . Whenever we do a full push of masterial/customer master from R3, it takes a lot of time for XI to process the messages, the messages hopping from Integration server and then to J2EE server.
    We are moving to PI 7.1 and want to use the AAE ( advanced adapter engine ) to avoid the integration server in the above scenario and thus cut out an additional hop and send the message from R3 directly to the AAE on PI 7.1 server
    i.e R3 --> EOIO (QOS ) --> PI J2EE server(AAE ) -->SQL DB A, SQL DB B, SQL DB C .
    I read in new PI 7.1 features that AAE has all features available in Integration server ( routing ,mapping ) and also XI adapter type based SOAP connectivity ( R3 --> PI http connection ) is possible using AAE.
    In that case, can the above scenario in XI 3.0 be redesigned /reimplemented in PI 7.1 taking advantage of AAE and thus increasing the throughput ? Please advise with your thoughts and relevant documents on AAE on PI 7.1 with an example of implementation of the above scenario.

    I read in new PI 7.1 features that AAE has all features available in Integration server ( routing ,mapping ) and also XI
    adapter type based SOAP connectivity ( R3 --> PI http connection ) is possible using AAE.
    If not wrong this is available for SAP PI 7.1 with Ehp1.
    If you try to create SOAP channel ijn SAP PI 7.11 then in the Message Protocol then in the drop-down you see SOAP and XI3.0
    Regards,
    Abhishek.

  • Load balancing Central Advance Adapter Engine

    Hello All,
    I am trying to get more information on load balancing Central Advance Adapter Engine for SAP PI 7.1. How do I configure and load balance Advance Central Adapter Engine to handle more volume? Should I added extra non-central adapter engines to achieve this? If yes, How do I do this i.e. configuration etc? If not, then what is the best practice on load balancing the Central Advance Adapter Engine?
    Thank you for replying,
    Mayur

    Hi,
    I just post your Q&A here.
    Cheers,
    Aaron
    I have few follow up questions regarding your answers.
    1. For options 1 and 2, could you elaborate or point me some documentation on sap.help or somewhere else which talks more about these options?
       =========================================
       Basically you have more power with more processes (Instances or Server node) to process your messages in the Adapter Engine. That's the way to improve the system throughput.
       For more information, please refer to SAP PI tuning guide (I could not find the guide for 7.1, but the principle is still the same)
       https://websmp102.sap-ag.de/~sapidb/011000358700000592892005E.PDF
      =========================================
    2. For option 3, add non central adapter engine and configure scenarios.
        1. So, do I have to run non-central adapters on separate servers?
       ====================
        Yes. It is recommended to run non-central adapter enging on separate server to minimize the reciprocal impact in terms of resource contention.
       ==============
        2. Do I need web dispatcher to do the load balancing between central and non-central adapter engine?
        ========
        No. this is also not possible since the below is true.
        =========
    I somehow think that if I am selecting the non-central adapter engine when creating the communication channel then it won't be "load balancing" because I will be sending a particular interface to the non-central engine at design time instead of runtime.
    Thank you for taking time and replying to my questions.

  • Question about Integrated Configuration (Advanced Adapter Engine in PI 7.1)

    Hello,
    When you use Advanced Adapter Engine in PI 7.1 with Integrated Configuration scenario, it bypasses ABAP stack therefore you can't monitor processed message in SXMB_MONI.  Instead this message shows up only in RWB Adapter Engine message monitoring.  When you select the message from there, you can view the BEFORE mapping payload in Message Content tab.  My question is how do you view the AFTER mapping payload when using Integrated Configuration.
    Thanks,
    Jay

    > My question is how do you view the AFTER mapping payload when using Integrated Configuration.
    You can't.
    So first you have to configure a standard scenario and test the stuff. When everything is fine, remove the standard scenario and create an Integrated Configuration.

  • 1636215 - Performance monitoring for the Advanced Adapter Engine

    Hi ALL,
    How can we monitor the performance by changing the parameter to true in the above note please please help me
    Thanks,
    Raj

    Hi Dheeraj,
    Since you've gone through the note, I'm assuming you know how to activate the performance monitoring for adapter engine.
    However, there are reservations against doing it in any system Dev/Quality/Production. Reason being, it becomes performance/load intensive when the perf. monitoring is on.
    Still, you can diagnose bottlenecks and execution trends in Dev/Quality using performance monitoring as suggested in the note but be aware that your box is coping well with it. Please note, once activated, you don't have to do anything else. System will automatically collect performance data and you will be able to browse through it using the performance monitoring link.
    How to use it???
    You see a performance monitoring link in Monitoring Home (navigate via Configuration and Monitoring home from PI/PO homepage).
    It will help you analyze the flow of message on periodical basis (hourly/daily etc) and will give you more stats on number of messages in that time duration, average time taken, message sizes (min, max and avg), interface-by-interface detail of runtime consumption at every stage etc.
    Please go through standard SAP help for more clarity:
    Monitoring Performance - Advanced Adapter Engine - SAP Library
    Apart from this, there is this great blog by Suseelan around monitoring:
    http://scn.sap.com/docs/DOC-35805
    Hope this helps.
    Regards,
    Abhishek

  • Whats the Advanced Adapter Engine ?

    What is Advanced Adapter Engine and how its different from normal adapter engine

    HI Prathna
    You use the Advanced Adapter Engine to connect the Integration Engine to SAP systems (RFC adapter) and non-SAP systems. You use the various adapters in the Adapter Engine to convert XML- and HTTP-based messages to the specific protocol and format required by these systems, and the other way around.
    Using Integrated Configuration you can define a local Message Processing on the Advanced Adapter Engine. The Advanced Adapter Engine provides mapping and routing for this locally. Message Processing is only executed on the Advanced Adapter Engine from one adapter to another without the involvement of the Integration Engine. You can gain a great improvement in performance.
    You can implement all adapters on the Adapter Engine for a local Message Processing on the Advanced Adapter Engine, apart from the RNIF adapters and the CIDX adapters.
    If you do not use Integrated Configuration, Message Processing will always be performed by the Integration Engine to execute the routing and mapping there.
    The Advanced Adapter Engine is a separate software component that is automatically installed on the Integration Server. In this case, it is the central Advanced Adapter Engine. However, you can also install the Advanced Adapter Engine separately on another host. This is then a non-central Advanced Adapter Engine.
    cheers
    Abhishek

  • Messages got stuck in Adapter engine

    We are doing http to RFC sysnchronous scenario
    Message got stuck in adapter engine.so we are getting 500 HTTP timeout error in Http client.
    Please help us to find why messages got stuck in Adapter engine.
    Below Adapter engine audit log message is pasted for your reference.
    Audit Log message:
    Time Stamp Status Description
    26.09.2008 06:33:54 Success Message successfully received by messaging system. Profile: XI URL: http://devsap01:51000/MessagingSystem/receive/AFW/XI Credential (User): PIISUSER
    26.09.2008 06:33:54 Success Using connection RFC_http://sap.com/xi/XI/System. Trying to put the message into the request queue.
    26.09.2008 06:33:54 Success Message successfully put into the queue.
    26.09.2008 06:33:54 Success The message was successfully retrieved from the request queue.
    26.09.2008 06:33:54 Success The message status set to DLNG.
    26.09.2008 06:33:54 Success Delivering to channel: RFC_out_Test
    26.09.2008 06:33:54 Success MP: entering
    26.09.2008 06:33:54 Success MP: processing local module localejbs/RfcAFBean
    26.09.2008 06:33:54 Success RFC adapter received a synchronous message. Attempting to send sRFC for ZFTestRFC
    26.09.2008 06:33:54 Success RFC adapter received a synchronous message. Attempting to send sRFC for J2EE_GUEST
    ime Stamp Status Description
    26.09.2008 06:56:15 Success MP: leaving
    26.09.2008 06:56:15 Error Delivery of the message to the application using connection RFC_http://sap.com/xi/XI/System failed, due to: com.sap.aii.af.ra.ms.api.MessageExpiredException: Sync application request expired.. Setting message to status failed.
    26.09.2008 06:56:15 Error The message status set to FAIL.
    26.09.2008 06:56:15 Error Returning synchronous error message to calling application: com.sap.aii.af.ra.ms.api.MessageExpiredException: Sync application request expired..
    Kindly advise us on this issue.

    Hi krish,
           when i send a http request it got stuck in adapter engine with status "delivering" for some time....
    We found that RFC got successfully executed in R/3 system but the synchronous message is not delivered to PI.since adapter engine message is having status "delivering"
    after some time we got adapter engine message status as "cancelled with error"
    Error is Message expired exception which you can see audit log message I have pasted in my previous post.
    Meanwhile we also got HTTP timeout error in Http client.
    Could you please tell me why it got stuck in Adapter engine with status "delivering" since RFC is executed successfully.
    Why we are not getting synchronous message reply back to PI?

  • Changing Exactly-Once-in-Order Processing in the Adapter Engine

    During some issues with hanging messages in some communication channels I noticed that messages for other receivers were also on hold. So adapter engine was processing all messages EOIO while Integration Server does that per receiver.
    I found the [solution in the SAP Help |http://help.sap.com/saphelp_nw04/helpdata/en/45/13b942f14d29efe10000000a114a6b/content.htm] but I am not able to access the mentioned link: http://<host><port>/MessagingSystem/migration.jsp
    Error message I got is: 404 not found.
    Looks like something changed! I checked some simular links like http://<host>:50000/MessagingSystem/monitor/monitor.jsp and that works fine.
    (I also checked the role SAP_XI_ADMINISTRATOR_J2EE was included in my userprofile)
    Please help me finding what I do wrong...or what has changed.

    Hi Sunil,
    ok, but do you know how what happened with the
    http://<host>:50000/MessagingSystem/migration.jsp
    I need that link to change the EOIO processing in the adapter engine.
    Regards,
    Michel

  • Advanced Adapter Engine

    Hi Guys ,
             can u please tell me.hat is the use of Advanced Adapter Engine in 7.1
    Regards
    Syed

    Here you go
    http://www.riyaz.net/blog/local-processing-in-the-advanced-adapter-engine-using-pi-71/technology/sap/494/
    7.3 supports all the adapters in AAE processing including idoc, http
    7.11 supports proxy (native XI adapter) using soap adapter. So AAE is possible .
    Performance is improved many folds...
    You need to use Integrated configuration object in ID.  You dont need receiver agreement, interface determination and sender/receiver agreements. configuration is very simple.

  • Advanced Adapter Engine with Proxies Communication

    Hello there,
    I have built a scenario with an application system and a web service using PI (SAP Basis 7.11) and the advanced adapter engine. I would like to have a communication without participating the integration engine, but with proxies and using ICO. No proxies used, the communication without integration engine works properly, but with proxies included it doesnu2019t work at all. According to the paper from Daniel Horacio Bianchin, given in April 2009, page 26, (https://www.sdn.sap.com/irj/scn/elearn?rid=/library/uuid/00a8defd-e400-2c10-faaf-8049d83d1e94&overridelayout=true) the advanced adapter engine is able to work with ABAP and Java proxies as well. What is going wrong? 
    Kind regards,
    Heinz

    Hi Ravi,
    yes, I have tried to use the SOAP adapter and after generating the communication channels I have generated an Integratd Configuration Object. The income message from the business system via proxy is forwarded to the integration engine, but the receiver determination failed.
    Kind regards,
    Heinz

Maybe you are looking for