Handling large messages with MQ JMS sender adapter

Hi.
Im having trouble handling large messages with a MQ JMS sender adapter.
The messages are around 35-40MB.
Are there any settings I can ajust to make the communication channel work?
Error message is:
A channel error occurred. The detailed error (if any) : JMS error:MQJMS2002: failed to get message from MQ queue, Linked error:MQJE001: Completion Code 2, Reason 2010, Error Code:MQJMS2002
The communication channel works fine with small messages!
Im on SAP PI 7.11, MQ Driver is version 6.
Best Regards...
Peter

The problem solved itself, when the MQ server crashed and restarted.
I did find a note that might could have been useful:
Note 1258335 - Tuning the JMS service for large messages or many consumers
A relevant post as well: http://forums.sdn.sap.com/thread.jspa?threadID=1550399

Similar Messages

JMS Sender Adapter EOIO with different messages in Queue to RFC

Dear Colleague,
In one of my scenarios i am using JMS Sender Adapter and Websphere MQ series.
In my MQ Series Queue i get different Messages with Different Structures.
for e.g in my MQ Series Queue Q1 i have M1, M2, M3 coming in Order.
Now i need to doa Mapping of M1 to a Standard BAPI B1 call through RFC at the reciever side.
Now i need to doa Mapping of M2 to a Standard BAPI B2 call through RFC at the reciever side.
Now i need to doa Mapping of M3 to a Standard BAPI B3 call through RFC at the reciever side.
We are aware that on Receiver side we can have multiple Recievr Determinations.so i can send it to 3 different BAPIs.
Question:
But how do i split the Messges which are coming out of MQ series Q from JMS to 3 different Mapping Structures as we knwo that we do not 'Multiple Sender Interface Determinations' from Determined based on the Message which is coming in.
Hope i have been clear in making myself understand about the problem given above.
I have alos given below the same in a bit Graphical Form.
MQ Series --> M3, M2, M1(Messages) --> JMS Adapte(EOIO) --> M1(Message) -> RFC -> B1(Bapi)
--> JMS Adapte(EOIO) --> M2(Message) -> RFC -> B2(Bapi)
--> JMS Adapte(EOIO) --> M3(Message) -> RFC -> B3(Bapi)
Is it possible to achieve the above result. Answers fo the solution are most welcome. These can be also from the new Netweaver Release Versions. If we have the solution to these in New version we will implment the New Netweaver Releases.
Thanks & Warm Regards
Venugopal

Dear Kai,
if i have 3 MQ series Queues then how are we going to maintain the flow of the Messages in the same order in which has come into MQ series queues.
this mesans to say that all the Message come in Parallel out from JMS or MQ side and will be mapped onto Reciever side.
But in my case i wil need to have M1 first M2 second and M3 third.
This means to say that M1 recived and acknowledged then M2 should come and acknowledged and then M3 should be acknowledged.
How this will be possible with your solution of making 3 MQ series Queues.
Please do let me know.
Thanks
Venugopal

XI JMS Sender adapter EOIO with serialized messages

Hello
I have a customer question. They would like to use a JMS sender adapter with quality of service EOIO. There will potentially be multiple messages in a MQ Series queue at the same time, but they want XI to pick up these messages in the correct order. Is this possible? The documentation for JMS sender adapter lists the following:
"Specify the Processing J2EE Cluster Server (Cluster ID).
This specification stops queue-jumping in the JMS queue. The valid cluster ID is located on the J2EE server Administrator under Server."
Does this relate?
Thank you,
Harold

> I have a customer question. They would like to use a
> JMS sender adapter with quality of service EOIO.
> There will potentially be multiple messages in a MQ
> Q Series queue at the same time, but they want XI to
> pick up these messages in the correct order. Is this
> possible?
Yes. Just choose Exactly-onces-in-order for Quality of Service.
> The documentation for JMS sender adapter
> lists the following:
> "Specify the Processing J2EE Cluster Server (Cluster
> ID).
> This specification stops queue-jumping in the JMS
> queue. The valid cluster ID is located on the J2EE
> server Administrator under Server."
When you choose EOIO, the processing can be done by one J2EE server node only. So put the cluster ID of the required server note here.
Regards
Stefan

JMS sender adapter issue for encrypted message

Hello Folks,
We have JMS to AS2 interface facing issues when JMS sender channel read the encrypted files placed in MQ queue, messages size is
increasing to almost double when it reaches PI.
When sending an encrypted message from MQ to AS2, message is showing in success flag but inbound file size is increasing almost double the size, when compared to message size placed in the MQ Queue. When partner is decrypting the message he is getting total garbage values. But it working fine for unencrypted messages,we are getting the same size as it is in MQ queue.
Can you please trrough some light on the issue not getting excatly issue is in MQ or JMS sender adapter.
Kind Regards
Praveen Reddy

Hi Praveen,
the issue seems to be with your encryption/decryption mechanism rather then JMS adapter. if you have encrypted file in JMS queue then channel only pick the file and sent to target (i am assuming there is no tranformation). So it will not alter the file size.
Please check how the file is encrypted before it places in JMS queue.
regards,
Harish

JMS sender adapter is not picking up message from MQ

Hi Experts,
I have configured the JMS sender adapter for getting message from Websphere MQ. In RWB the adapter and the communicaiton channel all looking good. The trace file tells me the connection to the queue has been established.
But the problem is this JMS sender adapter is not picking up message from the Queue defined on the MQ site.
Any Idea what could be wrong?
Thanks!
Jason
Jason

Hi,
1) Can you activate the JMS adapter again ( edit save and activate it )
2) Check whether the right Queue is addressed.
Regards
Agasthuri Doss

Best practices for handling large messages in JCAPS 5.1.3?

Hi all,
We have ran into problems while processing larges messages in JCAPS 5.1.3. Or, they are not that large really. Only 10-20 MB.
Our setup looks like this:
We retrieve flat file messages with from an FTP server. They are put onto a JMS queue and are then converted to and from different XML formats in several steps using a couple of jcds with JMS queues between them.
It seems that we can handle one message at a time but as soon as we get two of these messages simultaneously the logicalhost freezes and crashes in one of the conversion steps without any error message reported in the logicalhost log. We can't relate the crashes to a specific jcd and it seems that the memory consumption increases A LOT for the logicalhost-process while handling the messages. After restart of the server the message that are in the queues are usually converted ok. Sometimes we have however seen that some message seems to disappear. Scary stuff!
I have heard of two possible solutions to handle large messages in JCAPS so far; Splitting them into smaller chunks or streaming them. These solutions are however not an option in our setup.
We have manipulated the JVM memory settings without any improvements and we have discussed the issue with Sun's support but they have not been able to help us yet.
My questions:
* Any ideas how to handle large messages most efficiently?
* Any ideas why the crashes occur without error messages in the logs or nothing?
* Any ideas why messages sometimes disappear?
* Any other suggestions?
Thanks
/Alex

* Any ideas how to handle large messages most efficiently? --
Strictly If you want to send entire file content in JMS message then i don't have answer for this question.
Generally we use following process
After reading the file from FTP location, we just archive in local directory and send a JMS message to queue
which contains file name and file location. Most of places we never send file content in JMS message.
* Any ideas why the crashes occur without error messages in the logs or nothing?
Whenever JMSIQ manager memory size is more lgocialhosts stop processing. I will not say it is down. They
stop processing or processing might take lot of time
* Any ideas why messages sometimes disappear?
Unless persistent is enabled i believe there are high chances of loosing a message when logicalhosts
goes down. This is not the case always but we have faced similar issue when IQ manager was flooded with lot
of messages.
* Any other suggestions
If file size is more then better to stream the file to local directory from FTP location and send only the file
location in JMS message.
Hope it would help.

Problem in JMS Sender Adapter

Hi All,
I am trying to Pick two different XML types of Messages from a Single Queue.
For Example :- Despatch Advice and Replishment Proposal.
Queue Name is : - JMS_XI_Sender
SAP XI is not allowing me to create two different sender agreements for the same communication channel.
Service :- BS_JMS
Interface : - Despatch_Advice_OB
CC :- JMS_SENDER
and
Service :- BS_JMS
Interface : - Replishment_Proposal_OB
CC :- JMS_SENDER
Can any one tell how can SAP XI will differentiate these two messages and sends to two different receivers.

Hi Rama,
I am using XML Despatch Advice and Replishment Proposal types .
Basically I do have one sender which will post Two types of XML messages in to one single MQ Queue.
SAP XI/PI has to pick that message and then needs to check what is the Value in the "Message Type" Tag .
I do also have two different Interfaces and Mappings and Two different Receivers.
Depending on the value in Message Type SAP XI/PI has to check for the Particular Interface and Mapping, finally needs post the message to Particular Receiver
You need to have defined two different sender agreements with two different Communication channels.
In the JMS adapter Sender configuration you can mention the Queue name to pick the message . After picking the message the JMS sender adapter need to map it to the correct message type - it is defined by message interface defined in the sender agreement .
Please let us know if you need any further calrification.
Regards,
kishore

JMS Sender adapter configuration

Hi,
I have a problem in configuring my JMS sender adapter. My source structure is in the form of a FIXED lenght file.
Its structure is as follows:
Rec ID Required Loop repeat
SHC R 1
SCO R 1
SAM O n
SCD R 1
SCP O n
LTX O n
SCC O n
SUM R 1
where R indicates Required record type
 O indicates Optional record type
1 indicates the record type occurs only ONCE in a record
n indicates the record may occur 0 to unbounded times in the record.
This is how I have defined my record set structure in the Module tab of the JMS adapter configuration.
SHC,1,SCO,1,SAM,,SCD,,SCP,,LTX,,SCC,*,SUM,1
The problem with this configuration is that the adapter expects the input file in this format
SHC
SCO
SAM
SAM.
SAM
SAM
SCD
SCD
SCD
SCD
SCP
SCP
SCP
SCP
LTX
LTX
LTX
LTX
SCC
SCC
SCC
SCC
SUM
Whereas my input file format has the following structure
SHC
SCO
SAM
SAM
SCD
SCP
SCC
SCD
SCP
SCPSCC
SCC
SCD
SCP
SCC
SCC
Could please tell me how I can handle this in my adapter config. I have gone through the following How To guide "How to ...Use the Content Conversion Module within the XI 3.0 J2EE JMS Adapter" but dont find how I can do this.
Cheers.

HI,
Please see the below content conversion parameters
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/f02d12a7-0201-0010-5780-8bfc7d12f891
Regards
Chilla

Failed to generate Alert for JMS Sender adapter

Hi Folks,
My scenario is JMS to IDOC..
I have configured the Alert rules and the alerts are working fine for the Integration engine errors.. and apart from the alert rule there is one more alert rule configured for capturing the alerts of the adapter engine..
When i provide the queue name as invalid one .. i am able to receive the alerts for the same via alert rule of adapter engine..
When I force to make the channel to error with the invalid headers of RFH2 (with correct queuename) the channel status is showing error ..but interestingly no alert for the same...
Now My question here is how to test the generation of the alerts by forcing the JMS sender channel to error. ?
I already checked the report SXMSALERT_LOGREADER for verification but no luck..
Can some one throw light on this?
Forgot to mention i am using IBM MQ ...
Regards
Rajesh
Edited by: Rajesh on Jul 8, 2010 10:08 AM

Hi Raj,
Thanks for your reply...I am fetching the RFH headers using UDF via Dynamic config only..
Apart from the configurations errors mentioned for alerts(as i am success in this case)...I am testing if there any data related errors like wrong RFH Headers for JMS sender adapter though the channels showing error status in this case ...but its not throwing the alerts...
I want to know whether the alert will be triggered for this or not...if not why ..as it should..
if yes i am unable to get.. what troubleshooting can be done for this...
if you have any other cases (aprt from config issues)for alert trigger...and also apart from RFH headers case..can u pls share..so that i will try the same..
MY only question here is why the adapter not trigering the alerts when wrong RFH Headers are sent along the message..but showing the channel status as red..(is it a bug ?)
Thanks in Advance
Rajesh

Concurrency for JMS Sender Adapter - Async/Sync Bridge

Hi,
We have implemented a number of Async/Sync bridges using JMS Adapters, and are encountering problems scaling the solution.
Async-Sync Bridge Scenario:
JMS Sender Adapter -> Integration Server -> Sync ABAP Proxy (CRM) -> JMS Receiver Adapter
The bridge is using the Adapter Framework modules: RequestResponseBean & ResponseOnewayBean within the Sender Adapter.
The problem is that concurrency of processing seems to be driven from the number of Java Server Cluster Nodes on the Adapter Engine. The JMS sender adapters do not appear to read from the external messaging system (MQ) in a concurrent fashion. They appear to process in a sequential manner per Adapter:
1. Read from request Message Queue (MQ)
2. Send request for processing (IS)
3. Wait response message
4. Receive response message
5. Write response message to Message Queue (MQ)
6. Read from request Message Queue (MQ)
7. Send request for processing (IS)
8. Wait response message
9....
We need to be able to introduce some means of scaling the solution so that mesages can be read from the MQ request message queue in a concurrent manner. Hopefully we can do this without adding more javer server nodes to the Adapter Engine.
We were looking intot he possibility of tuning AS Java properties that control the number of connections to the Messaging System of the Adapter Engine but this has not provided a solution.
Any information on this topic would be much appreciated.
regards
Murray

As far as I know, the only wasy for JMS adapter to do concurrent reads from a queue is by having multiple server nodes. This is document in note 856346, point 6.2
Thanks
KK

JMS sender adapter To File scenario

Hi all,
How the Message picked from the JMS Queue will be converted to XML using JMS Sender adapter. We have the setting "Mapping of Message" set either to Message Payload = JMS Payload or Entire Message = JMS payload. What should be the Message Interface, MT and DT for these kind of setting in JMS adapter.
Thanks in advance.
Amul

The JMS adapter does not convert the message to XML by default. You can use the MessageTransformBean to achieve this.
Check this document:
https://websmp207.sap-ag.de/~sapdownload/011000358700001186732005E/HowToConveModuleJMS.pdf
Regards
Stefan

Content conversion in XI using JMS Sender Adapter.

Hi,
I have scenario where i will get fixed length flat file from MQ and i need to create an IDOC.
The flat file structure is like below.
HEADER001002003 (Occurs once)
DELIVERY0000111112222 (Min - 1 and Max - Unbounded)
Detail33333344444455555 (Min - 1 and Max - Unbounded)
NOTE -- Detail record is sub level record of DELIVERY.
I would like to do content conversion in JMS SENDER ADAPTER.
Did anybody worked on similar scenario?
I would appreciate ,if anybody provides info on how to do it.
Regds,
Jagdish.

Hi
Please have a look at these threads..u get an idea abt the content conversion.
JMS Adapter: Content Conversion
https://forumsn.sdn.sap.com/click.jspa?searchID=2171243&messageID=3319704
JMS Adapter Content Conversion
JMS Content Converrsion
Hope these help you!

Doubts in JMS Sender adapter configuration (SonicMQ JMS Provider)

Hi All,
I am doing a TIBCO--> XI integration using JMS sender adapter. Adapter status is as follows..
"Sender channel. Details: (No detail information set.)".
XML Msg in TIBCO-ems queue which JMS adapter access is as follows.....
<?xml version="1.0" encoding="UTF-8"?>
<ns0:MT_Studdetails xmlns:ns0="http://abc.com/xi101/XSLTmap">
 <Records>
 <student_ID>
 <fname>abc</fname>
 <lname>efg</lname>
 <DOB>11/09/1980</DOB>
 <marks>
 <science>90</science>
 <maths>78</maths>
 <lang>80</lang>
 </marks>
 </student_ID>
 </Records>
</ns0:MT_Studdetails>
My Queries...
what will be the Msg selector entry for my JMS sender Adapter? Is it MT_Studdetails???
My sender adapter is green in RWB Adapter Monitor, but I am not able see my msg in SXMB_MONI. why it is so??
regards,
Raks

Hi,
Did you follow the how-to guide available at SAP Marketplace to deploy the JMS Adapter. If so, i believe the information given in that guide is incomplete.
Once you have installed the JMS Driver, you must deploy the Java libraries on the J2EE server so that the JMS adapter can access the required Java classes at runtime.
If you use MQSeries 53x.xxx, you must enter the following JAR files in aii_af_jmsproviderlib.sda.
com.ibm.mq.jar
com.ibm.mqbind.jar
com.ibm.mqjms.jar
connector.jar (use the JAR file from the J2EE client directory)
and if ur question is, "Where do I get the Java Library from "
The required Java libraries are product-specific and can be obtained from either the product vendor or other providers.
And i guess the 4 jar files should be enough. Just remember to add these 4 jar files to 'provider.xml' file inbetween the <jars>..</jars> tag.
Follow the instructions as per the guide,
https://websmp205.sap-ag.de/~sapdownload/011000358700003994312004E/HowTo_ConfigExtAdapters.pdf
But just remember to have all the 4 jar files in aii_af_jmsproviderlib.sda
Regards,
Abhy

NameNotFoundException in JMS Sender Adapter

Hi,
I am doing JMS to File Scenario.
In the JMS Sender Adapter, I am getting the following error.
Channel error occurred. Detailed error (if any) : com.sap.aii.adapter.jms.api.connector.ConnectorException: Error looking up connection factoryQueueConnectionFactory, for profile: ConnectionProfile of channel: JMS_Senderon node: 215438950 having object id: 8a69f5589d733e01b34a6dd53c6c4acf: javax.naming.NameNotFoundException: QueueConnectionFactory in QueueConnectionFactory not found at com.sap.aii.adapter.jms.core.connector.JndiConnectorImpl.createConnectionFactory(JndiConnectorImpl.java:134)
Can someone let me know why this error is happening and the solution ?
Thanks in advance,
Neena

Hi Neena,
What JMS server are you using?
This seems the parameter settings in JMS sender is incorrect. check this link for vendor specific details
http://help.sap.com/saphelp_nw04/Helpdata/EN/c1/739c4186c2a409e10000000a155106/content.htm
Hope the JMS drivers were installed properly!!!
Regards
Suraj

Format of "JMS Message Destination Parameter" for JMS Sender Adapter

Hi,
I am trying to use the JMS Sender Communication Channel for several Interfaces by using the "JMS Message Destination Parameter". Currently, the Comm.Channel is reading the message and puts it back on the queue with the following error:
Fehler bei der XI-Eingangsverarbeitung für Message am bzw. um 2007-07-25|09:34:12.057+0200. JMS- und XI-Identifikatoren für die Message sind ID:414d512051535749515441302020202046a4e892201c4d04 bzw. 701ec850-3a81-11dc-8176-00306e2c36a3. Der JMS-Adapter führt einen Rollback der Datenbank und der JMS-Sitzungtransaktionen durch. Wird die Sitzung ausgeführt, geht die Message nicht verloren und wird später erneut durchgeführt. Der Ausnahme-Stack-Trace ist java.lang.RuntimeException: MQJMS0003: Destination not understood or no longer valid: UserCreateRequest
at com.ibm.mq.jms.MQDestination.createDestination(MQDestination.java:790)
at com.ibm.mq.jms.MQSession.createDestination(MQSession.java:1092)
at com.ibm.jms.JMSMessage.getJMSDestination(JMSMessage.java:4127)
What is the format I will have to fill this parameter with in order for XI to understand it? I have tried the following so far which did not work:
1. (as in error message above)
Help much appreciated.
KR,
Colin.

One option in BPEL is to have a mid process receive, but this would require you to handle the Correlation of the message with BPEL process instance.
Please refer the following section in SOA Guide for the same.
Using Correlation Sets and Message Aggregation - 11g Release 1 (11.1.1.7)
Please note the example is with File adapter but the same can be achieved for Any Adapter.

Handling large messages with MQ JMS sender adapter

Similar Messages

Maybe you are looking for