Number of records picked by MQ Adapter / JMS Adapter per poll
Hi All,
We have BPEL 10.1.3.3 running on an OC4J instance.
We are using an MQ Adapter to pull messages from an IBM MQ.
When the Queue goes down and comes up all the messages in the Queue are pulled by the Adapter at once and we lose the sequence in which they are arriving.
As each message creates a new instance we are not able to process them in sequence. Is there a work around for this?
Can we restrict the number of records picked per Poll by the MQ Adapter / JMS Adapter?
Thanks in advance
Hi Ben,
There is no standard way to limit the number of files to be processed by the communication channel.
On the Sender File CC, there is a parameter " Maximum File Size" which restricts the files bigger than the specific size, but this is just a prevention not a solution.
If you have a single big size file, then somehow you have to create small sized files out of it.
Thanks,
Pooja Pandey
Similar Messages
-
Restrict SOA JMS Adapter dequeue frequency
Hi,
we are reading messages from third party JMS queues in the BPEL Process using JMS Adapter in the Composite. Sometimes because of more load on the JMS queue ie around 40 records per second we are facing load issues. BPEL is able to read close to 40 records per second from the queue and calls the Oracle Agile 9.3.2 Web services but the Agile web services are not able to handle such heavy load.
We want to throttle the JMS Adapter and limit the number of messages we dequeue.
What properties in JMS Adapter need to configured to control the dequeue rate.
Here is .jca file of the JMS adpater
<adapter-config name="ReadFAQueue" adapter="Jms Adapter" wsdlLocation="ReadFAQueue.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/jms/C3FAQueueCF" UIJmsProvider="THIRDPARTY" adapterRef=""/>
<endpoint-activation portType="Consume_Message_ptt" operation="Consume_Message">
<activation-spec className="oracle.tip.adapter.jms.inbound.JmsConsumeActivationSpec">
<property name="DestinationName" value="zzqmsbw1.queue.bw.fa"/>
<property name="UseMessageListener" value="false"/>
<property name="PayloadType" value="TextMessage"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
Regards,
Sudhakar.MHi All,
Finally I got Answer from SR.
Here is the link which explain frequency set..http://sudhakarsoa.blogspot.com/2011/03/how-to-set-delay-between-jmsaq-quque.html -
Payload level filter JMS Adapter with Queue - not filtering
Hi ,
I have created AQ Queue in my Database, Using JMS Adapter i am able consume and produce the messages. I want a filter condition, which is not happening.
The scenario is i have a field ImportInd in my XSD and i need to pick the message with ImportInd = 1, otherwise the message should lie on the queue.
Please help me in this,
Thanks,
PadminiTrying to give you the counterparts I have in my working example.
In my case the queue is on a separate machine, and the BPEL is deployed on a separate machine. Cross-domain security config needs to be done for these machines to be able to talk.
In weblogic console: where BPEL is running.
under deployment jmsadapter -> Outbound Connections -> jndi name is jms/PRISMQueue -> ConnectionFactoryLocation Property is jms/SoaCF
where queue is configured.
Under JMS Module Connection Factory Name is SoaConnectionFactory which JNDI name is jms/SoaCF
Under JMS Module Queue Name SOAPostActivityStatusQueue which JNDI name is jms.SOAPostActivityStatusQueue
Services>Messaging>JMSModules>MyModule>SOAPostActivityStatusQueue>
JNDI name - jms.SOAPostActivityStatusQueue
Adapter in BPEL/Composite-
Destination - jms.SOAPostActivityStatusQueue
JNDI - jms/PRISMQueue
JCA:
<adapter-config name="PostResponseFromPCService" adapter="JMS Adapter" wsdlLocation="PostResponseFromPCService.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="jms/PRISMQueue" UIJmsProvider="WLSJMS" UIConnectionName="tacoma"/>
<endpoint-activation portType="Consume_Message_ptt" operation="Consume_Message">
<activation-spec className="oracle.tip.adapter.jms.inbound.JmsConsumeActivationSpec">
<property name="PayloadType" value="TextMessage"/>
<property name="UseMessageListener" value="false"/>
<property name="DestinationName" value="jms.SOAPostActivityStatusQueue"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
HTH.
Thanks! -
Hi,
I have different queues at my sender side from which i need to pick the data ,using JMS adapter, so do i need to create seperate communication channel for each queue and thus corresponding sender aggremnet for each communication channel.
Regards,
Kiran.hi,
just like Wojciech said you not only need it
but it will be very helpful
as if you one message type per one queue
you will be able to route it in the XI
if you would have all message in one queue
(with one sender agreement)
if would be much more difficult
Regards,
michal
<a href="/people/michal.krawczyk2/blog/2005/06/28/xipi-faq-frequently-asked-questions"><b>XI / PI FAQ - Frequently Asked Questions</b></a> -
Jms adapter not polling messages from jms topic
Hi
We have a jms adapter configured in BPEL process which need to poll messages from JMS topic.Unfortunately its not polling message from JMS Topic if we add Message Selector and Durable Subscriber properties in jca file.Please find jca file content below
<adapter-config name="SyncCustomerPartyListCDHJMSConsumer" adapter="JMS Adapter" wsdlLocation="oramds:/apps/AIAMetaData/AIAComponents/ApplicationConnectorServiceLibrary/CDH/V1/ProviderABCS/SyncCustomerPartyListCDHProvABCSImpl.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/jms/aia/syncCustomerParty_cf" UIJmsProvider="WLSJMS" UIConnectionName="Dev"/>
<endpoint-activation portType="Consume_Message_ptt" operation="Consume_Message">
<activation-spec className="oracle.tip.adapter.jms.inbound.JmsConsumeActivationSpec">
<!--property name="DurableSubscriber" value="XYZ"/-->
<property name="PayloadType" value="TextMessage"/>
<!--property name="MessageSelector" value="Target in ('XYZ')"/-->
<property name="UseMessageListener" value="true"/>
<property name="DestinationName" value="jms/aia/Topic.jms.COMMON.CustomerParty.PUBLISH"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
If we remove Durable subscriber and message selector properties,its able to poll messages.
Any pointer will help
thanks in advance
BajiAfter changing below property in jca file.JMS adapter is able to poll messages from JMS Topic.
<property name="UseMessageListener" value="false"/>
But if i un comment below line and deploy my code again, it stop pulling the messages from topic.
<property name="DurableSubscriber" value="XYZ"/>
If i bounce the server after above change and deployment ,it will start polling the message.I am not sure why i need to restart my server after adding above property.
Thanks
Baji -
Hi,
I could not find very relevant documentation on this one, so asking the question here.
I am trying to use a JMS Adapter to read from a queue, and use the same interface(wsdl) for a mediator. In this mediator, I am trying to generate events based on the message payload received.
Somehow the Mediator does not read from the queue, but if I invoke the mediator as a service, and push the message, it works absolutely fine. Is that something I am missing?
Thanks in advance,
AbhiTrying to give you the counterparts I have in my working example.
In my case the queue is on a separate machine, and the BPEL is deployed on a separate machine. Cross-domain security config needs to be done for these machines to be able to talk.
In weblogic console: where BPEL is running.
under deployment jmsadapter -> Outbound Connections -> jndi name is jms/PRISMQueue -> ConnectionFactoryLocation Property is jms/SoaCF
where queue is configured.
Under JMS Module Connection Factory Name is SoaConnectionFactory which JNDI name is jms/SoaCF
Under JMS Module Queue Name SOAPostActivityStatusQueue which JNDI name is jms.SOAPostActivityStatusQueue
Services>Messaging>JMSModules>MyModule>SOAPostActivityStatusQueue>
JNDI name - jms.SOAPostActivityStatusQueue
Adapter in BPEL/Composite-
Destination - jms.SOAPostActivityStatusQueue
JNDI - jms/PRISMQueue
JCA:
<adapter-config name="PostResponseFromPCService" adapter="JMS Adapter" wsdlLocation="PostResponseFromPCService.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="jms/PRISMQueue" UIJmsProvider="WLSJMS" UIConnectionName="tacoma"/>
<endpoint-activation portType="Consume_Message_ptt" operation="Consume_Message">
<activation-spec className="oracle.tip.adapter.jms.inbound.JmsConsumeActivationSpec">
<property name="PayloadType" value="TextMessage"/>
<property name="UseMessageListener" value="false"/>
<property name="DestinationName" value="jms.SOAPostActivityStatusQueue"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
HTH.
Thanks! -
Maximum number of records which can be added to custom list
HI,
What is the maximum number of records added to custom list, without increasing the list throttling?
Thanksits two differnt thing you are asking.
1) Max Number of Record MSFT supported is 30,000,000 per library/List
http://technet.microsoft.com/en-us/library/cc262787.aspx#ListLibrary
For List Throttling.
To minimize database contention, SQL Server often uses row-level locking as a strategy to ensure accurate updates without adversely
impacting other users who are accessing other rows.
check this one to understand more about throttling.
http://blogs.msdn.com/b/spses/archive/2013/12/02/sharepoint-2010-2013-list-view-lookup-threshold-uncovered.aspx
Please remember to mark your question as answered &Vote helpful,if this solves/helps your problem. ****************************************************************************************** Thanks -WS MCITP(SharePoint 2010, 2013) Blog: http://wscheema.com/blog -
How to increase the files picked up by File Adaptor per poll interval
Hi,
We have a scenario where in we post 80 files in the source directory and and the file adapter is configured for every 300 sec but i have noticed that the File adaptor is picking up one or two files per poll interval.Can some please suggest how to increase the number of files picked up by File adaptor
Thank You,
NandiniNandini:
Did you mention all the files names in the Adapter channel. One thing you can do is use wild cards and file adapter picks most of them
/people/mickael.huchet/blog/2006/09/18/xipi-how-to-exclude-files-in-a-sender-file-adapter
In case if your files are huge, then I guess file size may cause to process few files during each poll -
JMS Adapter not picking file in PI7.0
Hello,
I am working jms to jms scenario on PI7.0 Service Pack13. file is not able to pick up sendar JMS Channel. I am using WebSphereMQ Transport Protocol. JMS drivers are installed. ports and protocals are correct.
I checked all parameters of JMS Adapter. no mistake in parameters. What is the problem. Please suggest as soon as possible.
Thanks
venkatHi San ,
Please checke the status of JMS communication channel. In Runtime work bench , U will get the adapter monitoring there if any activity happens it shows the event details .
I hope picking the file is initial event so you can get some idea with those event log for Communication channel .
Cheers,
Reddy -
JMS adapter not picking the file
Hello,
I am working jms to jms scenario on PI7.0 Service Pack13. file is not able to pick up sendar JMS Channel. I am using WebSphereMQ Transport Protocol. JMS drivers are installed.
I checked all parameters of JMS Adapter. no mistake in parameters. What is the problem. Please suggest as soon as possible.
ThanksHi,
Whether the Driver file has been mentioned in Provider XML file and check the messages are in the right sender Queue.
Check the Port and Protocol are right one.
Regards
Agasthuri Doss -
Number of files picked up by file adapter
Hi
I have a scenario in which - I have a large number of files at the same time - to be picked up by the file adapter - each file is very small in size - like a token file a few k in size.
If I have - say 1000 files present in the folder meeting the criteria to be picked up , will the comm.channel pick up all of the 1000 - or is there a limit - on the number of files picked up in each polling ? Where is this limit set - in the comm. channel definition or somewhere on the J2EE engine at a much higher level ?
Any correct answers will be instantly rewarded.you need to sizing our XI server
SAP XI sizing guide
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/72e2bb90-0301-0010-e883-c390ad8a975a
Check this -
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/150ac490-0201-0010-0cb3-dee8d5262778
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/72e2bb90-0301-0010-e883-c390ad8a975a -
SOA 10g JMS adapter does not pick up large messages in Oracle AQ
I am using SOA 10g 10.1.3.4 MLR #9. When I enqueue a large JMS message ( of type SYS.AQ$_JMS_TEXT_MESSAGE ) into the AQ from SOA 11g it goes into the TEXT_LOB portion of the USER_DATA column in AQ. In addition to this GROUPID and GROUPSEQ do not seem to get set. When that happens, my JMS adapterfrom SOA 10g does not seem to dequeue the message. But if I enqueue the same message using sql and set the GROUPID and GROUPSEQ my JMS adapter from 10g picks up the clob message.
How do we make the 10g adapter always pick up the large message in TEXT_LOB? I don't have this problem when the message is small because it goes into TEXT_VC field instead of TEXT_LOB field.We are having this problem and have not figured it out yet. We need help. An oracle SR is opened but no progress from Oracle yet. I need to get some traction on this so anyone's help is appreciated. Our suspicion is that the AQ client in the wls 10.3.1 is incorrectly choosing to put the xml payload in TEXT_LOB even though the character size is less than 4000.
Here is a summary of our observations....
Today we did some testing with our old 6.3.1 OSM environment and our new 7.0.2 environment. We tested each against our QA1 environment and then our QA2 environment. Scenrio 1 is our problem. Scenario 2,3,and 4 all behave similar to each other. Why does Scenario 1 behave differently. It is causing AIA a problem when it dequeues the message.
Scenario 1:
We pointed our 7.0.2 OSM/Weblogic 10.3.1/Out of the Box AQ (which is part of our QA1 environment) to send messages to the AIA AQ table in our QA1 environment. The AIA database uses ALT32UTF8 character set. We don't know what character set the 7.0.2 OSM/Weblogic/AQ uses. Wehn we sent messages to the AIA QA1 table we saw that everything under TEXT_LEN 1000 went to TEXT_VC, Over 1000 went to TEXT_LOB. This is causes AIA to throw an exception if the message is over 1000 when it dequeus the message, because it thinks it shoudl look in the TEXT_VC which is null for AIA.
Scenario 2:
We pointed our 7.0.2 OSM/Weblogic 10.3.1/Out of the box AQ (which is part of our QA1 environment) to send messages to the AIA AQ table in our QA2 enviornment. The AIA database uses UTF8 character set. We don't know what character set the 7.0.2 OSM/Weblogic/AQ uses. When we sent messages to the AIA QA2 AQ table we saw that everything under TEXT_LEN 4000 went to TEXT_VC. Over 4000 went to TEXT_LOB. This is fine for us.
Scenario 3:
We pointed our 6.3.1 OSM/Weblogic 9.2.1/Custom AQ Solution (which is part of our QA2 environment) to send messages to the AIA AQ table in our QA2 environment. The AIA database uses UTF8 character set. We don't know what character set the 6.3.1 OSM/Weblogic/AQ uses. When we sent messages to the AIA QA2 AQ table we saw that everything under TEXT_LEN 4000 went to TEXT_VC. Over 4000 went to TEXT_LOB. This is fine for us.
Scenario 4:
We pointed our 6.3.1 OSM/Weblogic 9.2.1/Custom AQ Solution (which is part of our DEVINT1 environment) to send messages to the AIA AQ table in our QA1 enviornment. The AIA database uses ALT32UTF8 character set. We don't know what character set the 6.3.1 OSM/Weblogic/AQ uses. When we sent messages to the AIA QA1 AQ table we saw that everything under TEXT_LEN 4000 went to TEXT_VC. Over 4000 went to TEXT_LOB. This is fine for us. -
Maximum message size JMS adapter can pick
Dear All,
I have query on JMS adapters.
1) I would like to know what is the maximum size message JMS adapter can pick?
2) Is there any option in JMS adapter, to define the maximum size?
You help/guidance will be very much appreciated.
Thanks,
Praveenkumar1) If you see any issues with JMS XI Adapter handling 30MB messages in
Production systems.
If message size beyond 10MB then the message wont come to SXMB_MONI itself.....may be even in CC monitoring there may not be an entry....you mentioned Production Systems.....did you checked in Dev? The behavior wont change from Dev to Prod.
2) If 30MB is huge, what is the maximum permissible message size
greater than 10MB as break point.
10MB itself is the limit...anything above that wont be processed.
Regards,
Abhishek. -
Content conversion in Sender JMS Adapter
Hi,
Scenario is file to IDoc
My source file is ' ; ' separated file coming from MQ via JMS adapter. now I need to convert this to XI.
Source DT looks like
Root
HEADER (Occurance 1)
Field 1
ISOCURCD
TRANKODE
IDENTIFIER
DATO
TIME
DETAIL(Occurance 1 to unbounded)
ISOCURCD
TRANKODE
EFFDATE
COMMDATE
DKKVAL1
USDVAL1
TRAILER(Occurance 1)
ISOCURCD
TRANKODE
TRANCOUNT
According to How to use content conversion in JMS guide from SDN i have configured the content conversion parameters in the module of JMS sender adapter.
In the processing sequence given the module name as localejbs/AF_Modules/MessageTransformBean and module Key as Plain2XML.
And in module configuration
Parameter Name Parameter Value
Transform.Class com.sap.aii.messaging.adapter.Conversion
Transform.ContentType text/xml;charset=utf-8
xml.keyFieldName TRANKODE
xml.keyFieldType CaseSensitiveString
xml.recordsetName Root
xml.documentName MT_ROOT
xml.documentNamespace http://XXX.XXX.XX/xi/XXXXX
xml.processFieldNames fromConfiguration
xml.conversionType StructPlain2XML
xml.recordsetStructure HEADER,1,DETAIL,*,TRAILER,1
xml.HEADER.fieldNames Field1,ISOCURCD,TRANKODE,IDENTIFIER,DATO,TIME
xml.HEADER.fieldSeparator ";"
xml.HEADER.keyFieldValue H
xml.fieldSeparator ";"(if i don't use this then the file is not being picked and getting an error in the CC monitoring of RWB saying xml.field separator missing.)
Similarily for Detail and Trailer records as well.
But when I run the scenario, the file is being picked up but I am not getting any payload into the inbound message.
Can you please help me where I have configured wrongly. And one more thing will this configuration help for ; separated file .
Thanks & Regards,
Kumar
Edited by: Kumar on Dec 19, 2007 11:11 AM
Edited by: Kumar on Dec 19, 2007 11:15 AMHI,
Have you gone through the below pdf i think it will help to find ur mistake.
How to use conversion modules in JMS - https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/f02d12a7-0201-0010-5780-8bfc7d12f891
Thnx
Chiarg -
JMS Adapter - Queue Message Loss
Hi Folks,
I am working on MQ - to - File Scenario, working fine. But some Cases message is fail in SMQ1 & SMQ2, I am not able to re-process that message because of that messages are System Error.
So My Problem was, Once JMS Adapter is pick the Data from MQ, no more data in MQ, some cases message is fail, We can't re-process that message, So i dont want to lose that data.
How can i recover that MQ Data...
Thanks for help,Hi S R,
What is the error detail in SMQ1,SMQ2?
Did you try to reprocess them from execute luws? try to change the status to recorded if possible.then execute again.
thanks
Maybe you are looking for
-
Adobe Bridge Reports Inaccurate File sizes
Im still in CS4 but can't seem to find a forum on CS4. In any case, why does Bridge report inaccurate file sizes? I thought I could use bridge to select all of the M2V files in a folder which I wanted to use in an Encore DVD project to get an accur
-
I would like to get a credit to my account for the 1.99 I have had to spend twice to purchase the Song Pop version that is upgraded. I am sure you can check my account and see that I have purchased it twice.
-
Ipad software updates states 5.1.1 is latest version
I have recently inherited an ipad from a friend and restored if after connecting it to my laptop, using itunes. I have tried to download a few apps but many state that they need IOS 6. I have tried checking for updates via both methods - using itunes
-
I have a bunch of strings that I would like to write to the same file. I want each string to be on a different line. Up to now, all the strings are on the same line. What could I do Thanks for your assistance Alexandre Berchemin-Sirven Sent via Deja.
-
Shocking speed and trouble loading up web pages wi...
last Wednesday my GigE has stopped working so i have to use normal ethernet, since then my internetspeeds have been really slow and i have had problems logging into pages with a https. Sites like my email, forums, bank account etc. I have spoken to