XML Message Size in PI

Hi Guys,
Can any one please explain me how to see xml message size in PI.
Thanks,
Siva.

Hi,
Please see the below thread, it might be useful to you.
how to check the message size in SXI_Monitor
Regards,
P.Rajesh

Similar Messages

Handling xml message of size more than 100mb in SAP PI 7.1

Dear Experts,
Is it possible for PI to pick-up and process a XML message of size more than 100 MB in PI 7.1 EHP-1?
If yes, can you please let me know how to handle it?
Thank you.

Hi Saravana,
it is not a best practice to more than 100mb..
you can increase below parameters and so that you would be able to process for the best..
u2022     UME Parameters : May be we need to look into the pool size and poolmax wait parameters - UME recommended parameters (like: poolmaxsize=50, poolmaxwait=60000)
u2022     Tuning Parameters: May be we need to look/define the Message Size Limit u201Clike: EO_MSG_SIZE_LIMIT = 0000100u201D under tuning category
u2022     ICM Parameters: May be we need to consider ICM parameters (ex: icm/conn_timeout = 900000. icm/HTTP/max_request_size_KB = 2097152)
Thanks and Regards,
Naveen

Is there any way in the SOA suite to reject XML messages over certain size?

I am working for a client at the moment and we are currently in the system test phase of the first SOA implementation project.
We have a process that is made externally available to third parties via an ESB service which is secured using the OWSM. The problem we are having is that the XML message schema has some elements that are unbounded meaning that potentially the messages could be submitted into our system of an unprocessable size. We have been testing with message of 10Mb which fail and 5Mb which have severe performance problems. We would like to be able to reject messages over a specified limit (3Mb for example) to ensure our service is not detrimentally affected by a single message.
Does anyone know of a way of checking a message size before processing it in either OWSM, ESB or BPEL processes?

I don't know your deployment details, but I would definitely try something easy and straightforward. If there is HTTP transport layer used, my first choice would be Apache HTTP Server.
http://httpd.apache.org/docs/2.0/mod/core.html#limitrequestbody
At least for WebLogic, there is very good Apache plugin.

Read XML message from a CLOB

We are currently receiving XML messages from a business partner that goes
through a transformation/parser first to make sure the xml document was
in MISMO form (Mortgage Industry Standard Message Organization). Then the
document is stored in a clob in a table. The document is stored Without
the tags. We are storing these XML messages into a CLOB datatype for
later processing. I want to read the CLOB and then parse out the
individual fields to store into a table. What is the best way to
accomplish this in PL/SQL? Here is one sample record:
<MORTGAGEDATA>
<APPLICATION LoanPurposeType="OTHER">
<LenderCaseIdentifier>3631681</LenderCaseIdentifier>
<LendersBranchIdentifier>2966448</LendersBranchIdentifier>
</APPLICATION>
<PROPERTY PropertyUsageType="Primary">
<Address1>1335 test</Address1>
<City>las cruces</City>
<State>NM</State>
<PostalCode>88001</PostalCode>
</PROPERTY>
<SUBJECTPROPERTY>
<SubjectPropertyEstimatedValueAmount>69000</SubjectPropertyEstimatedValueAmount>
</SUBJECTPROPERTY>
<BORROWERRECONCILEDLIABILITY LiabilityType="HelocSubjectProperty">
<LiabilityUnpaidBalanceAmount>0</LiabilityUnpaidBalanceAmount>
<LiabilityMonthlyPaymentAmount>0</LiabilityMonthlyPaymentAmount>
</BORROWERRECONCILEDLIABILITY>
<BORROWERRECONCILEDLIABILITY LiabilityType="MortgageLoanSubjectProperty">
<LiabilityUnpaidBalanceAmount>0</LiabilityUnpaidBalanceAmount>
</BORROWERRECONCILEDLIABILITY>
<BORROWER>
<FirstName>scooby</FirstName>
<MiddleName/>
<LastName>doo</LastName>
<NameSuffix/>
<MothersMaidenName>velma</MothersMaidenName>
</BORROWER>
</MORTGAGEDATA>
NOTE: I have tried to use DBMS_XMLQUERY and it comes out like this using a
stored procedure called printclob: When I do this the data is put into
one field called xml_app_msg. The problem is how do I reference the
individual fields like FirstName and so on to store in another table? Can
I apply a stylesheet and if so, how?
Or do I create an object type called xml_app_msg with the fields lastname
and so on?
-- The table is raw_xml_msg_tbl and the field with the stored infomation is
xml_app_msg.
set serveroutput on size 50000
declare
queryCtx DBMS_XMLquery.ctxType;
result CLOB;
begin
queryCtx := DBMS_XMLQuery.newContext('select xml_app_msg from raw_xml_msg_tbl where app_id = :APP_ID');
-- DBMS_XMLQuery.clearBindValue(queryCtx);
DBMS_XMLQuery.setBindValue(queryCtx,'APP_ID','LT1001');
-- get the result..!
result := DBMS_XMLQuery.getXML(queryCtx);
-- Now you can use the result to put it in tables/send as messages..
printClobOut(result);
DBMS_XMLQuery.closeContext(queryCtx); -- you must close the query handle..
end;
OUTPUT:
<?xml version = '1.0'?>
<ROWSET>
<ROW num="1">
<XML_APP_MSG><MORTGAGEDATA>
<BORROWER>
<FirstName>Falls</FirstName>
<MiddleName/>
<LastName>Water</LastName>
<NameSuffix/>
<SSN>123-45-6789</SSN>
</BORROWER>
</MORTGAGEDATA>
</XML_APP_MSG>
</ROW>
</ROWSET>
null

I parse the XML doc into a domdocument and then loop through using xpath.valueof to pull the individual values from the nodes and then build a generic insert. It works quite well with a small number of columns. I'm not sure how it would work with a lot of columns. You can get code examples from Steve Muench's book "Developing Oracle XML Applications".

Few Queries regarding Message Size in XI

Hi ,
I have posted the same question before many times over but did not get a satisfactory reply.
I have many file to idoc scenarioes.
Now the file size is large .It is a CSV or a Tab-delimited file.
IT can grow upto 100 mb.
DEV has 4gb of RAM
QA and PRODUCTION have 16 GB of RAM
INTEL DUAL CORE PROCESSOR ON EACH box.
If I want to send a complete 60-100 mb file I run into "LOCK table overflow"
WE have increased the table size parameter on recieving CRM system.
recordset parameter is set for all interfaces from 500 to 5000.
Since I am not able to send a complete file I am breaking it into chunks and sending as I do not have much choice.
For certain interfaces where I am having large number of fields I am able to send only 2000 records per file for others about 14000 records per file.
In order to take care of errors like "LOCK table overflow " and to automate the process I have scheduled a report 'RSARFCEX".Otherwise I'll end up putting one file at a time and wait for it to get processed (i.e. create idocs with status 64 in the recieving system.) and this takes a long time.
I see here on sdn people are able to send a large file in one go.
Even if I try to split a file using xi ..multimapping..extended interface determination...the works et cetra ...It fails for a file of size 6mb.
That too after increasing the no. of work processes.
Besides tried to follow XI tunning parameters ...but there was no change in status-quo.Finally I am using an abap program in xi which is spillting the file (in a matter of few minutes) so that file adapter can pick it up .
I am surprised by xi system's performance .I am not using BPM .There is content conversion on sender side.
Would the experts on the forum please provide a solution.

Hi deepak
Did you check this weblog
/people/alessandro.guarneri/blog/2006/03/05/managing-bulky-flat-messages-with-sap-xi-tunneling-once-again--updated
and this related thread
XML file size
regards
krishna
Message was edited by:
Krishnamoorthy Ramakrishnan

How and where to get the correct message size in XI ?

Hi,
I need to get the message size in bytes in the following stages in SAP XI. Please help me.
1. Message size after adapter engine
2. Message size before entering the integration engine
3. Message size after transformation/mapping in integration engine
I appreciate your input in this regard.
Regards
Gopal

1. Message size after adapter engine
After adapter engine at receiver side, the message is out of XI and you cannot check the size then. At sender side, after adapter engine would mean inside integration engine. You may check it in sxmb_moni trace or Copy the source of payload in notepad, save it as xml and check the size.
2. Message size before entering the integration engine
That means inside adapter engine. You may use RWB -> Performace Monitoring
3. Message size after transformation/mapping in integration engine
This is as 1st case inside integration engine. Use the same method as in case 1.
Regards,
Prateek

XI pricing / message size

Hi guys!
I understand that XI licensing is based on message throughput, both for inbound and outbound messages and if originator or destination is SAP licensed system, then message is not counted.
What I need is the information about size of the message which SAP measures. Is it original inbound / outbound message size (for example, I'm sending zipped IDoc to XI engine) or it's converted XML message which XI is using for mapping?
Thx in advance,
Ivan

Tim,
On similar lines, any idea on what about Lookup's?
Say I have a JDBC lookup , would that mean licensing costs ?
And if it is a RFC Lookup , no licensing ? If yes, then I am for RFC lookup's and not JDBC anywhere I go from here on. After all I need to help my client reduce his costs
Regards
Bhavesh

Monitor XML-Messages sent by the XIF adapter

Hello to everybody,
I am looking for a possibility to monitor all XML-messages that are sent by the XIF Adapter to external servers. I would like to see the detailed XML messages.
Does there exist anything?
Thanks and regards
Michaela

Hi Michaela
XML messages can be sent to the SAP infrastructure where the XML messages can be mapped in to other XML schemata.CRM business connector communication.IDocs should be used:An IDoc transfer is quicker in comparison to SOAP/XML because the IDoc document contains no metadata information(tags)unlike an XML document ,and therefore ,the size of documents sent down line is substainally smaller in comparison.More information about XIF adapter may be found in the SAPNet vai the alias:crm:ci about the external systems.
Cheers

Average message size

Hi All,
Kindly tell wht can be the Average message size and maximum number of messages per hour that can flow through the XI by taking consderation that of messages only Asyncronous case and considering both Async nd Syncronous scenarios.
and if we assume XML message is 500KB and number of messages 7000 per hour, is ok or not.
Kindly help me out in this regard.
Thanks,
Siva

and if we assume XML message is 500KB and number of messages 7000 per hour, is ok or not.
is 500KB the Total message size or is it just the payload size?....if payload size is 500KB then note that the actual message in XI may be 500 x X.....so your XI/ PI server should be capable to not only handle 500KB messages but also to process the total message size....or it may overload.
We do not have a average message size....and the max limit is defined by your hardware.
Regards,
Abhishek.

XML messages Filter in RBW

Hello
In XI 30, look like very small question about RWB container variables filter...
Simple how to Filter XML error messages in RWB (Alert configure), I couldn't find that answer anywhere... is anyone has idea
We are receiving XML messages in E mail and (To Interface: continair variable) shows value "Acknowledgement" thease messages we don't need to display, so how to Filter it in RWB or some other palce....
Please Advised, at lest little advise
Thanks a lot

Hi,
Sure, I can exaplin this clearly!
Question #1
In (Exchange Infrastructure 3.0 SP20), setup XML messages (Error) and all error messages goes E mail + blackbarry, We receiving of 90% messages for "Acknowledgment" and display result (To Interface: Acknowledgment) so we would like to Filter it thease messages
Question #2
I am another question related same issue
In SXMB_MONI shows list of XML error messages: and its also display under SOAP Header (Error)
<SAP:Stack>No receiver could be determined</SAP:Stack>
I would like to display above line in E mail, but I couldn't found any continair variable or may be it has some other procedure
I am sending Screenshot to see clear view...
http://www.flickr.com/photos/25222280@N03/2701501246/sizes/o/
Thanks for your time... and really appriciated it for fast response
J

Best way to parse XML Message ?

Hi,
I have to implement in PL/SQL an interface which receives for example orders in xml format. Something like this:
<order>
<order_no>4711</order_no>
<order_line>
<skuid>10001</skuid>
<qty>34</qty>
</order_line>
<order_line>
<skuid>10002</skuid>
<qty>35</qty>
</order_line>
</order>
I have to parse this xml and store it into an order_mast and order_detl table.
I'm uncertain which would be the best approach. I read in this document http://www.oracle.com/technology/tech/xml/xdk_sample/xdksample_040602.pdf to do it with an XDK Sax Parser.
According to this document the performance is better when using SAX then DOM for large xml message.
But how "large" is large? In my case the xml message can have theoretically several thousand lines, is this already a performance issue for DOM ?
Are besides the performance any good reason to use DOM instead of SAX ?
Are there in Oracle 10g any even better possiblities to do this ?
I read about some DMBS_XML packages, but do know them really.
I really appreciate any hint or suggestion.
Many Thanks!
Peter

I use the DBMS_XMLDOM package to parse through XML Schemas (about 2Mb in text file terms, thousands of lines (never counted them)) on my desktop, and including all of the processing I do and storing all the information in database tables, the whole lot is processed in about 30 seconds. These are fairly large schemas with lots of included schemas. I imagine it's gonna be a helluva lot faster when we put it on our server, so I don't think DBMS_XMLDOM is a slow way of doing it. Guess the best thing to do is to try different ways and do some performance testing based on your own business requirements i.e. varying size of XML messages and frequency/amount of messages being received.
;)

Design Help (XML Messaging)

I have a situation where a client (c program) that I have no control over needs to send an XML message to a remote server (java program). I'm looking at two options, using SOAP or possibly using JMS (something like Websphere MQ).
Using SOAP I'd have to use SAAJ and not something like Axis, since Axis uses JAX-RPC and the c program wouldn't be able to use this protocol? Or can I use JAX-RPC on the java end and not care about what the c program is using? Does anyone know how this works with synchronous communication?
The reason I'm looking at JMS is that I need to be able to guarantee that no data will be lost. Using something like Websphere MQ I can queue up messages so that if the server goes down the messages get processed when the server comes back up again.
The two most important things for me are reliability and performance. It's likely that the amount and size of the XML messages sent will be large.
So can anyone help me decide what's the best design? Any other options?

The "best" design would be the one that conforms with
the way your unchangeable client actually works.
Setting up something that it couldn't communicate with
wouldn't be "best" in my opinion.They haven't developed it yet. I need to tell them what do to, that is, whether to use SOAP or some JMS based messaging service.

How to log message size ?

Hi,
How can message size be logged in ALSB ? I mean "logged" in a general way, not specifically through a Log Action:
-using a Report Action ?
-using the JMX monitoring API ? In that case, is it possible to add a new statistic "Message Size" to the ressource type SERVICE ?
Thanks in advance.

Message size is not typically provided by service bus and this is an expensive operation. I believe there is an xquery function to determine the size of a variable. You can then save this value either using a pipeline alert, a logging action or a javacallout where you can write your own logging logic. If you use java callout you can also determine the message size from there.
Gregory Haardt
ALSB Prg. Manager
[email protected]

XML Message Body Selector in Automation

Hi,
I'm having some trouble implementing a XML Message Body Selector in an automated task. I'm running OSM 7.2.0.7 in a Unix environment and using Design Studio 7.2.1.
I'm sendind in my request to an external system a request tthe following string: OSM-TaskName-%{CARTRIDGE_VERSION}
<Request>
    <Header>
        <dueDate>20131128</dueDate>
        <application>OSM-MSS_Lookup-1.0.0.0.5</application>
    </Header>
</Request>
The response of MSS is:
<Response>
    <Header>
        <dueDate>20131128</dueDate>
        <application>OSM-MSS_Lookup-1.0.0.0.5</application>
    </Header>
In the selector I've tried different XPath expressions:
Select:
/*[local-name() ='Response']/*[local-name()='Header']/*[local-name()='application']/text()
*[local-name() ='Responset']/*[local-name()='Header']/*[local-name()='application']/text()
//*[local-name() ='Response']/*[local-name()='Header']/*[local-name()='application']/text()
/*[local-name() ='Response']/*[local-name()='Header']/*[local-name()='application']
*[local-name() ='Response']/*[local-name()='Header']/*[local-name()='application']
//*[local-name() ='Response']/*[local-name()='Header']/*[local-name()='application']
/Response/Header/application
/Response/Header/application/text()
Compare: OSM-MSS_Lookup-%{CARTRIDGE_VERSION}
I keep getting the following error in the log file for the differente selectors:
####<Nov 28, 2013 10:34:31 AM CST> <Info> <oms> <hostname> <SOM_ManagedServer_1> <[ACTIVE] ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'
> <sceadmin> <BEA1-49AB960B7AE5258D5CC8> <0710a255d6bbb54d:-1d6ed94c:142960580fb:-8000-0000000000026363> <1385656471431> <BEA-000000> <api.e:
        namespace/version: SOM_Cartridge/1.0.0.0.5
        automator type: taskAutomator
        plugin JNDI name: MSS_Lookup.automatedtask.somprovisioning.MSS_LookupReceiverBean
        plugin class name: oracle.communications.ordermanagement.automation.plugin.XQueryReceiver
        run plugin as: oms-automation   receiver:
                type: external
                JMS source: sky/MSS/Product/WebServiceResponseQueue
                message [property|body] selector: JMS_BEA_SELECT('xpath', '/*[local-name() ='Response']/*[local-name()='Header']/*[local-name()='application']')='OSM-MSS_Lookup-1.0.0.0.5'
####<Nov 28, 2013 10:34:31 AM CST> <Warning> <EJB> <hostname> <SOM_ManagedServer_1> <[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'> <oms-automation> <> <0710a255d6bbb54d:-1d6ed94c:142960580fb:-8000-000000000002650a> <1385656471454> <BEA-010061> <The Message-Driven EJB: MSS_Lookup.automatedtask.somprovisioning.MSS_LookupReceiverBeanMDB is unable to connect to the JMS destination: sky/MSS/Product/WebServiceResponseQueue. The Error was:
javax.jms.InvalidSelectorException: weblogic.messaging.kernel.InvalidExpressionException: Expression : "JMS_BEA_SELECT('xpath', '/*[local-name() ='Response']/*[local-name()='Header']/*[local-name()='application']')='OSM-MSS_Lookup-1.0.0.0.5'"
Nested exception: javax.jms.InvalidSelectorException: weblogic.messaging.kernel.InvalidExpressionException: Expression : "JMS_BEA_SELECT('xpath', '/*[local-name() ='Response']/*[local-name()='Header']/*[local-name()='application']')='OSM-MSS_Lookup-1.0.0.0.5'"
I would appreciate any help or ideas.
Cheers

Hi,
Could you confirm on below:
1 ) Are you using multiple automation plug-in external event receivers in the same automation task ?
2 ) And are you having the default Correlation Message property set to 'JSMCorrelationID' in external event receiver?
If your answer for the first question is No, they i would suggest to use Correlation XML Body as
*[local-name() ='Response']/*[local-name()='Header']/*[local-name()='application']
The value of the field(application) in request must match the value of the field in response, in your case it is matching. And you will be reading this correlation id in response processing xquery.
Regards
Srinivas

Unable to Execute a Report to send PAN XML messages out of SNC

Hi All,
We are unable to Execute a Report /SCA/DM_TIMESERIES_OUT to send Product Activity Notifications in the form of XML messages out of SNC. We have manitained some Planned Reciepts data in SNC and would like to transfer it out to ECC.
Could anyone help in understanding if we have to maintain mandatory settings before executing this report.
Thanks & Regards,
Sadiq

Hi Pravin,
As per the documentation(http://help.sap.com/saphelp_snc70/helpdata/EN/48/6bdb4767a431cbe10000000a42189d/frameset.htm), we have tried both the manual and automatic features to configure the output from SNC in the form of XML messages.
The manual method gave a message "Time series data for selection is empty" and the Automated method could trigger the XML messages on every incoming message from ECC but we are unable to see the Planned Receipts in that XML messages.
Was just wondering if we can see the Planned Receipt info by changing the settings of this report or by using any other simillar report as the PR info is very important for our development.
Thanks & Regards,
Sadiq

XML Message Size in PI

Similar Messages

Maybe you are looking for