Split Bulk Xml message in to many

Hi,
How to split large xml message in to many xml messages in biztalk 2006. For example if that xml message contain more then 10,000 records then I have split into each 10,000 records. Can anyone help me?
Thanks,

Hi,
There are four methods to get your message debatched:
Receive Port Pipeline Debatching
Orchestration debatching by calling a pipeline.
Orchestration XPath Debatching
Orchestration Atomic Scope Node List Debatching
1)
Receive Port Pipeline Debatching
http://social.technet.microsoft.com/wiki/contents/articles/26005.biztalk-server-debatch-xml-with-envelope.aspx
2)
Orchestration debatching by calling a pipeline.
http://jeremyronk.wordpress.com/2011/10/03/how-to-debatch-into-an-orchestration-with-a-pipeline/
3)
Orchestration XPath Debatching
http://www.digitaldeposit.net/blog/2006/12/message-debatching-inside-biztalk.html
4)
Orchestration Atomic Scope Node List Debatching
http://geekswithblogs.net/sthomas/archive/2005/03/21/26924.aspx
You can check out the performance of each method @
http://geekswithblogs.net/sthomas/archive/2004/12/12/17373.aspx
Rachit
If this answers your question please mark it accordingly. If this post is helpful, please vote as helpful by clicking the upward arrow mark next to my reply.

Similar Messages

How to split big xml-messages with file inbound adapter

Hello,
we have big xml-messages in our filesystem, which are processed by XI 3.0 (SP11). We are using the file inbound adapter. Now we want to split these big xml-message into some smaller messages.
Exist there a corresponding function to the "xml.recordsetsPerMessage" which is working with xml-files?
Thanks!
Regards
Stefan

Hi,
maybe you can split the message in the BPM
with 1:N mapping?
Process Integration (PI) & SOA Middleware
I don't think anythink like "recordsetsPerMessage" is possible for xml messages
Regards,
michal

Split an inbound xml message in to multiple o/b idocs

HI,
We have a requirement to split an XML message(Source) into multiple idocs with different order nos and respective item details. We are working on XI 3.0 and we have a restriction not to use the BPM. Could you please let me know whether its possible to do 1:n mapping in XI 3.0 and how can we do this ?
Thanks,
Hari

Then how you can do that in PI,we should know how many Target IDocs required,then we can import it in to PI.
if you want to genarate same IDoc multiple times then we can do this,like change IDoc occurace to 0 to Unbounded then import as a external def and use it in mapping,logic you have to write in mapping.
Regards,
Raj

Code to split biztalk xml inner node message in to many

Hi,
I want to split inner node message into many. Actually my xml message look like bellow
<MSg>
<Header>
<InterfaceName></InterfaceName>
</Header>
<Detail>
<detail1>1</detail1>
<detail2>2</detail2>
<detail3>3</detail3>
<detail4>4</detail4>
</Detail>
</MSg>
Above message need to be splitted to bellow
<MSg>
<Header>
<InterfaceName></InterfaceName>
</Header>
<Detail>
<detail1>1</detail1>
<detail2>2</detail2>
</Detail>
</MSg>
<MSg>
<Header>
<InterfaceName></InterfaceName>
</Header>
<Detail>
<detail3>3</detail3>
<detail4>4</detail4>
</Detail>
</MSg>
<MSg>
Can anyone help me to give the disassemble code to do it

Hi,
You can write your own Custom Disassemble Pipeline Component
which will break a message into batch of multiple messages. Batch size can be configured at pipeline design time by Implement members of IPersistPropertyBag interface.
The Scenario provided in the below link is exactly the same as your requirement. You just need to do few tweaks to the
code.
http://blogs.msdn.com/b/brajens/archive/2006/12/03/how-to-develop-biztalk-custom-pipeline-components-part2.aspx
Rachit
If this answers your question please mark it accordingly. If this post is helpful, please vote as helpful by clicking the upward arrow mark next to my reply.

XI have to break/split XML-File into N times a XML Message

Hello,
Can anyone help with this one. I guess this is not an easy exercise but I need to solve it urgently.
XI gets a XML-file from a system.
This file has N times a element <XBT>.
Every time XI gets such a file the number of <XBT> is different.
XI haves to break this xml into N xml messages according to element ><XBT> in order to send them to Sap sequentially.
For example the following XML file have to split up into 2 xml files (the elements XBT occurs 2 times)
How can this be done?
<mt_BubaBestand>
<b><XBT></b>
<Algemeen>
     <Verkooporganisatie>5000</Verkooporganisatie>
     <Distributiekanaal>50</Distributiekanaal>
     <Productgroep>50</Productgroep>
     <Ordernummer>123123</Ordernummer>
     <Verkoopgroep/>
     <Documentdatum>20061207</Documentdatum>
     <Medewerker_nr>e60217</Medewerker_nr>
     <Medewerker_naam>Hermans</Medewerker_naam>
     <CRM_nr/>
     <CIFDedicated/>
     <Klantgroep/>
</Algemeen>
<b></XBT></b>
<b><XBT></b>
<Algemeen>
     <Verkooporganisatie>5000</Verkooporganisatie>
     <Distributiekanaal>50</Distributiekanaal>
     <Productgroep>50</Productgroep>
     <Ordernummer>123123</Ordernummer>
     <Verkoopgroep/>
     <Documentdatum>20061207</Documentdatum>
     <Medewerker_nr>e60217</Medewerker_nr>
     <Medewerker_naam>Hermans</Medewerker_naam>
     <CRM_nr/>
     <CIFDedicated/>
     <Klantgroep/>
</Algemeen>
<b></XBT></b>
</mt_BubaBestand>

This is pretty standard procedure if you are posting these messages to R/3. As was pointed out in the weblogs above, when using IDocs you don't need to do any tricky configuration. Just make sure that your XML structure is set correctly (ie: 1 to unbounded, etc) to the limits that you want, and XI will automatically loop the mapping process for each instance of the <XBT> item that it detects in the source message. You mentioned:
<i>For example the following XML file have to split up into 2 xml files (the elements XBT occurs 2 times)</i>
Well, you don't actually split it into two XML files per say, XI just processes the source message straight to multiple IDocs using the IDoc adapter.

Splitting xml message using XSLT

Hi,
I have XML message that I want to split up using XSLT. Following is the structure of the XML message.
<Meters>
<Meter>
<ID>1</ID>
<Type>A</Type>
<Reading ref="1A" />
</Meter>
<Meter>
<ID>2</ID>
<Type>A</Type>
<Reading ref="2A" />
</Meter>
<Meter>
<ID>3</ID>
<Type>B</Type>
<Reading ref="3B" />
</Meter>
<Reading>
<refLink>1A</refLink>
<quantity>Watts</quantity>
<value>221.00</value>
</Reading>
<Reading>
<refLink>2A</refLink>
<quantity>Wh d</quantity>
<value>0.00</value>
</Reading>
<Reading>
<refLink>3B</refLink>
<quantity>Wh r</quantity>
<value>3.00</value>
</Reading>
</Meters>
The split up should happen on the <Meter> tag. Currently, this message has three <Meter> elements. The output should result in 3 different XML messages each having its own <Meter> element. Also, please note that each <Meter> has <Reading> which is linked to the actual <Reading> data using "ref" attribute and "refLink". The value of "ref" attribute will be unique through out the XML message.
Expected output: 1.xml
<Meters>
<Meter>
<ID>1</ID>
<Type>A</Type>
<Reading ref="1A" />
</Meter>
<Reading>
<refLink>1A</refLink>
<quantity>Watts</quantity>
<value>221.00</value>
</Reading>
</Meters>
and similarly 2 more XMLs.
Please let me know if anyone has done this kind of work in XSLT.

You are right I see that xsl:document is in 1.1 recommendation, but was referred by
XSLT books I have.
I found one site that's explaining this
http://www.vbxml.com/xsl/elmxsl_document.asp
http://www.w3.org/TR/xslt11/#multiple-output
I am almost trying now to reverting to using java.util.regex and doing the split
brutforce.. :))))
- Ravi

Testcase, how to split up an xml message and call a BPEL process.

Another question.
Considering the following XML message.
<?xml version="1.0" encoding="UTF-8"?>
<rows>
<row>
<id>10</id>
<naam>A</naam>
</row>
<row>
<id>20</id>
<naam>B</naam>
</row>
</rows>
An input message can consist of 1 to about 20000 <row></row> elements. I would like to split up this message into individual <row></row> and call a BPEL process for further processing.
I've tried to use the file adapters feature "Files contain Multiple Messages" Publish Messages in batches of.." This did not work. ( root element expected exceptions ).
I've also tried to invoke an extra async routing service with a mapping which removes the root element. This also doesn't work as it leaves the following ( incorrect ) xml message at the end.
<row>
<id>10</id>
<naam>A</naam>
</row>
<row>
<id>20</id>
<naam>B</naam>
</row>
Which is logical considering how an XSL transformation works.
Is there any way to achieve this?
Any help is appreciated!

You shoul create a while loop, that loops through XML payload for each row. Than you can process each individual row. See also example:
C:\orabpel\samples\tutorials\112.Arrays\ArraySample.bpel

How to loop through many XML messages and parse them ?

Hi All
I have been trying very hard to loop through many XML messages and process each of them. Let me first explain the problem -
Suppose I have the following String -
<xyz>
<abc>happy</abc>
</xyz>
<xyz>
<abc>new</abc>
<xyz>
<xyz>
<abc>year</abc>
</xyz>
I have to process each message within the <xyz></xyz> tag and find the falue of <abc> element (happy, new and year).
The extraction of <abc> value is very simple, I am using SAX parser's startElement() method to check every element's name and if the element's name is <abc> pick up the value. But I am not able to loop through the different messages within the <xyz></xyz> tag.
I am thinking of using another DOM parser -
DOMParser domParser = new DOMParser();
StringReader rdr = new StringReader(inputXML);
InputSource src = new InputSource(rdr);
domParser.parse(src);
Document doc = domParser.getDocument();
NodeList nodeList = doc.getElementsByTagName("xyz");
Now I can loop through this nodeList, but not able to. Is using the DOM parser and NodeList the preferable way of lopping through the messages, then how I can loop through ? Or is there any other way ?
I have been trying on this for quite a few days, but not able to. Can you please help me out ?
Thanking you in advance ....
Nirmalya Sinha

Hi,
Try using the SAX reader from the dom4j package. The document object that you receive contains methods for getting the root elements and with that you can traverse down to the sub elements of it.
Hope this was of some help.

Attachments in XML message

Hi All,
We are into SRM 7.01 with SUS functionality. We want transfer the PO attachment (both in header and line item) from ECC to SUS and i want to trace whether the attachment has been transferred or available in XML message or not.
So how do I find out that attachment is flowing or not in XML message. How to display data that is being carried by XML message.
Thanks and Regards

Hi,
we can use many adapters with attachments (jpg,pdf)
like mail adapter, receive via file adapter
but soap adapter (so proxies and soap adapter) handle it in an natual way I'd say
Regards,
michal

RE: Validating XML message...

Actually I stand corrected. XML Spy does seem to provide an OLE API to XML
validation ( the isValid method on the IDocument class ) although I haven't
tested it yet.
In my previous post I was thinking of another XML product I tested earlier
in the week which did not.
-----Original Message-----
From: Shaughnessy, Kevin
Sent: Friday, April 20, 2001 08:59
To: 'Rumen Georgiev'
Cc: [email protected]
Subject: RE: Validating XML message...
Rumen,
One idea that is possible is to use an OLE interface to a 3rd party XML
product. This assumes your logic which needs to validate is running on a
Windows box. But if so, it may work. Many products have type libraries which
can be run through OLEGen to create Forte classes. Then you can use TOOL to
talk OLE to that product.
For example, XML Spy 3.5 has a type library from which I created a Forte
project. Unfortunately this product didn't offer any extra features than
Forte's XMLParser ( i.e. the API didn't allow me to validate the XML ) so I
am back to using Forte's parser until I can test another product. If you
find one that does what you want let me know.
I've used OLE a lot with Forte to get functionality from other products (
VISIO, MS Office ) that Forte doesn't provide and it works well. Its a
platform dependent solution but one that may work for you.
Kevin
-----Original Message-----
From: Rumen Georgiev [mailto:[email protected]]
Sent: Friday, April 20, 2001 07:21
To: [email protected]
Cc: [email protected]
Subject: RE: Validating XML message...
Hi Kevin,
From the answers I've got it seems Forte parser is anon-validating one. So we have to look for an external
tool to validate these messages. What I am concerned
about is the integration with Forte.
Thanks for your help!
Rumen
Rumen,
From Tech Note 11811:
"ParserFactory.makeParser() will return a default,
non-validating XML parser."
My experience is that Forte's default XML parser will
not validate but will throw an exception if the XML
document is not well formed. I'm using the DOM
model and this exception happens on the
Document.importDocument( ) method.
If you want anything more than that you'll have to do
it externally.
Kevin-----Original Message-----
From: Rumen Georgiev [mailto:[email protected]]
Sent: Thursday, April 19, 2001 11:49 AM
To: [email protected]
Subject: Validating XML message...
We have to validate inbound XML messages before
processing them. The guys on the other side are
following XMLSchema recommendations to create their
messages using xsd file for validation. We plan to
use XMLParser Forte library and as far as I know it
validates against dtd file (haven't tried yet). If
this is true we have two options:
1. Find a program to convert xsd into dtd file and
use Forte XMLParser for validation.
2. Validate the message beforehand with an external
tool. That means integration between Forte and this
tool.
I would appreciate any help with either approach. Do
you know of a program doing xsd into dtd? Have you
used any existing tool on the market to validate
using XMLSchema? Or may be there is another solution
to
this?
Thank you in advance,
Rumen
=====
Rumen Georgiev
Forte Developer
EXE Technologies
(610) 872-4400 Ext.222
Do You Yahoo!?
Yahoo! Auctions - buy the things you want at great prices
http://auctions.yahoo.com/

Hi,
there is some change in the XMLSPy4.3/XMLType Library 1.2 :
Validation
One common task on documents is to validate them against an assigned schema or DTD. If the XML file has no schema or DTD already assigned, use "Document.AssignSchema" or "Document.AssignDTD" to add the necessary references to the document.
Examples:
objSpy.ActiveDocument.AssignSchema "C:\mySchema.xsd", False
or
objSpy.ActiveDocument.AssignDTD "C:\myDTD.dtd", False
If you want the user to select a schema or DTD, pass True as the second parameter to these functions to display a file-dialog. These methods only put the reference into the document and do not check the existence of the specified file. If the file path is not valid, the validation will fail.
After you have assigned a valid schema or DTD reference to your file, you are able to validate it with "Document.IsValid". IsValid needs some out-parameters that must be declared as VARIANTs to be accessible from script languages like VBScript and JavaScript.

One IDOC to multiple XML messages

Hi! I am using the graphical mapper in XI to map the SHPMNT03 IDOC to an XML message. The IDOC has a shipment node and potentially multiple delivery nodes, for example:
E1EDT20
- E1EDL20
- E1EDL20
- E1EDL20
I need to create one XML message per E1EDL20 node. I figured I could do this in the mapper but when I execute the map for an IDOC with multiple E1EDL20 nodes, I get a 'Cannot cast 2 to boolean' error. The map executes fine when there is a single E1EDL20 in the IDOC.
As always, help is very much appreciated and points awarded.
Thx, Duncan

Hi Duncan,
Can you just check if this is what you have done,
IR
1. Message Mapping -- Occurence of the Destination message type ( file ) is unbounded
2. Interface Mapping -- Occurence of the Destination Interface ( File ) is unbounded
ID
1. No sender communication channel , sender agreement
2. Receiver communcation channel for FIle with appropriate FILE CONSTRUCTION MODE
3. Receiver Determination and Interface Determination with Sender Interface as the IDOC interface and Receiver Interface as the FILE INTERFACE.
I think there is some misunderstanding on this front.
Multimapping will work if you are trying to do an IDOC to FILE with a 1:N split
just check this and let me know if you ve missed something.
Regards,
Bhavesh

SXMB_MONI: No Payload under XML Message\Response

Hi All,
At transaction SXMB_MONI in the left frame you have usually three folders "Inbound Message", "Receiver Grouping" and "Response" under XML Message for the pipeline monitoring.
Under our XI system I miss the folder "Payloads" under folder "Response" above.
So I am not able to monitor the outgoing Payload at SXMB_MONI.
Is there any configuration missing?
Many thanks in advance!
Jochen

Hi Jochen,
You can see the response payload under Response Msg Id = <>
in "Request Message Mapping" under Payload folder
If you are not able to see this, go to sxmb_adm -> Integration Engine Configurarion -> Specific Configureation
add/update the parameter TRACE_LEVEL in categoy RUNTIME to value 3
Regards,
Sreenivas

Triggering and view XML messages in SAP AMI

We have configured the AMI. Also setup the AMI enabled devices.
We have created Meter Reading Orders for the periodic meter reading as bulk .
But the creation of MROs does not trigger creation of XML messages.
We found the Enterprise Service responsible for meter reading order Request Smart Meter Meter Reading Document Creation as Bulk SmartMeterMeterReadingDocumentERPBulkCreateRequest_Out
But the XML messages are not getting generated on MRO creation. Also no XML message generated on AMI enabled device creation. Would like to know where we can view the generated XML and also trouble shoot.
Thanks in advance for the information
Vijay

Hi,
Thanks a lot for the informaiton , I could go into SXMB_MONI with date and time stamp to view the XML message, still i am not able to view it.
Is there any thing specific needs to be configured to have the XML message in SXMB_MONI
The process we are following is we are creating periodic meter reads and using the transaction ELMU Customized to our needs to trigger the SmartMeterMeterReadingDocumentERPBulkCreateRequest_Out . Are we following the right approach.
Can you provide the check points.
thanks,
Vijay
Edited by: vijay gunti on May 26, 2010 8:39 AM
Edited by: vijay gunti on May 26, 2010 8:46 AM
Edited by: vijay gunti on May 26, 2010 8:49 AM

Namespace Element within Outbound XML Message

Hi there,
I am using XI 2.0 and trying to map an IDoc to an XML message to be passed onwards via JMS to a 3rd Party MQ System.
I've created the mapping without too many issues but the 3rd Party says that I need to remove the namespace element tag from my final message as they don't want to see this (It's not in their DTD). Is there any way in XI 2.0 to suppress this part of the XML output so that you only get the main XML definition tag...
i.e. rather than the final message being...
<?xml version="1.0" encoding="UTF-8"?>
<ns0:MessageType xmlns:ns0="namespace">
<first_tag>Data<first_tag/>...
Instead produce...
<?xml version="1.0" encoding="UTF-8"?>
<first_tag>Data<first_tag/>...
Any help would be much appreciated.
Regards,
Gordon

Gordon--
I think I have some good news, and some bad news.
The good news is that you should be able to remove the namespace alias declaration attribute ('xmlns:ns0=...') and namespace qualifiers ('ns0:[tagname]'). You can do this by writing a dispatcher function and adding it to the JMS adapter.
The bad news is that this means you'll have to code the transformation that removes the tags. Dispatchers are essentially the 'user exits' of XI. This transformation can be either Java or XSLT -- XSLT is probably easier for a case like this.
There is a touch of documentation about how to do this in the adapter engine online help (or the 'Adapter Engine' guide for XI 2.0 SR1). See the sections for the JMS adapter for help on installing your dispatcher transformation. See the section "Using the Dispatcher: Example" for a bit of help on using dispatchers.
If you do it in Java, your dispatcher class will have to be accessible in the adapter engine classpath. If you do it in XSLT, I'm not sure where the .xsl file goes -- perhaps in the Adapter Engine working directory?
--Dan King
Capgemini

Sequenced Sending of Inbound XML Messages

We are using ABAP proxies which communicate through XML messages. The current problem that we are facing is that from one INVRPT EDI message, it has to be transformed to two different messages and be sent to the same receiver. The main obstacle is that the first type of message should be processed first before the second type should be sent. If the second message is received by the receiving SAP system, that message will be invalidated and raise an issue at the receiver side.
The current solution we are looking at is for the receiving SAP system to send an acknowledgment message however, as I looked through BPM, it is only capable of having one sending step (we need to send two messages from one outbound message however at different time intervals).
Any idea on how to circumvent the problem? Your help will be greatly appreciated.
Many Thanks and Best Regards,
Rommel Mendoza
SAP XI Consultant
HP GDAS GDPC

Hi Udo,
Basically, a customer sends an EDI ORDERS file via AS2. When XI receives the message, it will transform the message to 2 XML messages, one is for order promotion while the second is the actual order XML. The order promotion XML should be sent first to SAP SNC (Supply Network Collaboration) for it to be processed there. Now, once the promotion is in place in SNC, that is the only time the order XML should be sent. If the order XML comes first before the promotion, the message will be invalidated and SNC will raise an error. We are using XI Adapters and the ABAP proxies are SAP predevelivered content for XI (so that we don't need to configure or recreate the XML structures in XI).

Split Bulk Xml message in to many

Similar Messages

Maybe you are looking for