Best way to parse XML Message ?

Hi,
I have to implement in PL/SQL an interface which receives for example orders in xml format. Something like this:
<order>
<order_no>4711</order_no>
<order_line>
<skuid>10001</skuid>
<qty>34</qty>
</order_line>
<order_line>
<skuid>10002</skuid>
<qty>35</qty>
</order_line>
</order>
I have to parse this xml and store it into an order_mast and order_detl table.
I'm uncertain which would be the best approach. I read in this document http://www.oracle.com/technology/tech/xml/xdk_sample/xdksample_040602.pdf to do it with an XDK Sax Parser.
According to this document the performance is better when using SAX then DOM for large xml message.
But how "large" is large? In my case the xml message can have theoretically several thousand lines, is this already a performance issue for DOM ?
Are besides the performance any good reason to use DOM instead of SAX ?
Are there in Oracle 10g any even better possiblities to do this ?
I read about some DMBS_XML packages, but do know them really.
I really appreciate any hint or suggestion.
Many Thanks!
Peter

I use the DBMS_XMLDOM package to parse through XML Schemas (about 2Mb in text file terms, thousands of lines (never counted them)) on my desktop, and including all of the processing I do and storing all the information in database tables, the whole lot is processed in about 30 seconds. These are fairly large schemas with lots of included schemas. I imagine it's gonna be a helluva lot faster when we put it on our server, so I don't think DBMS_XMLDOM is a slow way of doing it. Guess the best thing to do is to try different ways and do some performance testing based on your own business requirements i.e. varying size of XML messages and frequency/amount of messages being received.
;)

Similar Messages

SAP PI/PO 7.31 - Single Stack - Best way of handling 'TBDL' messages

Hi All,
I would like to know what is the best way of processing 'TBDL' messages that are shown in 7.31 message monitoring.
One way I know is to resend the messages but if the volume is huge (100k+), is there a strategy to reprocess them automatically by creating a Job? AFAIK, a job only picks NDLV messages for reprocessing.
Please share some information on handling such scenarios.
(PS: I've been through many links with TBDL issue but strategy wise, could not find any concrete responses. One of them suggested cancelling all using SQL command. I would like to know if there are some other ways.)
Thanks,
Abhishek

Hi Abhishek,
1. TBDL message are handled automatically by the system. Is there a specific time frame(or any setting) under which they start getting delivered automatically? Or it waits for resource/thread recovery?
- TBDL is an intermediate message status. Depending on the number of queues/threads for this adapter type, you will also have 5/10 messages in Delivering status. Something is preventing these messages from being delivered and this results in the backlog of messages in TBDL status. Only when the messages in Delivering status are processed will the threads be released and then become available for the messages which are backed up in TBDL.
2. If messages remain in TBDL for a longer time than expected(like 3-4 days), is there a way to resend them? Any job configuration that can do this?
- There is no way to resend TBDL messages. As above, this is an intermediate status. The focus should be on the messages in Delivering status and why these are not reaching their target and thus freeing up the threads for the backlog.
3. I would like to understand what factors on sender/receiver side can cause this to happen? Any supporting/clarifying documents? (1808554 is already analyzed and we are on a higher patch level)
- It is very difficult to answer this. There could be many different factors which could cause this to happen. Receiver system may not be available, network issues, bugs on SAP side etc. It really depends on the individual case. Best practice here would be to ensure any timeout settings are configured for the relevant adapter types. This can help prevent issues.
4. Changing message status at DB level is advisable or not? If yes, then setting them to NDLV and reprocessing using a job is suggested?
We do not advise to make any changes to message status at DB level. This option should only ever be used as an absolute last resort.
Ultimately the best way to get to the bottom of this is capture Java Thread dumps and create a support ticket with SAP.
Regards
Mark

What's the best way to parse a BSTR in TestStand?

I receive a BSTR from an OLE interface; what is the best way to parse this into something understandable? Has anyone written a routing for this?

Hi,
If you are using a OLE interface I think you will be using the Active X Automation adaptor.
TestStand Active X Automation Adaptor automatically converts BSTR when it store the data in a TestStand variable.
Then you should be able to use the regular string functions which are available in TestStand to parse the strings.
Please let me know if you have any more questions.
Regards
Anand Jain

PO 7.4 RESTAdapter issue : Unable to parse XML message payload

Dear experts,
We are implementing the scenario Exposing a function module as Restful service with the PO RESTAdapter that's avaiable in PO 7.4 SP09 as described in the blog written by Ivo:
PI REST Adapter – Exposing a function module as RESTful service
When we test the scenario to processing messages the adapter reports the error message:
Error while sending message to module processor: senderChannel '589b39c9b91c3ae99040d9addc6a818b': Catching exception calling messaging system: Unable to parse XML message payload to extract operation for receiver determinationorg.xml.sax.SAXParseException: Premature end of file.
Anyone an idea or solution direction?
Thanks in advance.
Cheers, Luc

Hi YRV isa,
Issue solved by Ivo Kulms
"Either you use a Dummy Interface in the IFlow for the adapter or you have to specify on the Operation Determination Tab which XI Operation / Interface should be used. The table on the tab allows to specify different interface name depending on the internal variables. In the variable columns add for example the REST operation, by entering "operation", in the expression column "GET" or "POST" or "*" and in the operation/namespace columns the XI operation / interface you want to reference.
The variable "operation" has to be in curly brackets, so that it gets evaluated. So the entry should look like "{operation}" ( or like "{service}" if you want to map the XI operation by REST service name)"
Kind regards, Luc

Which is the best way to parse nested XML

Hello, I am just getting back into using ColdFusion and I am
working on a project that needs to parse some XML.
The XML is generated by a third party document.
I figured out how to grab individual values and such, but I'm
not sure what is the best way to grab a value in relation to where
it is in the XML.
Following is a rather simplified example of the XML
I need to grab the value of 'Rich Text' in relation to the
'ID name' value.
<project>
<CT text>
<Group>
<id name = text1>
<Rich Text>some sample text</Rich
Text>
</id>
</Group>
</CT Text>
<CT text>
<Group>
<Group>
<id name = text1>
<Rich Text>some sample text</Rich
Text>
</id>
</Group>
</Group>
</CT Text>
<CT text>
<id name = text2>
<Rich Text>some more sample text</Rich
Text>
</id>
</CT Text>
</project>
Once parsed, the info I need to output on the page would look
like
text 1
some sample text
text 2
some more sample text
The part that makes this difficult for me is that there may
be 0 'Group' values or there might be a number of them. As such, I
can't just grab the value by listing the tree out, since it changes
depending on the document (there are thousands of these documents
that I need to parse).
From what I have seen in some XML examples, there are a
number of ways to go about doing this, but before I put a lot of
time into any of them, I was wondering what the 'best' way to do
this is.
XSLT? XMLSearch? Structures? Some combination of those or
other functions?
P.S. what little I know of using ColdFusion with XML all
comes from the doc written by Nate Weiss.
I was a bit let down that after spending well over $1,000 for
ColdFusion, Adobe left out the only two books that were worth
printing (the CFML reference guide and the Advanced book). It
wouldn't have bothered me as much if there was something on the
product page listing the manuals that said 'we only actually give
you 2 of the ones listed'.
Best regards
Kevin R.

Hello,
Could someone do me a huge favor and provide some sample code
that would parse/output the above xml so that the output would look
something like the following. . .
text 1 = some sample text
text 2 = some more sample text
The problem I am having is displaying the xmltext for the
RICH TEXT element in relation to the ID element.
The code below will return the value of the RICHTEXT
(incorrectly named in the original XML examples) easily enough, but
I need to have it show which text number it is.
Best regards,
Kevin R.

Best way to position h:message

Hi All,
I'm having real trouble getting my h:message components to display correctly.
I have an h:panelGrid with 2 columns, one for the field label and one for the field inputbox, and I would like to display the h:message directly beneath the invalid inputbox as soon as the request is submitted. Unfortunately, no matter what I try I can't get it to output correctly (at the correct location while keeping the relative position of all the other components).
So, I'm hoping to get some suggestions from all of you on where to position the h:message components? I also tried adding an additional column next to each component, but it didn't resize when displaying the h:message, meaning that the text was squased into this small space.
Thank you,
Ristretto

I use the DBMS_XMLDOM package to parse through XML Schemas (about 2Mb in text file terms, thousands of lines (never counted them)) on my desktop, and including all of the processing I do and storing all the information in database tables, the whole lot is processed in about 30 seconds. These are fairly large schemas with lots of included schemas. I imagine it's gonna be a helluva lot faster when we put it on our server, so I don't think DBMS_XMLDOM is a slow way of doing it. Guess the best thing to do is to try different ways and do some performance testing based on your own business requirements i.e. varying size of XML messages and frequency/amount of messages being received.
;)

What the best way to create XML files from JAVA application?

Hi to all,
I need to edit and to create new filex in format of xml. I know to parse, but what would be the best way to do:
1. - Create new file, create like simle text file, or there is some clases that know to do it in more simple way
2.a - Edit XML file, to take some data and add it to the XML in the place I want to.
2.b - Also Edit, but not to add fields, just update some of them.
Code examples or links to samples woul be welcomed.
Best regards, Nick.

I have tried working with XML directly using the Java classes but this was a pain. I then looked at DOM4J and JDOM and found JDOM easier to use.

Best way to handle XML data

I was hoping someone could tell me if I'm doing something stupid or a much harder way then needed.
I have some data that is stored in an xml file. Probably 150 items (will stay around this number) with less then a dozen attributes per item.
The name of each of these will be loaded into a list on a jsp. When clicking on an item the details will be displayed on the page below it.
Right now my plan is to:
!. read the file in on application startup and store the items in a collection of beans in the session, or maybe at application scope.
2. Then in the jsp use AJAX and pass the items ID to a servlet.
3. The servlet pulls the collection out of session or application scope and find the correct item and sends it back as xml.
4. Then either parse the xml or use JSON to convert it to an object.
5. Populate the fields on the jsp.
I'm just worried that I'm doing something incredibly inefficient or stupid.
With only 150 items would I be better served just loading all the items into a multi dimensional javascript array on loading the page and just get rid of AJAX all together?

Comments are shown below preceeded by *******:
I was hoping someone could tell me if I'm doing something stupid or a much harder way then needed.
**** Yes, I think its much harder than it needs to be.
I have some data that is stored in an xml file. Probably 150 items (will stay around this number) with less then a dozen attributes per item.
****** Normally, such data is stored in a database table (no xml involved). However, you can store them in a file if you want.
****** If you store it in a file, I suggest not using xml. Its an advanced topic. I suggest using a tab delimited file (you can use a text editor to create it).
The name of each of these will be loaded into a list on a jsp. When clicking on an item the details will be displayed on the page below it.
***** ok, so far
Right now my plan is to:
!. read the file in on application startup and store the items in a collection of beans in the session, or maybe at application scope.
****** Your options are:
***** request scope: need to read the file each time the user needs the data. Not efficient.
****** session scope: data lasts as long as user is logged on. Good idea.
****** application scope: data lasts after the user logs off. Bad idea. takes up memory permidently. Must remove it from application scope when last user logs off.
****** Store it in a database: best idea, but takes time to learn.
2. Then in the jsp use AJAX and pass the items ID to a servlet.
****** Dont use AJAX, its an advanced topic. Learn JSP and XHTML first.
3. The servlet pulls the collection out of session or application scope and find the correct item and sends it back as xml.
****** send it back via request.setAttribute() and read it on the JSP via <useBean>. xml is not the way to go.
4. Then either parse the xml or use JSON to convert it to an object.
****** dont use xml.
5. Populate the fields on the jsp.
***** Yes. Note JSP should not contain business logic. Business logic should be done in a servlet. The servlet should put data in request scope
for the JSP to populate itself. The data objects put in request scope should contain just data, no business logic functionality.
I'm just worried that I'm doing something incredibly inefficient or stupid.
***** Best way to learn is to try stuff out and make your next project better than the previous.
With only 150 items would I be better served just loading all the items into a multi dimensional javascript array on loading the page and just get rid of AJAX all together?
******** Javascript is an advanced topic. Its main purpose on the JSP is to handle simple onclick events from html tags and to do some basic client side validation.
***** I believe a book on JSP would be very helpful.

Best way to transfer XML based data

All,
I am looking for the best possible way of transferring XML based data from a server to a web based client.
XML file is generated on server and its size is massive. I am looking for all possible alternatives and possibly the best way.
Could it be AJAX, SOAP, parsing through a servlet, creating value objects?
I appreciate all inputs.
Thanks,
S.

You can make a bootable copy of your system now, but you won't be able to boot from it with the new computer. They are not usually backwards compatible with the OS. But when you first boot into the new system, use SetUp Assistant to migrate the data from the cloned copy. That will work just fine.

Oracle 10.1, Whats the best way to load XML in database?

Hi All,
I am a typical Oracle developer. I know some Java and some XML technologies, but not an expert.
I will be receiving XML files from some system, which will be,
- of reasonable size like 2 to 15 MBs
- of reasonable complexity, like the root element have children, grand-children and great-grand-children, with attributes and all
- Every day it needs to be loaded to Oracle database, in relational format
- we need not update the XML data, only put the XML data in relational table
My questions are,
- With Oracle 10.1, XML DB, what is the best way to load this XML file to relational Oracle tables ?
- What can be the steps in this process ?
- In the documentation, I was lost and was not able to decide anything concrete
- If I write a pure Java program with SAX API and load the data to Oracle database in same program, is it a good idea?
- Is there any pure Oracle based way to do this?
- If I want to avoid using DOM parser, as it will need more JAVA_POOL_SIZE, what can be the way ?
Please help.
Thanks

Many customer solve this problem by registering an XML Schema that corresponds to their XML and then creating relational views over the XML that allow them to access the content in a relational manner. They then use insert as select operations on the relational views to transfer data from the XML into relational tables where necessary. There are a large number of threads in this forum with detailed examples of how this can be done. Most of the customers who have adopted this approach have discovered that this is the least complex approach in terms of code that to be developed / maintained and offeres acceptable performance.

What's the best way to create XML file with a schema from a database table?

Hi,
I want to create an XML file from a database table (which has over 600 columns) using XML schema (.xsd file). I want to know the best way to do this.
The output XML file is NOT a direct data dump from the DB table, there�re some logic around it, such as the XML file has some hierarchy with repeating tags.
I have done this using JAXB by creating Java classes form XML schema, but I don�t want to map 600 DB columns to these Java classes manually, and loop through the record set to create repeating tags.
I know there are few tools around now like MapForce (Altova), how do people do these now?
Thanks,
Chandi

Can you use a schema when we compose XML doc from Database tables?
Actually, I'm using SQL Server (sorry, wrong forum). But, I thought a Java tool would have a solution for me.

Best way of displaying xml from a database column.

I have lots of xml stored as xmltype.
The core data is displayed in a report. If I click on a link in the report I call a popup page which should display the xml.
This xml does occasionally exceed 32K so I can't use a textarea directly.
Whats the best way to display the xml?
I was thinking of maybe a URL region but haven't used these before.
Edited by: Keith Jamieson on Dec 23, 2008 11:38 AM

When I used htp.p I just got the description printed out.
I now have a pl/sql region as follows:
declare
v_clob clob;
BEGIN
for cur in
( SELECT xmltype.getclobval(profile_text_xml) text
from ci_profile
where profile_id='IKM'
LOOP
htp.p('--------------------------------------------------------------------------------------');
htp.plaintext(cur.text);
htp.p('--------------------------------------------------------------------------------------');
END LOOP;
END;
The problem now is that although the xml displays correctly, The bottom of the page is now not interpreted as a web page but rather as plain text.
What I really need is the start of the page to display normally,
the xml to be dispalyed as is,
and then the bottom of the page to be displayed normally again.
The bottom of my page looks like follows:
</PLAINTEXT> -------------------------------------------------------------------------------------- </td> </tr> </table><div class="t1NavigationRegion" id="R3183505456749710" ><table summary="" cellspacing="0" cellpadding="0" border="0" width="100%"><tr><td align="left"></td></tr></table><table id="apex_layout_3183505456749710" class="formlayout" summary="" ><tr><td></td><td colspan="1" rowspan="1" align="left"><input type="hidden" name="p_arg_names" value="3184424442749715" /><input type="hidden" name="p_t02" value="" id="P0_TREE_ROOT" /><a class="eLink" title="Edit" href="javascript:popupURL('f?p=4000:371:3897603899166057::::P371_ID,FB_FLOW_ID,FB_FLOW_PAGE_ID:3184424442749715,111,4');" tabindex="999"><img src="/i/e.gif" alt="Edit" class="eLink" /></a></td></tr> </table> </div></td> <td valign="top">
</td> </tr> </table></td> </tr> </table><table width="100%" cellpadding="0" cellspacing="0" border="0" summary=""> <tr> <td><img src="/i/themes/theme_1/bot_bar_left.png" alt="" /></td> <td class="t1BotbarMiddle"><div id="t1user">ADMIN</div></td> <td class="t1BotbarMiddle"><div id="t1copy"><span class="t1Customize"></span></div></td> <td><img src="/i/themes/theme_1/bot_bar_right.png" alt="" /></td> </tr> </table>
<input type="hidden" name="p_md5_checksum" value="" /></form> <script type="text/javascript">  </script> <script type="text/javascript"> function popupInfo() { w = open("f?p=4000:34:3897603899166057:PAGE:NO:34:F4000_P34_SESSION,F4000_P34_FLOW,F4000_P34_PAGE:3897603899166057,111,4","winLov","Scrollbars=1,resizable=1,width=700,height=450"); if (w.opener == null) w.opener = self; w.focus(); } </script><table cellpadding="0" border="0" cellspacing="0" summary="Developer Toolbar" align="center"><tbody><tr><td><a class="htmldbToolbar" href="f?p=4500:1000:3897603899166057" style="border-left:1px solid black;" title="Application Express Home Page">Home</a></td><td><a class="htmldbToolbar" title="Application 111" href="f?p=4000:1:3897603899166057::NO:1,4150,RP:FB_FLOW_ID,FB_FLOW_PAGE_ID,F4000_P1_FLOW,F4000_P4150_GOTO_PAGE,F4000_P1_PAGE:111,4,111,4,4" style="border-left:1px solid #000000;border-right:1px solid #000000;">Application 111</a></td><td><a class="htmldbToolbar" title="Edit Page 4" href="f?p=4000:4150:3897603899166057::NO:1,4150:FB_FLOW_ID,FB_FLOW_PAGE_ID,F4000_P1_FLOW,F4000_P4150_GOTO_PAGE,F4000_P1_PAGE:111,4,111,4,4">Edit Page 4</a></td><td><a class="htmldbToolbar" href="f?p=4000:336:3897603899166057::::FB_FLOW_ID,FB_FLOW_PAGE_ID,F4000_P1_FLOW,F4000_P4150_GOTO_PAGE,F4000_P1_PAGE:111,4,111,4,4" style="border-left:1px solid black;" title="Create">Create</a></td><td><a class="htmldbToolbar" href="javascript:popupInfo()" style="border-left:1px solid black;" title="Session">Session</a></td><td><a class="htmldbToolbar" href="f?p=4000:14:3897603899166057::::FB_FLOW_ID,FB_FLOW_PAGE_ID,F4000_P1_FLOW,F4000_P4150_GOTO_PAGE,F4000_P1_PAGE:111,4,111,4,4" style="border-left:1px solid black;" title="Activity">Activity</a></td><td><a class="htmldbToolbar" title="Debug" style="border-left:1px solid black;" href="f?p=111:4:3897603899166057::YES">Debug</a></td><td id="hideEdit" style="display:none;"><a class="htmldbToolbar" title="Hide Edit Links" href="javascript:quickLinks('HIDE');" style="border-right:1px solid #000000;border-left:1px solid black;">Hide Edit Links</a></td><td id="showEdit"><a class="htmldbToolbar" title="Show Edit Links" href="javascript:quickLinks('SHOW');" style="border-right:1px solid #000000;border-left:1px solid #000000;">Show Edit Links</a></td></tr></tbody></table> <script type="text/javascript"> if(GetCookie('ORA_WWV_QUICK_EDIT') != null){ if(GetCookie('ORA_WWV_QUICK_EDIT') == 'SHOW') quickLinks('SHOW'); } </script> </body> </html>
Edited by: Keith Jamieson on Jan 2, 2009 2:28 PM

Best way to extract XML data to DB

Hello,
In our work we need to extract data from XML documents into a database. Here are some extra notes:
+ There is no constant schema for the XML documents.
+ Some processing on the XML files is required.
+ The XML documents are very big.
+ The database is Oracle 8i or 9i (Enterprise Edition both) and our framework is NET.
Our questions are:
1. What is the best way to extract the data into the database under the above circumstances ?
2. In case there was a constant schema for the XML documents, would there be a better way ?
3. Is writing the data to text files first, and then loading it via SQL-Loader is an effective way ?
Any thoughts would be welcome. Thanks.

Hi Nicolas,
The answer depends on your actual storage method (binary, OR, CLOB?), and db version.
You can try XMLTable, it might be better in this case :
SELECT x.elem1, x.elem2, ... , x.elem20
FROM your_table t
   , XMLTable(
      '/an/xpath/to/extract'
      passing t.myxmltype
      columns elem1 varchar2(30) path 'elem1'
            , elem2 varchar2(30) path 'elem2'
            , elem20 varchar2(30) path 'elem20'
     ) x
;

Need to Parse XML Message from my Message Driven Bean

Hi
I am using Message Driven Beans for listening to a Queue .
I am getting a Big XML file from my Queue in form of a TextMessage .
Now my task is to read / parse the XML Message .
Please tell me what is the appropiate parsing technique i need to use (Should i use SAX or DOM )
Please share your ideas .
Thank you .

Generally you want to use SAX if the file is so big that loading it all in memory (as DOM does) will create memory problems.
Read about these methods on the wiki page for [JAXP.|http://en.wikipedia.org/wiki/Java_API_for_XML_Processing]

Best way to extract XML value wiith an xpath

Hello,
I wonder what is the best way to extract text value from XmlType with an xpath.
I need to insert a row inside a table where the row's data come from xpath extractions of an XmlType. I do a lot of (approximative 20) :
EXTRACTVALUE(var.myxmltype , '/an/xpath/to/extract/elem1').
EXTRACTVALUE(var.myxmltype , '/an/xpath/to/extract/elemI').
EXTRACTVALUE(var.myxmltype , '/an/xpath/to/extract/elem20').
inside the insert statement
Is this way is the best or is there a more optimal way ?
For example extracting the node '/an/xpath/to/extract/' and sarting from this node extracting "elem1", ... , "elemI", "elemN" children.
Thanks for your help,
Regards,
Nicolas

Hi Nicolas,
The answer depends on your actual storage method (binary, OR, CLOB?), and db version.
You can try XMLTable, it might be better in this case :
SELECT x.elem1, x.elem2, ... , x.elem20
FROM your_table t
   , XMLTable(
      '/an/xpath/to/extract'
      passing t.myxmltype
      columns elem1 varchar2(30) path 'elem1'
            , elem2 varchar2(30) path 'elem2'
            , elem20 varchar2(30) path 'elem20'
     ) x
;

Best way to parse XML Message ?

Similar Messages

Maybe you are looking for