Xml data into non-xml database.. solution anyone?

Hi,
My current project requires me to store the client's data on our servers. We're using Oracle9i. Daily, I will download the client's data for that day and load it into our database. My problem is that the data file is not a flat file so I can't use sql*loader to load the data. Instead, the data file is an xml file. What is the best way to load xml data into a non-xml database? Are there any tools similar to sql*Loader that will load xml data into non-xml database? Is it the best solution for the client to give me an XML dump of their data to load into our database, or should I request a flat file? My last resort would be to write some sort of a script to parse the xml data into a flat file, and then run it through sql*loader. Is this the best solution? One thing to note is that these files could be very large.
Thanks in advance.
-PV

I assume that just putting the XML file into an
extremely large VARCHAR field is not what you want.
Instead, you want to extract data elements from the
XML and write them to columns in a table in your
database. Right?Yes. Your assumption is correct.
It sounds like you already have a script that loads a
flat file into your database. In that case I would
write an XSL transformation that converts the client's
XML into a correctly-formatted flat file.Thank you. I'll look into that. Other suggestions are welcome.

Similar Messages

Inserting XML data into and XML template

I have XML data structured according to a schema. I also have a
template structured with the same schema, plus a schema for document formatting. I want to merge the XML data into the Template to produce an output file.
I know I can write a program to use XPath or DOM, but I am sure a generic solution already exists for this. I did not have any luck with google.
Suggestions?
thanks
d1

I have XML data structured according to a schema. I also have a
template structured with the same schema, plus a schema for document formatting. I want to merge the XML data into the Template to produce an output file.
I know I can write a program to use XPath or DOM, but I am sure a generic solution already exists for this. I did not have any luck with google.
Suggestions?
thanks
d1

Load XML data into an Oracle Database

Hi
I would like to know how to load data from XML into an Oracle Database. Thanks

forum has many examples
plz search for your needs
as example
XML DB FAQ
Re: I want insert data from xml file
Re: How to load a XML file into a table using PL/SQL
Process multiple XML files in directory
using DBMS_LOB.LOADCLOBFROMFILE

Loading XML file into non-XML table(s)

HI Gentlemen,
I successfully registered my schema and generated an xml-based table and a TYPE. However, I do not have the table that would correspond to this TYPE. How do I get to it? How can I use FTP or HTTP protocol to load actual data from the corresponding .xml file into this table?
Thanks in advance, kind regards from
Miklos HERBOLY

You need to include the XML schema location information in the XML documents to point to the registered XML schema.
For example,
If you register an XML schema to XML DB with "http://www.example.com/po.xsd"
In the XML document, the xml schema location can be:
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.example.com/po.xsd http://www.example.com/po.xsd">
For more information, you can check the example in the following page:
http://www.oracle.com/technology/sample_code/tech/xml/xmldb/index.html
Best,

Does anyone can help me to import XML string into a ORACLE database

Hi guys!
i have some problem that my friend wants me to convert XML string to Oracle relational database which means.
let's say, there is a table that a row has XML string.
so table has XML string with varchar type.
what my friend want me to do is, the string needs to be solved as a relational database.
like
A table has 'ID', 'data', 'result' rows
and Data column has XML string like <?xml version...............>
then wants to convert that data column's XML data into TABLE B with structure normally XML has.
i'm so confused and have no idea at all.. also i couldn't find any solution related to my stuff..
if someone knows how to solve the problem, just let us know
thx

The database is 10.2.0
What sort of example do u want me to give you..
i thought i give all information on the post..
i will explain it
let's say there are 3 columns ID,Name,Code
Id = normal integer
Name= varchar
Code= varchar
and i need to conver that XML in the Code column into relational databases
the code column has normal XML code which is starting from <?xml version.... and so on
so does it explain?
please help me!

Load xml data into database

Hi,
I need to load the xml data into the relational tables. I was trying to use a DOM parser, but the thing is that i had to hard code the element node values to match the columns in the tables, and in later stage if there is change to the xml i have to change my program and recompile, i want a more flexible solution, where in i can parse the data and load into database without much changes. I do not know how to accomplish this. I have searched on this topic, but could not find a clear solution anywhere. Can anybody suggest a solution to this.
Thanks & regards.

For which database?
With the Oracle database an XML document may be stored in a database with the XML SQL (XSU) utility.
1. Create a table in the database with columns corresponding to the elements in the XML document.
2. With the XSU store the XML document. The attributes in the XML document do not get stored.
3. To store the attributes also, apply an XSLT to the XML document and convert the attributes to elements.

Parsing xml data into oracle database

Oracle ACEs,
We got a requirement that needs to load xml data into oracle db. Is it possible to load xml data into oracle db using built-in package. Is Oracle provides one ?
Our database version is Oracle 9i.
Your help in this regard is highly appreciated.
Many Thanks.

Check this out.
http://download-west.oracle.com/docs/cd/B10501_01/appdev.920/a96612/d_xmlsav.htm#1008593

Best method to load XML data into Oracle

Hi,
I have to load XML data into Oracle tables. I tried using different options and have run into a dead end in each of those. I do not have knowledge of java and hence have restricted myself to PL/SQL solutions. I tried the following options.
1. Using DBMS_XMLSave package : Expects the ROWSET and ROW tags. Connot change format of the incoming XML file (Gives error oracle.xml.sql.OracleXMLSQLException: Start of root element expected).
2. Using the XMLPARSER and XMLDOM PL/SQL APIs : Works fine for small files. Run into memory problems for large files (Gives error java.lang.OutOfMemoryError). Have tried increasing the JAVA_POOL_SIZE but does not work. I am not sure whether I am changing the correct parameter.
I have read that the SAX API does not hog memory resources since it does not build the entire DOM tree structure. But the problem is that it does not have a PL/SQL implementation.
Can anyone PLEASE guide me in the right direction, as to the best way to achieve this through PL/SQL ??? I have not designed the tables so am flexible on using purely relational or object-relational design. Although would prefer to keep a purely relational design. (Had tried used object-relational for 1. and purely relational for 2. above)
The XML files are in the following format, (EXAMINEEs with single DEMOGRAPHIC and multiple TESTs)
<?xml version="1.0"?>
<Root_Element>
<Examinee>
<MACode>A</MACode>
<TestingJID>TN</TestingJID>
<ExamineeID>100001</ExamineeID>
<CreateDate>20020221</CreateDate>
<Demographic>
<InfoDate>20020221</InfoDate>
<FirstTime>1</FirstTime>
<LastName>JANE</LastName>
<FirstName>DOE</FirstName>
<MiddleInitial>C</MiddleInitial>
<LithoNumber>73</LithoNumber>
<StreetAddress>SomeAddress</StreetAddress>
<City>SomeCity</City>
<StateCode>TN</StateCode>
<ZipCode>37000</ZipCode>
<PassStatus>1</PassStatus>
</Demographic>
<Test>
<TestDate>20020221</TestDate>
<TestNbr>1</TestNbr>
<SrlNbr>13773784</SrlNbr>
</Test>
<Test>
<TestDate>20020221</TestDate>
<TestNbr>2</TestNbr>
<SrlNbr>13773784</SrlNbr>
</Test>
</Examinee>
</Root_Element>
Thanks for the help.

Please refer to the XSU(XML SQL Utility) or TransX Utility(for Multi-language Document) if you want to load data in XML format into database.
Both of them require special XML formats, please first refer to the following docs:
http://otn.oracle.com/docs/tech/xml/xdk_java/doc_library/Production9i/doc/java/xsu/xsu_userguide.html
http://otn.oracle.com/docs/tech/xml/xdk_java/doc_library/Production9i/doc/java/transx/readme.html
You can use XSLT to transform your document to the required format.
If you document is large, you can use SAX method to insert data into database. But you need to write the code.
The following sample may be useful:
http://otn.oracle.com/tech/xml/xdk_sample/xdksample_040602i.html

Inserting xml data in a MYSQL database

Hi,
I would like to know how i can insert data from an xml file into a MYSQL database using a java program, I currently have a program which retrieves an xml record and i need to insert the information between the tags into a table in MYSQL..please help me out if anyone knows...i am not very familiar with java...thanks

Hi there Sherkhan,
Im trying to do exactly what ur doing, inserting xml data in to a mySQL database. Any chance u could share the code for this???
Many thanks in advance.

Can't import XML data into my databse-connected PDF form

Hi All
Excellent forum, and thanks for all the revealing insights so far viewed, however one question.I'm using a PDF form to collect info via email in the format of XML datafiles. I also have an identical PDF which has database connectivity and that works fine. It was suggested on this forum that I could then import the XML data into my Database via the DB-connected PDF, in effect a user form and one with DB connectivity. Now, I've checked the data types and they all match, but when I import XML file, it creates a blank record in the database and none of the information is carried through. Please could someone offer guidance on what I'm doing wrong, I've been trying to figure this out for a week now?
Thanks
Steppe

Maybe it's because I'm replying by email, so I'll try the forums directly;
</script>
            </event>
            <assist>
               <toolTip>Click to delete the current record fromthe database</toolTip>
               <speak priority="toolTip"/>
            </assist>
         </field>
         <field name="Decam_Done" y="44.45mm" x="165.1mm" w="28.575mm" h="13.707mm">
            <ui>
               <textEdit>
                  <border>
                     <?templateDesigner StyleID aped3?>
                     <edge stroke="lowered"/>
                  </border>
                  <margin/>
               </textEdit>
            </ui>
            <font typeface="Myriad Pro"/>
            <margin topInset="1mm" bottomInset="1mm" leftInset="1mm" rightInset="1mm"/>
            <para vAlign="middle"/>
            <caption reserve="4.2353mm" placement="top">
               <font typeface="Myriad Pro"/>
               <para vAlign="middle"/>
               <value>
                  <text>Decam_ Done</text>
               </value>
            </caption>
            <border>
               <edge/>
               <corner thickness="0.175mm" join="round" radius="2mm"/>
            </border>
            <bind match="dataRef" ref="$.Decam_Done"/>
            <validate nullTest="error"/>
         </field>
         <?templateDesigner expand 1?></subform>
      <proto/>
      <desc>
         <text name="version">8.2.1.3144.1.471865.466429</text>
      </desc>
      <?templateDesigner expand 1?></subform>
   <?templateDesigner DefaultLanguage FormCalc?>
   <?templateDesigner DefaultRunAt client?>
   <?acrobat JavaScript strictScoping?>
   <?templateDesigner Grid show:0, snap:1, units:0, color:ff8080, origin:(0,0), interval:(125000,125000)?>
   <?templateDesigner FormTargetVersion 26?>
   <?templateDesigner Zoom 75?>
   <?templateDesigner Rulers horizontal:1, vertical:1, guidelines:1, crosshairs:0?>
   <?templateDesigner SaveTaggedPDF 1?>
   <?templateDesigner SavePDFWithEmbedded

How to convert indesign document's data into the xml file

Hi all,
First let me explain what exactly i am trying to do.
just i want to ge all page items data (type,frame etc ) from a document and i want to convert all those data into my xml structure .
now i am able to get page item's data from a document . i dont know how to approach it further
any advise ? how do i approach it?.
Experts Please help!

What are you trying to achieve specifically. Did you look into IDML to see if suits your needs?
Manan Joshi
- Efficient InDesign Solutions -
MetaDesign Solutions
http://metadesignsolutions.com/services/indesign-development.php

Insert XML Data Into An Existing PDF Form

I am working on an application, written with XHTML and JavaScript, and running on AIR, so it is a desktop application.
Users enter data into an XHTML form and upon submission I create an XML file of the data using JavaScript.
At any later time users will be able to open the XML file from the application. I will use JavaScript, again, to read the XML and fill in an XHTML form. But at this point I will provide a button for users to generate a PDF with the data. I would then like to insert the XML data into the appropriate fields of the existing PDF form. I would like to continue to do this from within the AIR application using JavaScript.
Is this possible?
What version of Acrobat would I need as the developer? Professional or Standard or Other or None?
What version of Acrobat would the end users need? Professional or Standard or Other or None?
Can this all be done using only JavaScript and the Acrobat SDK? Does using AIR offer any help (all Adobe products)?
When the end user clicks the generate PDF button would Acrobat have to open? Can this be done without the user seeing Acrobat open? Either way is ok, I would just like the user to see an alert saying that the file has be generated and point them to its location on the local machine. But again, this is not a requirement.
Thanks in advance.
Not asking for source code here, just if its possible. :)
I'll figure out the how.

You have two choices
1) You can use JavaScript in your AIR application to communicate with the JavaScript in the PDF to fill in the form directly. This can all be done inside of your AIR app. This is certainly the best route to go and there is (IIRC) a sample in the AIR SDK.
2) You can create an XFDF file from your XML data and then have Acrobat/Reader open the XFDF file to fill in the data.
Both methods will work with Acrobat and Reader - HOWEVER, Reader users won't be able to save the PDF unless it has been Reader Enabled.
Leonard

How to store the XML data? file or database?

i'm frustrate at it.
If store XML data into files, then when i query any data,how can i search data using relationship as SQL?
But if store XML data into database.How can i transform the xml data to the data table?
Can any one give me an clear example.

XML is perfect for data interchange and readability. However, to make it searchable you should resolve it properly into tables, in accordance of your own choice of model.
1. Investigate the XML files and resolve the model
<Person sex="male">John
<Pet animal="dog">Doggy</Pet>
<Pet animal="cat">Catty</Pet>
</Person>
2. Create the tables in your database, let one or several tables keep the raw xml for retrieval of original xml data.
--- XMLDocument ---
id XML_data
--- Person ---
id XML_Document_id sex name
(foreign key)
--- Pet ---
id Person_id animal name
(foreign key)
3. Resolve data from the xml files and insert it into the database. Do this through your ContentHandler, or from your DOM model.
--- XMLDocument ---
id XML_data
0 <Person>...</Person>
--- Person ---
id XML_Document_id sex name
0 0 male John
--- Pet ---
id Person_id animal name
0 0 dog Doggy
1 0 cat Catty
Gil

Loading XML Data into Relational Table

Hello,
I receive an XML file generated from another tool (on Windows), I am trying to create a Linux shell script that will gather the needed XML file from my Linux database server, then have Oracle use this file to load the XML data into a relational table. This activity & data will be needed on an ongoing basis.
I have tried this two ways. First, I loaded the XML document into the database and tried to extract the data directly from the document, but that is not working. Now I want to try to read the data directly from the file on the server via select, however I am not getting any data returned. In the Select statement below, I am simply trying to query the data to see what is returned for my testing.
Create Table ci_results_table (transactionID Varchar2(100), //transactionID should be PrimaryKey but was getting NULL value errors during insert test, so removed PK
message Varchar2(200),
ci Varchar2(50),
processeddate xmltype,
status Varchar2(50),
sourcefile VarChar2(100));
select x.*
from XMLTable(
     'TSPLoadResults/Results'
     PASSING xmltype(bfilename('CMDB_DEVADHOCRESULTS_DIR','LoadResults-HP_146.results.xml'), nls_charset_id('AL32UTF8'))
     COLUMNS
       transactionID Varchar2(100) PATH 'TransactionID',
       Result XMLType PATH 'Result',
       Message Varchar2(200) PATH 'Message',
       PrimaryKey Varchar2(50) PATH 'PrimaryKey',
       ProcessedDate date PATH 'ProcessedDate',
       Status Varchar2(50) PATH 'Status',
       SourceFile VarChar2(100) PATH 'SourceFileName'
   ) x
Eventually I will need to build on this to limit the data returned to those records where SourceFileName is like 'HPDS%' and insert what is returned in to the ci_results_table. Attached is a sample Results XML file I am trying to load, It is named "ResultsTransformedtoUnix" because I used dos2Unix to convert it to Unix which may be right or wrong. (The output file I send out has to be transformed to DOS format before the other application can read it). Original file (before Unix conversion) named in script is also attached.
Please help. Thank you!

Hi,
I see some wrong things in your query.
1) The obvious one, explaining why you're not getting any data : there's a typo in the XQuery expression, it's "Result" not "Results"
2) ProcessedDate cannot be extracted as a date (at least not directly) since it actually represents a timestamp, use TIMESTAMP WITH TIME ZONE datatype and cast back to DATE in the SELECT clause
3) transactionID is an attribute, it must be accessed with '@' (or 'attribute::' axis)
4) If the file encoding is truly ISO-8859-1 as the prolog suggests, then do not use AL32UTF8 but the corresponding charset name : WE8ISO8859P1
Here's the working query :
select x.transactionID
     , x.Message
     , x.Primarykey
     , cast(x.ProcessedDate as date) ProcessDate
     , x.Status
     , x.SourceFile
from XMLTable(
       '/TSPLoadResults/Result'
       PASSING xmltype(bfilename('XML_DIR','LoadResults-HP_146.results.xml'), nls_charset_id('WE8ISO8859P1'))
       COLUMNS
         transactionID Varchar2(100)            PATH '@transactionID',
         Message       Varchar2(200)            PATH 'Message',
         PrimaryKey    Varchar2(50)             PATH 'PrimaryKey',
         ProcessedDate timestamp with time zone PATH 'ProcessedDate',
         Status        Varchar2(50)             PATH 'Status',
         SourceFile    VarChar2(100)            PATH 'SourceFileName'
     ) x
Using this query directly over the file will only perform decently (for large files) on 11.2.0.4 and onwards.
On prior versions, first load the file in a (temporary) XMLType column with Binary XML storage and SELECT from there.
because I used dos2Unix to convert it to Unix which may be right or wrong.
This conversion shouldn't be necessary.

Loading xml data to a oracle database problem in style sheet

Hi,
I Have one small Problem While loading xml data to a oracle database.
In the XML i have the Columns and Data Like this.
<Data>
<TRAN>
<Type_Trs>A</Type_Trs>
<T1>2</T1>
<T2>3</T2>
</TRAN>
<TRAN>
<Type_Trs>B</Type_Trs>
<T1>2</T1>
<T2>3</T2>
</TRAN>
</Data>
I have TRAN Table having Field Like this.
TRAN(Type_Trs,T1,F)
Note:- The XML Column T2 is Not matching with TRAN Table Column F
I want to fetch T2 data into F column.
When I am fetching the xml data into oracle table only
one row is fetching.
Can You help me
To load the the all the record of XML data into the Oracle Table
What will be my XLS Style Sheet File Please
suggest me.
Regards
MBR
Thnks in Advance

Hi MBR
You would be better posting your question to the general XML forums:
http://forums.oracle.com/forums/category.jspa?categoryID=51
This is purely for XML/BI Publisher where we get the data back out of the db :o)
Tim

Xml data into non-xml database.. solution anyone?

Similar Messages

Maybe you are looking for