Helped, how to load xml data into database

Hi,
Given a DTD, can the XML SQL Utility generate
the database schema?
I currently have the dtd file to define
the data type and xml data and I am looking
for ways of how the XML/DTD can be loaded
into the oracle db.
Any suggestions/recommendations are
appreciated.
Thanks,
Judy
null

You could check out this web site:
http://www.rpbourret.com/xml/XMLAndDatabases.htm#software
where you can find a list of products that can translate a DTD to a relational schema. Also, there are several technical papers that discuss algorithms to carry out this translation. FYI, We have implemented a similar system,and testing it out.
null

Similar Messages

Load xml data into database

Hi,
I need to load the xml data into the relational tables. I was trying to use a DOM parser, but the thing is that i had to hard code the element node values to match the columns in the tables, and in later stage if there is change to the xml i have to change my program and recompile, i want a more flexible solution, where in i can parse the data and load into database without much changes. I do not know how to accomplish this. I have searched on this topic, but could not find a clear solution anywhere. Can anybody suggest a solution to this.
Thanks & regards.

For which database?
With the Oracle database an XML document may be stored in a database with the XML SQL (XSU) utility.
1. Create a table in the database with columns corresponding to the elements in the XML document.
2. With the XSU store the XML document. The attributes in the XML document do not get stored.
3. To store the attributes also, apply an XSLT to the XML document and convert the attributes to elements.

How to load xml data into a database table....

Hi All,
Iam new to this forum.I have an xmldoc table of xmltype(datatype).Iam able to insert xml data to it.I have another table called new_books.sql:
CREATE TABLE NEW_BOOKS
TITLE          VARCHAR2(255) NOT NULL,
LINK          VARCHAR2(80) NULL,
PUBLISHER     VARCHAR2(255) NULL,
SUBJECT     VARCHAR2(80) NULL,
PUBDATE     VARCHAR2(40) NULL,
DESCRIPTION     VARCHAR2(4000) NULL,
AUTHOR     VARCHAR2(80) NULL,
PRIMARY      KEY(TITLE)
Now i want to copy the data in the xmldoc table into the table new_books.sql.Is there any procedure to do that in PL/SQL?
Given below is the xmlfile:
- <rdf>
- <item>
<title>Enterprise SOA: Designing IT for Business Innovation</title>
<link>http://safari.oreilly.com/0596102380?a=102682</link>
<publisher>O'Reilly</publisher>
<creator>Thomas Mattern</creator>
<creator>Dan Woods</creator>
<subject>IT Infrastructure</subject>
<date>April 2006</date>
</item>
</rdf>
Thanks in Advance,
Gita.

Assuming the table xmldoc(of xmltype) has this XML
SQL> select * from xmldoc;
SYS_NC_ROWINFO$
<rdf>
<item>
<title>Enterprise SOA: Designing IT for Business Innovation</title>
<link>http://safari.oreilly.com/0596102380?a=102682</link>
<publisher>O'Reilly</publisher>
<creator>Thomas Mattern</creator>
<creator>Dan Woods</creator>
<subject>IT Infrastructure</subject>
<date>April 2006</date>
</item>
</rdf>
SQL> INSERT INTO NEW_BOOKS(TITLE, LINK, PUBLISHER, SUBJECT)
2 select extractvalue(value(x),'/rdf/item/title') as title,
3 extractvalue(value(x),'/rdf/item/link') as link,
4 extractvalue(value(x),'/rdf/item/publisher') as publisher,
5 extractvalue(value(x),'/rdf/item/subject') as subject
6 from xmldoc x
7 ;
1 row created.

How to load xml data into a table

Hi,
i am a newbie. I want to insert the data of xml file into a table. I am doing this using XSU api for java.
I am using oracle 9i and jdk 1.7.
I am using OracleXmlSave class.
but i am getting following error.
java.lang.NoClassDefFoundError: oracle/jdbc2/Clob
Please help in this regard. this is my first thread.
thanks.
Edited by: 979682 on Jan 3, 2013 3:39 AM

Hi,
You can insert XML data from XML file to Oracle database by this script :
Hi,
For reading and inserting the data from XML file to Oracle Database :
1. CREATE A BLANK TABLE with same structure as XML file :
select * from xml_test
2. SELECT QUERY DIRECTLY ON XML FILE :
SELECT XMLTYPE(bfilename('TEST_DIR', 'data_file.xml'), nls_charset_id('UTF8')) xml_data FROM dual
3. CREATE ORACLE DIRECTORY AND PLACE XML FILE IN THIS DIRECTORY LOCATION:
--CREATE DIRECTORY TEST_DIR as '/oracle/test';
--grant all on directory TEST_DIR to public;
4. INSERT THE XML DATA IN ORACLE TABLE:
INSERT INTO xml_test(column1,coumn2)
WITH t AS (SELECT XMLTYPE(bfilename('TEST_DIR', 'attachment.xml'), nls_charset_id('UTF8')) xml_col FROM dual)
SELECT
extractValue(value(x),'/ROW/COLUMN1') column1
,extractValue(value(x),'ROW/COLUMN2') column2
FROM t,TABLE(XMLSequence(extract(t.xml_col,'/ROWSET/ROW'))) x;
I have assumed a table with 2 columns.
Regards,
Rohit Chaudhari
[email protected]

Best method to load XML data into Oracle

Hi,
I have to load XML data into Oracle tables. I tried using different options and have run into a dead end in each of those. I do not have knowledge of java and hence have restricted myself to PL/SQL solutions. I tried the following options.
1. Using DBMS_XMLSave package : Expects the ROWSET and ROW tags. Connot change format of the incoming XML file (Gives error oracle.xml.sql.OracleXMLSQLException: Start of root element expected).
2. Using the XMLPARSER and XMLDOM PL/SQL APIs : Works fine for small files. Run into memory problems for large files (Gives error java.lang.OutOfMemoryError). Have tried increasing the JAVA_POOL_SIZE but does not work. I am not sure whether I am changing the correct parameter.
I have read that the SAX API does not hog memory resources since it does not build the entire DOM tree structure. But the problem is that it does not have a PL/SQL implementation.
Can anyone PLEASE guide me in the right direction, as to the best way to achieve this through PL/SQL ??? I have not designed the tables so am flexible on using purely relational or object-relational design. Although would prefer to keep a purely relational design. (Had tried used object-relational for 1. and purely relational for 2. above)
The XML files are in the following format, (EXAMINEEs with single DEMOGRAPHIC and multiple TESTs)
<?xml version="1.0"?>
<Root_Element>
<Examinee>
<MACode>A</MACode>
<TestingJID>TN</TestingJID>
<ExamineeID>100001</ExamineeID>
<CreateDate>20020221</CreateDate>
<Demographic>
<InfoDate>20020221</InfoDate>
<FirstTime>1</FirstTime>
<LastName>JANE</LastName>
<FirstName>DOE</FirstName>
<MiddleInitial>C</MiddleInitial>
<LithoNumber>73</LithoNumber>
<StreetAddress>SomeAddress</StreetAddress>
<City>SomeCity</City>
<StateCode>TN</StateCode>
<ZipCode>37000</ZipCode>
<PassStatus>1</PassStatus>
</Demographic>
<Test>
<TestDate>20020221</TestDate>
<TestNbr>1</TestNbr>
<SrlNbr>13773784</SrlNbr>
</Test>
<Test>
<TestDate>20020221</TestDate>
<TestNbr>2</TestNbr>
<SrlNbr>13773784</SrlNbr>
</Test>
</Examinee>
</Root_Element>
Thanks for the help.

Please refer to the XSU(XML SQL Utility) or TransX Utility(for Multi-language Document) if you want to load data in XML format into database.
Both of them require special XML formats, please first refer to the following docs:
http://otn.oracle.com/docs/tech/xml/xdk_java/doc_library/Production9i/doc/java/xsu/xsu_userguide.html
http://otn.oracle.com/docs/tech/xml/xdk_java/doc_library/Production9i/doc/java/transx/readme.html
You can use XSLT to transform your document to the required format.
If you document is large, you can use SAX method to insert data into database. But you need to write the code.
The following sample may be useful:
http://otn.oracle.com/tech/xml/xdk_sample/xdksample_040602i.html

Option to load XML data into BI 70

Hi All,
I have read some postings on forums and also have read the "HOW TO load XML data in BW" guide. I am confused when I read the SAP online help documentation for loading XML data .
Question : Out of the 3 options listed below which option is best suited for loading XML data into BW . XML file is going to be provided by 3rd party company ?
Thanks and appreciate any input .
Smith .
Here is what I found for BI 70 EHP1 help :
http://help.sap.com/saphelp_nw04s/helpdata/en/b2/e50138fede083de10000009b38f8cf/frameset.htm
Data is generally transferred into SAP BW by means of a data request, which is sent from SAP BW to the source system (pull from the scheduler). You can also send the data to SAP BW from outside the system. This is a data push into SAP BW.
A data push is possible for various scenarios:
●     Transferring Data Using the SOAP Service SAP Web AS
●     Transferring Data Using Web Services
●     Transferring Data Using SAP XI
In all three scenarios, data transfer takes place using transfer mechanisms that are sufficient for Simple Object Access Protocol (SOAP); the data transfer is also XML-based.
The SOAP-based transfer of data is only possible for flat structures. You cannot transfer hierarchy data.

Hi,
I feel you can go with 2nd option. But still wait for some more inputs from Experts........
Regards,
Suman

How to store xml data into file in xml format through java program?

HI Friends,
Please let me know
How to store xml data into file in xml format through java program?
thanks......
can discuss further at messenger.....
Avanish Kumar Singh
Software Engineer,
Samsung India Development Center,
Bangalore--560001.
[email protected]

Hi i need to write the data from an XML file to a Microsoft SQL SErver database!
i got a piece of code from the net which allows me to parse th file:
import java.io.IOException;
import org.xml.sax.*;
import org.xml.sax.helpers.*;
import org.apache.xerces.parsers.SAXParser;
import java.lang.*;
public class MySaxParser extends DefaultHandler
private static int INDENT = 4;
private static String attList = "";
public static void main(String[] argv)
if (argv.length != 1)
System.out.println("Usage: java MySaxParser [URI]");
System.exit(0);
String uri = argv[0];
try
XMLReader parser = XMLReaderFactory.createXMLReader("org.apache.xerces.parsers.SAXParser");
MySaxParser MySaxParserInstance = new MySaxParser();
parser.setContentHandler(MySaxParserInstance);
parser.parse(uri);
catch(IOException ioe)
ioe.printStackTrace();
catch(SAXException saxe)
saxe.printStackTrace();
private int idx = 0;
public void characters(char[] ch, int start, int length)
throws SAXException
String s = new String(ch, start, length);
if (ch[0] == '\n')
return;
System.out.println(getIndent() + " Value: " + s);
public void endDocument() throws SAXException
idx -= INDENT;
public void endElement(String uri, String localName, String qName) throws SAXException
if (!attList.equals(""))
System.out.println(getIndent() + " Attributes: " + attList);
attList = "";
System.out.println(getIndent() + "end document");
idx -= INDENT;
public void startDocument() throws SAXException
idx += INDENT;
public void startElement(String uri,
String localName,
String qName,
Attributes attributes) throws SAXException
idx += INDENT;
System.out.println('\n' + getIndent() + "start element: " + localName);
if (localName.compareTo("Machine") == 0)
System.out.println("YES");
if (attributes.getLength() > 0)
idx += INDENT;
for (int i = 0; i < attributes.getLength(); i++)
attList = attList + attributes.getLocalName(i) + " = " + attributes.getValue(i);
if (i < (attributes.getLength() - 1))
attList = attList + ", ";
idx-= INDENT;
private String getIndent()
StringBuffer sb = new StringBuffer();
for (int i = 0; i < idx; i++)
sb.append(" ");
return sb.toString();
}// END PRGM
Now , am not a very good Java DEv. and i need to find a soln. to this prob within 1 week.
The next step is to write the data to the DB.
Am sending an example of my file:
<Start>
<Machine>
<Hostname> IPCServer </Hostname>
<HostID> 80c04499 </HostID>
<MachineType> sun4u [ID 466748 kern.info] Sun Ultra 5/10 UPA/PCI (UltraSPARC-IIi 360MHz) </MachineType>
<CPU> UltraSPARC-IIi at 360 MHz </CPU>
<Memory> RAM : 512 MB </Memory>
<HostAdapter>
<HA> kern.info] </HA>
</HostAdapter>
<Harddisks>
<HD>
<HD1> c0t0d0 ctrl kern.info] target 0 lun 0 </HD1>
<HD2> ST38420A 8.2 GB </HD2>
</HD>
</Harddisks>
<GraphicCard> m64B : PCI PGX 8-bit +Accel. </GraphicCard>
<NetworkType> hme0 : Fast-Ethernet </NetworkType>
<EthernetAddress> 09:00:30:C1:34:90 </EthernetAddress>
<IPAddress> 149.51.23.140 </IPAddress>
</Machine>
</Start>
Note that i can have more than 1 machines (meaning that i have to loop thru the file to be able to write to the DB)
Cal u tellme what to do!
Even better- do u have a piece of code that will help me understand and implement the database writing portion?
I badly need help here.
THANX

Step- by- Step on How to Load Excel data into Crystal Reports?

Hi Friends,
Can anyone send me a Step- by- Step on How to Load Excel data into Crystal Reports? Pls help me. Thanks in Advance.
Vijay

It's also important to 'prep' the excel file prior to connecting to it.
Give the data tab a meaningful name
Make sure the column headers are unique and that every column has a header
Delete any blank tabs
If you have trouble with Excel changing the data type of a field (say, a social security number you want to be a string value rather than a number so you don't lose leading zero) an alternative would be to save the spreadsheet file as a CSV, create a schema.ini to specify the data types for each column (example below) and use the same steps to connect except instead of choosing Excel 8.0, scroll to the bottom and choose Text. You have to make sure the CSV file is in the same folder as the schema.ini file that defines the columns.
Schema.ini example:
200912PUSD.csv
ColNameHeader=True
Format=CSVDelimited
MaxScanRows=25
CharacterSet=OEM
Col1=SSN Char Width 9
Col2=LAST_NM Char Width 25
Col3=FIRST_NM Char Width 25
Col4=DOB Date
Col5=STDNT_ID Char Width 10
Col6=SORTKEY Char Width 10
Col7=SCHOOL_NM Char Width 30
Col8=OTHER_ID Integer
Col9=GRADE Char Width 2
The filename in the first line needs to have the [] brackets around it, but I couldn't get it to display in this forum correctly.
Edited by: Eric Petersen on Jan 27, 2010 9:40 AM

How to load image data into cube?? Is it possible??

How to load image data into cube?? Is it possible??
Any sugession??

Hi Andre,
Document will be of ASCII characters right?? but image data will be in binary format. as per database concept it is stored as binary large object. But in datawarehousing the back end is also going to be some database such as Oracle or other DBs.
which can take blob's. so it would be possible to store the binary data.
If any one has faced this situation can reply.to this ques.
can post the step to load image(jpg/bmp or any image format) data in to info cube??
hi andre if u have done loading image data as you say.pls reply me if you have the steps with you.
thanks Andre

Loading XML files into Database table

Loading XML files into Database table
Hi I have some XML files say 100 files in a virtual directory created using "Create or replace directory command" and those files need to be loaded into a table having a column of XMLTYPE. 1)How to load that using Oracle provided procedures/packages

Check out the Oracle XDB Developer's Guide, Chapter 3. There is an example of using BFileName function to load the xml files from a directory object created using create or replace directory. It works really well.
Ben

How to load oracle data into SQL SERVER 2000?

how to load oracle data into SQL SERVER 2000.
IS THERE ANY UTILITY AVAILABLE?

Not a concern for an Oracle forum.
Als no need for SHOUTING.
Conventional solutions are
- dump the data to a csv file and load it in Mickeysoft SQL server
- use Oracle Heterogeneous services
- use Mickeysoft DTS
Whatever you prefer.
Sybrand Bakker
Senior Oracle DBA

How to maintain the data into database table

Hi,
experts,
how to maintain the data into database table

There are several ways to maintain data in the database
1. Use table maintanance generator . You can create this using SE11 and data can be edited through SM30.
2. Loginto SE11 with the specified table and check the ATTRIBUTES tab. There you can set some parameters for maintaining the database. When you set Maintain database, you edit the data thorugh SE11 it self
3. Through Se16 as well.
4. A small abap program can do the above task as well.
Thanks,
Raj
Edited by: Rajanya Kolavennu on Feb 5, 2008 8:33 PM

How to insert large xml data into database tables.

Hi all,
iam new to xml. i want to insert data in xml file to my database tables.but the xml file size is very large. performance is also one of the issue. can anybody please tell me the procedure to take xml file from the server and insert into my database tables.
Thanks in advance

Unfortunately posting very generic questions like this in the forum tends not to be very productive for you, me or the other people who read the forum. It really helps everyone if you take a little time to review existing posts and their answers before starting new threads which replicate subjects that have already been discussed extensively in previous threads. This allows you to ask more sensible questions (eg, I'm using this approach and encountering this problem) rather than extremely generic questions that you can answer yourself by spending a little time reviewing existings posts or using the forum's search feature.
Also in future your might want to try being a little more specific before posting questions
Eg Define "very large". I know of customers who thing very large is 100K, and customers who think 4G is medium. I cannot tell from your post what size your files are.
What is the content of the file. Is it going to be loaded into a single record, or a a single table, or will it need to be loaded into multiple records in a single table or multiple records in multiple tables ?
Do you really need to load the data into exsiting relational tables or could your application work with relational views of the XML Content.
Finally which release of the database are you working with.
Define performance. Is it reasonable to expect to process this kind of document on this machine (Make, memory, #number of CPUs, CPU Speed, number of discs) in this period of time.
WRT to your original question. If you take a few minutes to search this forum you will find a very large number of threads with very similar titles to yours. These theads document a number of different approaches that can be used to solve this problem.
I suggest you start by looking for threads that cover topics like DBMS_XMLSTORE, XMLTable(), Relational Views of XML content, loading XML content in relational tables.

Loading XML Data into Relational Table

Hello,
I receive an XML file generated from another tool (on Windows), I am trying to create a Linux shell script that will gather the needed XML file from my Linux database server, then have Oracle use this file to load the XML data into a relational table. This activity & data will be needed on an ongoing basis.
I have tried this two ways. First, I loaded the XML document into the database and tried to extract the data directly from the document, but that is not working. Now I want to try to read the data directly from the file on the server via select, however I am not getting any data returned. In the Select statement below, I am simply trying to query the data to see what is returned for my testing.
Create Table ci_results_table (transactionID Varchar2(100), //transactionID should be PrimaryKey but was getting NULL value errors during insert test, so removed PK
message Varchar2(200),
ci Varchar2(50),
processeddate xmltype,
status Varchar2(50),
sourcefile VarChar2(100));
select x.*
from XMLTable(
     'TSPLoadResults/Results'
     PASSING xmltype(bfilename('CMDB_DEVADHOCRESULTS_DIR','LoadResults-HP_146.results.xml'), nls_charset_id('AL32UTF8'))
     COLUMNS
       transactionID Varchar2(100) PATH 'TransactionID',
       Result XMLType PATH 'Result',
       Message Varchar2(200) PATH 'Message',
       PrimaryKey Varchar2(50) PATH 'PrimaryKey',
       ProcessedDate date PATH 'ProcessedDate',
       Status Varchar2(50) PATH 'Status',
       SourceFile VarChar2(100) PATH 'SourceFileName'
   ) x
Eventually I will need to build on this to limit the data returned to those records where SourceFileName is like 'HPDS%' and insert what is returned in to the ci_results_table. Attached is a sample Results XML file I am trying to load, It is named "ResultsTransformedtoUnix" because I used dos2Unix to convert it to Unix which may be right or wrong. (The output file I send out has to be transformed to DOS format before the other application can read it). Original file (before Unix conversion) named in script is also attached.
Please help. Thank you!

Hi,
I see some wrong things in your query.
1) The obvious one, explaining why you're not getting any data : there's a typo in the XQuery expression, it's "Result" not "Results"
2) ProcessedDate cannot be extracted as a date (at least not directly) since it actually represents a timestamp, use TIMESTAMP WITH TIME ZONE datatype and cast back to DATE in the SELECT clause
3) transactionID is an attribute, it must be accessed with '@' (or 'attribute::' axis)
4) If the file encoding is truly ISO-8859-1 as the prolog suggests, then do not use AL32UTF8 but the corresponding charset name : WE8ISO8859P1
Here's the working query :
select x.transactionID
     , x.Message
     , x.Primarykey
     , cast(x.ProcessedDate as date) ProcessDate
     , x.Status
     , x.SourceFile
from XMLTable(
       '/TSPLoadResults/Result'
       PASSING xmltype(bfilename('XML_DIR','LoadResults-HP_146.results.xml'), nls_charset_id('WE8ISO8859P1'))
       COLUMNS
         transactionID Varchar2(100)            PATH '@transactionID',
         Message       Varchar2(200)            PATH 'Message',
         PrimaryKey    Varchar2(50)             PATH 'PrimaryKey',
         ProcessedDate timestamp with time zone PATH 'ProcessedDate',
         Status        Varchar2(50)             PATH 'Status',
         SourceFile    VarChar2(100)            PATH 'SourceFileName'
     ) x
Using this query directly over the file will only perform decently (for large files) on 11.2.0.4 and onwards.
On prior versions, first load the file in a (temporary) XMLType column with Binary XML storage and SELECT from there.
because I used dos2Unix to convert it to Unix which may be right or wrong.
This conversion shouldn't be necessary.

Load XML data into MySQL table

I have numerous XML files, one for each record, with a structure like this (only a small part actually, each file is around 170 KB):
<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<speccydata version="1.20.446" formatversion="2.0" languageID="0" time="20130323T222711" localtime="20130323T232711+0100">
    <mainsection title="Summary">
        <section title="Operating System" id="1">
            <entry value="Microsoft Windows 8 Enterprise 64-bit" />
        </section>
        <section title="CPU" id="2">
            <entry title="Intel Core i7 3930K @ 3.20GHz" value="32 °C" />
            <entry title="Sandy Bridge-E 32nm Technology" value="" />
        </section>
        <section title="RAM" id="3">
            <entry value="64,0 GB DDR3 @ 1091MHz (11-11-11-31)" />
        </section>
        <section title="Motherboard" id="4">
            <entry title="ASUSTeK COMPUTER INC. P9X79 WS (LGA2011)" value="25 °C" />
        </section>
        <section title="Graphics" id="5">
            <entry title="SyncMaster (1920x1080@60Hz)" value="" />
            <entry title="SyncMaster (1920x1080@60Hz)" value="" />
            <entry title="24W_LCD_TV (1920x1080@50Hz)" value="" />
            <entry title="Microsoft Basic Render Driver" value="" />
            <entry title="NVIDIA GeForce GTX 680" value="" />
        </section>
        <section title="Hard Drives" id="6">
            <entry title="238GB Corsair Performance Pro (SSD)" value="" />
            <entry title="238GB Corsair Performance Pro (SSD)" value="" />
            <entry title="932GB Seagate ST1000NM0011 (SATA)" value="24 °C" />
            <entry title="16764GB Areca ARC-1882-VOL#000 SCSI Disk Device (RAID)" value="" />
        </section>
        <section title="Optical Drives" id="7">
            <entry title="HL-DT-ST BD-RE BH10LS38" value="" />
            <entry title="HL-DT-ST BD-RE BH10LS38" value="" />
        </section>
        <section title="Audio" id="8">
            <entry title="Realtek High Definition Audio" value="" />
        </section>
    </mainsection>
    <mainsection title="Operating System" id="1">
        <entry>
            <entry title="Model" value="MS Windows 8" />
            <entry title="Edition" value="Enterprise" />
            <entry title="Architecture" value="64-bit" />
            <entry title="Service Pack" value="" />
        </entry>
I have a table in MySQL, where each record contains the name of the .XML file in a field.
I need to open the .XML file and load relevant data into a specific field for record 1, then repeat for record 2, until all records are filled with the data from the various .XML files. As an example from the above .XML code, I want to extract the BOLD information and get it into fields called:
os, cpu, ram, mobo, graphics, hard_drives, etc.
How to do that?

Not a trivial task, but one that could be done by writing a script that queries the database to get the XML filename and the record's primary key.
You can then use SimpleXML to open the XML file, extract the values that you need, and store them in variables. Use the variables and primary key to build a SQL query to update the record with the data you have extracted.

Helped, how to load xml data into database

Similar Messages

Maybe you are looking for