JDOM parser fails to parse Huge Size Xml Files ??? Unable to Parse ???

Hi All,
When i transformed or parsed many XML Files of huge
size...I am getting java.lang.OutOfMemory error for
all the huge xml files. It is working fine for files
which is of small size.Of course it is.
>
I've 2GB ram in my system. I have also set heapsize for the JVM.
-Xms512M -Xmx1800M (or) -Xms512M -Xmx1500MYou can't always get what you want. Your JVM is competing with all the other processes on your machine, including the OS, for RAM.
I like to know what are the drawbacks of JDOM parser ?You just discovered it: all DOM parsers create an in-memory representation of the entire document. A SAX parser does not.
What is the maximum size of the Xml which JDOM can parse ?The max amount of memory that you have available to you.
I've read a long time before that parsers have
certain limitations. Can anybody tell me the
limitations of the parses?See above.
Please help. i'm currently using jdom.jar to parse the xml files.You can try a SAX parser or a streaming parser. Maybe those can help.
%

Similar Messages

When parsing a large size xml file , OutOfMemorry exception(attach code)

Dear all ,
I met a OutOfMemorry exception when I parse a xml file (20M) in my application(I extract data in xml file for building my application data), but I found that it take long time(for 2 more minutes) even just searching the xml file , because my application is viewed by web page , so it's too bad for waiting.
what I used is org.jdom.input.SAXBuilder(jdom1.0beta8-dev) , and my xml file structure is like :
<errors>
<item1>content</item1>
<item2>content</item2>
</errors>
and this is my source code of parsing xml file :
import java.io.*;
import java.text.*;
import java.util.*;
import org.jdom.*;
import org.jdom.input.*;
import org.jdom.output.*;
public class XMLProperties {
 private File file;
 private Document doc;
 private Map propertyCache = new HashMap();
 public XMLProperties(String filename) {
 SAXBuilder builder = new SAXBuilder();
 // Strip formatting
 DataUnformatFilter format = new DataUnformatFilter();
 builder.setXMLFilter(format);
 long time_start = System.currentTimeMillis();
 Runtime run = Runtime.getRuntime();
 doc = builder.build(new File(filename));
 System.out.println("Build doc memory ="+(run.totalMemory()-
 run.freeMemory())/1024+"K");
 System.out.println("Build doc used time :"+(
 System.currentTimeMillis()-time_start)/1000+" s");
 catch (Exception e) {
 System.err.println("Error creating XML parser in "
 + "PropertyManager.java");
 e.printStackTrace();
 public String [] getChildrenProperties(String parent) {
 // Search for this property by traversing down the XML heirarchy.
 Element element = doc.getRootElement();
 element = element.getChild(parent);
 if (element == null) {
 // This node doesn't match this part of the property name which
 // indicates this property doesn't exist so return empty array.
 return new String [] { };
 // We found matching property, return names of children.
 List children = element.getChildren();
 int childCount = children.size();
 String [] childrenNames = new String[childCount];
 for (int i=0; i<childCount; i++) {
 childrenNames[i] = ((Element)children.get(i)).getName();
 return childrenNames;
 }the test main class:
import java.util.Map;
import java.util.HashMap;
import org.jdom.*;
import org.jdom.input.*;
public class MyTest {
public static void main(String[] args) {
 long time_start = System.currentTimeMillis();
 Runtime run = Runtime.getRuntime();
 Map childs = new HashMap();
 System.out.println("Used memory before="+(run.totalMemory()-run.freeMemory())/1024 + "K");
 XMLProperties parser = new XMLProperties("D:\\projects\\edr\\jsp\\status-data\\edr-status-2003-09-01.xml");
 String[] child = parser.getChildrenProperties("errors");
 for(int i=0;i<child.length;i++) {
// childs.put(new Integer(i), child);
if(i%1000 == 0) {
System.out.println("Used memory while="+(run.totalMemory()-run.freeMemory()/1024+"K"));
System.out.println("child.length="+child.length);
System.out.println("Used memory after="+(run.totalMemory()-run.freeMemory())/1024+"K");
System.out.println("Time used: "+(System.currentTimeMillis()-time_start)/1000+"s");
The result is : Used memory before=139K
Used memory while=56963K
Used memory after=51442K
child.length=27343
Time used: 146s
is that some way to solve this problem ?
Thanks for your help

I met a OutOfMemorry exception when I parse a xml
l file (20M) in my application(I extract data in xml
file for building my application data)...Rule of thumb for parsing XML: the memory you need is about 10 times the size of the XML file. So in your case you need 200 MB of free memory.
, but I found
that it take long time(for 2 more minutes) even just
searching the xml file , because my application is
viewed by web page...Then you need to redesign your application. Parsing 20 megabytes of XML for every request is -- as you can see -- impractical. Sorry I can't suggest how, since I have no idea what your application is.

Oracle UCM fails to check in text/xml files

We have an Oracle UCM server that is failing to check in xml files over a certain size - I haven't narrowed down the size limit yet, but a <100kb file will work 100% of the time, while 300+ Kb xml files fail almost all the time, though there has been some success. Image files and zip file succeed on new check ins 100% of the time as well. We have tried with the SOAP API and the UCM new check in form - in both cases we get an empty repsonse from the server. In firefox we get the "The connection was reset" page. I'm at a loss as to explain why, but I have almost no experience with Oracle UCM. This particular server has been running for over a year happily accepting xml files of all sizes, then one day just stopped - as far as I am aware, nobody changed any
settings/upgraded anything/changed network topology.
When I look in the server output, I don't really see any indication of failure or find any mention of the file name or content title like I do when a file successfully checks in.
I have already asked the DBA to drop and rebuild the database index, started the Collection rebuild cycle (it finished successfully) and turned on the webless file store option on the defaultfilestore provider.
UCS Version : 10.1.3.3.3 (080807) (Build:7.2.2.188)
Database : Microsoft SQL Server 09.00.4035 currently using DATABASE.METADATA though I think it was at one point using Full text search, but the database was not.
Java Version:1.6.0
Please ask if there is any other information you need, but I do not have physical access to the machine, and I may not be able to reveal certain info due to privacy/security concerns.

Hello,
I think you should open an SR with support to help out. Be that as it may, here's some observations/suggestions...
* You are running a 4-year old content server. There have been numerous fixes since then. Your system may have grown to a point where it's hit one of the older issues.
* Is it possible the XML encoding may have changed? i.e. that whatever generates the XML files is now generating them slightly differently and therefore the encoding is different so check-in doesn't follow the same rules? I'd look at the first line of older files versus the new files which fail. If there's a difference, refer to KM note 978689.1 in our knowledge base.
* You say there doesn't appear to be anything in the logs, so let's increase them:
- Login to UCM as Administrator. Go to Administration->System Audit Information. Switch on the Full Verbose Tracing checkbox. In the Active Sections field, put in:
systemdatabase - this will show you what queries and inserts are made to the database and should show whether there's a problem at that level.
requestaudit - this shows you the requests as they come in, as well as a roundup of all requests every 2 minutes. If you see large amounts of time being taken on requests, your server could be creaking because of resources.
publish - tells you about publishing related issues, most XML file check-ins are related to this.
- Try to check in a file which should fail.
- Switch off verbose logging (see above) to reduce overhead.
If the OS is Windows then the <install>/config.cfg file needs to have UseRedirectedOutput=true in order to generate a log file for this tracing. On Windows the file is the <install>/bin/IdcServerNT.log file. (if the above config is set)
On *nix it is in the <install>/etc/log file (notice that there is no file extension on the file)
If none of the logs helps you, an SR is probably in order.
Regards,
Frank.

Xml publisher generate huge size excel file

hi,
we use xml publisher to generate excel file.
the problem is:
when there are over 100,000 rows, the excel file size will be very very huge,and it will take very very long time to open it.
i open the excel file with UltraEdit and find it is filled with html sytax.
When that excel file is opened with excel and saved as .xls file, the size will be dramatically reduced.
anyone can help?

Hello
I am getting the same problem, the EXCEL output file size is huge.
What I notice that it is stored as Web Pages *.htm; *.html (Save as Type) in Excel this is the reason it is huge.
If I save as Microsoft Office Excel Workbook *.xls it Reduce the size.
I don't know how to save as *.xls through XML Publlisher.
Any body knows? please Help..
Thanks.

Illustrator - Maximum allowed size of variable library xml file loaded from variables palette?

Hi-
One question I can’t seem to find the answer to anywhere – any idea on what the maximum size xml file one can use when making data driven graphics in Illustrator?
I can successfully batch when I load a single variable library with about 100 datasets at one time but anything much larger than that in the same xml format gives me a “the incoming variable library is invalid” error. Elsewhere on this discussion forum I have seen answers say there is no limit to the size of the XML file. (http://forums.adobe.com/thread/647934). But my experience with Illustrator CS5 says otherwise.
I have thousands I need to create. Any help would be most appreciated.
1. If there is a maximum size either in file size, number of datasets, or number of variables/values, please share what the limit is.
2. I still need to create thousands of the final document I am creating - if the limit is close to 100 and I need to create many thousands - any suggestions on either scripting or other methods to get this done?
Thanks,
Michael

yey!! now we know 1,000 is not the limit. Tested wiht 2 variables, 1122 data sets.
<v:sampleDataSet dataSetName="1121">
<ZIPPER>
6” ZIPPER
</ZIPPER>
<FLY>
1121
</FLY>
</v:sampleDataSet>
<v:sampleDataSet dataSetName="1122">
<ZIPPER>
6” ZIPPER
</ZIPPER>
<FLY>
1122
</FLY>
</v:sampleDataSet>
</v:sampleDataSets>
</variableSet>
</variableSets>
</svg>

How To read an XML file with JDom

I have read through some tutorials after installing JDom on how to read an existing XML file and I was confused by all of them. I simply want to open an XML file and read one of the node's content. Such as <username>john doe</username> this way I can compare values with what the user has entered as their username. I am not sure were to start and I was hoping someone could help me out.
I know that this seems like an insecure way to store login information but after I master opening and writing XML files with JDom I am going to use AES to encrypt the XML files.

Here is a test program for JDom and XPath use considering your XML file is named "test.xml" :import org.jdom.input.*;
import org.jdom.xpath.*;
public class JDomXPath {
public static void main(String[] args) {
SAXBuilder saxBuilder = new SAXBuilder("org.apache.xerces.parsers.SAXParser");
try {
 org.jdom.Document jdomDocument = saxBuilder.build("test.xml");
 org.jdom.Element usernameNode = (org.jdom.Element)XPath.selectSingleNode(jdomDocument, "//username");
 System.out.print(usernameNode.getText());
} catch (Exception e) {
 e.printStackTrace();
}(tested with Eclipse)

Can I validate an XML file using an external DTD

Hi,
I'm trying to use an external DTD to validate an XML
file (which does not refer to this DTD). The java docs that ship
with the XML parser aren't clear on how exactly to do this (or
whether it can be done). I'd appreciate any advice on how I
should perform this operation.
Here's what I'm doing right now.
1) The Java file
import oracle.xml.parser.v2.*;
public class ParseWithExternalDTD
public static void main(String args[]) throws Exception
DOMParser dp=new DOMParser();
dp.parseDTD
("file:d:/jdk1.2/sample/test/family.DTD","family");
DTD dtd=dp.getDoctype();
dp.setDoctype(dtd);
dp.parse("file:d:/jdk1.2/sample/test/family.xml");
System.out.println("Finished with no errors!");
2) The family.DTD file
<!ELEMENT family (member*)>
<!ATTLIST family lastname CDATA #REQUIRED>
<!ELEMENT member (#PCDATA)>
<!ATTLIST member memberid ID #REQUIRED>
<!ATTLIST member dad IDREF #IMPLIED>
<!ATTLIST member mom IDREF #IMPLIED>
3) The family.xml file
<?xml version="1.0" standalone="no"?>
<family lastname="Smith">
<TagToFoilParserValidation>
</TagToFoilParserValidation>
<member memberid="m1">Sarah</member>
<member memberid="m2">Bob</member>
<member memberid="m3" mom="m1" dad="m2">Joanne</member>
<member memberid="m4" mom="m1" dad="m2">Jim</member>
</family>
4) The output
Finished with no errors!
As you can see, the DOMParser failed to validate the family.xml
file against the family dtd otherwise, it would have reported a
validation error when it came across the
TagToFoilParserValidation.
Any insight as to what I'm doing wrong would be much appreciated.
Sincerely,
Keki
Project Iona
Manufacturing Applications
Oracle Corporation
The views and opinions expressed here are
my own and do not reflect the views and
opinions of Oracle Corporation
null

Keki Burjorjee (Oracle) (guest) wrote:
: 2 further questions related to this issue.
: 1) Say I am using XSLT to transform A.xml into B.xml, and I
: want to embed a reference to B.dtd within the B.xml file. Is
: there an XSLT command which will allow me to do this?
: 2) Is it possible for your team to give me a mechanism whereby
I
: can preset the xml parser to validate the next xml file (or
: inputstream) it receives against a particular DTD? This scheme
: does not require the dtd to be present within the XML file
: Thanks,
: - Keki
: Oracle XML Team wrote:
: : What you are doing wrong is not including a reference to the
: : applicable DTD in your XML document. Without it there is no
: way
: : that the parser knows what to validate against. Including
the
: : reference is the XML standard way of specifying an external
: : DTD. Otherwise you need to embed the DTD in your XML
Document.
: : Oracle XML Team
: : http://technet.oracle.com
: : Oracle Technology Network
: : Keki Burjorjee (guest) wrote:
: : : Hi,
: : : I'm trying to use an external DTD to validate an XML
: : : file (which does not refer to this DTD). The java docs that
: : ship
: : : with the XML parser aren't clear on how exactly to do this
: (or
: : : whether it can be done). I'd appreciate any advice on how I
: : : should perform this operation.
: : : Here's what I'm doing right now.
: : : 1) The Java file
: : : import oracle.xml.parser.v2.*;
: : : public class ParseWithExternalDTD
: : : public static void main(String args[]) throws Exception
: : : DOMParser dp=new DOMParser();
: : : dp.parseDTD
: : : ("file:d:/jdk1.2/sample/test/family.DTD","family");
: : : DTD dtd=dp.getDoctype();
: : : dp.setDoctype(dtd);
: : : dp.parse("file:d:/jdk1.2/sample/test/family.xml");
: : : System.out.println("Finished with no errors!");
: : : 2) The family.DTD file
: : : <!ELEMENT family (member*)>
: : : <!ATTLIST family lastname CDATA #REQUIRED>
: : : <!ELEMENT member (#PCDATA)>
: : : <!ATTLIST member memberid ID #REQUIRED>
: : : <!ATTLIST member dad IDREF #IMPLIED>
: : : <!ATTLIST member mom IDREF #IMPLIED>
: : : 3) The family.xml file
: : : <?xml version="1.0" standalone="no"?>
: : : <family lastname="Smith">
: : : <TagToFoilParserValidation>
: : : </TagToFoilParserValidation>
: : : <member memberid="m1">Sarah</member>
: : : <member memberid="m2">Bob</member>
: : : <member memberid="m3" mom="m1" dad="m2">Joanne</member>
: : : <member memberid="m4" mom="m1" dad="m2">Jim</member>
: : : </family>
: : : 4) The output
: : : Finished with no errors!
: : : As you can see, the DOMParser failed to validate the
: : family.xml
: : : file against the family dtd otherwise, it would have
: reported
: : a
: : : validation error when it came across the
: : : TagToFoilParserValidation.
: : : Any insight as to what I'm doing wrong would be much
: : appreciated.
: : : Sincerely,
: : : Keki
: : : Project Iona
: : : Manufacturing Applications
: : : Oracle Corporation
: : : The views and opinions expressed here are
: : : my own and do not reflect the views and
: : : opinions of Oracle Corporation
1) No XSLT commands exist that allow you to embed a DTD while
doing the transformation.
2) You can use the setDocType() method in the parser, to set a
DTD based on which the XML document will be validated. The
parseDTD() method allows you to parse a DTD file separately and
get a DTD object. Here is a sample code :
DOMParser domparser = new DOMParser();
domparser.setValidationMode(true);
// parse the DTD file
domparser.parseDTD(new FileReader(dtdfile));
DTD dtd = domparser.getDocType();
// Parse XML file - XML file will be validated based on the DTD.
domparser.setDocType(dtd);
domparser.parse(new FileReader(xmlfile));
Document doc = domparser.getDocument();
Oracle XML Team
http://technet.oracle.com
Oracle Technology Network
null

How read the PDF and XML files after Unzipping the folder

Hi Gurus,
I have a zipped folder and i this two types of files .XML and .PDF files.
I am able to unzip the folder and reading the .XML files, unable to read the PDF files.
I want to send this PDF file to the target as it is.
Please help me.
Regards
Sreeni

Hi,
Hi ,
Plse see the below thread
PI 7.1 : Taking a input PDF file and mapping it to a hexBinary attribute
It will help you.
You can write custom adapter modules:
Java Mappingh;
SAP Conversion agent:
http://www.riyaz.net/blog/parsing-pdf-files-using-sap-conversion-agent-part-i/technology/sap/628/
http://help.sap.com/saphelp_nw04/helpdata/en/43/4c38c4cf105f85e10000000a1553f6/content.htm

Any way to present xml file to hieratic view

Hi
i ahve xml file tat contains non english text i try things
other than flash to draw it but failed
can i draw te xml file to hieratic view like a tree family
if its hard .
is there any extension that can do that?
thanks in advance.

This is what I heard:
Playlists show up as album art until you tap on one to reveal the list of songs in the playlist. That is the way that the new Music App works in iOS 5.

Parsing a XML file using Jdom-Problem.

Hi all,
I am reposting it as I was told to format the code and send it again.
I am trying to parse a xml file using a jdom java code.This code works fine if I remove xmlns attribute in the root element. (I get the expected result) .If the "xmlns" attribute is put in the xml as it should be then the parsing and retrieving returns null. Please tell me how to fix this issue.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Xml
<process name="CreateKBEntryService" targetNamespace="http://serena.com/CreateKBEntryService" suppressJoinFailure="yes" xmlns:tns="http://serena.com/CreateKBEntryService" xmlns="http://schemas.xmlsoap.org/ws/2003/03/business-process/" xmlns:bpelx="http://schemas.oracle.com/bpel/extension" xmlns:ora="http://schemas.oracle.com/xpath/extension" xmlns:nsxml0="http://localhost:8080/axis/services/CreateKBEntryService" xmlns:nsxml1="http://DefaultNamespace" xmlns:bpws="http://schemas.xmlsoap.org/ws/2003/03/business-process/">
<partnerLinks>
<partnerLink name="client" partnerLinkType="tns:CreateKBEntryService" myRole="CreateKBEntryServiceProvider"/>
<partnerLink name="CreateKBEntryPartnerLink" partnerLinkType="nsxml0:CreateKBEntryLink" partnerRole="CreateKBEntryProvider"/>
</partnerLinks>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~`
Java:
import java.io.*;
import java.util.*;
import org.jdom.Document;
import org.jdom.Element;
import org.jdom.input.SAXBuilder;
public class sample1 {
public static void main(String[] args) throws Exception {
// create a XML parser and read the XML file
SAXBuilder oBuilder = new SAXBuilder();
Document oDoc = oBuilder.build(new File("**xml file location**"));
Element root = oDoc.getRootElement();
System.out.println(root.getName());
String tgtns= root.getAttributeValue("targetNamespace");
System.out.println("tgt ns "+ tgtns);
List list= root.getChildren("partnerLinks");
Iterator it1= list.iterator();
System.out.println("Iterator 1 - "+list.size());
while(it1.hasNext()){
Element partnerlinks = (Element)it1.next();
List list2= partnerlinks.getChildren("partnerLink");
System.out.println("iterator 2 - "+list2.size());
}~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Result:
Without Xmlns in xml file(Expected and correct output)
process
tgt ns http://serena.com/CreateKBEntryService
Iterator 1 - 1//expected and correct result that comes when I remove xmlns attribute from xml
iterator 2 - 2
Result with xmlns:
process
tgt ns http://serena.com/CreateKBEntryService
Iterator 1 - 0 //instead of 0 should return 1

LOL
This is what you get for working 12 hours straight....
I changed:
xmlObject["mydoc"]["modelglue"]["event-handlers"]["event-handler"][i].xmlAttrib utes["name"] 
to:
#mydoc["modelglue"]["event-handlers"]["event-handler"][i].xmlAttrib utes["name"]# 
xmlObject is the name of my xml object in memory, and then you reference from the root of the xml doc down the chain.
Sorry for the inconvenience,
Rich

JDOM: Parsing XML String, getting error

Hello,
I am new to this forum, so please forgive me
if this has already been asked before. I want to
parse an XML string. I know the JDOM parser works
great with a file, but apparently I have been
unsuccessful parsing an XML String. Below is how I
initialize the parser:
import java.io.*; //Import proper packages
import org.jdom.*;
import org.jdom.input.*;
import org.jdom.output.*;
import java.util.*;
import java.lang.*;
public class XMLParser{
private Document doc = null;
public XMLParser(String xml){
doc = readDocument(xml);
private Document readDocument(String xml) {
try {
SAXBuilder builder = new SAXBuilder();
org.jdom.Document result = builder.build(new
StringReader(xml));
return result;
} catch(JDOMException e) {
e.printStackTrace();
} catch(NullPointerException e) {
e.printStackTrace();
return null;
} //readDocument
The following is the error I receive:
JDOM/xmlparser.java [81:1] cannot resolve symbol
symbol : method build (java.io.StringReader)
location: class org.jdom.input.SAXBuilder
org.jdom.Document result = builder.build(new
StringReader(filename));
--> Arrow pointing to builder.build
Please if someone can help me out. If JDOM does not
have this feature, then can someone please recommend a
parser that can parse an XML String.

Thank you for your help, although it seems like it was JDom 9 beta. When I tried with JDOM 8 beta, everything worked fine even with the StringReader. So if anyone is having similar problems with JDom 9 then try with JDom 8.

Parse failed: Exception DBD, The supplied XML is not valid[Measures].[SAP_OBJECT_NAME] State:N/A error for hidden KFs when migrated to HANA

Hi All
Please help me with the following query. We are migrating SAP BW 7.4 on Oracle to HANA. We have few WEBI report's universes built on BEx queries. In one of those reports there are some hidden RKFs, these works perfectly fine in reports based on oracle. Now we migrated to HANA in development system and when i refresh the universe structure they started giving errors like "Parse failed: Exception DBD, The supplied XML is not valid[Measures].[SAP_OBJECT_NAME] State:N/A". The object giving this error is in hidden state. I tried to unhide it and run the report then it runs fine but that not the client want as there might be so many hidden KFs in other reports also. BO version is 4.1 SP 2. We are on SAPKW74006 support package on BW side. Is there any notes to correct this error. Please pass me the relevant links. Highly appreciate your help.
Thanks
Dwaraka

DCA-40012: The Web Service call failed. A connection to the target Web Service could not be created.
First of all test the web service you have created in model project. Right click the web service name and select "Test WebService". If you see any issue(s) while testing fix it first before you run the jspx page.
Check the port number in the URL and connections.xml, it have to be same.

Maximum XML file size that can parsed with c++ XML parser

Hi!
what is the maximum file size that can be parsed using the xml parser(version 1) for c++ on linux .
i'm getting an error(error no 231) when i try to parse an XML file of 3MB on Red Hat Linux 6.1
Regards
anjana

moving to xml db forum

Trying to parse a huge XML file

I'm trying to parse a large (~200 Meg) XML file. I get out of memory errors with DOM, and so far using SAX has been a huge disaster. My program has to run on IE and Netscape as an applet. I've run into a HUGE amount of errors. While I have been doing Java programming for about 2 years, this is the first time I've ever worked with XML. The error I am currently getting is an abstract method error associated with the following code :
SAXParserFactory spf = new
                         com.sun.xml.parser.SAXParserFactoryImpl();
               spf.setValidating(false);
               try {
               out.write("Gets past SAXParserFactory creation");
               out.flush();
                    catch (Exception e) {}
               xmlReader = null;
               try {
                         // Create a JAXP SAXParser
                         saxParser = spf.newSAXParser();
                         // Get the encapsulated SAX XMLReader
                         out.write("gets to assigning an XMLReader");
***THIS LINE OF CODE ***                         xmlReader = saxParser.getXMLReader();
                         out.write("gets past assigning an XMLReader");
                         out.flush();
I've run out of ideas and would greatly appreciate any help anyone could offer on this most frustrating problem.

With XML, we don't have to check each line of the file, only the data in those tags of each element that we are searching on.That's true, once you have read the entire XML and parsed it. Reading the entire XML would of course take much longer than reading the text file it was generated from, so you would want to pre-parse it into a DOM and store that somehow. But then to do a search you'd have to load that DOM, which is in turn much larger than the XML it was generated from...
What you describe sounds to me a lot like a database application. Of course I don't know anything about the specifics of what you are doing with the text, but storing it in a database with indexes that support the searches seems to me like a better approach. Of course you then have the challenge of distributing the database and its supporting software in a form that doesn't require installation. But I'd respectfully suggest that banning any installation at all is a bit extreme. After all, where I live you can buy an encyclopedia on a CD, from a gas station, for $10. And when you load the CD, it runs through an installation procedure. No big deal these days.

Want parse huge xml file for CDATA

HI all
I want to parse hude xml file for getting values of CDATA
can u plz give me sample code for that
here i am attaching the part of my xml file
<initParams>
<param description="simulation mode " name="smtpSimulationMode" passOn="false" required="false" type="bool" varSubstitute="false">
<![CDATA[false]]>
</param>
<param description="full name of smtp host" name="smtpHost" passOn="false" required="true" type="string" varSubstitute="false">
<![CDATA[222222]]>
</param>
<param description="smtpUserName for authentication" name="smtpUserName" passOn="false" required="false" type="string" varSubstitute="false"/>
<param description="smtpUserPassword for authentication" name="smtpUserPassword" passOn="false" required="false" type="string" varSubstitute="false"/>
<param description="ip address for remote server" name="serverId" passOn="false" required="true" type="string" varSubstitute="false">
<![CDATA[1111111]]>
</param>
<param description="location of file on remote server side" name="fileRemoteLocation" passOn="false" required="false" type="string" varSubstitute="false">
<![CDATA[test/]]>
</param>
<param description="user name for authentication" name="userName" passOn="false" required="true" type="string" varSubstitute="false">
<![CDATA[abc]]>
</param>
</initParams>
thanks in advance

There are several Java XML API's available. SAX, JXpath, DOM4J, Xerces, etcetera.

JDOM parser fails to parse Huge Size Xml Files ??? Unable to Parse ???

Similar Messages

Maybe you are looking for