Parsing Larg files

Question

Has anyone tried parsing large XML files. I need parse a fiel
about 70M+. When I try and parse this file I get
java.io.UTFDataFormatException: Invalid UTF8 encoding
When I break the file down into smaller size about 2M it has no
problems. Also the sample data I am using was created using
OracleXMLQuery. Anyone have the same problem, solutins,
suggestions?
Any help is appricated
Thanks
null

Answer 1

I wasn't using any kind of encoding but I did have problems
parsing large files with the DOMParser. It seemed that whenever
you attempt to use a reader or InputSource, it would throw some
error...I think it was arrayoutofbounds error. I used the
following code, and it seemed to work:
xmlDoc is a String of xml
byte aByteArr [] = xmlDoc.getBytes();
ByteArrayInputStream bais = new ByteArrayInputStream
(aByteArr, 0, aByteArr.length);
domParser.parse(bais);
This also works if you use the URL version of .parse as well,
but I am under the contraint of not being able to write out a
file, so I need to use some kind of memory-based buffer.
ByteArrayInputStream works for me. I think the reason this
works is that the actual length of the stream is specified.
Hope this helps.
Dan
Arpan (guest) wrote:
: Has anyone tried parsing large XML files. I need parse a fiel
: about 70M+. When I try and parse this file I get
: java.io.UTFDataFormatException: Invalid UTF8 encoding
: When I break the file down into smaller size about 2M it has
no
: problems. Also the sample data I am using was created using
: OracleXMLQuery. Anyone have the same problem, solutins,
: suggestions?
: Any help is appricated
: Thanks
null