DBLP data -- Unknown exception from NsSAX2Reader

Question

I was trying to read DBLP data (474 MB, [ http://dblp.uni-trier.de/xml/dblp.xml| http://dblp.uni-trier.de/xml/dblp.xml] , + DTD) into Berkeley DB XML container,
but I receive the following exception:
[java] Exception in thread "main" com.sleepycat.dbxml.XmlException: Error:
Unknown exception during NsSAX2Reader parse File: \dbxml-2.4.13\dbxml\src\dbxml\
nodeStore\NsSAX2Reader.cpp Line: 366, errcode = INTERNAL_ERROR
[java] at com.sleepycat.dbxml.dbxml_javaJNI.XmlContainer_putDocumentInt
ernal__SWIG_0(Native Method)
[java] at com.sleepycat.dbxml.XmlContainer.putDocumentInternal(XmlConta
iner.java:884)
[java] at com.sleepycat.dbxml.XmlContainer.putDocument(XmlContainer.jav
a:103)
[java] at com.sleepycat.dbxml.XmlContainer.putDocument(XmlContainer.jav
a:54)
[java] at it.unimore.ir.search.benchmark.tc.Test.main(Unknown Source)
[java] Java Result: 1
BUILD SUCCESSFUL
Total time: 1 minute 42 seconds
What could be the reason ?
Below I attach isolated sample application causing the problem.
TIA,
Maciej
public class Test {
public static void main(String[] args) throws DatabaseException, IOException {
EnvironmentConfig config = new EnvironmentConfig();
config.setCacheSize(50 * 1024 * 1024); // 50MB
config.setAllowCreate(true);
config.setInitializeCache(true);
config.setTransactional(false);
config.setInitializeLocking(true);
config.setInitializeLogging(true);
config.setErrorStream(System.err);
Environment dbEnv = new Environment(new File("db/"), config);
// setup manager
XmlManagerConfig mgrConfig = new XmlManagerConfig();
mgrConfig.setAllowExternalAccess(true);
XmlManager mgr = new XmlManager(dbEnv, mgrConfig);
// setup container
XmlContainer openedContainer = mgr.createContainer("test.dbxml");
// put document from file to container
URL url = new URL("file:etc/data/dblp/dblp.xml");
XmlInputStream stream = mgr.createInputStream(url.openStream());
XmlDocument xmlDoc = mgr.createDocument();
xmlDoc.setName(url.getFile());
xmlDoc.setContentAsXmlInputStream(stream);
openedContainer.putDocument(xmlDoc);
}

Answer 1

Hi,
I can try with the reader-2-writer approach. I've taken a look at your suggestion and it looks I only have to write kind of a reader (parser), as the writer for the container is already given, and EventReaderToWriter class I have from the example you told, me, am I right ?
If so, the reader should override com.sleepycat.dbxml.XmlEventReader class and work as standard SAX parser. The XmlEventReader class uses native reader. Do you have or suggest me some documentation about functionality and arguments of functions from this class like the one below:
public void setExpandEntities(boolean value) throws XmlException {
dbxml_javaJNI.XmlEventReader_setExpandEntities(swigCPtr, this, value);
Thank you,
Maciej
ps. The code descibing the idea comes below. Is that what you mean ?
// setup container
XmlContainerConfig cc = new XmlContainerConfig();
cc.setNodeContainer(true);
XmlContainer openedContainer = mgr.createContainer("test.dbxml", cc);
// prepare empty document
XmlDocument xmlDoc = mgr.createDocument();
xmlDoc.setName("some name");          
// get an XmlEventWriter to create the new content
XmlEventWriter writer = openedContainer.putDocumentAsEventWriter(xmlDoc);
// get XmlEventReader to read existing document
XmlEventReader reader = null; // TODO should I write some event-based parser here ?
// copy
EventReaderToWriter r2w = new EventReaderToWriter(reader, writer);
r2w.start();
// clean up (EventReaderToWriter does not close its arguments)
writer.close();
reader.close();