Dom - OutOfMemoryError:heap space

Question

Hey
I have a text file with the following format:
galia_na skCiKjcpdm02-pdm23p--2o6 2008/10/28-09:14:11:595 80006024 8860002 68100509 2008/10/15 90 487.35 IskAFT046
1.     galia_na – User Name
2.     skCiKjcpdm02-pdm23p--2o6 – Invoice OBID (unique ID)
3.     2008/10/28-09:14:11:595 – CreationDate or TimestampOut of the Invoice
4.     80006024 – Invoice Number
5.     8860002 – Batch Number
6.     68100509 – Supplier Number
7.     2008/10/15 – Invoice Date
8.     90 – Currency
9.     487.35 – New Amount
10.     IskAFT046 – Invoice Type
The file is large, and when trying to build an xml file using DOM tree parser, I encounter " Exception in thread "main" java.lang.OutOfMemoryError: Java heap space". (IT'S because DOM is not working properly with big files, The DOM tree consumes large amount of memory)
The Xml format:
<Year ID="2008" netAmount="15883.700" quantity="6">
<Month ID="Oct" netAmount="2247.310" quantity="3" year="2008">
<Data ID="0" display="History">
<OBID display="">skCiKjcpdm02-pdm23p--2o6</OBID>
<Days_waiting_for_approval display="Days waiting for approval">0</Days_waiting_for_approval>
<TimeStampOut display="Action Date">2008/10/28</TimeStampOut>
<InvoiceNumber display="Invoice Number">80006024</InvoiceNumber>
<BatchNumber display="Batch Number">8860002</BatchNumber>
<SupplierNumber display="Supplier Number">68100509</SupplierNumber>
<InvoiceDate display="Invoice Date">2008/10/15</InvoiceDate>
<Currency display="Currency">90</Currency>
<NetAmount display="Net Amount">487.35</NetAmount>
<InvoiceType display="Invoice Type">Purchase</InvoiceType>
</Data>
<Data ID="1" display="History">
<OBID display="">skCiCxdpdm02-pdm23p--2oW</OBID>
<Days_waiting_for_approval display="Days waiting for approval">0</Days_waiting_for_approval>
<TimeStampOut display="Action Date">2008/10/28</TimeStampOut>
<InvoiceNumber display="Invoice Number">80005892</InvoiceNumber>
<BatchNumber display="Batch Number">8860003</BatchNumber>
<SupplierNumber display="Supplier Number">68100509</SupplierNumber>
<InvoiceDate display="Invoice Date">2008/10/02</InvoiceDate>
<Currency display="Currency">90</Currency>
<NetAmount display="Net Amount">799.96</NetAmount>
<InvoiceType display="Invoice Type">Purchase</InvoiceType>
</Data>
<Data ID="2" display="History">
<OBID display="">skCjegjpdm02-pdm23p--2pL</OBID>
<Days_waiting_for_approval display="Days waiting for approval">0</Days_waiting_for_approval>
<TimeStampOut display="Action Date">2008/10/28</TimeStampOut>
<InvoiceNumber display="Invoice Number">3231</InvoiceNumber>
<BatchNumber display="Batch Number">8860004</BatchNumber>
<SupplierNumber display="Supplier Number">68104784</SupplierNumber>
<InvoiceDate display="Invoice Date">2008/09/24</InvoiceDate>
<Currency display="Currency">90</Currency>
<NetAmount display="Net Amount">960.00</NetAmount>
<InvoiceType display="Invoice Type">Purchase</InvoiceType>
</Data>
<Month ID="Dec" netAmount="13636.390" quantity="3" year="2008">
<Data ID="0" display="History">
<OBID display="">smbna6hpdm02-pdm23p--6dX</OBID>
<Days_waiting_for_approval display="Days waiting for approval">0</Days_waiting_for_approval>
<TimeStampOut display="Action Date">2008/12/01</TimeStampOut>
<InvoiceNumber display="Invoice Number">80295</InvoiceNumber>
<BatchNumber display="Batch Number">8850770</BatchNumber>
<SupplierNumber display="Supplier Number">68100508</SupplierNumber>
<InvoiceDate display="Invoice Date">2008/11/05</InvoiceDate>
<Currency display="Currency">90</Currency>
<NetAmount display="Net Amount">4250.25</NetAmount>
<InvoiceType display="Invoice Type">Purchase</InvoiceType>
</Data>
<Data ID="1" display="History">
<OBID display="">smbnhJepdm02-pdm23p--6eo</OBID>
<Days_waiting_for_approval display="Days waiting for approval">0</Days_waiting_for_approval>
<TimeStampOut display="Action Date">2008/12/01</TimeStampOut>
<InvoiceNumber display="Invoice Number">4744</InvoiceNumber>
<BatchNumber display="Batch Number">8850771</BatchNumber>
<SupplierNumber display="Supplier Number">68103640</SupplierNumber>
<InvoiceDate display="Invoice Date">2008/11/17</InvoiceDate>
<Currency display="Currency">90</Currency>
<NetAmount display="Net Amount">1749.78</NetAmount>
<InvoiceType display="Invoice Type">Purchase</InvoiceType>
</Data>
<Data ID="2" display="History">
<OBID display="">smbniAbpdm02-pdm23p--6el</OBID>
<Days_waiting_for_approval display="Days waiting for approval">0</Days_waiting_for_approval>
<TimeStampOut display="Action Date">2008/12/01</TimeStampOut>
<InvoiceNumber display="Invoice Number">4663</InvoiceNumber>
<BatchNumber display="Batch Number">8850772</BatchNumber>
<SupplierNumber display="Supplier Number">68103640</SupplierNumber>
<InvoiceDate display="Invoice Date">2008/11/07</InvoiceDate>
<Currency display="Currency">90</Currency>
<NetAmount display="Net Amount">7636.36</NetAmount>
<InvoiceType display="Invoice Type">Purchase</InvoiceType>
</Data>
</Month>
</Month>
I wonder how to process only one "Month" in a time. Write a fragment of the DOM tree into the targer xml file, remove the month which was already updated in the xml file and continue…
I have read about xml streaming, (javax.xml.stream package), but the thing is I have accumulative data tags, netAmount and quantity, and modifying xml with STax involves read it in... modify it, and write it out again
<Year ID="2008" netAmount="15883.700" quantity="6">
<Month ID="Oct" netAmount="2247.310" quantity="3" year="2008">
I wonder if there is a parser I can use for this purpose! I am using MyEclipse with jdk version 1.4 (can't upgrade!!!)
Thanks for the help !
Natalie

Answer 1

avoid multi post
http://forums.sun.com/thread.jspa?threadID=5427470