I need help on reading a large file, thanks.

I try to read a txt file into an array, just like what I ususally do. But this time the file is too big (300k rows, 100 columns seperated by single space), I got the message "java.lang.OutOfMemoryError".
I need to do some calculation for every possible row pair. Can someone help me out of this? Thanks a lot.

Try changing your approach - don't read it into an array, process it one line at a time. Obviously any approach where you have the whole file in memory is going to exceed memory at some size of the file.

Similar Messages

Need help with reading XML using File Adapter

I have created a simple BPEL process that uses a file adapter to read files containing XML messages of a simple xsd schema. But when reading the xml, I get the following error message:
[2010/03/01 23:43:13] Invalid data: The value for variable "Receive_1_Read_InputVariable", part "revision-report" does not match the schema definition for this part.The invalid xml document is shown below: More...
[2010/03/01 23:43:13] "{http://schemas.oracle.com/bpel/extension}invalidVariables" has been thrown. less
-<invalidVariables xmlns="http://schemas.oracle.com/bpel/extension">
-<part name="code">
<code>
9710
</code>
</part>
-<part name="summary">
<summary>
Invalid xml document.
According to the xml schemas, the xml document is invalid. The reason is: Error::cvc-complex-type.4: Attribute 'doc' must appear on element 'revision-report'.
Error::cvc-complex-type.4: Attribute 'model' must appear on element 'revision-report'.
Error::cvc-complex-type.4: Attribute 'pubdate' must appear on element 'revision-report'.
Error::cvc-complex-type.2.4.b: The content of element 'revision-report' is not complete. One of '{"http://xmlns.oracle.com/xmlfile":alternategroup}' is expected.
Please make sure that the xml document is valid against your schemas.
</summary>
</part>
</invalidVariables>
It seems that there is some issue with the namespace, but even after trying out various combinations, I am not able to resolve this.
Here the message schema (xsd):
<?xml version="1.0" encoding="UTF-8" ?>
<xs:schema elementFormDefault="qualified"
targetNamespace="http://xmlns.oracle.com/xmlfile"
xmlns:tns="http://xmlns.oracle.com/xmlfile"
xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="revision-report">
<xs:complexType>
<xs:sequence maxOccurs="unbounded">
<xs:element name="alternategroup">
<xs:complexType>
<xs:attribute name="name" use="required" type="xs:string"/>
<xs:attribute name="Desc" use="required" type="xs:string"/>
</xs:complexType>
</xs:element>
</xs:sequence>
<xs:attribute name="doc" use="required" type="xs:string"/>
<xs:attribute name="model" use="required" type="xs:string"/>
<xs:attribute name="pubdate" use="required" type="xs:string"/>
</xs:complexType>
</xs:element>
</xs:schema>
And here is the xml file to be read by the file adapter:
<?xml version="1.0" encoding="UTF-8" ?>
<revision-report doc="doc2" model="model4" pubdate="pubdate5">
<alternategroup Name="ABC" Desc="ABC-Desc">
</alternategroup>
<alternategroup Name="DEF" Desc="DEF-Desc">
</alternategroup>
<alternategroup Name="GHI" Desc="GHI-Desc">
</alternategroup>
</revision-report>
Appreciate any help.
Thanks in advance for your attention.
Jay

Thanks for your response.
I am not sure if there is any easier way, but I tried out the following tool available on the net to check an xml against a xsd:
http://tools.decisionsoft.com/schemaValidate/
There were a few issues, that I corrected and finally had a xsd and xml that were matching and valid. I tried this out in my file reading BPEL process, but the error still remained the same!
Here is my updated/simplified xsd and xml:
<?xml version="1.0" encoding="UTF-8" ?>
<xs:schema targetNamespace="http://xmlns.oracle.com/xmlfile"
xmlns:tns="http://xmlns.oracle.com/xmlfile"
xmlns:xs="http://www.w3.org/2001/XMLSchema"
xmlns="http://xmlns.oracle.com/xmlfile">
<xs:element name="revision-report">
<xs:complexType>
<xs:sequence>
<xs:element maxOccurs="unbounded" ref="alternategroup"/>
</xs:sequence>
<xs:attribute name="doc" use="required" type="xs:string"/>
<xs:attribute name="model" use="required" type="xs:string"/>
<xs:attribute name="pubdate" use="required" type="xs:string"/>
</xs:complexType>
</xs:element>
<xs:element name="alternategroup">
<xs:complexType>
<xs:attribute name="Name" use="required" type="xs:string"/>
<xs:attribute name="Desc" use="required" type="xs:string"/>
</xs:complexType>
</xs:element>
</xs:schema>
<?xml version="1.0" encoding="UTF-8" ?>
<revision-report doc="doc2" model="model4" pubdate="pubdate5" xmlns="http://xmlns.oracle.com/xmlfile">
<alternategroup Name="ABC" Desc="ABC-Desc"/>
<alternategroup Name="DEF" Desc="DEF-Desc"/>
<alternategroup Name="GHI" Desc="GHI-Desc"/>
</revision-report>
I even tried the option that is available in JDeveloper to generate a sample xml from a xsd (when in the context of a Transformation activity). The xml generated by this also seems exactly like the one above.
So, I am not able to figure out why my BPEL process errors out with the message Invalid xml document.

Need help with reading a midi file!!!

I want to be able to make a java program that can read midi files. I need to know what notes are played and when. how can i do this.
A bit of code would be nice to to use as a resource.
thnx

http://java.sun.com/products/java-media/sound/
There are links to code samples and maybe a tutorial

I need help viewing password protected PDF files on my tablet

I need help veiwing password protected PDF files on my tablet

Any free apps available especially for this purpose?
not that i know of. but i think _*Documents To Go*_ will be worth the expenditure.
JGG
edited by the Jolly Green Giant (where Green stands for environmentally friendly)

Please advice me on reading a large file

Hi,
I need and advice on reading a large file using JSP. I need to read a text file which contains around 2 millions records (lines). Also some times I need to find a specific line from that.
I have to make a small web application to generate reports on the Text files after parsing those into a database (Oracle or MySQL). I have already a small similar application which based on PHP / MySQL. But still time consumption issue is there while parsing the text file into Database.
How will it be improve if I go for Tomcat / Oracle / Java Web Component Development?
Please advice me.
Thanks

Try changing your approach - don't read it into an array, process it one line at a time. Obviously any approach where you have the whole file in memory is going to exceed memory at some size of the file.

I had to put my computer by together without migration or time machine I NEED help with order of the files?

I had to put my computer by together without migration or time machine I NEED help with order of the files?

Hi, where are these other files exactly?

Need Help Exporting Previous Recipients to File

Need help exporting "Previous Recipients" to file not to Contacts. Sorry if this is a duplicate, I can't find this answer
anywhere for Maverick. Thanks.

Hi,
This'll do what you're after:
$out = @()
$mbxs = Get-Mailbox -Identity '*smith*'
foreach ($mbx in $mbxs) {
$whenCreated = $mbx.WhenCreated
$out += Get-MailboxStatistics -Identity $mbx.SamAccountName |
Select DisplayName,TotalItemSize,ItemCount,LastLoggedOnUserAccount,LastLogonTime, @{n="WhenCreated";e={$whencreated}}
$out | Sort DisplayName | Export-Csv .\mbxStats.csv -NoTypeInformation
Don't retire TechNet! -
(Don't give up yet - 12,950+ strong and growing)

How can I get to read a large file and not break it up into bits

Hi,
How do I read a large file and not get the file cut into bits so each has its own beginning and ending.
like
1.aaa
2.aaa
3.aaa
4....
10.bbb
11.bbb
12.bbb
13.bbb
if the file was read on the line 11 and I wanted to read at 3 and then read again at 10.
how do I specify the byte in the file of the large file since the read function has a read(byteb[],index,bytes to read);
And it will only index in the array of bytes itself.
Thanks
San Htat

tjacobs01 wrote:
Peter__Lawrey wrote:
Try RandomAccessFile. Not only do I hate RandomAccessFiles because of their inefficiency and limited use in today's computing world, The one dominated by small devices with SSD? Or the one dominated by large database servers and b-trees?
I would also like to hate on the name 'RandomAccessFile' almost always, there's nothing 'random' about the access. I tend to think of the tens of thousands of databases users were found to have created in local drives in one previous employer's audit. Where's the company's mission-critical software? It's in some random Access file.
Couldn't someone have come up with a better name, like NonlinearAccessFile? I guess the same goes for RAM to...Non-linear would imply access times other than O(N), but typically not constant, whereas RAM is nominally O(1), except it is highly optimised for consecutive access, as are spinning disk files, except RAM is fast in either direction.
[one of these things is not like the other|http://www.tbray.org/ongoing/When/200x/2008/11/20/2008-Disk-Performance#p-11] silicon disks are much better at random access than rust disks and [Machine architecture|http://video.google.com/videoplay?docid=-4714369049736584770] at about 1:40 - RAM is much worse at random access than sequential.

Need help to read Instant messenger packet

I need help to read the IM packet from the LAN.Can anyone help me? I doing my project to monitor the IM in LAN.If got example,pls show me.

There are several problems with this. First, it is not possible to separate IM packets from any other packets floating around a network. Second, to peek at packets intended for other computers is a pretty big no no.
If you really need to do this, build a proxy server or some layer in the middle of your IM where you can record
I need help to read the IM packet from the LAN.Can
anyone help me? I doing my project to monitor the IM
in LAN.If got example,pls show me.

Need help to share Number/Pages file visa Mail option. Cannot do with iPad Air (iOS7)

Need help to share Number/Pages file visa Mail option. Cannot do with iPad Air

Oh, okay. After selecting the format I want to send, it says "creating... ". Then irrespective of the format I choose the message e.g. "creating spreadsheet" disappears, and so does the choice window (where I earlier chose Mail). I am taken back to the Numbers (or Page) where I had started from. Diavonex's note indicated that after "creating ... " stage I should be taken to an option where I can type in email address where I want to send the file, if I want to copy it to another address etc. I cannot arrive at that page - no matter whether I am working with Pages or Number, or which format I choose for the file to share !
I will try to close as you have suggested and try. However, I have switched on and off several times by now, but nothing changed!
Will look forward to any ideas to solve this !!!
Thanks much!
Best

Need help in FCC in reciver file adapter

Hi Experts,
      I have a flat file structure as below -
   Header
       Text
   Rows
       FName    LName     EmpId     Location
   when i generate a CSV file i need to have these field names in the first row and then below these filed names i need values for these fileds
I am able to get the values for these fields but we need the field names in the file
Thanks in advance.

Hi,
Do one thing, at your target structure in mapping, right click on Rows and select "Duplicate Subtree". Now in the first parent node "Rows" just hard code 'FName', 'LName', 'EmpId', 'Location' and in the second parent node "Rows" do your mappings as you did earlier.
By doing so, you will not require to do any changes in your Data Type.
P.s. No need to do any change in your receiver FCC.
Regards,
Sarvesh

HT3775 I get the following message when trying to open an .avi downloaded from my video cam, need help, can not find the codec, thank you.The document "IMAG0026.AVI" could not be opened. A required codec isn't available.

I get the following message when trying to open an .avi downloaded from my video cam, need help, can not find the codec, thank you. This is for Quicktime Player.
"The document “IMAG0026.AVI” could not be opened. A required codec isn't available."

Try Perian.
http://perian.org/

Cannot create new folders on desktop. Cannot drag new items onto desktop. Desktop in Finder opens with Terminal. Not sure if this has anything to do with upgrading to Mavericks but I need help if anyone has ideas. Thank you.

I can no longer create new folders on my desktop. The option to do that is now light gray on the drop down menu and can't be selected.
I cannot drag new items onto desktop any longer either.
The Desktop in Finder opens with Terminal.
Folders and items on Desktop open and work normally.
Not sure if this has anything to do with upgrading to Mavericks but I need help if anyone has ideas.
Thank you.

Take these steps if the cursor changes from an arrow to a white "prohibited" symbol when you try to move an icon on the Desktop.
Sometimes the problem may be solved just by logging out or rebooting. Try that first, if you haven't already done it. Otherwise, continue.
Select the icon of your home folder (a house) in the sidebar of a Finder window and open it. The Desktop folder is one of the subfolders. Select it and open the Info window. In the General section of the window, the Kind will be either Folder or something else, such as Anything.
If the Kind is Folder, uncheck the box marked Locked. Close the Info window and test.
If the Kind is not Folder, make sure the Locked box is not checked and that you have Read & Write privileges in the Sharing & Permissions section. Then close the Info window and do as follows.
Back up all data.
Triple-click anywhere in the line below on this page to select it:
xattr -d com.apple.FinderInfo Desktop
Copy the selected text to the Clipboard by pressing the key combination command-C.
Launch the Terminal application in any of the following ways:
☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
☞ Open LaunchPad. Click Utilities, then Terminal in the icon grid.
Paste into the Terminal window (command-V). You should get a new line ending in a dollar sign (“$”). Quit Terminal.
Relaunch the Finder.
If the problem is now resolved, and if you use iPhoto, continue.
Quit iPhoto if it's running. Launch it while holding down the option key. It will prompt you to select a library. Choose the one you want to use (not the Desktop folder.)

Need help to start with some file and text manipulation

Hello script mavens,
I need help with starting a script that does the following:
-within a base folder it takes an inventory (list?) of all the files (which happen to be image files).
-creates a new folder inside the base folder and calls it imagesX where X increases by one every time the script is run
-moves all the files into the images folder
-within the base folder it creates a new text file and calls it imagesX.js
-writes a "//-" into imagesX.js
-then writes the list of filenames into the imagesX.js twice, separated by an empty line, and adds a semicolon to the end of each filename and saves imagesX.js
-from a folder a level above the base folder it copies a file called index.html into the base folder and renames in indexX.html
-in indexX.html it replaces a string "replaceThis" with "imagesX.js"
The task is more complex but this would help me tremendously do the rest.
If I am asking for too much on this forum please let me know

This should get you started.
The description of how you want to write the data isn't clear, but the rest should work (untested):
property imageNum : 0 -- last used ImageNumber
-- within a base folder it takes an inventory (list?) of all the files (which happen to be image files).
-- get the folder:
set baseFolder to (choose folder)
-- now get the files within it:
tell application "Finder"
set fileList to every file of folder baseFolder as alias list
end tell
--creates a new folder inside the base folder and calls it imagesX where X increases by one every time the script is run
tell application "Finder"
set imageNum to imageNum + 1
set newImageFolder to make new folder at baseFolder with properties {name:"images" & imageNum}
-- moves all the files into the images folder
move every file of folder baseFolder to newImageFolder
--within the base folder it creates a new text file and calls it imagesX.js
set textFile to (open for access file (baseFolder as text) & "images" & imageNum & ".js" with write permission)
--writes a "//-" into imagesX.js
write "//-" to textFile
-- then writes the list of filenames into the imagesX.js twice, separated by an empty line, and adds a semicolon to the end of each filename and saves imagesX.js
-- need more info here
-- a blank line between each instance of the file name? or all file names, blank line, all file names again?
-- an example, please
close access textFile
--from a folder a level above the base folder it copies a file called index.html into the base folder
--and renames in indexX.html
--in indexX.html it replaces a string "replaceThis" with "imagesX.js"
-- the easiest way of doing this is to read the file and write a new copy with the changes - that's easier than changing it in situ:
set indexHTML to (read file "index.html" of folder (container of baseFolder))
set {oldTIDs, my text item delimiters} to {my text item delimiters, "replaceThis"}
set indexHTML to text items of indexHTML
set my text item delimiters to "imagesX.js"
set indexHTML to indexHTML as text
set my text item delimiters to oldTIDs
set indexFile to (open for access file ("index" & imageNum & ".html") with write permission)
write indexHTML to indexFile
close access indexFile
end tell

Need help in linking a pdf file to my website, it stopped working

I want to upload a pdf file to my web site form my documents and it stop working, its been working fine until Sunday July 28. The support team from my web site said its a firefox issue,because if I use internet explorer it works fine Please help me Thanks Liz

When you have a problem with one particular site, a good "first thing to try" is clearing your Firefox cache and deleting your saved cookies for the site.
(1) Bypass Firefox's Cache
Use Ctrl+Shift+r to reload the upload page fresh from the server.
Alternately, you also can clear Firefox's cache completely using:
orange Firefox button (or Tools menu) > Options > Advanced
On the Network mini-tab > Cached Web Content : "Clear Now"
If you have a large hard drive, this might take a few minutes.
(2) Remove the site's cookies (save any pending work first).
While viewing a page on the site:
* right-click and choose View Page Info > Security > "View Cookies"
* Alt+t (open the classic Tools menu) > Page Info > Security > "View Cookies"
In the dialog that opens, you can remove the site's cookies individually.
Then try reloading the page and uploading again. Does that help?

I need help on reading a large file, thanks.

Similar Messages

Maybe you are looking for