Cfspreadsheet and reading the xlsx files issue

I am trying to process large excel files (65,000 rows) into the DB. So I try to use the new cfspreadsheet tag to read in the files by 5000 rows at a time and then process the query into the tables. The process is working fine when reading the (pre 2003 format "xls" files) but not when reading the new "xlsx" type of files. The server is running out of memory trying to read those files for some reason. Is this a known bug in ColdFusion 9.0?? Has anyone experiansed similar issues?
Thanks

if it's a POI issue (not likely, admittedly), of CF's
usage thereof.
If you check the POI archives, you should see a LOT of memory issues with large xlsx files. Usually related to how the file is processed. IIRC the standard way of loading a spreadsheet ie new XSSFWorkbook(name) just reads the whole file into memory in one shot. So with all the bloated xml and parsing going on it is very prone to OOM errors.
For big files, they actually recommend using the event api instead, because of its lower footprint. I used it a couple months ago for a side project and it made a huge difference! I did some basic profiling and the standard method (usermodel) was definitely more prone to big spikes in memory and oom errors. In contrast, memory usage with event api was far lower and more stable.
Reason for bringing this all of this up ...? Well depending on how CF actually reads/loads spreadsheets internally, maybe the problem is a little bit of both .. ? Just my $0.02
-Leigh
Message was edited by: -==cfSearching==-

Similar Messages

Modifying and reading the WSDL file

I�ve got some questions about modifying and reading the WSDL file:�
READING
I want to read the elements of a determinated type (for example, documentation) from an WSDL that is in an URI. How can I do it?
I�ve been trying with the api from IBM WSDL4J, but I wasnt able to create an Element from type "documentation" to search it (if that is the way...)
MODIFYING
How can I insert in an WSDL file a new element (for example documentation) in an exactly place?
Any help is grateful,
Thanks in advance
Gobellot

The problem is I want to insert documentation elements (and that is not done automatically by the jwsdp (unless i dont know how to do it, please tell me if there is a way) and I want to interpret too some things from the documentation elements so I have to read it separately because de wsdltojava doesnt do anything special for that.
thanks anyway
Gobellot

How to login to a remote (FTP??) server and read an XML file?

Hello all,
I would like some information on how to login to a remote server using a Java program.
The server might be a ftp server, because the client will ftp a xml file to this server, and the java program needs to login to this server and read the xml file, then convert it into a general report with headings and data from the xml file.
How can I quickly find the API information to login to a server and read an xml file?
If anyone knows the packages off the top of their heads, that would save me some time surfing.
If anyone can provide me some links, code examples, or information I'd greatly be thankful.
sharla

You can also just use plain java.net. It supports FTP. Example:URL u = new URL("ftp://user:passwd@server/path/to/file.xml");
InputStream in = u.openStream();
// do what you want ...

When I am open file with adobe Pro and reader the resolution in my computer failing, change the resolution from 1920x1200 to 800x600. my video card is nvidia quadro 2000. w7 & 32 bits

when I am open file with adobe Pro and reader the resolution in my computer failing, change the resolution from 1920x1200 to 800x600. my video card is nvidia quadro 2000. w7 & 32 bits

Hi fabiangs,
I'm not sure that I follow. Are you saying that when you open a PDF file in Acrobat or Reader, that the display resolution changes automatically on your system?
What version of Acrobat/Reader are you using? Do you see this same issue in other files/applications?
I look forward to hearing back from you.
Best,
Sara

Powershell script - how to read a registry hive and store the value in text file and then again read the text file to write the values back in registry

Hi All,
powershell script Method required to read a value from registry and then taking the backup of that values in some text file.
For example the hive is
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Session Manager\Environment\Path
and under path i need to take back up of values in some text file and then put some value in the registry after back is taken in text file.
Also how to read the text file values so that we can again write to registry hive back from the back up text file.
Your help is much appreciated.
Umeed4u

I think you need to read this first:
http://social.technet.microsoft.com/Forums/scriptcenter/en-US/a0def745-4831-4de0-a040-63b63e7be7ae/posting-guidelines?forum=ITCG
Don't retire TechNet! -
(Don't give up yet - 12,830+ strong and growing)

How to read the and Write the PDF file give me the solution

Hi all,
How to read the and Write the PDF file give me the solution
My coding is
import java.io.File;
import com.asprise.util.pdf.PDFImageWriter;
import com.asprise.util.pdf.PDFReader;
import java.io.*;
import java.io.FileOutputStream;
public class example {
// public example() {
     public static void main(String a[])
          try
          PDFReader reader = new PDFReader(new File("C:\\AsprisePDF-DevGuide.pdf"));
               reader.open(); // open the file.
               int pages = reader.getNumberOfPages();
               for(int i=0; i < pages; i++) {
               String text = reader.extractTextFromPage(i);
               System.out.println("Page " + i + ": " + text);
// perform other operations on pages.
PDFImageWriter writer = new PDFImageWriter(new FileOutputStream("c:\\new11.pdf"));
               writer.open();
               writer.addImage("C:\\sam.doc");
               writer.close();
               System.out.println("DONE.");
reader.close();
          catch(Exception e){System.out.println("error:"+e);
          e.printStackTrace();
I get the pdf content then it returns the string value but ther is no option to write the string to PDF, and we only add a image file to PDF,but i want to know how to wrote the string value to PDF file,
Please give response immtly
i am waiting for your reply.
thanks,
Suresh.G

I have some question flow
How library to use this code.
I try runing but have not libary.
Please send me it'library
Thank you very much!

Hi... I would like to purchase a Tablet Sony Xperia Z 2 10.1 (the last one of the Z series) and I was told that Adobe does not support Sony anymore.... I need to be able to open and read Adobe PDF files and I would like to know if this tablet can still us

Hi... I would like to purchase a Tablet Sony Xperia Z 2 10.1 (the last one of the Z series) and I was told that Adobe does not support Sony anymore.... I need to be able to open and read Adobe PDF files and I would like to know if this tablet can still use Flash Player...
Is there anyo who can help me with this? I asked in the shop and I was told "yes of course" , but when I contacted Sony directly I was advised to check with Adobe as apparently in the recent months Adobe and Sony haven't been getting along anymore...

You may be mixing up two entirely different Adobe products.
1. Adobe Flash Player. Needed to view web pages designed with Flash. Not needed to view PDF files. Not available for Android (not just Sony).
2. Adobe Reader. Reads PDF files. However, the Android can also read most PDF files without needing Adobe Reader.

I have the latest downloadable version of LR5. It crashed while it was createing 1:1 previews during an import. After a Win7(64) restart, it shows a message that LR needs to quit because it can't read the preview files and it will try to fix it the next

I have the latest downloadable version of LR5. It crashed while it was createing 1:1 previews during an import. After a Win7(64) restart, it shows a message that LR needs to quit because it can't read the preview files and it will try to fix it the next time is launches. I get the same message the next and every subsequent time it launches so I can't launch LR at all now.
I get that the preview file got corrupted somehow. Is there some way to fix this problem without building a new catalog?

Use Windows Explorer to open the folder containing your catalog. You will see a folder with the extension .lrdata. You need to delete that folder and then start Lightroom again. Lightroom will generate a new previews folder.

How can I read the bootstrap files and extract the fragment-URLs and fragment-numbers in plain text?

How can I read the bootstrap files of any HDS Live stream and extract the fragment-URLs and fragment-numbers in plain text?
Could it be that it is some kind of compressed format in the bootstrap? Can I uncompress it wirh f4fpackager.exe? Could not find any download for f4fpackager.exe. I would prefere less code to do so. Is there something in Java of JavaScript, that can extract the fragment-numbers?
Thank you!

Doesn't sound too hard to me. Your class User (the convention says to capitalize class names) will have an ArrayList or Vector in it to represent the queue, and a method to store a Packet object into the List. An array or ArrayList or Vector will hold the 10 user objects. You will find the right user object from packet.user_id and call the method.
Please try to write some code yourself. You won't learn anything from having someone else write it for you. Look at sample code using ArrayList and Vector, there's plenty out there. Post in the forum again if your code turns out not to behave.

Hi im having huge problems trying to install flash for my mac 10.5 imac, iv gone through the internet and tried all of the solutions, everytime i try to install flash it says cant read the download file, or it just wont install, anybody plz help!

hi im having huge problems trying to install flash for my mac 10.5 imac, iv gone through the internet and tried all of the solutions, everytime i try to install flash it says cant read the download file, or it just wont install, anybody plz help!
iv unistalled flash, iv checked plug ins it just wont work,

It would have been a great help to know precisely what Mac you have, so some of the following may not apply:
You can check here: http://www.adobe.com/products/flash/about/ to see which version you should install for your Mac and OS. Note that version 10,1,102,64 is the last version available to PPC Mac users*. The latest version,10.3.183.23 or later, is for Intel Macs only running Tiger or Leopard, as Adobe no longer support the PPC platform. Version 11.4.402.265 or later is for Snow Leopard onwards.
(If you are running Mavericks: After years of fighting malware and exploits facilitated through Adobe's Flash Player, the company is taking advantage of Apple's new App Sandbox feature to restrict malicious code from running outside of Safari in OS X Mavericks.)
* Unhelpfully, if you want the last version for PPC (G4 or G5) Macs, you need to go here: http://kb2.adobe.com/cps/142/tn_14266.html and scroll down to 'Archived Versions/Older Archives'. Flash Player 10.1.102.64 is the one you download. More information here: http://kb2.adobe.com/cps/838/cpsid_83808.html
You should first uninstall any previous version of Flash Player, using the uninstaller from here (make sure you use the correct one!):
http://kb2.adobe.com/cps/909/cpsid_90906.html
and also that you follow the instructions closely, such as closing ALL applications (including Safari) first before installing. You must also carry out a permission repair after installing anything from Adobe.
After installing, reboot your Mac and relaunch Safari, then in Safari Preferences/Security enable ‘Allow Plugins’. If you are running 10.6.8 or later:
When you have installed the latest version of Flash, relaunch Safari and test.
If you're getting a "blocked plug-in" error, then in System Preferences… ▹ Flash Player ▹ Advanced
click Check Now. Quit and relaunch your browser.
You can also try these illustrated instructions from C F McBlob to perform a full "clean install", which will resolve the "Blocked Plug-in" message when trying to update via the GUI updater from Adobe.
Use the FULL installer for 12.0.0.44: Flash Player 12 (Mac OS X)
And the instructons are here: Snow Leopard Clean Install.pdf
(If you are running a PPC Mac with Flash Player 10.1.102.64 and are having problems with watching videos on FaceBook or other sites, try the following solution which fools the site into thinking that you are running the version 11.5.502.55:)
Download this http://scriptogr.am/nordkril/post/adobe-flash-11.5-for-powerpc to your desktop, unzip it, and replace the current Flash Player plug-in which is in your main/Library/Internet Plug-Ins folder, (not the user Library). Save the old one just in case this one doesn't work.

How can I download my issues with Reader's Digest when each time a pop appears and reads " the item you tried to buy is no longer available"?

I can no longer download my purchased Reader's Digest magazine since August as it requires updating the RD app. So when i try to download the RD app a pop up appears and reads " the item you tried to buy is no longer available". What does this mean and what do I do? I have 2 pending reader's digest issues that needs to be downloaded.

I don't have an answer for you but it may help to have a look at the "More Like This" section at the far right of this page. Reading those additional threads may get you some idea of the actual issue and how to resolve it. It could be that problems were found with the app and it was temporarily pulled for some reason which may be the reason for the "the item you tried to buy is no longer available" message.

I just updated to Adobe Reader 11.0.07 on my Mac 10.6.8 and now the video files don't work. How do I uninstall the update and return to the previous version?

I just updated to Adobe Reader 11.0.07 on my Mac OS version 10.6.8 and now the video files don't work. How do I uninstall the update and return to the previous version?

I received a notice from Chris Campbell at Adobe that stated : "....we are aware that Macs created between 2006 and 2008 are currently running into problems using the latest release of Flash Player (version 13)." My question is will the update of Adobe Reader 11.0.07 cause this problem with Flash Player 13 on my Mac? Sometimes when I try to view streaming video I get sound but no video.
>

Read a csv file and read the fiscal yr in the 4th pos?

Hello ABAP Experts,
how to write a code for read a csv file and read the fiscal year in the 4th position.
any suggestions or code highly appreciated.
Thanks,
BWer

Hi Bwer,
Declare table itab with the required fields...
Use GUI UPLOAD to get the contents of the file (say abc.csv) in case if the file is on the presentation server...
CALL FUNCTION 'GUI_DOWNLOAD'
EXPORTING
    filename                        = 'c:\abc.csv'
   FILETYPE                        = 'ASC'
    WRITE_FIELD_SEPARATOR           = 'X'
tables
    data_tab                        = itab
EXCEPTIONS
   FILE_WRITE_ERROR                = 1
   NO_BATCH                        = 2
   OTHERS                          = 22
IF sy-subrc <> 0.
MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
         WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
ENDIF.
Use OPEN DATASET in case if the file is on the application server..
After that USE SPLIT command at comma to get the contents of the 4th field...
Regards,
Tanveer.
<b>Please mark helpful answers</b>

How can I download and read a SWF file on IPad 2? The message returned is that Safari cannot download that file

How can I download and read a SWF file on IPad 2? The message returned is that Safari cannot download that file

SWF files are flash files, which are not supported on the iPad : http://www.apple.com/hotnews/thoughts-on-flash/
If you want to play the file then the iSwifter or Skyfire browser apps might work (they don't work on all flash sites) but you won't be able to download it

I have written a binary file with a specific header format in LABVIEW 8.6 and tried to Read the same Data File, Using LABVIEW 7.1.Here i Found some difficulty.Is there any way to Read the Data File(of LABVIEW 8.6), Using LABVIEW 7.1?

I have written a binary file with a specific header format in LABVIEW 8.6 and tried to Read the same Data File, Using LABVIEW 7.1.Here i Found some difficulty.Is there any way to Read the Data File(of LABVIEW 8.6), Using LABVIEW 7.1?

I can think of two possible stumbling blocks:
What are your 8.6 options for "byte order" and "prepend array or string size"?
Overall, many file IO functions have changed with LabVIEW 8.0, so there might not be an exact 1:1 code conversion. You might need to make some modifications. For example, in 7.1, you should use "write file", the "binary file VIs" are special purpose (I16 or SGL). What is your data type?
LabVIEW Champion . Do more with less code and in less time .

Cfspreadsheet and reading the xlsx files issue

Similar Messages

Maybe you are looking for