Export Data- csv Extremely Slow

I am using SQL Developer 1.5.1 Build MAIN-5440 on Mac OS X 10.5.5 and the Export Data=>csv command is taking 20 minutes to show the file dialogue window. The query takes the expected amount of time and once I choose to save the file the remaining records are retrieved and the file is saved quickly. Anyone know of a workaround for this bug?
Thanks,
Jason

As discussed above, there is a bug in the SQL Developer export (since the initial 1.0 release from what I have seen) where the query is executed again (just fetching the first 50 records - not all of them) before the export dialog is displayed. This means that if your statement took 10 minutes to query the first 50 records when you first executed it, then it will take another 10 minutes between selecting the export option and the dialog being displayed. If your statement took a second to query the first 50 records, then it will take only another second between selecting the export option and the dialog being displayed.
Ordinarily, I would suggest that you upgrade to the current version (1.5.3) from 1.2, but 1.5.3 has other problems with the export sometimes not working. The export problems in 1.5.3 are not in 1.5.1, but even 1.5.1 has the bug where the export reruns the query before displaying the export dialog.
theFurryOne

Similar Messages

Very strange : Export from Organizer extremely slow

Today I came something strange while "exporting Files as New File" from the Organizer. I decided to report it, because the observation may point to a potential improvement.
In the Organizer (PSE V7), I went through File--> "Export as New File..." to export approximately 350 Jpeg Photo-Files (around 3 MBeach) to a USB Stick. I was knowing that writing to my USB stick was slow. But the Export Process was much slower than expected. It was ***extremely*** slow and after more than 1/2 hour, only 16% of the Photos had been exported. Also my PC (Windows XP Professional with SP3) was extremely slow in responding.
I therefore diced to kill the PSE Organizer.
Then I decided to 1) export the 350 Jpeg Files first to a Folder on my ***internal*** disk and then 2) to copy with Windows Explorer that Folder to my USB Stick. This was much, much more rapid.
From this experience, I get the impression that the "Export as new File" logic of PSE is doing something very vstrange and very inefficient ...something that could get probably improved.

I may not be having a snow leopard problem at all.
Going back to an old project in 1080i of an 8 minute length. the estimated time to render is about 50 minutes it says @20% of the way thru. Thats about 6x real time.
Maybe thats what I should expect. I was hoping for a significant speed increase in rendering times with the new OS. What is teh factor averaging for other people ?
I am rendering down to 720p multi pass 2320 kbit rate .MP4 in h.264
Maybe I have a settings problem in project properties in my other project.
I also got inspired and moved the render folders to a separate disk from the source files and put the caches on a 3rd drive. my I/O readings now are at 60 reads/sec.
Thanks for helping me work this issue out with you guys. Will keep you posted.

Data transfer extremely slow

My wifi network seems to be very slow in transferring data - Airplay on ATV or file exchange between macs is extremely slow. Playing Airplay video from iOS to ATV is worse than watching Youtube. My internal network appears slower than my internet connection.
Any suggestion on what I should check or reset? Thanks
It is a provider's Huawei modem and an Airport Extreme router, distance few meters. I will not wire devices:)

Please also note that using a "speed test service" like speedtest.net or other is a measurement of your WAN link, ie from your router's WAN interface to the specified test location. This is not a measurement of throughput to your "client device". These results would be the same between your wireless client connected at a poor 1Mbps speed and your 1Gbps wired desktop. Do not use these types of services as a measurement of throughput of your internal infrastructure.
Keep in mind file transfers in windows (like copy and paste to a file share) utilizes Microsoft's SMB/SMB2 protocol which is very chatty and very inneficient. This is not a good throughput test. Utilizing a pure TCP transfer method, like FTP, would give more realistic results. Even better would be to utilize an application like iPerf to perform pure tcp/udp throughput testing.
Also, Microsoft tends to display transfers in terms of MegaBytes, rather than MegaBits. Your 100Mbps (megabit) internet would provide a potential throughput of 12.5 MegaBytes. The same as on your LAN. When you're copying a file to a share and it's going at 2megaBytes per second, this is actually 16 megabits per second. So, your client connected at 54Mbps, half-duplex, realizing a throughput of probably around 20-25mbps is actually doing pretty good to get 2-3 megabytes of transfer speed using SMB file transfers.
Unless you have true tcp throughput tests prior to changes and after changes, the data you have provided thus far is not indicative of poor performance.

Export from FCE extremely slow after Snow leopard install

Instead of increasing my export times from FCE Snow Leopard has made them slower by a factor of ten. It is taking an hour to convert 3 minutes of 1080i to 720p !!!!! On an 8 core machine !!!
I am exporting 1080i to 720p with a bitrate of about 2000 for uploads to Utube. I tried using QT10 for export but I am not happy with the loss of control over my exports, it does work but not directly from FCE. The process called by QT10 is very fast and uses all 8 cores, but that process is not being called by FCE.
So at this point I wish I had never gone for the upgrade.
Lots of crashes with QT 7 during the open file dialogue and also same problem with MPEGStream Clip crashing on the file open dialogue as well after this OS upgrade

I may not be having a snow leopard problem at all.
Going back to an old project in 1080i of an 8 minute length. the estimated time to render is about 50 minutes it says @20% of the way thru. Thats about 6x real time.
Maybe thats what I should expect. I was hoping for a significant speed increase in rendering times with the new OS. What is teh factor averaging for other people ?
I am rendering down to 720p multi pass 2320 kbit rate .MP4 in h.264
Maybe I have a settings problem in project properties in my other project.
I also got inspired and moved the render folders to a separate disk from the source files and put the caches on a 3rd drive. my I/O readings now are at 60 reads/sec.
Thanks for helping me work this issue out with you guys. Will keep you posted.

Exporting to broadband extremely slow render

When I'm exporting a sequence to broadband quality it takes over 5 hours to export about an hour of video. How come its taking this long when I can export at full quality in only 12 minutes?

Think about it like this. You have a file that's 100MB, and you want to make another file in another codec that's 100MB. No problem. Simple transcode does it. Now you want to make a file that's 50MB. Takes twice as much work. Twice as much thinking and compression has to go on to reduce the file size. A lot of calculations have to be made to figure out how to throw out the data to make the file smaller. It can't simply trim off the last third of the movie. OK, now you want it to be 12MB. Now does it do that? A lot more thinking has to go into figuring out which bits of information can be thrown away and which can be preserved to make the file that small. The more compression you put into an image the more processing is required, the more calculations in determining pixels, and the more calculations the longer it takes.

Database export/exports are extremely slow

We run PeopleSoft (PeopleTools version 8.46) applications on Oracle 10g (10.1.0.3). database exports/imports were extremely slow, so when we contact PeopleSoft customer connection, we were advised to modify the init.ora file with the "_optimizer_cost_based_transformation=off". After we set the init.ora file, exports/imports are very fast.
What is optimizercost_based_transformation? will database performance have any effect by setting this parameter? Does anybody has issues with 10g export/import issues?
any help?
Thanks,

Here is the extract from PeopleSoft customer connection -
. Required INIT.ORA Parameters for Oracle 10g
. Change #1 - optimizercost_based_transformation=off
According to Oracle support: "This parameter controls whether query transformations (sub-query unnesting, complex view merging and push join predicate ) are performed using an algorithm that relies only on optimizer cost (new in 10g) or an algorithm that uses a combination of optimizer cost and heuristics (pre-10g). "
Can anbody tell me how extaclty this parameter will affect the performance of the system? Althoght we didn't see any performance issues right now (We are just in the process of implimentaion) Going forward, i am worried to have this im my init.ora file.
Any thoughts/suggestions related to this topic is helpful.
THanks,

How export to csv work in safari browser? In my application export to csv open like a raw data in new tab. But other browsers working great!. Need to open in a csv file or save it as a csv file.

How export to csv work in safari browser?
In my application export to csv open like a raw data in new tab.
But other browsers working great!.
Need to open in a csv file or save it as a csv file.
Please suggest me. Thank you in advance!.

Hi Adrian,
Why don't you try any another software for opening CSV files then Notepad ? According to my experience, you can use these softwares to open an CSV files and they are:-
Microsoft Excel
Open Office Calc
Google Docs
Also there is an additional tool available known as CSV viewer. You may try this, download it from here http://www.csvviewer.com/
I've never used Notepad for opening CSV files, because sometimes it contains some symbols which are not not at all compatibile with Notepad.
Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread.

[b]export data from a table to a csv or .txt file[/b]

hi plz i need help in how to export data from a table to a csv or .txt file

If you are using TOAD, then you can execute the statement like SELECT * FROM TABLE1
Then, you can go to Output Grid and you can say save as and you can save it as you want, excel, tab delimited or whatever.
Thanx,
Cheers,

How to export data from a string to a CSV file

Hello,
i do have a string in a Livecycle Designer script object with a couple of rows with different entries divided by a semicolon:
COLUMN1;COLUMN2;COLUMN3
Entry1;Entry2;Entry3
Entry4;Entry5;Entry6
The goal is now to export this string from Livecycle Designer into a CSV file by clicking a button. Is there any solution suggested?
Thank you very much.

Hi,
You can try creating a dataObject and then exporting it, you might get some warning messages popup but try this;
var csvData = "COLUMN1;COLUMN2;COLUMN3\r\n";
csvData += "Entry1;Entry2;Entry3\r\n";
csvData += "Entry4;Entry5;Entry6\r\n";
var pdf = event.target;
pdf.createDataObject("Data.csv", csvData);
pdf.exportDataObject({cName: "Data.csv"});
If you replace the last line with
pdf.exportDataObject({cName: "Data.csv", nLaunch: 2});
It will open in whatever .csv is registered for (Excel on my system)
Regards
Bruce

TS3899 After updating to ISO6, my email sending get extremely slow or dispeard. on the botton line of mail page always indicate "sending # of 9", however I do not know where to check or delete these unsent items. Please help! It has consumed lots of data.

After updating to ISO6, my email sending get extremely slow or dispeard. on the botton line of mail page always indicate "sending # of 9", however I do not know where to check or delete these unsent items. Please help! It has consumed lots of data.
I use @me.com and @hotmail.com

Hi,
>>A CHAR datatype and VARCHAR2 datatype are stored identically (eg: the word 'WORD' stored in a CHAR(4) and a varchar2(4) consume exactly the same amount of space on disk, both have leading byte counts).
Ok, but on the other hands:
SGMS@ORACLE10> create table x (name char(10), name2 varchar2(10));
Table created.
SGMS@ORACLE10> insert into x values ('hello','hello');
1 row created.
SGMS@ORACLE10> commit;
Commit complete.
SGMS@ORACLE10> select vsize(name),vsize(name2) from x;
VSIZE(NAME) VSIZE(NAME2)
10 5
SGMS@ORACLE10> select dump(name),dump(name2) from x;
DUMP(NAME) DUMP(NAME2)
Typ=96 Len=10: 104,101,108,108,111,32,32,32,32,32 Typ=1 Len=5: 104,101,108,108,111Cheers

Data modeler, error when exporting to csv files

hi, i have a relational model and i need to export this model to csv files, when exporting the model it errors,
displaying the following error nmessage:
Oracle SQL Developer Data Modeler Version: 2.0.0 Build: 584
Oracle SQL Developer Data Modeler Export Log
Date and Time: 2010-09-21 15:17:17
Design Name: Diagram
Model Name: CSV
Export Finished
Errors: 1
Warnings:0
<<<<< ERRORS >>>>>
java.lang.NullPointerException
the issue is a file is missing when exporting proccess is done, the file is DM_CommentsRDBMS.csv, this file contains the commens of columns.
Thanks.

Hi,
I logged bug however information is not enough to locate the problem.
You can use export to reporting schema in order to get your model exported - in database in that case.
We are not going to extend "export to CSV file" functionality any further - it'll be as it is now.
Philip

Export data to CSV in SQL Server

Hi,
I am trying to write a Java JDBC program exporting data
from the database into CSV file using SQL Server 2005 DB.
From that query:
String="SELECT * into OUTFILE '"+filename+'" FIELDS TERMINATED BY ',' FROM table1";
getting: "SQLException: Incorrect syntax near 'myfilename.csv'
Yes, I put filename in single quotes. Same problem without them, but it strips out csv file extension.
Using JTDS driver 1.2.4 on WinXP.
Will later need to insert that into a batch process.
What is a reason for that error? - I saw many many posts on the net, but no good explanations so far.
So how do I fix that ?
Is there a better way of doing it in SQL server ?
I am a Java developer, not a DBA or Unix Sys Admin ;-)
Please help !
TIA,
Oleg.

Here is one way to do it in Java. You can customize as you like. Do a Google on how to get a DataSource (or DriverManager) connection for SqlServer. If you do not know how to get a PrintWriter, you do something like:
PrintWriter writer = new PrintWriter(new FileOutputStream('results.csv");This will generate a generic CSV. It is probably not ideal, but should get you started.
    public final void serialize(final DataSource ds, final String sql, final PrintWriter writer)
        throws SQLException {
        Connection conn = null;
        PreparedStatement stmt = null;
        ResultSet results = null;
        try {
            conn = ds.getConnection();
            stmt = conn.prepareStatement(sql);
            results = stmt.executeQuery();
            ResultSetMetaData meta = results.getMetaData();
            int columnCount = meta.getColumnCount();
            while (results.next()) {
                for (int current = 0; current < columnCount; current++) {
                    Object value = results.getObject(current + 1);
                    if (current > 0) {
                        writer.print(", ");
                    writer.print("\"" + (value == null ? "" : value.toString()) + "\"");
                writer.println();
            writer.flush();
        finally {
            if (results != null) {
                try {
                    results.close();
                catch (SQLException e) {
                    e.printStackTrace();
            if (stmt != null) {
                try {
                    stmt.close();
                catch (SQLException e) {
                    e.printStackTrace();
            if (conn != null) {
                try {
                    conn.close();
                catch (SQLException e) {
                    e.printStackTrace();
    }My advice is to use BCP to start. The docs for the tool are here: [http://msdn.microsoft.com/en-us/library/aa174646(SQL.80).aspx]. You can manipulate the results in Access or Excel if you need to. Since it seems you are being thrown into an emergency and getting it fast is more important than you spending months learning additional Java API's.
- Saish

Show user entered date when ssrs report exported to csv format

Hi All,
How can I show date range parameter entered by user when ssrs report is exported to csv format.
my csv output should look like this....
Date : 01/01/2015 TO 01/31/2015 (user selected dates)
ID,EmpFirstName,EmpLastName,Location
1,Tom,Garry,NY
2,John,Graham,NJ
3,Ron,Lorrie,CA
Thanks,
RH
sql

Hi RH,
You can add two textbox at the top outside the tablix and using expression to get the parameter value use have selected to display in the textbox as blew:
TextBox1: =Parameters!Date.Value
TextBox2: =Parameters!To.Value
For Multiple value parameter you can use the expression like : =Join(Parameters!Date.Value,",")
You can rename the two textbox' name in the properties as "Date" and "To" then the two textboxs will display like belkow in the CSV report:
Date                 TO
01/01/2015     01/31/2015
ID   EmpFirstName    EmpLastName   Location
1      Tom                  Garry                  NY
2      John                 Graham               NJ
3      Ron                   Lorrie                 CA
If you still have any problem, please feel free to ask.
Regards
Vicky Liu
Vicky Liu
TechNet Community Support

Exporting data to csv files

Please can you help an Oracle newcomer?
Below is a script (which I took from the forums) that I used to
run in Lite to export data to a csv file.
As you can see I am having problems with running the same file
in 8i - It starts off OK i.e. asking for the name of the table
but then, instead of completing the full script it executes a
few lines then keeps asking me for the name of the table. I
suspect there is something wrng in my environment settings
(Comments ON etc.) but I have checked everything with no success.
Any help would be much appreciated as this is a really useful
script which I use the whole time.
Thanks very much for your help.
Regards
Andrew
SQL>
1 SET ECHO OFF
2 SET FEEDBACK OFF
3 SET HEADING OFF
4 SET PAGESIZE 0
5 SET TIMING OFF
6 SET VERIFY OFF
7 ACCEPT name_of_table PROMPT 'Enter the name of the table
you wish to convert: '
8 SPOOL query.sql
9 SELECT 'SPOOL ' || UPPER ('&name_of_table') || '.txt'
10 FROM DUAL;
11 SELECT 'SELECT ' || column_name
12 FROM all_tab_columns
13 WHERE table_name = UPPER ('&name_of_table')
14 AND column_id = 1;
15 SELECT '|| '','' || ' || column_name
16 FROM all_tab_columns
17 WHERE table_name = UPPER ('&name_of_table')
18 AND column_id > 1;
19 SELECT 'FROM ' || UPPER ('&name_of_table') || ';'
20 FROM DUAL;
21 SELECT 'SPOOL OFF'
22 FROM DUAL;
23 SPOOL OFF
24* START query
25 /
Enter value for name_of_table: new_table
old 9: SELECT 'SPOOL ' || UPPER ('&name_of_table') || '.txt'
new 9: SELECT 'SPOOL ' || UPPER ('new_table') || '.txt'
Enter value for name_of_table: new_table
old 13: WHERE table_name = UPPER ('&name_of_table')
new 13: WHERE table_name = UPPER ('new_table')
Enter value for name_of_table: new_table
old 17: WHERE table_name = UPPER ('&name_of_table')
new 17: WHERE table_name = UPPER ('new_table')
Enter value for name_of_table: New_table
old 19: SELECT 'FROM ' || UPPER ('&name_of_table') || ';'
new 19: SELECT 'FROM ' || UPPER ('New_table') || ';'
SET ECHO OFF
ERROR at line 1:
ORA-00922: missing or invalid option

Thanks for your help - problem solved I was using Run sql file
instead of Start sql file - oops!

Which version of the Forms Central subscription will allow me to export data to excel (CSV file)?

Which version of the Forms Central subscription will allow me to export data to excel (CSV file)?

Hi Heather 349
I believe you can do it with both FormsCentral Basic and FormsCentral PLUS
Also Refer : Tutorial: Exporting Responses to Excel, CSV or PDF

Export Data- csv Extremely Slow

Similar Messages

Maybe you are looking for