Issues when Downloading Large Datasets to Excel and CSV

Hi,
Hoping someone could lend a hand on the issues described below.
I have a prompted dahsboard that, dependent upon prompts selected, can return detail datasets. THe intent of this dashboard is to AVOID giving end users Answers Access, but still providing the ability to pull large amounts of detail data in an ad-hoc fashion. When large datasets are returned, end users will download the data to thier local machines and use excel for further analysis. I have tried two options:
1) Download to CSV
2) Download data to Excel
For my test, I am uses the dashboard prompts to return 1 years (2009) worth of order data for North America, down to the day level of granularity. Yes alot of detail data...but this is what many "dataheads" at my organization are requesting...(despite best efforts to evangelize the power of OBIEE to do the aggregation for them...). I expext this report to return somewhere around 200k rows...
Here are the results:
1) Download to CSV
Filesize: 78MB
Opening the downloaded file is failrly quick...
126k rows are present in the CSV file...but the dataset abruptly ends in Q3(August) 2009. The following error appears at the end of the incomplete dataset:
<div><script language="javascript" src="res/b_mozilla/browserdom.js"></script><script language="javascript" src="res/b_mozilla/common.js"></script><div class="ErrorMessage">Odbc driver returned an error (SQLFetchScroll).</div><div style="margin-top:2pt" onclick="SAWMoreInfo(event); return false;"><img class="ErrorExpanderImg" border="0" src="res/sk_oracle10/common/errorplus.gif" align="absmiddle">  Error Details<div style="margin-left:15px;display:none" compresssrc="res/sk_oracle10/common/errorminus.gif">
<div class="ErrorCodes">Error Codes: <span dir="ltr">OPR4ONWY:U9IM8TAC</span></div>
<div style="margin-top:4pt"><div class="ErrorSubInfo">State: HY000. Code: 10058. [NQODBC] [SQL_STATE: HY000] [nQSError: 10058] A general error has occurred.
[nQSError: 46073] Operation 'stat()' on file '/opt/apps/oracle/obiee/OracleBIData/tmp/nQS_31951_2986_15442940.TMP' failed with error: (75) ,Çyô@BÀŽB@B¨Ž¡pÇôäìž¬ü5HB. (HY000)</div></div></div></div></div>
2) Download to Excel
Filesize: 46MB
Opening the Excel file is extremely painful...over 20 minutes to open the file...making excel unusable during the opening process...defeinately not acceptable for end users.
When opened the file contains only 65k rows...when there should be over 200k...
Can you please help me understand the limitations of detail data output (downloading) from OBIEE...or provide workarounds for the circumstances above?
Thanks so much in advance.
Adam
Edited by: AdamM on Feb 9, 2010 9:01 PM
Edited by: AdamM on Feb 9, 2010 9:02 PM

@chandrasekhar:
Thanks for your response. I'll try with the export button but also willing to know how to create button on toolbar.And by clicking on that button a popup box will come having two radio buttons asking to download the report either in .xls or in .csv format. I am looking for the subroutines for that.
Thanks.
Message was edited by:
cinthia nazneen

Similar Messages

Downloading ALV report in excel and csv format

1.I have generated a report in ALV.
Now, I want a button 'generate' on my alv tooldbar.
How to do that?
2.Now clicking on that generate button will show a popup window containing the title 'Save list in file..'
And the window will contain two radio buttons to download the report in either in excel or in csv file format.
i. Spreadsheet(.xls)
ii.Spreadsheet(.csv)
How to get the popup window containing two radio buttons and having the options for downloading the alv report in the above file formats.
Kindly guide.

@chandrasekhar:
Thanks for your response. I'll try with the export button but also willing to know how to create button on toolbar.And by clicking on that button a popup box will come having two radio buttons asking to download the report either in .xls or in .csv format. I am looking for the subroutines for that.
Thanks.
Message was edited by:
cinthia nazneen

TS1368 when downloading large files such as videos of television season do you need to turn off autolock to prevent download from halting

when downloading large files such as videos of a television season do you need to turn off autolock to prevent download from halting? And if so, if the download will take a significant amount of time (not sure how much offhand) how do you prevent burn in from prolonged screen image?

Among the alternatives not mentioned... Using a TiVo DVR, rather than the X1; a Roamio Plus or Pro would solve both the concern over the quality of the DVR, as well as providing the MoCA bridge capability the poster so desperately wanted the X1 DVR to provide. (Although the TiVo's support only MoCA 1.1.) Just get a third-party MoCA adapter for the distant location. Why the hang-up on having a device provided by Comcast? This seems especially ironic given the opinions expressed regarding payments over time to Comcast. If a MoCA 2.0 bridge was the requirement, they don't exist outside providers. So couldn't the poster have simply requested a replacement XB3 from the local office and configured it down to only providing MoCA bridging -- and perhaps as a wireless access point? Comcast would bill him the monthly rate for the extra device, but such is the state of MoCA 2.0. Much of the OP sounds like frustration over devices providing capabilities the poster *thinks* they should have.

Hi there! So I am using Lightroom 3 on a pc and I have ran into an issue when exporting images. The DPI and image size (in inches) that I am selecting during the export process. For example I just exported a collection and set the dpi to 180 and the size

Hi there! So I am using Lightroom 3 on a pc and I have ran into an issue when exporting images. The DPI and image size (in inches) that I am selecting during the export process. For example I just exported a collection and set the dpi to 180 and the size to 7 inches on the long edge. My exported result is 457 dpi and sized at 3200x2134 pixels.. Any ideas on why this is happening and what I can do to correct it?

The DPI setting in a digital image has no meaning at all. You need to learn how to calculate what you need in your exported image. The only measurement in a digital image that has any meaning is the number of pixels in each direction. It doesn't matter what you set that DPI to (actually it's PPI or pixels per inch). The image will have the same number of pixels regardless of the setting. If you need an image that is 5 x 7" (for example) at 200 PPI then you would want an image that measured:
5 x 200 = 1000 pixels
7 x 200 = 1400 pixels
So you would need an image that is 1000 x 1400 pixels to have a 5 x 7" image at 200 PPI. The reason your exported image had such a high PPI setting is because you specified the number of inches you wanted the image to be. And there were enough pixels in the image that it calculated out to be that high PPI setting.
I apologize, I don't explain this very well. But you need to learn to do the math to determine how large you really want your exported images to be.

Hi, on my fathers pc sometimes when downloading multiple tabs start opening and I cannot stop this happening. Could anybody please help me?

Hi, on my fathers pc sometimes when downloading multiple tabs start opening and I cannot stop this happening. Could anybody please help me? for example, trying to download TomTom Start 25 user manual

You get that problem if you select the Firefox program to handle a file if you get an "open with" dialog.
*https://support.mozilla.com/kb/Firefox+keeps+opening+many+tabs+or+windows

When downloading updates for Quicktime 7 and Itunes 10 I keep getting an error saying that files shared by these updates has an invalid signature and that the downloaded has been removed.

When downloading updated for Quicktime 7 and Itunes 10 I keep getting an error saying that files shared by these updates has an invalid signature and that the downloaded has been removed. If I don't get that message I get a message saying that the download was unsuccesful and that in order to download I need to go to tools and then select dowload only. Please help I really want to update my iphone!

Thanks for helping out, but I already tried these steps.
I even tried this on a iMac with similar results. The only difference was that the errorcode was called 2001 instead of 21.
Today I took the phone to www.iphoneambulancen.dk. A guy (in Aarhus, Denmark) that specializes in iPhone repairs. I figured, that given his occupation he'd seen most errorcdes. Two hours later, he called me back, and told me that he had replaced the battery.
So, it turns out that a broken battery can cause this behaviour.
But thanks again

When downloaded adobe bridge on trial and select english ,when installed it comes up in Chinese language, i have uninstalled and installed a few times and this still happens ?

when downloaded adobe bridge on trial and select english ,when installed it comes up in Chinese language, i have uninstalled and installed a few times and this still happens ?

Unusual to be getting a DEP in those circumstances. (Still, I haven't been around all that much in recent times. So the world may have changed.)
What seems most likely is that we've got an iTunes preference file gone bad in some way. So I'd try the "Remove iTunes preferences files" section in the "User-specific troubleshooting" section from the following document. (Note you'll have to make sure that "Show hidden files and folders" is set on the PC in order to find the pref files.)
iTunes for Windows XP: Troubleshooting unexpected quits, freezes, or launch issues

When downloading a "Purchased" Photoshop package and you get an "Error 6...

When downloading a "Purchased" Photoshop package and you get an "Error 6", how do you actually get to speak with someone at Adobe? The program appeared to download properly and requested that I restart my computer, which I did, it indicated that I was experiencing an "Error 6" - and despite all of my efforts I could not find a single screen that would take me to a person at Adobe to assist me. It referred me to this source, and unfortunately I have a very unique situation that possibly only they could answer. Any help you could give me will be greatly appreciated. Thank you.

you purchased ps cs6?
and you see exit code 6 when installing ps cs6?

I tried to upgrade the new version for i pad mini but when downloading it just went off and told me to connect it to i tunes, so i did and now it says i need to restore it. Does that mean I will lose everything in my i pad?

I tried to upgrade the new version for i pad mini but when downloading it just went off and told me to connect it to i tunes, so i did and now it says i need to restore it. Does that mean I will lose everything in my i pad?

In other words, the upgrade process did not go altogether well and the device has lost all its contents. When you plug it in, they will be restored from the backup.

Export to excel and csv

I have table in a jsp and an export button. When user clicks on the export button the data in the table should be exported to either text, csv or excel depending on the option user chhoses. Can anyone help me with this? How to export to excel and csv format.

Hi arthur_branham,
I really liked the way you have replied. Can you pleae share the code with me at [email protected] below is my problem...
I had data in XML.I have displayed the data in jsp. Now i need to provide a link "Export to Excel" in jsp which will invokea servlet prepare the excel report and open up directly through a servlet....
I got some help from...http://www.javaworld.com/javaworld/jw-10-2006/jw-1019-xmlexcel.html?page=1...
This is my code in servlet...
HSSFWorkbook wb = new HSSFWorkbook();
HSSFSheet spreadSheet = wb.createSheet("Users");
spreadSheet.setColumnWidth((short) 0, (short) (256 * 25));
spreadSheet.setColumnWidth((short) 1, (short) (256 * 25));
// Creating Rows
HSSFRow row = spreadSheet.createRow(0);
HSSFCell cell = row.createCell((short) 1);
cell.setCellValue("Year 2005");
cell = row.createCell((short) 2);
cell.setCellValue("Year 2004");
HSSFRow row1 = spreadSheet.createRow(1);
HSSFCellStyle cellStyle = wb.createCellStyle();
cellStyle.setBorderRight(HSSFCellStyle.BORDER_MEDIUM);
cellStyle.setBorderTop(HSSFCellStyle.BORDER_MEDIUM);
cellStyle.setBorderLeft(HSSFCellStyle.BORDER_MEDIUM);
cellStyle.setBorderBottom(HSSFCellStyle.BORDER_MEDIUM);
cell = row1.createCell((short) 0);
cell.setCellValue("Revenue ($)");
cell = row1.createCell((short) 1);
cell.setCellValue("25656");
cell = row1.createCell((short) 2);
cell.setCellValue("15457");
FileOutputStream output = new FileOutputStream(new File("/tmp/Users.xls"));
response.setContentType("application/vnd.ms-excel");
response.setHeader("Content-Disposition", "attachment;filename=Users.xls");
ServletOutputStream out = response.getOutputStream();
wb.write(output);
output.flush();
output.close();
forward = null;
In firefox i get the download dialog box but not able to open in from there,i need to save it and then open. In IE i dont get the dialog box instead the excell open inside the browser......Please help me to open a excel sheet onclick on a link "Export to excel" in jsp......
1)If possible help me with the above code.
2)Or else plz sahre you code with me...
Its urgent....
Thanks in advance...

Export to Excel and CSV rounding differ

Hi All,
I was able to export data from report to excel and csv formats.However the excel format shows the downloaded values with decimal roundings, whereas CSV format is not showing the decimal roundings.
For example
Overall result is 253,333.39
Excell download will show it as 253,333.39
Assume that i have a scalling factor of 1000
CSV download will show is as 253.
How to download report with decimal roundings to CSV format.
Cheers,
Suresh.

Hi Anil,
Thanks for Reply, For example i have a Keyfigure as XXX with scaling factor as 1000.
The overall result for XXX is 253*1000 = 253,333.359
The overall result displayed in a BW web report is 253.
When we download the data to Excel it shows the value as
253,333.359.Which is correct.
The same function when we download to CSV format we can only see the total as 253*1000.
Hope this explains.
Cheers,
Suresh.

Ssrs 2008 export to excel and csv file

In a ssrs 2008 report, the user will export data to PDF, excel, and CSV files. When the report is exported to excel or csv file, the user wants me to hide some tablixes. Thus can you show me code on how to export the reports to csv or excel file without
and be able to hide a few tablixes?

Hi jazz_dog,
According to your description, you want to set the visibility for some tablixes based on the exporting file type. Right?
In Reporting Services 2008, we don't have any parameter to get type of exporting file. So we can only create a parameter and select a type before exporting to a file. Then use conditional expression to control the visibility. It's definitely not a good workaround,
so your goal can't be achieved in Reporting Services 2008. However, for Reporting Service 2008R2 or later version, we have a build-in parameter called Render Format Name, this parameter will display the type of exporting file automatically. So we can make
the judgment in expression based on the value of this parameter.
Reference:
Built-in Globals and Users References (Report Builder and SSRS)
If you have any question, please feel free to ask.
Best Regards,
Simon Hou

Increase width for Excel and CSV reports

HI ,
I am having problem with data in Excel and CSV reports , since the data is large and the width of the column is fixed its is displaying ###### ,
can u suggest me how to make the wodth of the columns variable depending upon the data passed.
I want to know how to increase the width of column in Excel and csv reports dynamically.
Thanks & Regards
Dipty

What has this to do with JSF?
It is obvious that it is a setting/bahaviour of Excel. Just doubleclick at the right column border, then it will be widen according to the largest cell contents.

IMac disconnects when downloading large files

The internet on my iMac is a wired connection, hooked up through my router. It works perfectly fine and never disconnects while I'm browsing, playing games, or anything like that. When I download small files, things are still fine. Whenever I download something that takes more than a few minutes, my connection will shut itself off like clockwork. It then takes a minute or two to kick back in and resume, but then after another few minutes it will disconnect itself again. It isn't my ISP, since my laptop (Windows 7) downloads fine on this same network. My iPhone and iPad also have no problem downloading large files on this network either. What could be causing this strange issue with my iMac?

Please read this whole message before doing anything.
This procedure is a diagnostic test. It’s unlikely to solve your problem. Don’t be disappointed when you find that nothing has changed after you complete it.
The purpose of this exercise is to determine whether the problem is caused by third-party system modifications that load automatically at startup or login. Disconnect all wired peripherals except those needed for the test, and remove all aftermarket expansion cards. Boot in safe mode and log in to the account with the problem. The instructions provided by Apple are as follows:
Be sure your Mac is shut down.
Press the power button.
Immediately after you hear the startup tone, hold the Shift key. The Shift key should be held as soon as possible after the startup tone, but not before the tone.
Release the Shift key when you see the gray Apple icon and the progress indicator (looks like a spinning gear).
Safe mode is much slower to boot and run than normal, and some things won’t work at all, including wireless networking on certain Macs.
The login screen appears even if you usually log in automatically. You must know your login password in order to log in. If you’ve forgotten the password, you will need to reset it before you begin.
Test while in safe mode. Same problem(s)?
After testing, reboot as usual (i.e., not in safe mode) and verify that you still have the problem. Post the results of the test.

Cells merge issue when extracting webi report in excel format

Hi Experts,
We have some WEBI reports in BO XI 3.1.
The reports have header where we are showing report name and some values which user selects in prompt.
Now the issue is that when we save our webi report in excel format, many cells get merge.
I have read many post on scn which suggest some solutions like changing the autofit width option to no and aligning the header width with colums.
Tried both the option but no success.
Is there any other way to achieve this.
Thanks in advance,
Regards,
Rishabh

Hi,
We managed to find the workaround for this merge cell issue.
Sharing it might be helpful for someone.
- Align the report name and other block in report in such a way that the ends are in line with the end point of any column. The only limitation is that when applying pivot to the excel output we neet to click on any of the ccolumn so that excel identify the data set.
- Second workaround is to break the webi document in two parts report1 will contain the report name and the block to show the prompt values selected by the user where as report2 will contain the table withactual data. The only limitation with this workaround is that when exporting the repot output to excel we will get two tabs in the excel sheet one containing the prompt values and secont tab containing the actual data.
Regards,
RS

Issues when Downloading Large Datasets to Excel and CSV

Similar Messages

Maybe you are looking for