Error with large amount of HTML received
Hi,
I'm using MS IE 6.0 and I'm having the same problem.
When loading a page containing huge informaion, I receive the following popup error:
"Internet Explorer cannot open the internet site http://localhost:8080/Tree/center.jsp?chapterValue=242&topicvalue=6745&chapterName=Chapter67&topicname=topic45
Operation aborted"
center.jsp accesses the database and returns the information which can be 80MB.
Interesting... MSIE reports the error when loading the page. When you click "OK" in the error popup, the page stays blank(i.e., says"Page cannot be displayed"), but if you click the refresh button on the browser, the page displays correctly.
Don't know if it's a problem associated with MS IE 6, but it seems to occur ONLY when loading the page that has huge data.
- Frank.
Sounds like the browser is timing out because the page is taking so long to load. Try doing a search of the forum on how to do a "page loading" JSP page. It comes up fairly frequently and should be easy to find.
Similar Messages
-
How do I pause an iCloud restore for app with large amounts of data?
I am using an iPhone app which is holding 10 Gb of data (media files) .
Unfortunately, although all data was backed up, my iPhone 4 was faulty and needed to be replaced with a new handset. On restore, the 10Gb of data takes a very long time to restore over wi-fi. If interrupted (I reached the halfway point during the night) to go to work or take the dog for a walk, I end up of course on 3G for a short period of time.
Next time I am in a wi-fi zone the app is restoring again right from the beginning
How does anyone restore an app with large amounts of data or pause a restore?You can use classifications but there is no auto feature to archive like that on web apps.
In terms of the blog, Like I have said to everyone that has posted about blog preview images:
http://www.prettypollution.com.au/business-catalyst-blog
Just one example of an image at the start of the blog post rendering out, not hard at all. -
Error in Generating reports with large amount of data using OBIR
Hi all,
we hve integrated OBIR (Oracle BI Reporting) with OIM (Oracle Identity management) to generate the custom reports. Some of the custom reports contain a large amount of data (approx 80-90K rows with 7-8 columns) and the query of these reports basically use the audit tables and resource form tables primarily. Now when we try to generate the report, it is working fine with HTML where report directly generate on console but the same report when we tried to generate and save in pdf or Excel it gave up with the following error.
[120509_133712190][][STATEMENT] Generating page [1314]
[120509_133712193][][STATEMENT] Phase2 time used: 3ms
[120509_133712193][][STATEMENT] Total time used: 41269ms for processing XSL-FO
[120509_133712846][oracle.apps.xdo.common.font.FontFactory][STATEMENT] type1.Helvetica closed.
[120509_133712846][oracle.apps.xdo.common.font.FontFactory][STATEMENT] type1.Times-Roman closed.
[120509_133712848][][PROCEDURE] FO+Gen time used: 41924 msecs
[120509_133712848][oracle.apps.xdo.template.FOProcessor][STATEMENT] clearInputs(Object) is called.
[120509_133712850][oracle.apps.xdo.template.FOProcessor][STATEMENT] clearInputs(Object) done. All inputs are cleared.
[120509_133712850][oracle.apps.xdo.template.FOProcessor][STATEMENT] End Memory: max=496MB, total=496MB, free=121MB
[120509_133818606][][EXCEPTION] java.net.SocketException: Socket closed
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:99)
at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
at weblogic.servlet.internal.ChunkOutput.writeChunkTransfer(ChunkOutput.java:525)
at weblogic.servlet.internal.ChunkOutput.writeChunks(ChunkOutput.java:504)
at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:382)
at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:469)
at weblogic.servlet.internal.ChunkOutput.write(ChunkOutput.java:304)
at weblogic.servlet.internal.ChunkOutputWrapper.write(ChunkOutputWrapper.java:139)
at weblogic.servlet.internal.ServletOutputStreamImpl.write(ServletOutputStreamImpl.java:169)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
at oracle.apps.xdo.servlet.util.IOUtil.readWrite(IOUtil.java:47)
at oracle.apps.xdo.servlet.CoreProcessor.process(CoreProcessor.java:280)
at oracle.apps.xdo.servlet.CoreProcessor.generateDocument(CoreProcessor.java:82)
at oracle.apps.xdo.servlet.ReportImpl.renderBodyHTTP(ReportImpl.java:562)
at oracle.apps.xdo.servlet.ReportImpl.renderReportBodyHTTP(ReportImpl.java:265)
at oracle.apps.xdo.servlet.XDOServlet.writeReport(XDOServlet.java:270)
at oracle.apps.xdo.servlet.XDOServlet.writeReport(XDOServlet.java:250)
at oracle.apps.xdo.servlet.XDOServlet.doGet(XDOServlet.java:178)
at oracle.apps.xdo.servlet.XDOServlet.doPost(XDOServlet.java:201)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292)
at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42)
at oracle.apps.xdo.servlet.security.SecurityFilter.doFilter(SecurityFilter.java:97)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3496)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(Unknown Source)
at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2180)
at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2086)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1406)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
It seems where the querry processing is taking some time we are facing this issue.Do i need to perform any additional configuration to generate such reports?java.net.SocketException: Socket closed
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:99)
at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
at weblogic.servlet.internal.ChunkOutput.writeChunkTransfer(ChunkOutput.java:525)
at weblogic.servlet.internal.ChunkOutput.writeChunks(ChunkOutput.java:504)
at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:382)
at weblogic.servlet.internal.CharsetChunkOutput.flush(CharsetChunkOutput.java:249)
at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:469)
at weblogic.servlet.internal.CharsetChunkOutput.implWrite(CharsetChunkOutput.java:396)
at weblogic.servlet.internal.CharsetChunkOutput.write(CharsetChunkOutput.java:198)
at weblogic.servlet.internal.ChunkOutputWrapper.write(ChunkOutputWrapper.java:139)
at weblogic.servlet.internal.ServletOutputStreamImpl.write(ServletOutputStreamImpl.java:169)
at com.tej.systemi.util.AroundData.copyStream(AroundData.java:311)
at com.tej.systemi.client.servlet.servant.Newdownloadsingle.producePageData(Newdownloadsingle.java:108)
at com.tej.systemi.client.servlet.servant.BaseViewController.serve(BaseViewController.java:542)
at com.tej.systemi.client.servlet.FrontController.doRequest(FrontController.java:226)
at com.tej.systemi.client.servlet.FrontController.doPost(FrontController.java:128)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292)
at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:175)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3498)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(Unknown Source)
at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2180)
at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2086)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1406)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:17
(Please help finding a solution in this issue its in production and we need to ASAP)
Thanks in Advance
Edited by: 909601 on Jan 23, 2012 2:05 AM -
How to load a large amount of HTML into HTML region?
I am trying to display a clickable image map (HTML <map>) in a region. The HTML source for the image map is fairly large and will not fit in the Apex editor (HTTP 400 error when I Apply Changes). I would also rather not manage that much HTML in the Apex web editor. So I stored the code in a file and added it to my applications file storage.
I have tried various methods of getting the HTML to load when the page is rendered. I tried a URL region, but that leads to all kinds of ACL/security issues that we do not want the customner to have to deal with. i also tried some PL/SQL:
DECLARE
l_file_id NUMBER;
BEGIN
SELECT id
INTO l_file_id
FROM APEX_APPLICATION_FILES
WHERE filename = 'myhtml';
APEX_UTIL.GET_FILE(
p_file_id => l_file_id,
p_inline => 'YES');
END;
But that just replaces the entire page, not just the region it's defined in (even when the HTML is without <head> etc).
Various attampes wih #APP_IMAGES#myhtml and &APP_IMAGES.myhtml just give me the translation of the APP_IMAGES variable.
So, how do I load a large chunk of HTML into a region dynamically at run time? I also need this to interact with APEX in the sense that JavaScript will set APEX variables and cause a SUBMIT when the use clicks on the image map.Hi Andy,
ATD wrote:
Does your HTML define the regions/points on the map using AREA tags?Yes. it is actually generated using MapSefrver from huge tables of SDO_GEOMETRY (Oracle Spatial).
If so, you could define a report template that does this and use this for a report based on a table that has the settings for shape, coords, href etcHmm, the code (HTML map) is auto-generated so if I understand you correctly, this might be difficult. One of the HTML is approximately 180KB of text.
I found a way to do this using dynamic PL/SQL. I created a new table that has a varchar filename and a CLOB for the file data. I then imported the HTML into the table using SQL Developer (copy&paste, nice!). I then created an HTML region and used the following:
declare
html clob;
len number;
st number;
c number;
begin
select length(data)
into len
from FILES
where name = 'state_query.html';
st := 1;
while len > 0
loop
if len > 32000 then
c := 32000;
else
c := len;
end if;
select substr( data,st,c )
into html
from FILES
where name = 'state_query.html';
htp.p( html );
st := st + c;
len := len - c;
end loop;
end;
Edited by: CoyoteTech on May 13, 2009 7:27 AM -
Out.println() problems with large amount of data in jsp page
I have this kind of code in my jsp page:
out.clearBuffer();
out.println(myText); // size of myText is about 300 kbThe problem is that I manage to print the whole text only sometimes. Very often happens such that the receiving page gets only the first 40 kb and then the printing stops.
I have made such tests that I split the myText to smaller parts and out.print() them one by one:
Vector texts = splitTextToSmallerParts(myText);
for(int i = 0; i < texts.size(); i++) {
out.print(text.get(i));
out.flush();
}This produces the same kind of result. Sometimes all parts are printed but mostly only the first parts.
I have tried to increase the buffer size but neither that makes the printing reliable. Also I have tried with autoFlush="false" so that I flush before the buffer size gets overflowed; again same result, sometimes works sometimes don't.
Originally I use such a system where Visual Basic in Excel calls a jsp page. However, I don't think that this matters since the same problems occur if I use a browser.
If anyone knows something about problems with large jsp pages, I would appreciate that.Well, there are many ways you could do this, but it depends on what you are looking for.
For instance, generating an Excel Spreadsheet could be quite easy:
import javax.servlet.*;
import javax.servlet.http.*;
import java.io.*;
public class TableTest extends HttpServlet{
public void doGet(HttpServletRequest request, HttpServletResponse response) throws IOException, ServletException {
response.setContentType("application/xls");
PrintWriter out = new PrintWriter(response.getOutputStream());
out.println("Col1\tCol2\tCol3\tCol4");
out.println("1\t2\t3\t4");
out.println("3\t1\t5\t7");
out.println("2\t9\t3\t3");
out.flush();
out.close();
}Just try this simple code, it works just fine... I used the same approach to generate a report of 30000 rows and 40 cols (more or less 5MB), so it should do the job for you.
Regards -
Working with large amount of data
Hi! I am writing an peer-to-peer video player and I need to operate with huge amounts of data. The downloaded data should be stored in memory for sharing with other peers. Some video files can be up to 2 GB and more. So keep all this data in RAM - not the best solution i think =)
Since the flash player does not have access to the file system I can not save this data in temporary files.
Is there a solution to this problem?No ideas? very sad ((
-
Ni reports crashes with large amounts of data
I'm using labview 6.02 and am using some of the Ni reports tools to generate a report. I create, what can be, a large data array which is then sent to the "append table to report" vi and printed. The program works fine, although it is slow, as long as the data that I send to the "append table to report" vi is less than about 30kb. If the amount of data is too large Labview terminates execution with no error code or message displayed. Has anyone else had a similar problem? Does anyone know what is going on or better yet how to fix it?
Hello,
I was able to print a 100x100 element array of 5-character strings (~50 kB of data) without receiving a crash or error message. However, it did take a LONG time...about 15 minutes for the VI to run, and another 10 minutes for the printer to start printing. This makes sense, because 100x100 elements is a gigantic amount of data to send into the NI-Reports ActiveX object that is used for printing. You may want to consider breaking up your data into smaller arrays and printing those individually, instead of trying to print the giant array at once.
I hope these suggestions help you out. Good luck with your application, and have a pleasant day.
Sincerely,
Darren N.
NI Applications Engineer
Darren Nattinger, CLA
LabVIEW Artisan and Nugget Penman -
PI 7.1 IMAP email Adapter Error reading large amounts of emails
Hi,
are there any known problems with the email-Adapter (Sender), reading IMAP MS Exchange Server?
We have an email adapter reading the MS Exchange Server Mail Account once per Minute and in the mail account are about 4.000 unread email (1KB each) .
After 2000 emails, the adapter stops working and throws only exceptions.
Any idea?
Thanks
hsHi Holger,
i made a few tests at that time, and there was no specific scenario which re-produced this error.
In some tests i was able to process more than 3000 emails before the error occured, next time only 2000.
And this only occured when the inbox had a huge amount of emails. if i moved, lets say 1000 emails to a temporary folder,
processed 1000 and then moved the 1000 back to the inbox, there was no problem. Now i'm polling every minute and i'm
not receiving 2000 emails in a minute, so i'm not having this issue anymore. it only happend when we stopped the
sender channel for a while and a lot of emails were queuing up in the inbox. I don't think that there are any MS Exchange settings that need to be changed and when we spoke to Support that time, they refered to the Note i mentioned earlier.
Maybe there is still a problem in the mail adapter itself..
regards,
Daniel -
XML-Export Error for large amount of data
Hi there...
I have an application process, which runs on demand (Button) and which exports data (from sql query) into a file (.xls).
The result is being formated and the export works fine as long as the query returns just a small amount of data, approx. 8 to 10 rows.
As the result is being stored in a clob, I output the data with "htp.prn" in a loop by "cutting" the clob into small pieces (varchar).
However, as soon as the amount is bigger than the mentioned 8 to 10 rows, I get an error (sqlerrm:ORA-06502: PL/SQL: numeric or value error).
I guess there must be something wrong with my loop or the way I "cut" the clob into pieces and output them.
Maybe someone has a hint for me where to look at exactly!?
Thanks in advance...
Johnny
Here is my code (I removed parts of it, which are not important for this issue):
declare
l_xml_header varchar2(32767);
l_xml_body clob;
l_xml_text varchar2(32767);
l_xml_footer varchar2(32767);
runner number;
clob_size number;
begin
runner := 2;
owa_util.mime_header( 'application/octet', FALSE);
htp.p('Content-Disposition: attachment; filename="Test.xls"');
owa_util.http_header_close;
l_xml_header := '<?xml version="1.0" encoding="utf-8"?>'||chr(10)||
'<?mso-application progid="Excel.Sheet"?>'||chr(10)||
'<Workbook xmlns="urn:schemas-microsoft-com:office:spreadsheet"'||chr(10)||
'xmlns:o="urn:schemas-microsoft-com:office:office"'||chr(10)||
'xmlns:x="urn:schemas-microsoft-com:office:excel"'||chr(10)||
'xmlns:ss="urn:schemas-microsoft-com:office:spreadsheet"'||chr(10)||
'xmlns:html="http://www.w3.org/TR/REC-html40">'||chr(10)||
'<DocumentProperties xmlns="urn:schemas-microsoft-com:office:office">'||chr(10)||
'<Version>1.0</Version>'||chr(10)||
'</DocumentProperties>'||chr(10)||
'<ExcelWorkbook xmlns="urn:schemas-microsoft-com:office:excel">'||chr(10)||
'<WindowHeight>8580</WindowHeight>'||chr(10)||
'<WindowWidth>15180</WindowWidth>'||chr(10)||
'<WindowTopX>120</WindowTopX>'||chr(10)||
'<WindowTopY>45</WindowTopY>'||chr(10)||
'<ProtectStructure>False</ProtectStructure>'||chr(10)||
'<ProtectWindows>False</ProtectWindows>'||chr(10)||
'</ExcelWorkbook>'||chr(10)||
'<Styles>'||chr(10)||
'<Style ss:ID="Default" ss:Name="Normal">'||chr(10)||
'<Alignment ss:Vertical="Bottom"/>'||chr(10)||
'<Borders/>'||chr(10)||
'<Font ss:FontName="Arial" x:Family="Swiss"/>'||chr(10)||
'<Interior/>'||chr(10)||
'<NumberFormat/>'||chr(10)||
'<Protection/>'||chr(10)||
'</Style>'||chr(10)||
'<Style ss:ID="s22">'||chr(10)||
'<Font x:Family="Swiss" ss:Bold="1"/>'||chr(10)||
'</Style>'||chr(10)||
'<Style ss:ID="s67">'||chr(10)||
'<Font ss:FontName="Arial" x:Family="Swiss" ss:Color="#FFFFFF"/>'||chr(10)||
'</Style>'||chr(10)||
'<Style ss:ID="s157">'||chr(10)||
'<Borders/>'||chr(10)||
'</Style>'||chr(10)||
'<Style ss:ID="s158">'||chr(10)||
'<Borders>'||chr(10)||
'<Border ss:Position="Right" ss:LineStyle="Continuous" ss:Weight="1"/>'||chr(10)||
'</Borders>'||chr(10)||
'</Style>'||chr(10)||
'</Styles>';
for z in 1..1
loop
l_xml_body:=l_xml_body||'<Worksheet ss:Name="Worksheet1"> <Table x:FullColumns="1" x:FullRows="1" ss:DefaultColumnWidth="60">';
l_xml_body:=l_xml_body||'<Row><Cell ss:StyleID="s163"><Data ss:Type="String">Colum1</Data></Cell>'||
'<Cell ss:StyleID="s163"><Data ss:Type="String">Colum2</Data></Cell>'||
'<Cell ss:StyleID="s163"><Data ss:Type="String">Colum3</Data></Cell>'||
'<Cell ss:StyleID="s163"><Data ss:Type="String">...</Data></Cell>'||
'<Cell ss:StyleID="s166"><Data ss:Type="String">ColumN</Data></Cell></Row>';
for z in (
select
a."Col1",
a."Col2",
b."Col3",
b."ColN"
from table1 a,
table2 b
where a.id = b.id
loop
l_xml_body := l_xml_body||'<Row><Cell ss:StyleID="s157"><Data ss:Type="String">'||
z.Col1||'</Data></Cell><Cell ss:StyleID="s157"><Data ss:Type="String">'||
z.Col2||'</Data></Cell><Cell ss:StyleID="s157"><Data ss:Type="String">'||
z.Col3||'</Data></Cell><Cell ss:StyleID="s157"><Data ss:Type="String">'||
... ||'</Data></Cell><Cell ss:StyleID="s157"><Data ss:Type="String">'||
z.ColN||'</Data></Cell>';
l_xml_body := l_xml_body||'</Row>'||chr(10);
runner := runner + 1;
end loop;
l_xml_body := l_xml_body||'</Table>';
end loop;
clob_size := dbms_lob.getlength(l_xml_body);
htp.prn(l_xml_header);
for i in 1..ceil(clob_size / 32767)
loop
l_xml_text := dbms_lob.SUBSTR (l_xml_body, 32767, v_count);
HTP.prn (l_xml_text);
v_count := v_count + 32767;
end loop;
htp.prn('</Worksheet></Workbook>');
HTMLDB_APPLICATION.g_unrecoverable_error := TRUE;
EXCEPTION
WHEN OTHERS
THEN
OWA_UTIL.mime_header ('application/octet', FALSE);
HTP.prn ('Content-Disposition: attachment; filename="Test.xls"');
OWA_UTIL.http_header_close;
HTMLDB_APPLICATION.g_unrecoverable_error := TRUE;
end;
#######################################################Thanks for the hint Paul,
here is my code in code-tags.
I appreciate any help!
Johnny
declare
l_xml_header varchar2(32767);
l_xml_body clob;
l_xml_text varchar2(32767);
l_xml_footer varchar2(32767);
runner number;
clob_size number;
begin
runner := 2;
owa_util.mime_header( 'application/octet', FALSE);
htp.p('Content-Disposition: attachment; filename="Test.xls"');
owa_util.http_header_close;
l_xml_header := '<?xml version="1.0" encoding="utf-8"?>'||chr(10)||
'<?mso-application progid="Excel.Sheet"?>'||chr(10)||
'<Workbook xmlns="urn:schemas-microsoft-com:office:spreadsheet"'||chr(10)||
'xmlns:o="urn:schemas-microsoft-com:office:office"'||chr(10)||
'xmlns:x="urn:schemas-microsoft-com:office:excel"'||chr(10)||
'xmlns:ss="urn:schemas-microsoft-com:office:spreadsheet"'||chr(10)||
'xmlns:html="http://www.w3.org/TR/REC-html40">'||chr(10)||
'<DocumentProperties xmlns="urn:schemas-microsoft-com:office:office">'||chr(10)||
'<Version>1.0</Version>'||chr(10)||
'</DocumentProperties>'||chr(10)||
'<ExcelWorkbook xmlns="urn:schemas-microsoft-com:office:excel">'||chr(10)||
'<WindowHeight>8580</WindowHeight>'||chr(10)||
'<WindowWidth>15180</WindowWidth>'||chr(10)||
'<WindowTopX>120</WindowTopX>'||chr(10)||
'<WindowTopY>45</WindowTopY>'||chr(10)||
'<ProtectStructure>False</ProtectStructure>'||chr(10)||
'<ProtectWindows>False</ProtectWindows>'||chr(10)||
'</ExcelWorkbook>'||chr(10)||
'<Styles>'||chr(10)||
'<Style ss:ID="Default" ss:Name="Normal">'||chr(10)||
'<Alignment ss:Vertical="Bottom"/>'||chr(10)||
'<Borders/>'||chr(10)||
'<Font ss:FontName="Arial" x:Family="Swiss"/>'||chr(10)||
'<Interior/>'||chr(10)||
'<NumberFormat/>'||chr(10)||
'<Protection/>'||chr(10)||
'</Style>'||chr(10)||
'<Style ss:ID="s22">'||chr(10)||
'<Font x:Family="Swiss" ss:Bold="1"/>'||chr(10)||
'</Style>'||chr(10)||
'<Style ss:ID="s67">'||chr(10)||
'<Font ss:FontName="Arial" x:Family="Swiss" ss:Color="#FFFFFF"/>'||chr(10)||
'</Style>'||chr(10)||
'<Style ss:ID="s157">'||chr(10)||
'<Borders/>'||chr(10)||
'</Style>'||chr(10)||
'<Style ss:ID="s158">'||chr(10)||
'<Borders>'||chr(10)||
'<Border ss:Position="Right" ss:LineStyle="Continuous" ss:Weight="1"/>'||chr(10)||
'</Borders>'||chr(10)||
'</Style>'||chr(10)||
'</Styles>';
for z in 1..1
loop
l_xml_body:=l_xml_body||'<Worksheet ss:Name="Worksheet1"> <Table x:FullColumns="1" x:FullRows="1" ss:DefaultColumnWidth="60">';
l_xml_body:=l_xml_body||'<Row><Cell ss:StyleID="s163"><Data ss:Type="String">Colum1</Data></Cell>'||
'<Cell ss:StyleID="s163"><Data ss:Type="String">Colum2</Data></Cell>'||
'<Cell ss:StyleID="s163"><Data ss:Type="String">Colum3</Data></Cell>'||
'<Cell ss:StyleID="s163"><Data ss:Type="String">...</Data></Cell>'||
'<Cell ss:StyleID="s166"><Data ss:Type="String">ColumN</Data></Cell></Row>';
for z in (
select
a."Col1",
a."Col2",
b."Col3",
b."ColN"
from table1 a,
table2 b
where a.id = b.id
loop
l_xml_body := l_xml_body||'<Row><Cell ss:StyleID="s157"><Data ss:Type="String">'||
z.Col1||'</Data></Cell><Cell ss:StyleID="s157"><Data ss:Type="String">'||
z.Col2||'</Data></Cell><Cell ss:StyleID="s157"><Data ss:Type="String">'||
z.Col3||'</Data></Cell><Cell ss:StyleID="s157"><Data ss:Type="String">'||
... ||'</Data></Cell><Cell ss:StyleID="s157"><Data ss:Type="String">'||
z.ColN||'</Data></Cell>';
l_xml_body := l_xml_body||'</Row>'||chr(10);
runner := runner + 1;
end loop;
l_xml_body := l_xml_body||'</Table>';
end loop;
clob_size := dbms_lob.getlength(l_xml_body);
htp.prn(l_xml_header);
for i in 1..ceil(clob_size / 32767)
loop
l_xml_text := dbms_lob.SUBSTR (l_xml_body, 32767, v_count);
HTP.prn (l_xml_text);
v_count := v_count + 32767;
end loop;
htp.prn('</Worksheet></Workbook>');
HTMLDB_APPLICATION.g_unrecoverable_error := TRUE;
EXCEPTION
WHEN OTHERS
THEN
OWA_UTIL.mime_header ('application/octet', FALSE);
HTP.prn ('Content-Disposition: attachment; filename="Test.xls"');
OWA_UTIL.http_header_close;
HTMLDB_APPLICATION.g_unrecoverable_error := TRUE;
end; -
Catalog mapping error- with large entries
Hello,
When the catalog containing around 4000 items was uploaded, I received the error
The exception occurred (program: /CCM/CL_MAPPING_MANAGER=======CP, include /CCM/CL_MAPPING_MANAGER=======CM00P, line: 465)
However when the same catalog is getting uploaded when the catalog was split into two and then uploaded. Also the catalog with this large entries is getting uploaded in test system.
Can anyone help me figure out the problem for mapping exception, and let me know if something can be done?
Thanks!
SwethaHi Swetha,
In my opinion this may be due to a timeout in mapping process. Which CCM SP level are you running?.
Have you had a look to the SAP Note 926007?.
I hope this help.
Best Regards -
Workspace Error with Large Financial Report Book
I have been having inconsistent issues getting certain FR books to run in Workspace with the only error I'm receiving being:
+5200: Error executing query: EssbPROD/RE/RE/nholmes/Error(1042006)
Network error [10048]: Unable to connect to [EssbPROD:1423]. The client timed out waiting to connect to Essbase Agent using TCP/IP. Check your network connections. Also make sure that server and port values are correct+
The reason I say inconsistent is that sometimes the same books that give me errors run just fine with no problems.
It has started to become an issue because it seems more and more that they will not run and they are being used for our month-end close so it's pretty important that they run when needed. Unfortunately I can't break up the report books because the accounting group wants to see them the way that they are now.
I have tinkered with Report Optimization Settings with the FR client to find a combination that might make it work better but it always eventually comes back to this error even if it works after change the settings. I see no need and modifying the reports since I know they work because they work sometimes. I just need to know if it is possibly a memory setting somewhere that can be adjusted to make these report books run consistently.
Thank you for any help that can be provided.
We are running 11.1.1.3The following KM might help
Financial Reporting (FR) Error: "5200: Client Timed Out Waiting to Connect to Analytic Services Agent Using TCP/IP." (Doc ID 604745.1) -
Converting tdm to lvm/ working with large amount of data
I use a PCI 6251 card for data aquisition, and labview version 8; to log 5 channels at 100 Khz for approximately 4-5 million samples on each channel (the more the better). I use the express VI for reading and writing data which is strored in .tdm format (file size of the .tdx file is around 150 MB). I did not store it in lvm format to reduce the time taken to aquire data.
1. how do i convert this binary file to a .mat file ?
2. In another approach, I converted the tdm file into lvm format, this works as long as the file size is small (say 50 MB) bigger than that labview memory gets full and will not save the new file. what is an efficient method to write data (say into lvm format) for big size files without causing labview memory to overflow? I tried saving to multiple files, saving one channel at a time, increased the computer's virtual memory (upto 4880 MB) but i still have problems with 'labview memory full' error.
3. Another problem i noticed with labview is that once it is used to aquire data, it occupies a lot of the computer's memory, even after the VI stops running, is ther a way to refresh the memory and is this mainly due to bad programming?
any suggestions?I assume from your first question that you are attempting to get your data into Matlab. If that is the case, you have three options:
You can treat the tdx file as a binary file and read directly from Matlab. Each channel is a contiguous block of the data type you stored it in (DBL, I32, etc.), with the channels in the order you stored them. You probably know how many points are in each channel. If not, you can get this information from the XML in the tdm file. This is probably your best option, since you won't have to convert anything.
Early versions of TDM storage (those shipping with LV7.1 or earlier) automatically read the entire file into memory when you load it. If you have LV7.1, you can upgrade to a version which allows you to read portions of the file by downloading and installing the demo version of LV8. This will upgrade the shared USI component. You can then read a portion of your large data set into memory and stream it back out to LVM.
Do option 2, but use NI-HWS (available on your driver CD under the computer based instruments tab) instead of LVM. HWS is a hierarchical binary format based on HDF5, so Matlab can read the files directly through its HDF5 interface. You just need to know the file structure. You can figure that out using HDFView. If you take this route and have questions, reply to this post and I will try to answer them. Note that you may wish to use HWS for your future storage, since its performance is much better than TDM and you can read it from Matlab. HWS/HDF5 also supports compression, and at your data rates, you can probably pull this off while streaming to disk, if you have a reasonably fast computer.
Handling large data sets in LabVIEW is an art, like most programming languages. Check out the tutorial Managing Large Data Sets in LabVIEW for some helpful pointers and code.
LabVIEW does not release memory until a VI exits memory, even if the VI is not running. This is an optimization to prevent a repeatedly called VI from requesting the same memory every time it is called. You can reduce this problem considerably by writing empty arrays to all your front panel objects before you exit your top level VI. Graphs are a particulary common problem.
This account is no longer active. Contact ShadesOfGray for current posts and information. -
Loosing indexes working with large amounts of data
SCENARIO
We are working on an Interface project with ORACLE 10g that works basically like this:
We have some PARAMETER TABLES in which the key users can insert, update or delete parameters via a web UI.
There is a download process that brings around 20 million records from our ERP system into what we call RFC TABLES. There are around 14 RFC TABLES.
We developed several procedures that process all this data against the PARAMETER tables according to some business rules and we end up with what we call XML TABLES because they are sent to another software, completing the interface cycle. We also have INTERMIDIATE TABLES that are loaded in the middle of the process.
The whole process takes around 2 hours to run.
We had to create several indexes to get to this time. Without the indexes the process will take forever.
Every night the RFC, INTERMIDIATE and XML tables need to be truncated and then loaded again.
I know It might seem strange why we delete millions of records and then load them again. The reason is that the data the users insert in the PARAMETER TABLES need to be processed against ALL data that comes from the ERP and goes to the other software.
PROBLEMS
As I said we created several indexes in order to make the process run in less than 2 hours.
We were able to run the whole process in that time for a few times but, suddenly, the process started to HANG forever and we realized some indexes were just not working anymore.
When running EXPLAIN we figured the indexes were making no effect and we had some ACCESS FULLS. Curiously when taking the HINTS off and putting them back in the indexes started working again.
SOLUTION
We tried things like
DBMS_STATS.GATHER_SCHEMA_STATS(ownname => SYS_CONTEXT('USERENV', 'CURRENT_SCHEMA'), cascade=>TRUE);
dbms_utility.analyze_schema
Dropping all tables and recreating the every time before the process starts
Nothing solved our problem so far.
We need advice from someone that worked in a process like this. Where millions of records are deleted and inserted and where a lot of indexes are needed.
THANKS!
Joseskynyrd wrote:
I don't know anything about
BIND variables
Stored Outlines
bind peeking issue
or plan stability in the docs
but I will research about all of them
we are currently running the process with a new change:
We put this line:
DBMS_STATS.GATHER_SCHEMA_STATS(ownname => SYS_CONTEXT('USERENV', 'CURRENT_SCHEMA'), cascade=>TRUE);
after every big INSERT or UPDATE (more than 1 million records)
It is running well so far (it's almost in the end of the process). But I don't know if this will be a definitive solution. I hope so.
I will post here after I have an answer if it solved the problem or not.
Thanks a lot for your help so farWell, you best get someone in there that knows what those things are, basic development, basic performance tuning and basic administration all are predisposed on understanding these basic concepts, and patching is necessary (unless you are on XE). I would recommend getting books by Tom Kyte, he clearly explains the concepts you need to know to make things work well. You ought to find some good explanations of bind peeking online if you google that term with +Kyte.
You will be subject to this error at random times if you don't find the root cause and fix it.
Here is some food for your thoughts:
http://structureddata.org/2008/03/26/choosing-an-optimal-stats-gathering-strategy/ (one of those "what to expect from the 10g optimizer" links does work)
http://kerryosborne.oracle-guy.com/2009/03/bind-variable-peeking-drives-me-nuts/
http://pastebin.com/yTqnuRNN
http://kerryosborne.oracle-guy.com/category/oracle/plan-stability/
Getting stats on the entire schema as frequently as you do may be overkill and time wasting, or even counterproductive if you have an issue with skewed stats. Note that you can figure out what statistics you need and lock them, or if you have several scenarios, export them and import them as necessary. You need to know exactly what you are doing, and that is some amount of work. It's not magic, but it is math. Get Jonathan Lewis' optimizer book. -
URLConnection with large amount of data causes OutOfMemoryError: Java heap
I am setting up a system where my customers can sent me their data files to my server. If I use a simple socket with a server permanently running on a chosen port, my customers are able to transfer files of any size without problem. However, If I adopt a different architecture, using a web server and a CGI program to receive their submissions, the client program that they run will crash if the file they are sending is any larger than about 30 Mbytes, with the exception OutOfMemoryError: Java heap.
The code in the two architectures is almost identical:
Socket con = new Socket( host, portno);
//URL url = new URL("http://"+host+":"+portno+path);
//URLConnection con = url.openConnection();
//con.setDoOutput(true);
File source_file = new File(file_name);
FileInputStream source = new FileInputStream(source_file);
out = new BufferedOutputStream(con.getOutputStream());
// First, Send a submission header.
data_out = submit_info.getBytes();
len = data_out.length + 1;
data_len[0] = (byte)len;
out.write(data_len, 0, 1);
out.write(data_out, 0, data_out.length);
// Then send the file content.
buff = new byte[(int)buffSize];
content_length = source_file.length();
long tot = 0;
while ( tot < content_length )
// Read data from the file.
readSize = (int) Math.min( content_length-tot, buffSize );
nRead = source.read(buff, 0, readSize);
tot += nRead;
if ( nRead == 0 ) break;
// Send data.
out.write(buff, 0, nRead);
"buffSize" is 4096. This code works fine, but if the first line is commented out and the next three are uncommented, the OutOfMemory exception is thrown within the loop when "tot" is around 30 million.
I have tried calling the garbage collector within the loop but it makes no difference. I am unable to anticipate the size of files that my customers will submit, so I cannot set the heap size in advance to cope with what they will sent. Fortunately, using a simple Socket avoids the problem, so there seems to be something wrong with how URLConnection works.Set the URLConnection to use chunked mode. This saves it from having to buffer the entire contents before sending to ascertain its length.
-
Messages with large attachements not being received
# ./imsimta version
Sun Java(tm) System Messaging Server 7u2-7.02 64bit (built Apr 16 2009)
libimta.so 7u2-7.02 64bit (built 02:28:03, Apr 16 2009)
Using /opt/sun/comms/messaging64/config/imta.cnf (compiled)
I have a user that is trying to receive an email with a somewhat sizable .tif image attached and he has not received it. Upon digging through the log file, I noticed the following errors. Any idea what is going on here?
05-Jan-2011 10:38:33.37 tcp_local ims-ms V 0 [email protected] mailto:rfc822,[email protected] spn@ims-ms-daemon psmtp.com ([unknown] [64.18.3.167]) Error reading SMTP packet
05-Jan-2011 10:39:27.60 tcp_local ims-ms E 9 [email protected] mailto:rfc822,[email protected] spn@ims-ms-daemon psmtp.com ([unknown] [64.18.3.70])
05-Jan-2011 10:39:27.71 ims-ms D 9 [email protected] mailto:rfc822,[email protected] spn@ims-ms-daemon
05-Jan-2011 10:46:07.67 tcp_local ims-ms V 0 [email protected] mailto:rfc822,[email protected] spn@ims-ms-daemon psmtp.com ([unknown] [64.18.3.179]) Timeout after 5 minutes trying to read SMTP packetDoes this indicate a problem going outbound?
05-Jan-2011 12:43:45.47 tcp_local QEQ 22 ... smtp;250 2.1.5 Recipient Accepted: Error reading SMTP packet; response to dot-stuffed message expected; likely probYes, similar problem. The MTA's smtp_client process has connected to the remote MTA, sent the MAIL FROM, RCPT TO, started the DATA phase, sent the data, and sent the "." to end the DATA phase and is now waiting for the response from the remote SMTP server acknowledging it has accepted the message. Something went wrong in receiving that acknowledgement. You could add the master_debug option to that channel definition in imta.cnf, cnbuild, and restart job_controller. That would create master debug log files which would have more info about what is happening. Or you could look at it with snoop. Or, if the remote MTA is your postini server, perhaps look at logs on that side.
Maybe you are looking for
-
Shop deleted my profile- how do I access my info?!
So I was having the ever-present Display issue that is oh-so-common with these iMacs, and sent it to THE ONLY Apple maintenance shop in all of Korea. While language was a barrier, we managed to describe the issue and told them emphatically that we do
-
Error in receiver mail adapter
Hi, i am working with file to mail scenario. I have two files.The second file i am sending as an attachment with the first file. My receiver communication channel has following error:: error occured: [2006-11-08T07:35:08Z] unable to call the mailer;
-
What determines output of 'D' in "to_char" function?
Hi, Oracle 10.1.0.4.0 on Red Hat Linux SQL> select to_char(sysdate,'D (DY) DD-MON-YYYY') as TODAY from DUAL; TODAY 5 (THU) 29-MAR-2007What causes Oracle to say that Thursday is the fifth day of the week? SQL> select NAME, VALUE from V$PARAMETER where
-
How to transfer from time domain data to FFT domain
I have built Labview program to acquire data, which in time domain I would like to change it to frequency domain in the same program for further processing,
-
Can you loop effects in Captivate?
Hello! I am trying to create the image of someone falling down a hole with the little speed lines trailing behind it. I'd like to give it the image of falling for the entire time the user is on the slide. Is there a way to loop effects to continue