XML Parser and memory utilization

I am using the sample given with
the PL/SQL Parser to transform a
1.5M file. When the document is
parsed Oracle's memory resources
increase 50M until the system
runs out of virtual memory and
errors out. If I decrease the
size of the file to ~750K it
works ok. When I use Saxon to
transform the file it uses ~10M.
Is there anyway to get the Oracle
parser to better utilize memory,
or am I missing some point?
sg

Hi,
I have checked the lib folder. xmlparsev2.jar is there. Is this the classpath? if not how do i get it to the classpath? and how do i do that?
Thanks for your help so far

Similar Messages

How to display CPU and memory utilization from ST06 in a report

Hi,
I want to display CPU Utilization and Memory utilization and File sys details from ST06 transaction in a report.
Is there any function module or any other method to do that.
Please advice.
Thanks,
Sandeep.

Hi Ranganath,
Thanks for your time.
And thank you very much for the reply.
Both the function modules are helpful.
But can u also help me in getting the data of FileSys from ST06.
Thankyou,
Sandeep.

XML Parser and Content-type/encoding problem

I've write a little and simple XML parser and a simple "trasformer" that recive an XML file and an XSL one and return HTML, here is the code:
public static String toHTML(Document doc, String xslSource){
 ByteArrayOutputStream testo = new ByteArrayOutputStream();
 try{
 DOMSource source = new DOMSource(doc);
 TransformerFactory tFactory = TransformerFactory.newInstance();
 System.out.println("----> " + xslSource);
 Transformer transformer = tFactory.newTransformer(new StreamSource(xslSource));
 transformer.setOutputProperty(OutputKeys.INDENT, "yes");
 transformer.setOutputProperty("{http://xml.apache.org/xslt}indent-amount", "2");
 transformer.setOutputProperty(OutputKeys.METHOD, "html");
 transformer.setOutputProperty(OutputKeys.OMIT_XML_DECLARATION, "yes");
 transformer.setOutputProperty(OutputKeys.ENCODING, "UTF-8");
 transformer.transform(source, new StreamResult(testo));
 }catch(Exception ioe){
 System.out.println("2 XMLTool.toHTML " + new java.util.Date());
 System.out.println(ioe);
 return testo.toString();
 }the problem is that I would like to put the HTML code its return into a JEditorPane; now I'm trying with this code:
JEditorPane jep1 = new JEditorPane();
jep1.setContentType("text/html");
jep1.setText(v);
// 'v' is the string returned by the code posted up (the XML/XSL transformer)but I can't see anything in my JEditorPane.
I think that the problem is this line of code that the transformer add automaticaly ad HTML code:
<META http-equiv="Content-Type" content="text/html; charset=UTF-8">Infact if I try to delete this line from the code I can see what I want but is'n good delete a line of code without understend where is the problem.
So, can anyone help me?

good.
when u set ur output properties to html , transformer
searches for all entity references and converts accordingly.
if u r using xalan these files will be used for conversion of
Character entity references for markup-significant
output_html.properties
(this should be in templates package)
and HTMLEntities.res(should be in serialize package)
vasanth-ct

SNMP OID for CPU and Memory Utilization on a MDS 9509

Does anyone know what the OIDs are for CPU and Memory utilization on a MDS 9509?
Thanks

CISCO-SYSTEM-EXT-MIB.my is a good place to start and you can determine the OID from the MIB.
Once you feel as though you are on the right track, have a look at:
http://www.oidview.com/mibs/9/CISCO-SYSTEM-EXT-MIB.html
I gather that what you need is:
1.3.6.1.4.1.9.9.305.1.1.1
and
1.3.6.1.4.1.9.9.305.1.1.2
Enjoy.
Stephen

OID for CPU and MEMORY utilization for wrv4400n

Hi,
Can any one please tell me the OID for CPU and MEMORY utilization for wrv4400n?
Thanks
Vipin

CISCO-SYSTEM-EXT-MIB.my is a good place to start and you can determine the OID from the MIB.
Once you feel as though you are on the right track, have a look at:
http://www.oidview.com/mibs/9/CISCO-SYSTEM-EXT-MIB.html
I gather that what you need is:
1.3.6.1.4.1.9.9.305.1.1.1
and
1.3.6.1.4.1.9.9.305.1.1.2
Enjoy.
Stephen

How to find CPU and Memory Utilization

Hi,
How to find CPU and Memory Utilization of my application which is
running in solaris workstation.My application has a management console in which we need to update the cpu and memory periodically.
(Notr : Usage of JNI is restrcited)
Thnx and Rgds,
Mohan

There is no CPU usage API in Java. You need some JNI code. For memory usage see the Runtime methods:
 * Get information of memory usage: max, total, free and (available/used).
 * <ul>
 * <li>Max is the maximum amount of bytes the application can allocate (see also java options -Xmx). This value is fixed.
 * If the application tries to allocate more memory than Max, an OutOfMemoryError is thrown.
 * <li>Total is the amount of bytes currently allocated from the JVM for the application.
 * This value just increases (and doesn't decrease) up to the value of Max depending on the applications memory
 * requirements.
 * <li>Free is the amount of memory that once was occupied by the application but is given back to the JVM. This value
 * varies between 0 and Total.
 * <li>The used amount of memory is the memory currently allocated by the application. This value is always less or equal
 * to Total.
 * <li>The available amount of memory is the maximum number of bytes that can be allocated by the application (Max - used).
 * </ul>
 * In brief: used <= total <= max
 * 
 * The JVM can allocate up to 64MB (be default) system memory for the application. If more is required, the JVM has to be started with the Xmx option
 * (e.g. "java -Xmx128m" for 128 MB). The amount of currently allocated system memory is Total. As the JVM can't give back unallocated memory
 * to the operating system, Total can just increase (up to Max).
 * @return Memory info.
 static public String getMemoryInfo() {
 StringBuilder sb = new StringBuilder();
 sb.append("Used: ");
 sb.append(toMemoryFormat(getUsedMemory()));
 sb.append(", Available: ");
 sb.append(toMemoryFormat(getAvailableMemory()));
 sb.append(" (Max: ");
 sb.append(toMemoryFormat(Runtime.getRuntime().maxMemory()));
 sb.append(", Total: ");
 sb.append(toMemoryFormat(Runtime.getRuntime().totalMemory()));
 sb.append(", Free: ");
 sb.append(toMemoryFormat(Runtime.getRuntime().freeMemory()));
 sb.append(")");
 return sb.toString();
 }//getMemoryInfo()

XML parser and XML processor

Hi,
I am trying to load the XML Parser and XSLT processor into the XDK that i have. Please can someone tell me how this is done. So far i keep hearing about classpath and .jar files. i have no idea what to do with these. Is there a manual which will tell me how to do this? Or can anyone explain to me?. Or can anyone tell me how to check if they are already there, the technican installed the software but does not know how to use it!, so i am very lost with this and am using it for my masters project.
Hope you can help.
Thanks

Hi,
I have checked the lib folder. xmlparsev2.jar is there. Is this the classpath? if not how do i get it to the classpath? and how do i do that?
Thanks for your help so far

Swapping XML Parser and XSLT to Xalan 2.7.0 - Not Working (OC4J 10.1.3)

Hi-
I'm trying to use the latest Xercies/Xalan classes in OC4J 10.1.3 as described in the How-To swap XML Parsers document:
http://www.oracle.com/technology/tech/java/oc4j/1013/how_to/how-to-swapxmlparser/doc/readme.html
What I can see happening is that the oracle.xml shared library is successfully 'turned off', but the xalan libraries are not added. Instead, the default xml classes that are distributed with the JDK become visible. For instance, using a slightly modified version of the index.jsp page from the how-to, I get this result:
------ Output from JSP page ----------------
TransformerFactory Instance: org.apache.xalan.processor.TransformerFactoryImpl
Transformer Instance: org.apache.xalan.transformer.TransformerIdentityImpl
Transformer Version: Xalan Java 2.4.1 (!!)
What I expect is for that last line to say version 2.7.0, which is the version of the xalan.jar included in my shared library (code to add that line to the how-to shown below).
I suspect what is happening is that the class loader is simply not letting a shared library override a system library - to do that you probably need to place the jar files in system endorsed directory.
Has anyone gotten this how-to to work - actually replacing the XML parser/transform classes with the latest Xalan classes? Are you sure it is seeing the current version you placed in the shared library?
Thanks,
Eric Everman
---- My modified getXSLTDetails() method in the index.jsp page of the how-to -------

<%@ page import="org.apache.xalan.Version" %>
public static String getXSLTDetails()
Transformer transformer=null;
TransformerFactory transformerfactory = TransformerFactory.newInstance();
 Version ver = null;
 String br = "<" + "br" + ">"; //otherwise the otn forum chocks on the break.
try
transformer = transformerfactory.newTransformer();
 ver = (Version) transformer.getClass().forName("org.apache.xalan.Version").newInstance();
 String ret_val =
 "TransformerFactory Instance: "+transformerfactory.getClass().getName() + br +
 "Transformer Instance: "+transformer.getClass().getName() + br;
 if (ver != null) {
 ret_val = ret_val + "Transformer Version: " + ver.getVersion() + br;
 } else {
 ret_val = ret_val + "Transformer Version not Available" + br;
 return ret_val;
catch (Exception e)
e.printStackTrace();
return e.getMessage();
}--------------------------------------------------------------------

Steve - Thanks for responding on this.
The Xalan SQL extension is built into Xalan. The most painless way to try it out is to run it via JEdit: www.jedit.org
JEdit a OS Java application with a fairly painless install process (I'm assuming you already have a current JRE installed). Once its installed, you'll need to install the XSLT plugin - in JEdit goto Plugins | Plugin Manager | Install and pick the XSLT plugin. You'll need the Oracle JDBC classes on your classpath - this can be done by copying the oracle_jdbc4.jar into the [JEdit install directory]/jars directory.
Restart to load that jar and you should be all set.
I included a sample XSLT page at the bottom of this post that is somewhat of a template transform for the SQL extension - its more complicated then it needs to be, but it does some nice things with the results of the query. Save it as a file and make the appropriate changes to the 'datasource' parameter near the top of the file.
Then in JEdit, open the file and make sure the XSLT plugin is visible (Plugins | XSLT | XSLT Processor Toggle - or alternately dock it in the window via global prefs). In the XSLT plugin: Allow the current buffer to be used as the source, Add that same file as a stylesheet via the '+' button, and pick a result file at the bottom. Then click the 'Transform XML' button.
Troubleshooting: I seem to remember having some classpath errors when I tried this on windows, but others have had it work w/o issues. I do remeber that the XSLT plugin had a popup window that gave a pretty good explaintion of the problem, if it occurs. Also, for some reason the XSLT plugin will not create a new file for the output, so its often best to create a file first, then choose it as the output. Of course, you can always run a transformation from the command line or w/in an applicatoin. Full docs on the Xalan SQL extension can be found at: http://xml.apache.org/xalan-j/extensionslib.html#sql
Here is my sample XSLT transform using the SQL extension:
<?xml version="1.0" encoding="UTF-8" ?>
<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform"
 xmlns:sql="http://xml.apache.org/xalan/sql"
 xmlns:str="http://exslt.org/strings"
 xmlns:xalan="http://xml.apache.org/xalan"
 extension-element-prefixes="sql str xalan">
 <xsl:output indent="yes"/>
 <xsl:param name="driver">oracle.jdbc.OracleDriver</xsl:param>
 <xsl:param name="datasource">jdbc:oracle:thin:jqpublic/jqpublic@server_name:1521:dbname</xsl:param>
 <xsl:param name="jndiDatasource"></xsl:param>
 <xsl:param name="debug">true</xsl:param>
 <xsl:variable name="connection" select="sql:new()"/>
 <xsl:variable name="uppercase" select="'ABCDEFGHIJKLMNOPQRSTUVWXYZ'"/>
 <xsl:variable name="lowercase" select="'abcdefghijklmnopqrstuvwxyz'"/>
 
 <xsl:param name="query">
 select * from (
SELECT
 'One' FIELD_1,
 'Two' FIELD_2
 FROM DUAL
 ) where rownum < 100
 </xsl:param>
 
 <xsl:variable name="connection" select="sql:new()"/>
 <xsl:template match="/">
 <xsl:choose>
 <xsl:when test="$jndiDatasource != ''">
 <xsl:if test="not(sql:connect($connection, $jndiDatasource))">
 <xsl:message>Failed to connect to db via jndi connection</xsl:message>
 <xsl:comment>Failed to connect to db via jndi connection</xsl:comment>
 <xsl:if test="$debug = 'true'">
 <xsl:copy-of select="sql:getError($connection)/ext-error"/>
 </xsl:if>
 </xsl:if>
 </xsl:when>
 <xsl:otherwise>
 <xsl:if test="not(sql:connect($connection, $driver, $datasource))">
 <xsl:message>Failed to connect to db via driver/url connection</xsl:message>
 <xsl:comment>Failed to connect to db via driver/url connection</xsl:comment>
 <xsl:if test="$debug = 'true'">
 <xsl:copy-of select="sql:getError($connection)/ext-error"/>
 </xsl:if>
 </xsl:if>
 </xsl:otherwise>
 </xsl:choose>
 
 <xsl:variable name="table" select="sql:query($connection, $query)"/>
 <xsl:if test="not($table)">
 <xsl:message>Error in Query</xsl:message>
 <xsl:copy-of select="sql:getError($connection)/ext-error"/>
 </xsl:if>
 <page>
 
 <xsl:copy-of select="xalan:checkEnvironment()"/>
 
 <meta>
 <cols>
 <xsl:apply-templates select="$table/sql/metadata/column-header"/>
 </cols>
 </meta>
 <rowset>
 
 <xsl:apply-templates select="$table/sql/row-set"/>
 </rowset>
 </page>
 <xsl:value-of select="sql:close($connection)"/>
 </xsl:template>
 <xsl:template match="row">
 <row>
 <xsl:apply-templates select="col"/>
 </row>
 </xsl:template>
 <xsl:template match="column-header">
 <col>
 <xsl:attribute name="type">
 <xsl:value-of select="@column-typename"/>
 </xsl:attribute>
 <xsl:attribute name="display-name">
 <xsl:call-template name="create-display-name"/>
 </xsl:attribute>
 <xsl:value-of select="@column-name"/>
 </col>
 </xsl:template>
 
 <xsl:template name="create-display-name">
 <xsl:variable name="col-name">
 <xsl:for-each select="str:tokenize(@column-name, '_')">
 <xsl:value-of
 select="concat(translate(substring(., 1, 1), $lowercase, $uppercase), translate(substring(.,2), $uppercase, $lowercase), ' ')"/>
 </xsl:for-each>
 </xsl:variable>
 <xsl:value-of select="substring($col-name, 1, string-length($col-name) - 1)"/>
 </xsl:template>
 
 <xsl:template match="col">
 <col>
 <xsl:attribute name="column-name"><xsl:value-of select="@column-name"/></xsl:attribute>
 <xsl:value-of select="."/>
 </col>
 </xsl:template>
</xsl:stylesheet>

XML,CLOB AND MEMORY : CONSUMED BUT NOT RELEASED !!!

Hi,
I'm working with XMLGEN Package and XSLT Processor to produce XML Document on Oracle 8.1.7.3 server, I use 9i XML and Java packages.
I'm facing the following BIG MEMORY problem :
Environment : I must generate an XML parsed with an XSL document of 80Mo (nearly 22 000 rows),
as XMLGEN is on DOM parsing method, I extract my XML by 500 Rows and I loop until 22 000 rows. I use DBMS_JOB with jobs who read and execute export each minute.
The algorithme is :
keeprow=22000
while keeprow>0
Create 3 clob (DBMS_LOB Package) : one for XSL Sheet, one for XML and one for result
GetXML (XMLGEN Package)
Transform in XSL (XSL Processor)
Write to disk (UTL_FILE Package)
Free the 3 Clob ((DBMS_LOB Package))
keeprow =keeprow-500
loop
The problem : The process start at 250Mo ot total memory and END at 1000 Mo of used memory and NEVER RELEASE 1 ko of memory.
So often I get a JavaOutOfMemoryError (I've allocated 1Go Ram to my JAVA process).
Any help will be very very appreciated !
My derived problem is 22 000 rows is not enough I've some export of 200 000 rows to do (And I cannot allocate 10 Go of RAM !!!)
Following My PL/SQL Code.
Regards
Fred
 PROCEDURE DO_EXPORT_XML(
 P_JOB_ID JOB_PARAMETRE.JOB_ID%TYPE,
 P_JOB_ID_ORDRE JOB_PARAMETRE.JOB_ID_ORDRE%TYPE,
 P_CLE_UP UPLOADREQ_TEMP.ID%TYPE,
 P_LOAD_OR_DELOAD VARCHAR2)
 IS
 L_FILE_NAME JOB_PARAMETRE.JOB_FILE_NAME_DEST%TYPE;
 L_REP_NAME JOB_PARAMETRE.JOB_REP_NAME_DEST%TYPE;
 L_FILE_STYLESHEET JOB_PARAMETRE.JOB_STYLESHEET%TYPE;
 L_VERSION_PDM JOB_PARAMETRE.JOB_VPDM%TYPE;
 P_SELECT varchar2(4000):='';
 P_CURSOR varchar2(4000):='';
 l_filehandler_out UTL_FILE.FILE_TYPE;
 --Variable pour le traitement par lot de 500
 L_NBROW_TODO_ATONCE number := 500;
 L_NBROW_MIN number := 1;
 L_NBROW_MAX number := -1;
 L_NBROWKEEPTODO number := -1;
 xslString CLOB := null;
 res number default -1;
 xmlString CLOB := null;
 li_ret number := 0;
 li_faitle number := 0;
 amount integer:= 255;
 li_loop integer := 0;
 charString varchar2(255);
 ls_deload varchar2(255) default '';
 ls_SQL varchar2(4000) default '';
 ls_temp_file varchar2(255) default '';
 text_file_dir varchar2(32) := 'e:\temporarydir';
 l_par xmlparser.parser;
 l_xml xmldom.domdocument;
 l_pro xslprocessor.processor;
 l_xsl xslprocessor.stylesheet;
 docfragnode xmldom.DOMNode;
 docfrag xmldom.DOMDocumentFragment;
 l_parsedclob clob := null;
 l_amount binary_integer := 32767;
 l_ligne varchar2(32767);
 l_offset number default 1;
 l_pos number default null;
 l_pos2 number default null;
 l_lobsize number default null;
 l_memsize number default 1073741824; --1024 Mo
 l_mempipo number default 0;
 type rc is ref cursor;
 l_cursor rc;
 cursor TEMPLATE is select UNSPSC,1 as NB from UPLOADREQ_TEMP where 1=2;
 c1rec TEMPLATE%rowtype;
 BEGIN
 l_mempipo:=setmaxmemorysize(l_memsize);
 dbms_lob.createtemporary(l_parsedclob, true, dbms_lob.session);
 dbms_lob.createtemporary(xmlstring, true, dbms_lob.session);
 --return the good select
 GET_SELECT_TO_EXPORT_XML(P_JOB_ID , P_JOB_ID_ORDRE , P_CLE_UP , P_SELECT,P_CURSOR, P_LOAD_OR_DELOAD);
 SELECT JOB_FILE_NAME_DEST,JOB_REP_NAME_DEST,JOB_STYLESHEET
 INTO L_FILE_NAME,L_REP_NAME,L_FILE_STYLESHEET
 FROM JOB_PARAMETRE
 WHERE JOB_ID =P_JOB_ID AND JOB_ID_ORDRE=P_JOB_ID_ORDRE;
 l_filehandler_out := UTL_FILE.FOPEN(text_file_dir, L_FILE_NAME, 'w',l_amount);
 --Return XSL Sheet in a clob : cause of memory consumed but not released
 xslString := METACAT.load_a_file( 1,L_FILE_STYLESHEET);
 open l_cursor for P_CURSOR;
LOOP
 fetch l_cursor into c1rec;
 exit when l_cursor%notfound;
 L_NBROW_MIN := 1;
 L_NBROW_MAX := 0;
 L_NBROWKEEPTODO:=c1rec.NB;
 LOOP
 begin
 if(L_NBROWKEEPTODO > L_NBROW_TODO_ATONCE) THEN
 begin
 L_NBROW_MAX:= L_NBROW_TODO_ATONCE + L_NBROW_MAX;
 L_NBROWKEEPTODO:= L_NBROWKEEPTODO - L_NBROW_TODO_ATONCE;
 end;
 else
 begin
 L_NBROW_MAX:= L_NBROW_MAX + L_NBROWKEEPTODO;
 L_NBROWKEEPTODO:=0;
 end;
 end if;
 --on ouvre le fichier de risultats
 ls_SQL:= P_SELECT || ' AND ( ROWNUM BETWEEN ' || L_NBROW_MIN || ' AND ' || L_NBROW_MAX || ' ) and UNSPSC=''' || c1rec.UNSPSC || '''';
 ls_temp_file := c1rec.UNSPSC || '_' || L_FILE_NAME;
 L_NBROW_MIN:=L_NBROW_TODO_ATONCE + L_NBROW_MIN;
 --CAT_AUTOLOAD.JOB_ADD_TRACE (P_JOB_ID,'UPLOAD REQUISITE : Export donnies REQUETE ' || to_char(li_loop), ls_SQL,'',0,0);
 xmlgen.resetOptions;
 xmlgen.setErrorTag('ERROR_RESULT');
 xmlgen.setRowIdAttrName('NAH');
 xmlgen.setRowIdColumn('NAH');
 xmlgen.setEncodingTag('ISO-8859-1');
 xmlgen.useNullAttributeIndicator(false);
 if(xmlString is not null) then
 dbms_lob.open(xmlString,dbms_lob.lob_readwrite);
 l_lobsize:= dbms_lob.Getlength(xmlString);
 if(l_lobsize>0) then
 dbms_lob.erase(xmlString,l_lobsize,1);
 end if;
 dbms_lob.close(xmlString);
 dbms_lob.freetemporary(xmlString);
 dbms_lob.createtemporary(xmlstring, true, dbms_lob.session);
 end if;
--Return XML in a clob : cause of memory consumed but not released
 xmlString := xmlgen.getXML(ls_SQL,0);
 l_par := xmlparser.newparser;
 xmlparser.parseclob(l_par, xslString);
 l_xsl := xslprocessor.newstylesheet(xmlparser.getdocument(l_par),null);
 xmlparser.parseclob(l_par, xmlString);
 l_xml := xmlparser.getdocument(l_par);
 l_pro := xslprocessor.newprocessor;
 xslprocessor.showWarnings(l_pro, true);
 xslprocessor.setErrorLog(l_pro, text_file_dir || substr(ls_temp_file,0,length(ls_temp_file)-4) || '_logerreur.XML');
 if(l_parsedclob is not null) then
 dbms_lob.open(l_parsedclob,dbms_lob.lob_readwrite);
 l_lobsize:= dbms_lob.Getlength(l_parsedclob);
 if(l_lobsize>0) then
 dbms_lob.erase(l_parsedclob,l_lobsize,1);
 end if;
 dbms_lob.close(l_parsedclob);
 dbms_lob.freetemporary(l_parsedclob);
 dbms_lob.createtemporary(l_parsedclob, true, dbms_lob.session);
 end if;
 --Return XML Processed with XSL in a clob : cause of memory consumed but not released
 xslprocessor.processxsl(l_pro,l_xsl,l_xml,l_parsedclob);
 --release NOTHING
 xmlparser.freeparser(l_par);
 xslprocessor.freeprocessor(l_pro);
 l_ligne:='';
 l_offset :=1;
 l_pos := null;
 l_pos2 := null;
 if(li_loop=0) then
 begin
 --on ouvre le fichier et on sauve l'entete + les donnies dedans.
 l_pos:=dbms_lob.instr(l_parsedclob,'</DATA>');
 if ( nvl(l_pos,0) > 0 ) then
 loop
 if(l_pos-1>l_amount + l_offset ) then
 l_ligne:=dbms_lob.SUBSTR(l_parsedclob,l_amount,l_offset);
 UTL_FILE.PUT(l_filehandler_out,l_ligne);
 UTL_FILE.fflush(l_filehandler_out);
 l_offset:=l_offset+l_amount;
 else
 l_ligne:=dbms_lob.SUBSTR(l_parsedclob,l_pos-1 -l_offset ,l_offset);
 UTL_FILE.PUT(l_filehandler_out,l_ligne);
 UTL_FILE.fflush(l_filehandler_out);
 exit;
 end if;
 end loop;
 else
 EXIT;
 end if;
 end;
 else
 --on met les donnies donc on ne repete pas le debut
 begin
 l_pos:=dbms_lob.instr(l_parsedclob,'<ITEM');
 if ( nvl(l_pos,0) > 0 ) then
 l_pos2:=dbms_lob.instr(l_parsedclob,'</DATA>');
 if ( nvl(l_pos2,0) > 0 ) then
 loop
 if(l_pos + l_amount <= l_pos2 -1 ) then
 l_ligne:=dbms_lob.SUBSTR(l_parsedclob,l_amount,l_pos);
 UTL_FILE.PUT(l_filehandler_out,l_ligne);
 UTL_FILE.fflush(l_filehandler_out);
 l_pos:=l_pos +l_amount;
 else
 l_ligne:=dbms_lob.SUBSTR(l_parsedclob,l_pos2 -1 -l_pos,l_pos);
 UTL_FILE.PUT(l_filehandler_out,l_ligne);
 UTL_FILE.fflush(l_filehandler_out);
 exit;
 end if;
 end loop;
 else
 exit;
 end if;
 end if;
 end;
 end if;
 li_loop:=li_loop + 1 ;
 --UTL_FILE.FCLOSE(l_filehandler_in);
 JAVA_GC();
 EXIT WHEN L_NBROWKEEPTODO=0;
 Exception
 when others then
 begin
 -- IF(utl_file.is_open(l_filehandler_in)) THEN
 -- utl_file.fclose( l_filehandler_in);
 -- END IF;
 IF(utl_file.is_open(l_filehandler_out)) THEN
 utl_file.fclose( l_filehandler_out);
 END IF;
 RAISE_APPLICATION_ERROR(-20001,'File with errors');
 end;
 END;
 END LOOP;
END LOOP;
CLOSE l_cursor;
 if ( xmlString is not null ) then
 dbms_lob.open(xmlString,dbms_lob.lob_readwrite);
 l_lobsize:= dbms_lob.Getlength(xmlString);
 if(l_lobsize>0) then
 dbms_lob.erase(xmlString,l_lobsize,1);
 end if;
 dbms_lob.close(xmlString);
 dbms_lob.freeTemporary( xmlString);
 end if;
 if(l_parsedclob is not null) then
 dbms_lob.open(l_parsedclob,dbms_lob.lob_readwrite);
 l_lobsize:= dbms_lob.Getlength(l_parsedclob);
 if(l_lobsize>0) then
 dbms_lob.erase(l_parsedclob,l_lobsize,1);
 end if;
 dbms_lob.close(l_parsedclob);
 dbms_lob.freetemporary(l_parsedclob);
 end if;
 UTL_FILE.NEW_LINE(l_filehandler_out);
 l_ligne:='</DATA></CATALOG>';
 UTL_FILE.PUT(l_filehandler_out,l_ligne);
 UTL_FILE.FCLOSE(l_filehandler_out);
 EXCEPTION
 when others then
 begin
 IF(utl_file.is_open(l_filehandler_out)) THEN
 utl_file.fclose( l_filehandler_out);
 END IF;
 end;
 END;
******************************

Thank you for the info - I had no idea I was puing myself in danger by cutting it so close. Since your post I have moved my iphoto library to an external drive and now have 165 GB of space on my HD. Following this I have 2 questions.
1. Since my available HD space was reduced by the size of the photo download it seems logical that the download is somewhere on my HD still. Is there a place where these photos might be hiding on my HD even though they are not available on the iphoto library?
2. I was able to recover the .jpg files which are fine. I also recovered the .mov files but they have been compromised. I am hoping I can find the originals still on the HD somewhere. If not, do you have any suggestions for recovery methods or programs? I have not used the SD card since the incident so I should be able to attempt another recovery to salvage the .mov files if there is an alternative method/program available.
Thanks again!

XML parser causes memory leakage, help!

I have the following function which called by other package to transfer xml. But every time it is called oracle will consume 600 to 700k memory and never release them. Any thought about it?
Function Transform(xml Clob,xsl Clob) Return Clob is
p xmlparser.Parser;
xmldoc xmldom.DOMDocument;
xsldoc xmldom.DOMDocument;
proc xslprocessor.Processor;
ss xslprocessor.Stylesheet;
cl Clob;
begin
p := xmlparser.newParser;
xmlparser.setValidationMode(p, FALSE);
xmlparser.setPreserveWhiteSpace(p, TRUE);
xmlparser.parseClob(p, xml); -- parse xml
xmldoc := xmlparser.getDocument(p);
xmlparser.parseClob(p, xsl); -- parse xsl
xsldoc := xmlparser.getDocument(p);
proc := xslprocessor.newProcessor;
ss := xslprocessor.newStylesheet(xsldoc, '');
dbms_lob.createtemporary(cl, TRUE);
xslprocessor.processXSL(proc, ss, xmldoc,cl);
xslprocessor.freeProcessor(proc);
xslprocessor.freeStyleSheet(ss);
xmlparser.freeParser(p);
return cl;
exception -- deal with exceptions
when xmldom.INDEX_SIZE_ERR then
raise_application_error(-20120, 'Index Size error');
when xmldom.DOMSTRING_SIZE_ERR then
raise_application_error(-20120, 'String Size error');
when xmldom.HIERARCHY_REQUEST_ERR then
raise_application_error(-20120, 'Hierarchy request error');
when xmldom.WRONG_DOCUMENT_ERR then
raise_application_error(-20120, 'Wrong doc error');
when xmldom.INVALID_CHARACTER_ERR then
raise_application_error(-20120, 'Invalid Char error');
when xmldom.NO_DATA_ALLOWED_ERR then
raise_application_error(-20120, 'Nod data allowed error');
when xmldom.NO_MODIFICATION_ALLOWED_ERR then
raise_application_error(-20120, 'No mod allowed error');
when xmldom.NOT_FOUND_ERR then
raise_application_error(-20120, 'Not found error');
when xmldom.NOT_SUPPORTED_ERR then
raise_application_error(-20120, 'Not supported error');
when xmldom.INUSE_ATTRIBUTE_ERR then
raise_application_error(-20120, 'In use attr error');
end Transform;
null

Would you try to free the alloced temporary lob whenever get Exception and try?
dbms_lob.createtemporary(cl, TRUE);
dbms_lob.freetemporary(cl);
Thanks.
null

A website I need to get information from returns a message stating that I do not have the most recent XML parser, and suggests using IE 5.5 or newer. This, of course, I have no intention of doing. Any suggestions?

This is supposed to be an animated Help page. However, when Itry to click on it, it gives me the message:
Your browser does not seem to have the most updated XML parser.
Please use Microsoft Internet Explorer 5.5 or up for PointingTheWay features.
System Can Not Proceed any further.

Unfortunately, it's a member-only page, with member id and password required. I'm trying to contact their IT dept., but without much luck, so far!

Xml parsing and report generation probs

Hello everyone,
I am facing with a peculiar problem.
I have an xml which contains special characters like �( cent) . So I parse it before i send it to the DOM parser. BufferedReader br = new BufferedReader(new InputStreamReader(inputFileName,"ISO-8859-1"));
and i have a function which replaces the cent with #xA2; .After i replace the special chars , i pass it to the parse method and i have some classes which update the database.the whole process works fine.
Now I have a report generation where i generate an HTML passing the string after the values are updated in the DB . So when i pass the string , and replace #xA2 with cent symbol, it is being interrupted as '?' in the windows and unix environment
This is something to do with the encoding.But my encoding is ISO-8859-1 as mentioned
Can you please help me out with this prob
Regards
KV

I have some sympathy with you because I had problems with the cent sign in the XML world too. But not much... you have XML parsing going on, you're writing to a database, you're generating HTML, you have a manual hack for the cent sign. One or more of these things is causing you a problem. Do not try to test them all at once, like you are doing. Test only one thing at a time.

Oracle XML parser and IBM jdk bug

Hello,
From a few messages found in the XML forum it seems that IBM jvm could cause problems with oracle XML parser. ( see http://technet.oracle.com:89/ubb/Forum11/HTML/003823.html )
I am using IBM jvm (jdk 1.3) on a linux box, and problems are starting to arise:
I have
- 1 BC4J based jsp app which works fine.
- 2 XML parsing BC4J apps which cause strange errors (like parsing 40 documents fine and failing on the 41st for no apparent reason)
Hopefully, Steven Muench provided precious advice on this (basically, disabling the JIT), however some issues are still open:
<BLOCKQUOTE>quote:<HR>You should file a bug with IBM to get this fixed, using your stylesheet as a testcase. Lots of people have hit this problem.<HR></BLOCKQUOTE>
Has anyone (from oracle or else) done this yet? I have gone (quickly) through IBM website but I didn't find any bug report utility or the like...
<BLOCKQUOTE>quote:<HR>Disable your JIT compiler (or switch JVM's) and you won't have the error.<HR></BLOCKQUOTE>
Turning off the JIT indeed made the errors vanish, thanks a lot for the tip!
I have a few more questions though :
* As the BC4J framework uses the xml parser, It is fairly possible that the ibm jvm bug will affect it...
I haven't had any problems (yet?) with the BC4J part of my applications, but I'm a bit concerned about having random bugs lurking around (I have more than enough of my own :) )
Has anyone stumbled upon IBM JVM vs oracle parser issues in BC4J? (oracle.xml.parser.v2.XXXXXX exceptions...)
* If BC4J is indeed affected, what's the solution?
- Disable the JIT? (And forget about performance?... hmmm... no)
- Switch parsers? (oracle parser is too tightly integrated in the BC4J Framework isn't it?.. hmm... not possible either)
- Wait for a patch from IBM (and use another one in the meantime) / switch JVM :
In either case, I'd really like to know what is the JVM that oracle people use / would advise.
Thanks for your help
null

For those interested,
last week i reported this bug in the ibm jvm news forum.
They said that the problem had been investigated and would be fixed in their next service release.
FYI: the current release (SR7, labeled "build cx130-20010329) still has various problems wih oracle XML parser.
Remi
null

SAX XML Parsing and Garbage Collection

I'm writing an XML parser that is running extremely slow while parsing large documents, I believe due to garbage collection. The implementation just overloads the DefaultHandler and hands that to a SAX Parser. This works fine on 2500 line XML document, taking on average a second or two, but becomes untennable when the document size is increased by a factor of 10 (often taking 5+ minutes).
I come from a C++ background and haven't dealt with automatic garbage collection at an expert level, so I'd appreciate any help. Below is a snapshot garbage collection done while a 25000 line document being parsed. It looks to me as the young objects are staying small, but older objects are going between 13M and 90M and back again. Is that what's happening? Can anyone give me leads as to what to look? Thanks in advance.
[GC [DefNew: 6234K->0K(7168K), 0.0057359 secs] 15517K->13022K(101696K), 0.0057907 secs]
[GC [DefNew: 6235K->0K(7168K), 0.0057748 secs] 19257K->16762K(101696K), 0.0060357 secs]
[GC [DefNew: 6235K->0K(7168K), 0.0023584 secs] 22997K->18009K(101696K), 0.0024123 secs]
[GC [DefNew: 6236K->0K(7168K), 0.0040785 secs] 24245K->20502K(101696K), 0.0041315 secs]
[GC [DefNew: 4990K->0K(7168K), 0.0041025 secs] 25492K->22996K(101696K), 0.0041544 secs]
[GC [DefNew: 4990K->0K(7168K), 0.0041486 secs] 27987K->25491K(101696K), 0.0042022 secs]
[GC [DefNew: 4991K->0K(7168K), 0.0040782 secs] 30481K->27985K(101696K), 0.0041299 secs]
[GC [DefNew: 4991K->0K(7168K), 0.0040935 secs] 32976K->30479K(101696K), 0.0046294 secs]
[GC [DefNew: 4991K->0K(7168K), 0.0041433 secs] 35471K->32974K(101696K), 0.0041958 secs]
[GC [DefNew: 4992K->0K(7168K), 0.0041114 secs] 37966K->35469K(101696K), 0.0041634 secs]
[GC [DefNew: 6240K->0K(7168K), 0.0024190 secs] 41709K->36717K(101696K), 0.0024729 secs]
[GC [DefNew: 6240K->0K(7168K), 0.0041377 secs] 42957K->39212K(101696K), 0.0041972 secs]
[GC [DefNew: 4993K->0K(7168K), 0.0041234 secs] 44205K->41707K(101696K), 0.0041762 secs]
[GC [DefNew: 4993K->0K(7168K), 0.0042827 secs] 46701K->44203K(101696K), 0.0046299 secs]
[GC [DefNew: 4994K->0K(7168K), 0.0043195 secs] 49197K->46699K(101696K), 0.0043751 secs]
[GC [DefNew: 4994K->0K(7168K), 0.0042740 secs] 51693K->49195K(101696K), 0.0043293 secs]
[GC [DefNew: 4995K->0K(7168K), 0.0042044 secs] 54190K->51692K(101696K), 0.0042575 secs]
[GC [DefNew: 4995K->0K(7168K), 0.0042237 secs] 56686K->54188K(101696K), 0.0042762 secs]
[GC [DefNew: 4996K->1K(7168K), 0.0040036 secs] 59183K->56685K(101696K), 0.0040550 secs]
[GC [DefNew: 4996K->1K(7168K), 0.0042095 secs] 61680K->59182K(101696K), 0.0045992 secs]
[GC [DefNew: 4997K->1K(7168K), 0.0042193 secs] 64178K->61679K(101696K), 0.0042715 secs]
[GC [DefNew: 4997K->1K(7168K), 0.0042301 secs] 66675K->64176K(101696K), 0.0042818 secs]
[GC [DefNew: 4997K->1K(7168K), 0.0042726 secs] 69173K->66674K(101696K), 0.0043251 secs]
[GC [DefNew: 4998K->1K(7168K), 0.0042564 secs] 71671K->69172K(101696K), 0.0043084 secs]
[GC [DefNew: 4998K->1K(7168K), 0.0040301 secs] 74169K->71669K(101696K), 0.0040812 secs]
[GC [DefNew: 4999K->1K(7168K), 0.0042656 secs] 76668K->74168K(101696K), 0.0047255 secs]
[GC [DefNew: 4999K->1K(7168K), 0.0043100 secs] 79166K->76666K(101696K), 0.0043737 secs]
[GC [DefNew: 5000K->1K(7168K), 0.0043492 secs] 81665K->79165K(101696K), 0.0044034 secs]
[GC [DefNew: 5000K->1K(7168K), 0.0043165 secs] 84164K->81664K(101696K), 0.0043693 secs]
[GC [DefNew: 5001K->1K(7168K), 0.0044196 secs] 86663K->84163K(101696K), 0.0044735 secs]
[GC [DefNew: 5001K->1K(7168K), 0.0044439 secs] 89163K->86662K(101696K), 0.0044967 secs]
[GC [DefNew: 5001K->1K(7168K), 0.0043983 secs] 91662K->89161K(101696K), 0.0045313 secs]
[GC [DefNew: 5002K->1K(7168K), 0.0043422 secs] 94162K->91661K(101696K), 0.0043944 secs]
[GC [DefNew: 5002K->1K(7168K), 0.0044223 secs] 96662K->94160K(101696K), 0.0044757 secs]
[GC [DefNew: 5002K->1K(7168K), 0.0048545 secs][Tenured: 96659K->9291K(97032K), 0.0863445 secs] 99162K->9291K(104200K), 0.0913954 secs]

I don't think I'm creating megabytes of data, not using hashes or other expandable arrays. I've copied and pasted some code from my overriding of a DefaultHandler to give better definition to the problem.
I'm working with TPTP right now as a profiler. Are there any others you'd recommend?
     public void startElement(String uri, String localname, String qName, Attributes attribs)
     throws SAXException
          if(qName.equals("Line"))
               attributes = attribs;
          else if(qName.equals("Note"))
               attributes = attribs;
          else if(qName.equals("Selection"))
               String idValue = attribs.getValue("id");
               String oValue = attribs.getValue("off");
               String lValue = attribs.getValue("len");
               if(idValue != null && oValue != null && lValue != null)
                    if(isImport)
                         issueSelectionContainer.addUnloadedSelection(Integer.parseInt(idValue), Integer.parseInt(oValue), Integer.parseInt(lValue));
                    else
                         issueSelectionContainer.addSelection(Integer.parseInt(idValue), Integer.parseInt(oValue), Integer.parseInt(lValue));
          else if(qName.equals("Issue"))
               attributes = attribs;
          if(qName.equals("IsFinal"))
               isFinal = true;
     public void endElement(String uri, String localname, String qName)
     throws SAXException
          if(textElement.length() > 0)
               if(qName.equals("Line"))
                    String qmValue = attributes.getValue("qm");
                    String lnValue = attributes.getValue("ln");
                    String pgValue = attributes.getValue("pg");
                    boolean qm = (qmValue != null && qmValue.equalsIgnoreCase("true"));
                    short ln = (lnValue != null) ? Short.parseShort(lnValue) : 0;
                    short pg;
                    if(pgValue != null)
                         pg = Short.parseShort(pgValue);
                         page = pg;
                    else
                         pg = page;
                    lineContainer.addLine(textElement + '\n', ln, pg, qm, null);
               else if(qName.equals("Note"))
                    String lnValue = attributes.getValue("line");
                    if(lnValue != null)
                         int line = Integer.parseInt(lnValue);
                         try
                              lineContainer.getLine(line).setNote(textElement);
                         catch (IndexOutOfBoundsException e)
                              throw new SAXException("XML/Data mismatch. Note on line \"" + line + "\" out of \"" + lineContainer.lineCount() + "\" lines", e);
               else if(qName.equals("Issue") && isImport)
                    String idValue = attributes.getValue("id");
                    String cValue = attributes.getValue("color");
                    if(idValue != null && cValue != null)
                         issueSelectionContainer.addUnloadedIssueSelection(Integer.parseInt(idValue), new Color(Integer.parseInt(cValue)), textElement);
               else if(qName.equals("Name"))
                    name = textElement;
               else if(qName.equals("Description"))
                    description = textElement;
               else if(qName.equals("CreationDate"))
                    date = getCalendarFromString(textElement);
               textElement = "";
               attributes = null;
     public void characters(char buf[], int offset, int len)
    throws SAXException
          textElement = new String(buf, offset, len);
    }

Oracle XML parser and schema validation

Hi Forum,
I have problem parsing XML with validation against XML schema. I define location of schema (URL) in xml file and Oracle parser could not find the schema (xml file is correct - checked in other programs). When I point to xml schema directly from Java (using parser.setXMLSchema) before calling parser.parse, it works just fine. Where is the problem? Does oracle parser works correctly with XML Schema?
TIA,
Alex

SAXParser saxParser=new SAXParser();
saxParser.setValidationMode(XMLParser.SCHEMA_VALIDATION);
Specify a Schema to validate a XML document with, for the SAXParser.
saxParser.setXMLSchema(SchemaUrl);
DefaultHandler handler=new DefaultHandler();
saxParser.setErrorHandler(handler);
Parse the XML document to validate with the XML schema.
saxParser.parse(XmlDocumentUrl);

XML Parser and memory utilization

Similar Messages

Maybe you are looking for