Problem with SAX parser - entity must finish with a semi-colon

Hi,
I'm pretty new to the complexities of using SAXParserFactory and its cousins of XMLReaderAdapter, HTMLBuilder, HTMLDocument, entity resolvers and the like, so wondered if perhaps someone could give me a hand with this problem.
In a nutshell, my code is really nothing more than a glorified HTML parser - a web page editor, if you like. I read in an HTML file (only one that my software has created in the first place), parse it, then produce a Swing representation of the various tags I've parsed from the page and display this on a canvas. So, for instance, I would convert a simple <TABLE> of three rows and one column, via an HTMLTableElement, into a Swing JPanel containing three JLabels, suitably laid out.
I then allow the user to amend the values of the various HTML attributes, and I then write the HTML representation back to the web page.
It works reasonably well, albeit a bit heavy on resources. Here's a summary of the code for parsing an HTML file:
      htmlBuilder = new HTMLBuilder();
parserFactory = SAXParserFactory.newInstance();
parserFactory.setValidating(false);
parserFactory.setNamespaceAware(true);
FileInputStream fileInputStream = new FileInputStream(htmlFile);
InputSource inputSource = new InputSource(fileInputStream);
DoctypeChangerStream changer = new DoctypeChangerStream(inputSource.getByteStream());
changer.setGenerator(
   new DoctypeGenerator()
      public Doctype generate(Doctype old)
         return new DoctypeImpl
         old.getRootElement(),
                          old.getPublicId(),
                          old.getSystemId(),
         old.getInternalSubset()
      resolver = new TSLLocalEntityResolver("-//W3C//DTD XHTML 1.0 Transitional//EN", "xhtml1-transitional.dtd");
      readerAdapter = new XMLReaderAdapter(parserFactory.newSAXParser().getXMLReader());
      readerAdapter.setDocumentHandler(htmlBuilder);
      readerAdapter.setEntityResolver(resolver);
      readerAdapter.parse(inputSource);
      htmlDocument = htmlBuilder.getHTMLDocument();
      htmlBody = (HTMLBodyElement)htmlDocument.getBody();
      traversal = (DocumentTraversal)htmlDocument;
      walker = traversal.createTreeWalker(htmlBody,NodeFilter.SHOW_ELEMENT, null, true);
      rootNode = new DefaultMutableTreeNode(new WidgetTreeRootNode(htmlFile));
      createNodes(walker); However, I'm having a problem parsing a piece of HTML for a streaming video widget. The key part of this HTML is as follows:
            <object classid="clsid:D27CDB6E-AE6D-11cf-96B8-444553540000"
              id="client"
        width="100%"
        height="100%"
              codebase="http://fpdownload.macromedia.com/get/flashplayer/current/swflash.cab">
              <param name="movie" value="client.swf?user=lkcl&stream=stream2&streamtype=live&server=rtmp://192.168.250.206/oflaDemo" />
         etc....You will see that the <param> tag in the HTML has a value attribute which is a URL plus three URL parameters - looks absolutely standard, and in fact works absolutely correctly in a browser. However, when my readerAdapter.parse() method gets to this point, it throws an exception saying that there should be a semi-colon after the entity 'stream'. I can see whats happening - basically the SAXParser thinks that the ampersand marks the start of a new entity. When it finds '&stream' it expects it to finish with a semi-colon (e.g. much like and other such HTML characters). The only way I can get the parser past this point is to encode all the relevant ampersands to %26 -- but then the web page stops working ! Aaargh....
Can someone explain what my options are for getting around this problem ? Some property I can set on the parser ? A different DTD ? Not to use SAX at all ? Override the parser's exception handler ? A completely different approach ?!
Could you provide a simple example to explain what you mean ?
Thanks in anticipation !

You probably don't have the ampersands in your "value" attribute escaped properly. It should look like this:
value="client.swf?user=lkcl&stream=...{code}
Most HTML processors (i.e. browsers) will overlook that omission, because almost nobody does it right when they are generating HTML by hand, but XML processors won't.

Similar Messages

Reference to entity must end with ;

Hi All,
My application uses SAX parser to strip and parse the incoming xml file. My problem is whenever the payload contains L@amp;T symbol, it is throwing 'SAX Exception saying that Reference to the entity must end with ;'.
But, i could open the xml file using xml tool such as xml spy and xml notepad. And as far i know, @amp; is valid representation in xml. I really don't understand why i am getting this exception?
For testing purpose i put one more ';' at the end of '&' like 'L&;T'. The file was processed successfully and in the output i saw 'L&;T', which was supposed to be L&T.
I will post the problamatic file as well as the exact exception phrase in my next post. In the meantime, if anybody encountered this problem before, kindly let me know the root cause of this problem and the way to resolve it.
Your earlier advice is greatly appreciated.
Thanks in advance for your time.
Thanks and regards,
ravi.

What happens if you use
L@amp;T
Hi All,
My application uses SAX parser to strip and parse the
incoming xml file. My problem is whenever the payload
contains L@amp;T symbol, it is throwing 'SAX
Exception saying that Reference to the entity must
end with ;'.
But, i could open the xml file using xml tool such as
xml spy and xml notepad. And as far i know, @amp; is
valid representation in xml. I really don't
understand why i am getting this exception?
For testing purpose i put one more ';' at the end of
'&' like 'L&;T'. The file was processed
successfully and in the output i saw 'L&;T', which
was supposed to be L&T.
I will post the problamatic file as well as the exact
exception phrase in my next post. In the meantime, if
anybody encountered this problem before, kindly let
me know the root cause of this problem and the way to
resolve it.
Your earlier advice is greatly appreciated.
Thanks in advance for your time.
Thanks and regards,
ravi.What happens if you use

Problem with sax parser

Hello..
I have the following problem. When I parse an xml document with blank spaces and numbers with decimals, its sometimes comes out as one string and sometimes as two, for example "First A" sometimes comes out as "First" and "A" and sometimes as "First A", which is how its stored in the xml file. Same with numbers like 19.20. Im enclosing a little of my code..
public void characters(char buf[], int offset, int len)
throws SAXException
if (textBuffer != null) {
SaveString = ""+textBuffer;
if(i>-1)
numbers = SaveString;
Whats wrong and how do I fix it.
Best Regards Dan
PS I have more code, in data and out data if needed.Ds

Hello,
I do not know if this is your problem, yet please find hereafter an excerpt of the SAX API:
public void characters(char[] ch,
                       int start,
                       int length)
                throws SAXException
... SAX parsers may return all contiguous character data in a single chunk, or they may split it into several chunks;...
... Note that some parsers will report whitespace in element content using the ignorableWhitespace method rather than this one (validating parsers must do so)...
In other words, I am afraid that your issue is the "standard behaviour" of a SAX parser.
I hope it helps.

Problem Using Sax parser with Eclipse 3.0 and command line

Hi,
I am parsing a xml file with sax. When I am running my programm in the command line everthing is ok and I get the right results from parsing.
But if I am running the programm in Eclipse 3.0 (the same java code) I get an other result (the wrong results).
Does anybody know what this can be the reason for. Is Eclipse using an other xml parser and if where I can change the parser?
It would be very kind if somebody can give me a reason for this strange behaviour.
Thanks in advance

I have solved my problem.
In the command line I used jre 1.4 and in Eclipse I used jre 1.5.
I think jre 1.5 uses an other xml parser so I got an other result.
If i use in Eclipse jre1.4 I get the same result as in the command line.

Probem with SAX parser

Hi to averybody!
I'm trying to parse a xml file using SAX parser but I found a problem.
When the method
public void characters(char[] ch, int start, int length)
I try to print the content in this way:
for (int i = start; i <= length; i++)
System.out.print(ch);
but nothing is printed except except in 2 cases.
the file parsed start like this:
<BatchMaint xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="http://www.ncr.com/bosphoenix/WSMaintenance_5.0.xsd">
<Id>1000950</Id>
<DateTime>2009-02-11T11:37:09</DateTime>
<FromPC>TD185008-1J7</FromPC>
<FromAppl>BatchToPosWS.dll</FromAppl>
<FromVersion>001.000.000.000</FromVersion>
the method print only "1000950" and "2009-02-11T11:37:09".
Has somebody any idea how fix the problem??

From the API documentation for the characters() method:
"The Parser will call this method to report each chunk of character data. SAX parsers may return all contiguous character data in a single chunk, or they may split it into several chunks; however, all of the characters in any single event must come from the same external entity so that the Locator provides useful information."

How to Create XML file with SAX parser instead of DOM parser

HI ALL,
I am in need of creating an XML file by SAX parser ONLY. As far as my knowledge goes, we can use DOM for such purpose(by using createElement, creatAttribute ...). Can anyone tell me, is there any way to create an XML file using SAX Parser only. I mean, I just want to know whether SAX provides any sort of api for Creatign an element, attribute etc. I know that SAX is for event based parsing. But my requirement is to create an XML file from using only SAX parser.
Any help would be appreciated
Thanx in advance
Kaushik

Hi,
You must write a XMLWriter class yourself, and that Class extends DefaultHandle ....., the overwrite the startElement(url, localName, qName, attributeList), startDocument(), endElement().....and so on.
in startElement write your own logic about how to create a new element and how to create a Attribute list
in startDocument write your own logic about how to build a document and encodeType, dtd....
By using:
XMLWriter out = new XMLWriter()
out.startDocument();
Attribute attr1 = new Atribute();
attr1.add("name", "value");
out.startElement("","","Element1", attr1);
Attribute attr2 = new Atribute();
attr2.add("name", "value");
out.startElement("","","Element2", attr2);
out.endElement("","","Element2");
out.endElement("","","Element1");
out.endDocument();

Problem with SAX parser with String format

hi, all I have the next problem:
I try to parse xml file with success, I write next code:
====================
my_class saxUms = new my_class();
File file = new File( "c:\\my_try_Response.xml" );
InputSource src1 = new InputSource( new FileInputStream( file ) );
XMLReader rdr = XMLReaderFactory.createXMLReader( "org.apache.xerces.parsers.SAXParser" ); rdr.setContentHandler( saxUms );
rdr.parse(src1);
===================
but when I try to parse the same in string variable, I write:
===================
my_class saxUms = new my_class();
StringReader strr = new StringReader(my_str);
InputSource intt = new InputSource(strr);
XMLReader prs= XMLReaderFactory.createXMLReader( "org.apache.xerces.parsers.SAXParser" );
prs.setContentHandler(saxUms);
prs.parse(intt);
===================
and error occurs:
"Exception: java.lang.ClassCastException: java.lang.StringBuffer"
how to fix the problem?
Thank you for collaboration!

where does the exception stack trace say the error is occurring?

XML closing tags missing throws exception with SAX Parser

Hey,
I'm trying to create an XML Document from some HTML.
I am getting this exception:
[Fatal Error] :1:334: The element type "input" must be terminated by the matching end-tag "</input>".
Exception in thread "main" java.lang.RuntimeException: org.xml.sax.SAXParseException: The element type "input" must be terminated by the matching end-tag "</input>".
     at server.XMLUtils.createDocument(XMLUtils.java:76)The xml is like this:
<html>
<input name="s" size="5">
</html>Is there some setting I can change in the parser to make it ignore missing closing tags?
Here is my current code
     public static Document createDocument(InputStream is) {
          try {
               Document doc;
               DocumentBuilderFactory dbf = DocumentBuilderFactory.newInstance();
               DocumentBuilder db = dbf.newDocumentBuilder();
               doc = db.parse(is);
               doc.getDocumentElement().normalize();
               is.close();
               return doc;
          } catch (Exception e) {
               throw new RuntimeException(e);
     }Thanks

Nether wrote:
Hey,
The xml is like this:
<html>
<input name="s" size="5">
</html>
That is not XML. It might qualify as HTML. An XML file would be
<html>
<input name="s" size="5"/>
</html>Winston

Reading xml file with sax parser: unknown protocol: c

Hi,
I've been googling around, and the best I can find is that the file name:
File test = new File("lib/test/parseTest/validate-test.xml");should be a url:
File test = new File("File://lib/test/parseTest/validate-test.xml");but I'm working on a linux machine and can't put "File://c:/pathToFile/file.xml"
Also, I did some testing and I can read a small xml file with just a few elements, but on large complex files, I get that error.
anyone ever run into this before?
bp
Edited by: badperson on Nov 1, 2008 2:19 PM

badperson wrote:
I've been googling around, and the best I can find is that the file name:
File test = new File("lib/test/parseTest/validate-test.xml");should be a url:
File test = new File("File://lib/test/parseTest/validate-test.xml");
No, that's wrong. The parameter for that constructor is a file path (relative or absolute). Not a URL. You must have misunderstood whatever you read.
but I'm working on a linux machine and can't put "File://c:/pathToFile/file.xml"What kind of a Linux machine is this which has a C drive? You must have misunderstood whoever told you to do that.

How to HTMLEditorKit's parser with Sax Parser?

How does one do it? I know you need to override getParser method. But the ParserCallback's handleStartTag, handleEndTag etc expect a parameter pos of type int. Needless to say, the pos is undocumented. I have not idea what value to pass. If I pass -1, I get some exceptions. Anyone has a working code snippet which he/she can share?
Thanks a bunch
Narayanan

ParserCallback is like an event listener.
Take for example a MouseListener. You don't invoke the mouseClicked(...) method. You add code to the mouseClicked(...) method to respond to the mouseClicked event.
Same thing with the ParserCallback. You don't invoke the handleStartTag(...) method. As the ParserCallback is parsing an HTML Document it will notify you when it finds a start tag in the Document. It tells you the tag it found and the position of the tag in the Document.
Here is a simple example that just displays all the text in the document:
import java.io.*;
import java.net.*;
import javax.swing.text.html.parser.*;
import javax.swing.text.html.*;
public class ParserCallbackText extends HTMLEditorKit.ParserCallback
     public void handleText(char[] data, int pos)
          System.out.println( data );
     public static void main(String[] args)
          throws Exception
          Reader reader = getReader(args[0]);
          ParserCallbackText parser = new ParserCallbackText();
          new ParserDelegator().parse(reader, parser, true);
     static Reader getReader(String uri)
          throws IOException
          // Retrieve from Internet.
          if (uri.startsWith("http:"))
               URLConnection conn = new URL(uri).openConnection();
               return new InputStreamReader(conn.getInputStream());
          // Retrieve from file.
          else
               return new FileReader(uri);
}

Problem on sax parser

why this does not work
import java.io.*;
import org.xml.sax.*;
import org.xml.sax.helpers.DefaultHandler;
import javax.xml.parsers.SAXParserFactory;
import javax.xml.parsers.ParserConfigurationException;
import javax.xml.parsers.SAXParser;
public class XMLParser extends DefaultHandler
SAXParserFactory factory = SAXParserFactory.newInstance();
SAXParser myparser = factory.newSAXParser();
myparser.parse(new File("c:/first.xml"), handler);

Put your code inside a method!

Trying to use XML SAX parser with JDK2 ...

Hi,
I'm pretty new to Java.
I'm trying to write and use java sample using XML SAX parser. I try with XP and XML4J.
Each time I compile it give me a error message like
"SAX01.java:23: unreported exception java.lang.Exception; must be caught or declared to be
thrown
(new SAX01()).countBooks();
^
Note: SAX01.java uses or overrides a deprecated API.
Note: Recompile with -deprecation for details.
1 error"
For what I found, it seems that "deprecated" mean usage of old classes or methods. What should I do ?
Wait for the XML parser to be rewrite ? ....
Thank's
Constant

"SAX01.java:23: unreported exception
java.lang.Exception; must be caught or declared to be
thrown
(new SAX01()).countBooks();
^Do this
public static void main(String[] args) throws Exception {
or do this
     try
                   first part of expression?(new SAX0()).countBooks();
     catch(Exception ex)
          System.out.println("problem "+ ex);
Note: SAX01.java uses or overrides a deprecated API.
Note: Recompile with -deprecation for details.
1 error"deprecation is just a warning if there are no errors elsewhere in your program it should compile fine, but if you want to find out how to change it do this:
javac YourClassName.java -deprecation
then look in the docs for an alternative.

Sax parser problem

hi,
i am assuming the problem is with sax parser but i cant be sure. I am parsing a xml file (about 1.4MB) with some data in it. the parser i have created reads the xml file correctly for the most part but when at some point the
"public void characters(char buf[], int offset, int len) throws SAXException"
function stops working correctly....i.e it doesnt fully read read the data between the "<start>" and "</start>" element. say it reads about 100 id's correctly---for 101 ID it does this. This is just an example. Since, the problem might be with how :
"public void characters(char buf[], int offset, int len) throws SAXException"
function is reading the data i was wondering if anybody else had encountered this problem or please let me know if i need to change something in the code: here's a part of the code :
Bascially i have created three classes to enter data into three mysql tables and as i parse the data i fill up the columns by matching the column header with the tagName.
import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.SQLException;
import java.sql.*;
import java.io.*;
import java.util.ArrayList;
import java.lang.Object;
import org.xml.sax.*;
import org.xml.sax.helpers.DefaultHandler;
import java.util.*;
import javax.xml.parsers.SAXParserFactory;
import javax.xml.parsers.ParserConfigurationException;
import javax.xml.parsers.SAXParser;
public class Echo03 extends DefaultHandler
StringBuffer textBuffer;
int issuedValue, prodValue;
OrdHeader header = new OrdHeader();
OrdDetail detail = new OrdDetail();
Member memInfo = new Member();
//new addition to store the dynamic value of the products
TestOrdheader prod = new TestOrdheader();
int counter;
String tag, newTag;
SetValue setVal = new SetValue();
String test;
public static void main(String argv[])
if (argv.length != 1) {
System.err.println("Usage: cmd filename");
System.exit(1);
// Use an instance of ourselves as the SAX event handler
DefaultHandler handler = new Echo03();
// Use the default (non-validating) parser
SAXParserFactory factory = SAXParserFactory.newInstance();
try {
// Set up output stream
out = new OutputStreamWriter(System.out, "UTF8");
// Parse the input
SAXParser saxParser = factory.newSAXParser();
saxParser.parse( new File(argv[0]), handler);
} catch (Throwable t) {
t.printStackTrace();
System.exit(0);
static private Writer out;
private String indentString = " "; // Amount to indent
private int indentLevel = 0;
//===========================================================
// SAX DocumentHandler methods
//===========================================================
public void startDocument()
throws SAXException
nl();
nl();
emit("START DOCUMENT");
nl();
emit("<?xml version='1.0' encoding='UTF-8'?>");
header.assign();
public void endDocument()
throws SAXException
nl(); emit("END DOCUMENT");
try {
nl();
out.flush();
} catch (IOException e) {
throw new SAXException("I/O error", e);
public void startElement(String namespaceURI,
String lName, // local name
String qName, // qualified name
Attributes attrs)
throws SAXException
indentLevel++;
nl(); //emit("ELEMENT: ");
String eName = lName; // element name
if ("".equals(eName)) eName = qName; // namespaceAware = false
if (qName.equals("Billing")){
issuedValue = 1;
}else if (qName.equals("Shipping")){
issuedValue = 2;
}else if (qName.equals("ShippingTotal")){
issuedValue = 3;
//check to see if "Product" is the name of the element thats coming next
if (qName.equals("Product")){
if (issuedValue != 3){
prodValue = 1;
prod.addCounter();
}else{
prodValue = 0;
tag = eName;
if (attrs != null) {
for (int i = 0; i < attrs.getLength(); i++) {
String aName = attrs.getLocalName(i); // Attr name
if ("".equals(aName)) aName = attrs.getQName(i);
nl();
emit(" ATTR: ");
emit(aName);
emit("\t\"");
emit(attrs.getValue(i));
emit("\"");
if (attrs.getLength() > 0) nl();
public void endElement(String namespaceURI,
String sName, // simple name
String qName // qualified name
throws SAXException
nl();
String eName = sName; // element name
if ("".equals(eName)){
eName = qName; // not namespaceAware
if ("Order".equals(eName)){
//enter into database
     databaseEnter();
textBuffer = null;
indentLevel--;
public void characters(char buf[], int offset, int len)
throws SAXException
nl();
try {
String s = new String(buf, offset, len);
if (!s.trim().equals("")){
settag(tag, s);
s = null;
}catch (NullPointerException E){
System.out.println("Null pointer Exception:"+E);
//===========================================================
// Utility Methods ...
//===========================================================
// Wrap I/O exceptions in SAX exceptions, to
// suit handler signature requirements
private void emit(String s)
throws SAXException
try {
out.write(s);
out.flush();
} catch (IOException e) {
throw new SAXException("I/O error", e);
// Start a new line
// and indent the next line appropriately
private void nl()
throws SAXException
String lineEnd = System.getProperty("line.separator");
try {
out.write(lineEnd);
for (int i=0; i < indentLevel; i++) out.write(indentString);
} catch (IOException e) {
throw new SAXException("I/O error", e);
===================================================================
///User defined methods
===================================================================
private String strsplit(String splitstr){
String delimiter = new String("=");
String[] value = splitstr.split(delimiter);
value[1] = value[1].replace(':', ' ');
return value[1];
public void settag(String tag, String s){
String pp_transid = null, pp_respmsg = null,pp_authid = null, pp_avs = null, pp_avszip = null;
if ((tag.equals("OrderDate")) || (tag.equals("OrderProcessingInfo"))){
if (tag.equals("OrderDate")){
StringTokenizer st = new StringTokenizer(s);
String orddate = st.nextToken();
String ordtime = st.nextToken();
header.put("ordDate", orddate);
header.put("ordTime", ordtime);
}else if (tag.equals("OrderProcessingInfo")){
StringTokenizer st1 = new StringTokenizer(s);
int tokenCount = 1;
while (tokenCount <= st1.countTokens()){
switch(tokenCount){
case 1:
String extra = st1.nextToken();
break;
case 2:
String Opp_transid = st1.nextToken();
pp_transid = strsplit(Opp_transid);
break;
case 3:
String Opp_respmsg = st1.nextToken();
pp_respmsg = strsplit(Opp_respmsg);
break;
case 4:
String Opp_authid = st1.nextToken();
pp_authid = strsplit(Opp_authid);
break;
case 5:
String Opp_avs = st1.nextToken();
pp_avs = strsplit(Opp_avs);
break;
case 6:
String Opp_avszip = st1.nextToken();
pp_avszip = strsplit(Opp_avszip);
break;
tokenCount++;
header.put("pp_transid", pp_transid);
header.put("pp_respmsg", pp_respmsg);
header.put("pp_authid", pp_authid);
header.put("pp_avs", pp_avs);
header.put("pp_avszip", pp_avszip);
}else{
newTag = new String(setVal.set_name(tag, issuedValue));
header.put(newTag, s);
//detail.put(newTag, s);
prod.put(newTag, s);
memInfo.put(newTag,s);
//Check to see-- if we should add this product to the database or not
boolean check = prod.checkValid(newTag, prodValue);
if (check){
prod.addValues(s);
setVal.clearMod();
==================================================================
Here's the error that i get:
java.util.NoSuchElementException
at org.apache.crimson.parser.Parser2.parseInternal(Parser2.java:691)
at org.apache.crimson.parser.Parser2.parse(Parser2.java:337)
at org.apache.crimson.parser.XMLReaderImpl.parse(XMLReaderImpl.java:448)
at javax.xml.parsers.SAXParser.parse(SAXParser.java:345)
at javax.xml.parsers.SAXParser.parse(SAXParser.java:281)
at Echo03.main(Echo03.java:47)

I haven't gone through your code but I also had a similar error....and the exception in my was because of an "&" instead of the entity reference & in one of the element values. I use a non-validating parser but if you use a validating one then this might not be the reason for your exception.

R3trans check finished with return code:12

Hello!
Can some one help me with the error:
R3trans check finished with return code:12
ERROR: Startup of database failed
/usr/sap/<SID>/SYS/exe/runn/startdb terminating with error 12.
I can start as ora<sid> the oracle, but have problem to start sap.
Thank you very much!
regards
Thom

Dear Thom,
Check ENV variables.Maybe there could be some prob with that .
Please paste the trans.log output of the R3trans -x.
That could help us in suggesting some thing .
Regards
Bharathwaj V

Parsing the large XML ( 1GB) using SAX PARSER

We have very large XMLs being generated by processes. These XMLs should be validated first and then parsed next. We have implementation that works for small files. My question is
how can we validate and parse large XMLs with SAX parser?

The same way as parsing a small XML file, no? Why don't you try it? Then if you have problems that you can't solve, ask about them here.

Problem with SAX parser - entity must finish with a semi-colon

Similar Messages

Maybe you are looking for