Read Text from HTML-Pages and want to solve "ChangedCharSetException"

Question

Hello,
I have an app that connect via threads with pages and parse them an gives me only the Text-version of a HTML-page. Works fine, but if it found a page, where the text is within images, than the whole app stopps and gave me the message:
javax.swing.text.ChangedCharSetException
        at javax.swing.text.html.parser.DocumentParser.handleEmptyTag(DocumentParser.java:169)
        at javax.swing.text.html.parser.Parser.startTag(Parser.java:372)
        at javax.swing.text.html.parser.Parser.parseTag(Parser.java:1846)
        at javax.swing.text.html.parser.Parser.parseContent(Parser.java:1881)
        at javax.swing.text.html.parser.Parser.parse(Parser.java:2047)
        at javax.swing.text.html.parser.DocumentParser.parse(DocumentParser.java:106)
        at javax.swing.text.html.parser.ParserDelegator.parse(ParserDelegator.java:78)
        at aufruf.main(aufruf.java:33)So I tried to catch them with "getCharSetSpec()" and "keyEqualsCharSet( )" from the class "javax.swing.text.ChangedCharSetException" and hoped that this solved the problem. But still doesen't work...
Then I looked at the web and found, that I have to add the line:
doc.putProperty("IgnoreCharsetDirective", new Boolean(true));"doc." is a new HTML Dokument, created with the HTMLEditorKit. I do not have much knowledge about that and so I hope, that someone can explain me, how I can solve that problem, within my code.
Here we go:
import javax.swing.text.*;
import java.lang.*;
import java.util.*;
import java.net.*;
import java.io.*;
import javax.swing.text.html.*;
import javax.swing.text.html.parser.*;
public class myParser extends Thread
        private String name;
        public void run()
                try
                        URL viele = new URL(name);                       // "name" ia a variable with a lot of links
                URLConnection hs = viele.openConnection();
                hs.connect();
                if (hs.getContentType().startsWith("text/html"))
                        InputStream is = hs.getInputStream();
                        InputStreamReader isr = new InputStreamReader(is);
                        BufferedReader br = new BufferedReader(isr);
                        Lesen los = new Lesen();
                        ParserDelegator parser = new ParserDelegator();
                        parser.parse(br,los, false);
        catch (MalformedURLException e)
                System.err.print("Doesn't work");
        catch (ChangedCharSetException e)
                e.getCharSetSpec();
                e.keyEqualsCharSet();
                e.printStackTrace();
        catch (Exception o)
        public void vowi(String n)
                name = n;
}and for the case that it is important here is the class "Lesen"
import java.net.*;
import java.io.*;
import javax.swing.text.*;
import javax.swing.text.html.*;
import javax.swing.text.html.parser.*;
class Lesen extends HTMLEditorKit.ParserCallback
        public void handleStartTag(HTML.Tag t, MutableAttributeSet a, int pos)
                try
                        if ((t==HTML.Tag.P) || (t==HTML.Tag.H1) || (t==HTML.Tag.H2) || (t==HTML.Tag.H3) || (t==HTML.Tag.H4) || (t==HTML.Tag.H5) || (t==HTML.Tag.H6))
                                System.out.println();
                catch (Exception q)
                        System.out.println(q.getMessage());
        public void handleSimpleTag(HTML.Tag t,MutableAttributeSet a, int pos)
                try
                        if (t==HTML.Tag.BR)
                                System.out.println(); // Neue Zeile
                                System.out.println();
                catch (Exception qw)
                        System.out.println(qw.getMessage());
        public void handleText(char[] data, int pos)
                try
                        System.out.print(data);                                           // prints the text from HTML-pages
                catch (Exception ab)
                        System.out.println(ab.getMessage());
}Thanks a lot for helping...
Stephan

Answer 1

parser.parse(br,los, false);
parser.parse(br,los, true);