Please help me... Its urgent

Question

Hi guys
I am writing a program which will download the HTML source code of pages. Before downloading, I am checking whether that URL exists or not. But my program seems to hang when I use the function getPage of WebGrabber many times.
My code is as follows :
urlExists.java
import java.net.*;
import java.io.*;
import java.util.*;
public class urlExists
     urlExists()
     public int exists(String urlname) throws IOException
          URL url=null;
          try
            url=new URL(urlname);
          catch(Exception e)
            HttpURLConnection connexion = (HttpURLConnection)(url.openConnection());
            if(connexion.getResponseCode()==HttpURLConnection.HTTP_NOT_FOUND)
                 connexion.disconnect();
                    return(0);
            else
                 connexion.disconnect();
                 return(1);
WebGrabber.java
import java.net.*;
import javax.net.*;
import java.io.*;
import java.util.Date;
public class WebGrabber
     private String content;
     private URL url;
     private Date lastModified;
     private InputStream input;
     private int c=0;
     private urlExists urlE;
     WebGrabber()
          This method expects the user to give the url to it and
          returns the contents of the page in the String format.
     public String getPage(String urlWanted)
         StringBuffer buf = new StringBuffer();
          InputStreamReader in;
          BufferedReader data;
         String line;
          content = "URL";
          int status = 1;
          url = null;
          try
               url = new URL("http://" + urlWanted);
          catch (Exception e) {}
          try
               urlE = new urlExists();
               status = urlE.exists("http://" + urlWanted);
               System.out.println("status : " + status);
          catch (IOException e)
               content = "";
          try
               if (!content.equals("") && status==1)
                    content = "";
                    HttpURLConnection u = (HttpURLConnection)(url.openConnection());
                    u.connect();
//                    if(u.getResponseCode()==HttpURLConnection.HTTP_NOT_FOUND)
//                         content = "";
//                    else
                                                            in = new InputStreamReader(u.getInputStream());
                                                            data = new BufferedReader(in);
                                                             while ((line = data.readLine()) != null)
                              System.out.println(line);
                              content += line + "\n";
//                        buf.append(line + "\n");
//                         content = buf.toString();
                         data.close();
                         in.close();
                    u.disconnect();
               else content = "";
          catch (Exception e)
               System.out.println("HEREEEE :    " + e);
               return content;
          return content;
     public static void main(String[] args)
          WebGrabber w = new WebGrabber();
          String u;
          String cont;
          u = "www.google.co.in";
          cont = w.getPage(u);
          System.out.println("CONTENT : " + cont);
          u = "www.yahoo.com";
          cont = w.getPage(u);
          System.out.println("CONTENT : " + cont);
          u = "www.google.com";
          cont = w.getPage(u);
          System.out.println("CONTENT : " + cont);
          u = "www.google.co.in";
          cont = w.getPage(u);
          System.out.println("CONTENT : " + cont);
          u = "www.yahoo.com";
          cont = w.getPage(u);
          System.out.println("CONTENT : " + cont);
          u = "www.google.co.in/options/index.html";
          cont = w.getPage(u);
          System.out.println("CONTENT : " + cont);
}I have tried a lot to debug including closing the InputStream and BufferedReader. Could you guys please help me out. I need to do this very soon ...
Regards
kbhatia

Answer 1

There was a recent posting which suggested two things
to say if you want to be ignored are put "please help
me" or "urgent" in you subject. You put both. :)
It is likely that you program is throwing an
exception as an error, but you are ignoring all
errors so you have know way of knowing what the
problem is.
Try printing out your exceptions, they may tell you
what the error is e.g.
e.printStackTrace();Hi
I am getting the following exception :
status : 1
HEREEEE : java.net.SocketException: Connection reset
java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:168)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:220)
at java.io.BufferedInputStream.read(BufferedInputStream.java:277)
at sun.net.www.http.ChunkedInputStream.fastRead(ChunkedInputStream.java
221)
at sun.net.www.http.ChunkedInputStream.read(ChunkedInputStream.java:662
at java.io.FilterInputStream.read(FilterInputStream.java:111)
at sun.nio.cs.StreamDecoder$CharsetSD.readBytes(StreamDecoder.java:406)
at sun.nio.cs.StreamDecoder$CharsetSD.implRead(StreamDecoder.java:446)
at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:180)
at java.io.InputStreamReader.read(InputStreamReader.java:167)
at java.io.BufferedReader.fill(BufferedReader.java:136)
at java.io.BufferedReader.readLine(BufferedReader.java:299)
at java.io.BufferedReader.readLine(BufferedReader.java:362)
at WebGrabber.getPage(WebGrabber.java:111)
at WebGrabber.main(WebGrabber.java:161)
What doessun.net.www.http.ChunkedInputStream.read mean? Also for the SocketException : Connection reset, what solution could you suggest?
Regards
kbhatia