URL Content Download

Question

Hi
i'd like to get data from an url... i used this code but doesn't works with all websites....
public byte[] getData(String url) throws Exception {
URL myUrl = new URL(url);
URLConnection conn = myUrl.openConnection();
     byte[] urldata;
     byte[] tmpdata;
URL_LENGTH = conn.getContentLength();
// Some websites release a connection length equals to -1
     if(URL_LENGTH!=-1)
urldata = new byte[URL_LENGTH];
else urldata = new byte[100000];
     InputStream input = conn.getInputStream();
// puts data in the array to return
     input.read(urldata);
     input.close();
FileOutputStream f = new FileOutputStream(new File("/myFile.html"));
f.write(urldata);
f.close();
     return urldata;
This code works only with a few of websites...does anyone can help me ?!?!
PLease

Answer 1

Here is a little class I use to copy files (either from the internet or from a hard drive). From the command line try:
java UFile http://developer.java.sun.com temp.txt
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.io.IOException;
import java.io.InputStream;
import java.io.OutputStream;
import java.net.URL;
import java.net.URLConnection;
public class UFile
     public static void main(String arg[])
      throws IOException
          InputStream is = getInputStream( arg[0] );
          OutputStream os = getOutputStream( arg[1] );
          System.out.println( UFile.copy(is, os) + " bytes copied" );
          System.exit(0);
     public static InputStream getInputStream(String fileName)
          throws IOException
          InputStream input;
          if (fileName.startsWith("http:"))
               URL url = new URL( fileName );
               URLConnection connection = url.openConnection();
               input = connection.getInputStream();
          else
               input = new FileInputStream( fileName );
          return input;
     public static OutputStream getOutputStream(String fileName)
          throws IOException
          return new FileOutputStream( fileName );
     public static int copy(InputStream in, OutputStream out)
          throws IOException
          int bytesCopied = 0;
          byte[] buffer = new byte[4096];
          int bytes;
          try
               while ( (bytes = in.read( buffer )) != -1 )
                    out.write( buffer, 0, bytes );
                    bytesCopied += bytes;
          finally
               in.close();
               out.close();
          return bytesCopied;
}If that doesn't help then take a look at this thread:
http://forum.java.sun.com/thread.jsp?forum=31&thread=331540