Please see my small code ( parsing html)

Question

The following code extracts URLs from a webpage. It is working fine for most of the URLs. But not for some, like
http://www.sun.com/java
http://www.kraftfoods.com/
http://www.kitchen-bath.com/
Actually , I observed for these URLs, they are getting redirected. How can I over come this?
Thanks.
Note : there is some redundant code in the program.
import java.io.*;
import java.util.regex.*;
import java.net.*;
import java.util.*;
import java.lang.reflect.*;
import javax.swing.text.html.*;
import javax.swing.text.*;
class Out
     public static String[] getLinks(String uriStr) {
List result = new ArrayList();
     try {
URL locator = new URL(uriStr);
               URLConnection connection = locator.openConnection();
               connection.setRequestProperty("User-Agent", "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Q312461)");
               connection.connect();
//               BufferedReader in = new BufferedReader(new InputStreamReader(connection.getInputStream()));
Reader rd = new InputStreamReader(connection.getInputStream());
// Parse the HTML
EditorKit kit = new HTMLEditorKit();
HTMLDocument doc = (HTMLDocument)kit.createDefaultDocument();
               doc.putProperty("IgnoreCharsetDirective", Boolean.TRUE);
kit.read(rd, doc, 0);
// Find all the A elements in the HTML document
HTMLDocument.Iterator it = doc.getIterator(HTML.Tag.A);
while (it.isValid()) {
SimpleAttributeSet s = (SimpleAttributeSet)it.getAttributes();
String link = (String)s.getAttribute(HTML.Attribute.HREF);
if (link != null) {
// Add the link to the result list
result.add(link);
it.next();
} catch (MalformedURLException e) {
                              System.out.println("In Out.java");
                         System.out.println(e);
                         e.printStackTrace();
} catch (BadLocationException e) {                    
                              System.out.println("In Out.java");
                         System.out.println(e);
                         e.printStackTrace();
} catch (IOException e) {               
                              System.out.println("In Out.java");
                         System.out.println(e);
                         e.printStackTrace();
// Return all found links
return (String[])result.toArray(new String[result.size()]);
     public static void main(String[] args)
          String links[] = getLinks(args[0]);     
          System.out.println(links.length);
          for(int i = 0 ; i < links.length ; i++)
               System.out.println(links);

Answer 1

I made the following changes.Still it is not working.
URL locator = new URL(uriStr);
HttpURLConnection connection = (HttpURLConnection)locator.openConnection();
               connection.setInstanceFollowRedirects(true);
Can anyone help me??
Thanks.