A little problem getting the style tag of a html file seperate from rest

Question

I'm making a program that will take in a URL and then search through that URL for all a, link, embed, frame, and img tags, find their sources, and download them. I also want to search through the style and find anything that uses a URL (ex. background-image:url('somepic.jpg')) and download that file. In the end, you should be able to go to the directory you saved it all in, open index.html, and see an exact replica of the original site. Now, my problem is that my program isn't getting the style tag's contents. Here's my code: import java.io.*;
import java.util.*;
import java.net.*;
public class Test
     //-->>>> MAIN <<<<--//
     public static void main(String...a)
          try{
               System.out.print("Enter URL: ");
               String target = new Scanner(System.in).next();
               URL url = null;
               try{
                    url = new URL(target);
               }catch(MalformedURLException x){
                    url = new URL("http://" + target);
               Scanner scan = new Scanner(url.openStream());
               scan.useDelimiter("<");
               ArrayList<String> tokens = new ArrayList<String>();
               while(scan.hasNext())
                    String str = scan.next();
                    str = str.trim();
                    Scanner tags = new Scanner(str);
                    if(tags.hasNext())
                         String tag = tags.next();
                         if(tag.equalsIgnoreCase("a") || tag.equalsIgnoreCase("img") || tag.equalsIgnoreCase("link") || tag.equalsIgnoreCase("embed") || tag.equalsIgnoreCase("frame"))
                              tokens.add(str);
                         else if(tag.equalsIgnoreCase("style"))
                              tokens.add(str);// This isn't adding anything
               for(String str : tokens)
                    System.out.println(str);
          }catch(UnknownHostException x){
               System.err.println("Host not found.");
          }catch(Exception x){
               x.printStackTrace();
     //-->>>> FindURLAttributes <<<<--// <--- Under construction
     private static ArrayList<String> findURLAttributes(String tag)
          ArrayList<String> tokens = new ArrayList<String>();
          tokens.add(tag);
          return tokens;
}

Answer 1

I've never tried it, but it seems like using an existing html parser would be a lot easier. I've worked with xml dom parsers, and it's not really that hard. I don't imagine working with an html dom would be too difficult either, at least it wouldn't be as hard as doing it by hand. Google for java html parser and see if any of them suit your needs.