How to skip a line like !-- PJG STAG 4700 -- ?

Question

I am doing a project that requires me to parse a documents.
The documents have different tags, and main text area between <TEXT> and </TEXT>, here is an example:
<DOC>
<DOCNO> FT911-3 </DOCNO>
<HEADLINE>
FT 14 MAY 91 / International Company News: Contigas plans DM900m east
German project
</HEADLINE>
<!-- PJG 0012 frnewline -->
<TEXT>
CONTIGAS, the German gas group 81 per cent owned by the utility Bayernwerk, said yesterday that it intends to invest DM900m in the next four years.
</TEXT>
</DOC>
Since the main porpuse is to read text body, so I will skip those text between tags except <TEXT></TEXT>.
I can use switch statement to skip the text between tags, but I can't find a way to skip a line like:
<!-- PJG 0012 frnewline -->
any suggestions?

Answer 1

Let me correct my former statement for jesper1, this is SGML( Standard Generalized Markup Language)
document, early version for XML, so jesper1 are kind of right.
For freekee:
First step:
/** returns a hashmap of initialized tags
    *  This way we can have more than one tagstring map to the same
    *  tag type.  For example, we might have DOCID and DOCUMENTID both
    *  map to the BEGIN_DOCID tag.
   private HashMap initTags() {
        int NUM_TAGS = 20;
        Integer tagVals[] = new Integer[NUM_TAGS];
        HashMap tags = new HashMap();
        for (int i = 0; i < NUM_TAGS; i++) {
            tagVals[i] = new Integer(i);
        tags.put("<DOC>",             tagVals[0]);
        tags.put("</DOC>",            tagVals[1]);
        tags.put("<PARENT>",          tagVals[2]);
        tags.put("<TITLE>",           tagVals[2]);
        tags.put("<TL>",              tagVals[2]);
        tags.put("<HEADLINE>",        tagVals[2]);
        tags.put("</PARENT>",         tagVals[3]);
        tags.put("</TITLE>",          tagVals[3]);
        tags.put("</TL>",             tagVals[3]);
        tags.put("</HEADLINE>",       tagVals[3]);
        tags.put("<TEXT>",            tagVals[4]);
        tags.put("</TEXT>",           tagVals[5]);
        tags.put("<DOCID>",           tagVals[6]);
        tags.put("<DOCNO>",           tagVals[6]);
        tags.put("</DOCID>",          tagVals[7]);
        tags.put("</DOCNO>",          tagVals[7]);
        tags.put("<DATELINE>",        tagVals[8]);
        tags.put("</DATELINE>",       tagVals[9]);
        return tags;
second step:
/* this will read the file of documents, parse them and return a list of document */
  /* objects.  Could be called the document factory since it generates useful       */
  /* document objects that can then be indexed.                                     */
  /* Documents are created when an end of document tag is encountered.              */
  public ArrayList readDocuments() {
      String      dateline     = null;
      String      docName      = null;
      ArrayList   documentList = new ArrayList();
      boolean     done         = false;
      int         documentID   = 0;
      int         length       = 0;
      int         offset       = 0;
      String      title        = null;
      boolean endOfFile = false;
      while (! done) {
          System.out.println("Token --> " + in.sval);
          /* check to see if we hit the end of the file */
          try {
              if (in.nextToken() == in.TT_EOF) {
                  done = true;
                  endOfFile = true;
                  continue;
              /* now test for a tag */
              switch (in.ttype) {
                // where does "END_DOC" come from?
                // Since: tags.put("</DOC>", tagVals[1]), so </DOC> is mapped to value 1.
                // and since in the initialization: private final static int END_DOC = 1;
                // in.ttype returns a int, like TT_WORD
             case END_DOC:
                        /* when we hit the end of a document, lets create a new object */
                        /* to store info needed for indexing                           */
                        length = in.currentPosition - offset;
                        Document d = new Document (documentID, docName, title, dateline,
                                         inputFileName, offset, length, distinctTerms);
                        ++documentID;
                        documentList.add(d);
                        break;
                /* initialize document attributes when we start a new doc */
                case BEGIN_DOC:
                        System.out.println("Started new document");
                        offset = in.currentPosition;
                        docName = null;
                        dateline = null;
                        title = null;
                        distinctTerms = new HashMap();
                        break;
             case BEGIN_DOC_NAME:
                     docName = readNoIndex(in, END_DOC_NAME);
                        break;
             case BEGIN_TITLE:
                        title = readNoIndex(in, END_TITLE);
                        break;
                case BEGIN_DATELINE:
                        dateline = readNoIndex(in, END_DATELINE);
                        break;
                case BEGIN_TEXT:
                        readText(in, stopWords);
                        break;
                /* only time we get a word here is if its outside of any tags */
                case WORD:
                        break;
             default: {
                    System.out.println("Unrecognized tag: "+in.sval);
                    System.exit(-1);
          } catch (IOException e) {
                  System.out.println("Exception while reading doc ");
                  e.printStackTrace();
      return documentList;
   }Did I answer your question correctly?