A line of text, tokenizing it using StringTokenizer

Question

Hello,
I feel I'm going round in circles, what I have is a line of text a mobile message like these
25 100
SEND 2228161 Hello Pete
RECEIVE 2228161 Hello Chris, how are you?
SEND 2227765 I hate text speak
RECEIVE 2228876 wot u on bout
SEND 2227975 The quick brown fox jumped over the lazy dog
SEND 2328161 Simple Simon met a pieman going to the fair
I'm to extract the message and check it's length, to then put in an array not an ArrayList if it's greater than 25, break it up into tokens. Is this how StringTokenizer works the SEND part is token 1, the mobile number is token 2 and the message is token 3. Or am I making it more difficult than it sounds? Should I just use String.split() method (which I'm confused on how to use). Another question BlueJ seems to read the file and then hang, I have to reset the machine, should,'t I have an EOF somewhere, because I thought I've closed the file here.
Here's the code so far, the file reads in OK, I get the ouput, for checking purposes
Public class Driver2
    public static void main(String[] args)
    //read the file
         BufferedReader reader = null;
        StringTokenizer tokens = null;
        String line = null;
    try
              reader = new BufferedReader(new FileReader(args[0]));
        line = reader.readLine();
        while ((line = reader.readLine()) != null)// read each line until null is returned
        { // line will be null when we reach end of the file
                int i = 0;
                // process data
                tokens = new StringTokenizer(line, "");
                while (tokens.hasMoreTokens())
                    //get next token
                     System.out.println(tokens.nextToken());
                    //(line = reader.readLine()) != null
                    // split on the white space with eiher RECEIVE or SEND before it
                    String[] storeTokens = line.split("(SEND|RECEIVE)\\s");
                    //("(?<=RECEIVE|SEND)\\s");
                    if (line.startsWith("SEND"))
                        System.out.println("SEND message");
                        if ((storeTokens[1].length()) > 25)
                            System.out.println("This too big");
                            String[] tempTokens = line.split("(?<=SEND)\\s");
                            System.out.println("Message has been: "+tempTokens[0]);
                            System.out.println("\tmessage = "+tempTokens[1]+"\n\tlength = "+tempTokens[1].length());
                    if (line.startsWith("RECEIVE"))
                        System.out.println("RECEIVE message");
                    if (line.startsWith("DELETE"))
                        System.out.println("DELETE message");
                    if (line.startsWith("VIEW"))
                        System.out.println("VIEW message");
          reader.close();
        catch( FileNotFoundException filenotfoundexxption )
            System.out.println( "File not found" );
        catch( IOException ioexception )
            ioexception.printStackTrace( );
     }// close main
}// End of classThanks in advance

Answer 1

Hello,
I am trying to strip out the SEND word and telephone number, leaving me a String to then test the length of and if it's greater than 25 characaters, split it up a number of times and store back into the array.
message is:
SEND 2226543 Mary had a little lamb, its fleece was white as snow
The code I used for the String split works, it returns this String - String[] sendTokens = line.split("\\SEND|[0-9]");Mary had a little lamb, its fleece was white as snow
I then have to test for the String length, in this case it is 52 characters, split this up into 3 separate strings thus:
Mary had a little lamb, i
ts fleece was white as sn
ow
I think I have to use the line.length => 25, then split the message up
What's wrong with the split method, I've used? I've tried every combination, this seems to work, although there are large gaps in the output, like this.
Christmas is coming the geese are getting fat
SEND message
Cristiano Ronaldo plays for Portugal
SEND message
Thanks for the advice