Is space a token in java?

Answer 1

By default, no. The StreamTokenizer class ignores spaces as white space.

If you need to make it a token, which you didn't specify, you can modify the default behavior by calling the function ordinaryChar (int ch), where ch is the character you would want to be treated as a token.

From the Java SE 6 API documentation:

ordinaryCharpublic void ordinaryChar(int ch) Specifies that the character argument is "ordinary" in this tokenizer. It removes any special significance the character has as a comment character, word component, string delimiter, white space, or number character. When such a character is encountered by the parser, the parser treats it as a single-character token and sets ttype field to the character value.

Making a line terminator character "ordinary" may interfere with the ability of a StreamTokenizer to count lines. The lineno method may no longer reflect the presence of such terminator characters in its line count.Parameters:ch - the character.