ITokenStream Properties

Only makes sense for streams that buffer everything up probably, but might be useful to display the entire stream or for testing. This value includes a single EOF.

Return the current input symbol index 0..n where n indicates the last symbol has been read. The index is the symbol about to be read not the most recently read symbol.

How far ahead has the stream been asked to look? The return value is a valid index from 0..n-1.

Where are you getting symbols from? Normally, implementations will pass the buck all the way to the lexer who can ask its input stream for the file name or whatever.

Where is this stream pulling tokens from? This is not the name, but the object that provides Token objects.