LegacyCommonTokenStream Class |
The most common stream of tokens is one where every token is buffered up
and tokens are prefiltered for a certain channel (the parser will only
see these tokens and cannot change the filter channel number during the
parse).
Inheritance HierarchyNamespace: Stimulsoft.Data.Expressions.Antlr.Runtime
Assembly: Stimulsoft.Data (in Stimulsoft.Data.dll) Version: 2019.3.1.0
SyntaxThe LegacyCommonTokenStream type exposes the following members.
Constructors| Name | Description | |
|---|---|---|
 | LegacyCommonTokenStream | Initializes a new instance of the LegacyCommonTokenStream class |
| LegacyCommonTokenStream(ITokenSource) | Initializes a new instance of the LegacyCommonTokenStream class |
| LegacyCommonTokenStream(ITokenSource, Int32) | Initializes a new instance of the LegacyCommonTokenStream class |
Properties| Name | Description | |
|---|---|---|
 | Count | |
| Index | |
| Range |
How deep have we gone?
|
| SourceName | |
| TokenSource |
Methods| Name | Description | |
|---|---|---|
| Consume |
Move the input pointer to the next incoming token. The stream
must become active with LT(1) available. consume() simply
moves the input pointer so that LT(1) points at the next
input symbol. Consume at least one token.
|
| DiscardTokenType | |
| Equals | Determines whether the specified object is equal to the current object. (Inherited from Object.) |
| FillBuffer |
Load all tokens from the token source and put in tokens.
This is done upon first LT request because you might want to
set some token type / channel overrides before filling buffer.
|
 | Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.) |
| Get |
Return absolute token i; ignore which channel the tokens are on;
that is, count all tokens not just on-channel tokens.
|
| GetHashCode | Serves as the default hash function. (Inherited from Object.) |
| GetTokens | |
| GetTokens(Int32, Int32) | |
| GetTokens(Int32, Int32, BitSet) |
Given a start and stop index, return a List of all tokens in
the token type BitSet. Return null if no tokens were found. This
method looks at both on and off channel tokens.
|
| GetTokens(Int32, Int32, IListInt32) | |
| GetTokens(Int32, Int32, Int32) | |
| GetType | Gets the Type of the current instance. (Inherited from Object.) |
| LA | |
| LB | Look backwards k tokens on-channel tokens |
| LT |
Get the ith token from the current position 1..n where k=1 is the
first symbol of lookahead.
|
| Mark | |
| MemberwiseClone | Creates a shallow copy of the current Object. (Inherited from Object.) |
| Release | |
| Reset | |
| Rewind | |
| Rewind(Int32) | |
| Seek | |
| SetDiscardOffChannelTokens | |
| SetTokenSource | Reset this token stream by setting its token source. |
| SetTokenTypeChannel |
A simple filter mechanism whereby you can tell this token stream
to force all tokens of type ttype to be on channel. For example,
when interpreting, we cannot exec actions so we need to tell
the stream to force all WS and NEWLINE to be a different, ignored
channel.
|
| SkipOffTokenChannels | Given a starting index, return the index of the first on-channel token. |
| SkipOffTokenChannelsReverse | |
| ToString | (Overrides ObjectToString.) |
| ToString(Int32, Int32) | |
| ToString(IToken, IToken) |
Fields| Name | Description | |
|---|---|---|
 | channel | Skip tokens on any channel but this one; this is how we skip whitespace... |
| channelOverrideMap | Map from token type to channel to override some Tokens' channel numbers |
| discardOffChannelTokens | By default, track all incoming tokens |
| discardSet | Set of token types; discard any tokens with this type |
| lastMarker | Track the last mark() call result value for use in rewind(). |
| p |
The index into the tokens list of the current token (next token
to consume). p==-1 indicates that the tokens list is empty
|
| tokens |
Record every single token pulled from the source so we can reproduce
chunks of it later.
|
RemarksTODO: how to access the full token stream? How to track all tokens matched per rule?
See Also