BaseRecognizer Methods

Has this rule already parsed input at the current index in the input stream? Return the stop token index or MEMO_RULE_UNKNOWN. If we attempted but failed to parse properly before, return MEMO_RULE_FAILED.

A hook to listen in on the token consumption during error recovery. The DebugParser subclasses this to fire events to the listenter.

Compute the context-sensitive FOLLOW set for current rule. This is set of token types that can follow a specific rule reference given a specific call chain. You get the set of viable tokens that can possibly come next (lookahead depth 1) given the current call chain. Contrast this with the definition of plain FOLLOW for rule r:

Consume tokens until one matches the given token set

Override this method to change where error messages go

Determines whether the specified object is equal to the current object.

Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.

Match needs to return the current input symbol, which gets put into the label for the associated token ref; e.g., x=ID. Token and tree parsers need to return different objects. Rather than test for input stream type or change the IntStream interface, I use a simple method to ask the recognizer to tell me what the current input symbol is.

What is the error header, normally line/character position information?

What error message should be generated for the various exception types?

Serves as the default hash function.

Conjure up a missing token during error recovery.

Return IListT of the rules in your parser instance leading up to a call to this method. You could override if you want more details such as the file/line info of where in the parser java code a rule is invoked.

A more general version of GetRuleInvocationStack where you can pass in the StackTrace of, for example, a RecognitionException to get it's rule stack trace.

Given a rule number and a start token index number, return MEMO_RULE_UNKNOWN if the rule has not parsed input starting from start index. If this rule has parsed input starting from the start index before, then return where the rule stopped parsing. It returns the index of the last token matched by the rule.

return how many rule/input-index pairs there are in total.

How should a token be displayed in an error message? The default is to display just the text, but during development you might want to have a lot of information spit out. Override in that case to use t.ToString() (which, for CommonToken, dumps everything about the token). This is better than forcing you to override a method in your token objects because you don't have to go modify your lexer so that it creates a new Java type.

Gets the Type of the current instance.

Match current input symbol against ttype. Attempt single token insertion or deletion error recovery. If that fails, throw MismatchedTokenException.

Match the wildcard: in a symbol

Creates a shallow copy of the current Object.

Record whether or not this rule parsed the input at this position successfully. Use a standard java hashtable for now.

Push a rule's follow set using our own hardcoded stack

Recover from an error found on the input stream. This is for NoViableAlt and mismatched symbol exceptions. If you enable single token insertion and deletion, this will usually not handle mismatched symbol exceptions but there could be a mismatched token that the match() routine could not recover from.

Attempt to recover from a single missing or extra token.

Report a recognition problem.

reset the parser's state; subclasses must rewinds the input stream

Returns a string that represents the current object.

A convenience method for use most often with template rewrites. Convert a list of IToken to a list of String.