All Types

This type defines the character types that are recognized by a scanner for a parsed language.

This type represents an opcode, which is a way of constructing a numeric representation of a token string that has special meaning to a parser.

This type defines the ways in which instances of AScanner handle instances of certain tokens:

• SCAN_NO_WHITESPACE: Discard whitespace tokens when they are encountered. When this behavior is enabled, AScanner.CurrentToken will never refer to an instance of ASpaceToken, and AScanner.next will read tokens from the source until one is encountered that is not determined to be whitespace.

• SCAN_CONSOLIDATE_WHITESPACE: Consolidate consecutive instances of the same whitespace character into a single instance of ASpaceToken. When this behavior is enabled, consecutive instances of the same whitespace character in the source will be collected into one instance of ASpaceToken; otherwise, multiple instances of ASpaceToken will be returned.

  Obviously, this flag has no effect if SCAN_NO_WHITESPACE is enabled.

• SCAN_CONSOLIDATE_LINE_ENDINGS: Consolidate consecutive instances of the same line ending character into a single instance of ALineEndingToken. When this behavior is enabled, consecutive instances of the same line ending character in the source will be collected into one instance of ALineEndingToken; otherwise, multiple instances of ALineEndingToken will be returned.

This type represents the scope of a symbol, which is a way of indicating the symbol table to which it belongs.