tokenscanner.hTokenScanner class that divides
a string into individual logical units called tokens.
| Class | |
| TokenScanner | This class divides a string into individual tokens. |
| Type | |
| TokenType | This enumerated type defines the values of the getTokenType method. |
enum TokenType { SEPARATOR, WORD, NUMBER, STRING, OPERATOR };
getTokenType method.