-
Constructor Summary
Constructors
-
Method Summary
Returns a list of tokens analyzed from the program text.
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Constructor Details
-
Lexer
Constructs a lexer.
- Parameters:
locale
- the locale for error message.
-
Method Details
-
apply
Returns a list of tokens analyzed from the program text.
The result tokens ends with an EotToken or an ErrorToken.
- Specified by:
apply
in interface Function<String,List<Token>>
- Parameters:
programText
- the program text to be analyzed.
- Returns:
- a list of token analyzed from the program text.