User:Ed Davis: Difference between revisions
no edit summary
No edit summary |
No edit summary |
||
Line 7:
Lexical analysis is the process of converting a sequence of characters (such as in a
computer program or web page) into a sequence of tokens (strings with an identified
"meaning"). A program that performs lexical analysis may be called a lexer, tokenizer,
or scanner (though "scanner" is also used to refer to the first stage of a lexer).
;The Task
Create a lexical analyzer for the Tiny programming language.
| |||