Compiler/lexical analyzer: Difference between revisions
Content added Content deleted
m (→{{header|Wren}}: Minor tidy) |
(remove heading from {{task heading}}) |
||
| Line 5: | Line 5: | ||
: ''Lexical analysis is the process of converting a sequence of characters (such as in a computer program or web page) into a sequence of tokens (strings with an identified "meaning"). A program that performs lexical analysis may be called a lexer, tokenizer, or scanner (though "scanner" is also used to refer to the first stage of a lexer).'' |
: ''Lexical analysis is the process of converting a sequence of characters (such as in a computer program or web page) into a sequence of tokens (strings with an identified "meaning"). A program that performs lexical analysis may be called a lexer, tokenizer, or scanner (though "scanner" is also used to refer to the first stage of a lexer).'' |
||
{{task |
{{task}} |
||
Create a lexical analyzer for the simple programming language specified below. The |
Create a lexical analyzer for the simple programming language specified below. The |
||