Compiler/lexical analyzer: Difference between revisions
Content deleted Content added
Line 4,886: | Line 4,886: | ||
</lang> |
</lang> |
||
This script uses <i>lexer.tokenize_text</i> to show the |
This script uses <i>lexer.tokenize_text</i> to show the token sequence produced from a source text. |
||
<lang Lua>lexer = require 'lexer' |
<lang Lua>lexer = require 'lexer' |