Compiler/lexical analyzer: Difference between revisions

m
→‎{{header|Perl 6}}: Correct a few misspellings / case mismatches
(CHANGE TOKEN NAMES FROM ALL CAPS to something a little easier on old eyes.)
m (→‎{{header|Perl 6}}: Correct a few misspellings / case mismatches)
Line 1,648:
token symbol:sym<,> { ',' { make 'Comma' } }
 
token identifier { <[_A..Za..z]><[_A..Za..z0..9]>* { make 'IDENTIFERIdentifier ' ~ $/ } }
token integer { <[0..9]>+ { make 'Integer ' ' ~ $/ } }
 
token char {
'\'' [<-[']> | '\n' | '\\\\'] '\''
{ make 'CHAR_LITERALChar_Literal ' ~ $/.subst("\\n", "\n").substr(1, *-1).ord }
}
 
Line 1,722:
18 40 String "String literal"
19 16 Op_add
19 40 IDENTIFER Identifier variable_name
20 26 CHAR_LITERAL Char_Literal 10
21 26 CHAR_LITERAL Char_Literal 92
22 26 CHAR_LITERAL Char_Literal 32
23 1 End_of_input
</pre>
 
10,333

edits