User:Ed Davis: Difference between revisions
Content added Content deleted
No edit summary |
No edit summary |
||
| Line 7: | Line 7: | ||
Lexical analysis is the process of converting a sequence of characters (such as in a |
Lexical analysis is the process of converting a sequence of characters (such as in a |
||
computer program or web page) into a sequence of tokens (strings with an identified |
computer program or web page) into a sequence of tokens (strings with an identified |
||
"meaning"). A program that performs lexical analysis may be called a lexer, tokenizer, |
"meaning"). A program that performs lexical analysis may be called a lexer, tokenizer, |
||
or scanner (though "scanner" is also used to refer to the first stage of a lexer). |
or scanner (though "scanner" is also used to refer to the first stage of a lexer). |
||
The Task |
;The Task |
||
-------- |
|||
Create a lexical analyzer for the Tiny programming language. |
Create a lexical analyzer for the Tiny programming language. |
||