lexical-analysis.md

title	Lexical Analysis

A Ghost program is read by a parser. Input to the parser is a stream of tokens, generated by the lexical analyzer. Below, we'll describe how the lexical analyzer breaks a file down into tokens and evaluated.