A lexical analyser generator. You write regular expressions in a .l file describing what each token looks like, and Lex generates C code that breaks raw text into a stream of tokens. Input text → Lex ...

All the token values are mapped in the same space, indexed by the token value directly. To account for enhancements and new tokens, gap are created, so that adding a token from one source does not ...