Back to Computer-Science-Concepts

Source code -> Lexical Analysis -> Parsing -> Semantic Analysis

Lexical Analysis

Lexicon is the vocabulary of a language. Lexical analysis is the process of separating a stream of characters into tokens, performed by a lexer. Tokens are any defined words for a programming language

Lexer Generator

How do we break text up into tokens and tokenize efficiently in O(1)? Regular Expressions!