Tokens

A token is a series of contiguous characters that the compiler treats as a unit. Translation phase 3 partitions a source file into a sequence of tokens. Tokens fall into six classes:

• Identifiers

• Keywords

• Constants, which can be further classified into numeric constants and character constants

• String literals

• Operators

• Punctuators and other separators