mirror of
https://github.com/carbon-language/carbon-lang.git
synced 2026-09-30 14:15:04 +01:00
The [Operators proposal #601](https://github.com/carbon-language/carbon-lang/pull/601) got accepted and but the details were not updated in the design docs. Added `symbolic_tokens.md` file to add the details of the proposal and its discussion. Closes #1992 Co-authored-by: Avi Aaron <81820388+aviRon012@users.noreply.github.com>
961 B
961 B
Lexical conventions
Table of contents
Lexical elements
The first stage of processing a source file is the division of the source file into lexical elements.
A lexical element is one of the following:
-
a maximal sequence of whitespace characters
-
a word
-
a literal:
-
a comment
The sequence of lexical elements is formed by repeatedly removing the longest initial sequence of characters that forms a valid lexical element.