mirror of
https://github.com/carbon-language/carbon-lang.git
synced 2026-09-27 13:20:10 +01:00
Richard Smith
48d5b18026
Provide an initial rough structure for the specification so we can add things as they are decided. Split the specification into a language and a library section. In the language section, use one file per broad area of functionality. Divide the language up based on the intended layering of the language design.
892 B
892 B
Lexical analysis
TODO
Lexical elements
-
The sequence of Unicode code points in a source file is partitioned into contiguous subsequences called lexical elements. Formation of lexical elements begins with the first code point in the source file and proceeds in code point order.
-
At each step, the longest valid lexical element that can be formed from a prefix of the remaining code points is formed, even if this would result in a failure to form a later lexical element. Repeating this process shall convert the entire source file into lexical elements.
-
Valid lexical elements are:
TODO: Add a list of lexical elements once we've decided on them.