Chandler Carruth
437be71f1f
Four regions had `end` patterns that could fail to match, so `return var;`, a `fn` with no parameter list, and an unterminated `"` each swallowed the rest of the file; 77 of 1696 testdata files lost their highlighting partway through. Operators were wrapped in `\b`, which only holds next to a word character, so `a + b` highlighted nothing. And the keywords had drifted about two years behind the lexer. Identifiers are now classified by naming convention plus a call-site lookahead, the way the Rust grammar does it, so nothing carries between lines. Regions survive only for strings and embedded C++, where a terminator reliably turns up, and raw strings spell out hash levels 0 through 2, so `\n` is an escape in `"..."` and plain text in `#"..."#`. Trailing comments, character literals, raw identifiers, `$0`, `0o` octal, arbitrary integer widths and six missing keywords are covered now, `destructor` is gone, and `i32` reads as a type rather than as a keyword. Highlighting stays forgiving rather than diagnostic: anything after `//` is a comment and odd numeric spellings still read as numbers. Pointing out mistakes is the toolchain's job, and lenient rules hold steady while you are still typing. Every keyword and symbol in `token_kind.def` is covered, and unscoped tokens across examples and the toolchain drop from 39% to 21%. Note that I haven't tried to read and reason about every minute change here as there are just too many. But I'm working on a follow-up PR that adds testing that should be significantly easier te review. Assisted-by: Claude Code
Textmate Language Definition
This directory contains a TextMate bundle which can be used in various editors such as TextMate, Atom, or the IntelliJ family for syntax highlighting of Carbon source files.
If you are using TextMate, see the documentation on
how to install TextMate bundles.
Clone the repository with Git and symlink/copy the utils/textmate directory to
any of the paths TextMate will search through (you can find these paths in the
TextMate documentation above).
IntelliJ
If you are using IntelliJ or a IntelliJ Platform product, you can find
documentation on
how to install TextMate bundles in IntelliJ.
Clone the repository with Git and open the utils/textmate directory inside the
IntelliJ TextMate Bundle window.
Atom
If you are using Atom, you can convert the bundle to an Atom-compatible one. See the Atom documentation on how to do that.
Other
For other editors that support TextMate bundles you can consult your editors documentation to see how to use the bundle.
Samples
Samples/ holds Carbon sources that exercise the grammar, each with an SVG
rendering of how this bundle highlights it. Some deliberately contain invalid
code, to show that highlighting stays sensible while something is being typed.
The renderings are generated, not screenshotted, so they always reflect the grammar in this repository. Regenerate them in the same commit as any change to the grammar, so a reviewer can see what the change does to real code:
utils/textmate/render_sample.py utils/textmate/Samples/*.carbon