Chandler Carruth 88160496e1 Fix which tokens the lexer flags as bracket-recovery tokens. (#7457) ...

`ErrorRecoveryBuffer::Apply` flagged each inserted token via the
pre-insertion index of the token it was inserted before. Once any
earlier insertion had been applied, that index no longer matches the
token's position in the merged list: with two closers inserted at the
same point (`{((}`), the second recovery token was left unflagged, and
with insertions at two separate points (`{(} {(}`), a real token was
flagged in the second one's place.

`IsRecoveryToken` now reports exactly the inserted tokens. This will
matter for `carbon format`: a recovery token's text exists in no source
byte range, so a minimal-edit model must know not to anchor edits on it.

Assisted-by: Claude Code

2026-07-06 14:39:50 +00:00

..

fuzzer_corpus

Rename lexer dir to lex (#3179)

2023-09-01 02:39:04 +00:00

testdata

Trailing comments (#7441)

2026-07-04 06:42:02 +00:00

BUILD

Centralize benchmarking infrastructure and the toolchain-wide benchmarks (#7212)

2026-05-15 20:17:23 +00:00

character_set.h

Rename lexer dir to lex (#3179)

2023-09-01 02:39:04 +00:00

dump.cpp

Remove the Dump method from Printable (#7118)

2026-04-26 16:21:07 +00:00

dump.h

Rewrite Dump calls to use std::string returns (#5195)

2025-03-27 21:17:54 +00:00

helpers.cpp

Improve parsing large integers (#6908)

2026-03-16 20:00:51 +00:00

helpers.h

Drop "diagnostic" from some filenames in the "diagnostics" folder (#6686)

2026-02-04 17:24:55 +00:00

lex.cpp

Fix which tokens the lexer flags as bracket-recovery tokens. (#7457)

2026-07-06 14:39:50 +00:00

lex.h

Drop "diagnostic" from some filenames in the "diagnostics" folder (#6686)

2026-02-04 17:24:55 +00:00

numeric_literal_benchmark.cpp

Add support for octal numbers (#6909)

2026-03-16 21:28:37 +00:00

numeric_literal_fuzzer.cpp

Move diagnostics into a namespace (#5173)

2025-03-26 19:12:10 +00:00

numeric_literal_test.cpp

Add support for octal numbers (#6909)

2026-03-16 21:28:37 +00:00

numeric_literal.cpp

Fix missing include for std::log2 (#7015)

2026-04-02 18:27:46 +00:00

numeric_literal.h

Add support for octal numbers (#6909)

2026-03-16 21:28:37 +00:00

string_literal_benchmark.cpp

Support lexing characters (#5893)

2025-08-01 18:24:03 +00:00

string_literal_fuzzer.cpp

Support parse/check/lower for char (#5901)

2025-08-06 20:39:01 +00:00

string_literal_test.cpp

Trailing comments (#7441)

2026-07-04 06:42:02 +00:00

string_literal.cpp

Trailing comments (#7441)

2026-07-04 06:42:02 +00:00

string_literal.h

Trailing comments (#7441)

2026-07-04 06:42:02 +00:00

test_helpers.h

Drop "diagnostic" from some filenames in the "diagnostics" folder (#6686)

2026-02-04 17:24:55 +00:00

token_index.h

Use inline constexpr where appropriate. (#6374)

2025-11-14 13:50:56 +00:00

token_info.h

Convert TokenInfo::ResetAs... functions to return new TokenInfos. (#7252)

2026-05-23 01:22:22 +00:00

token_kind_test.cpp

Formalize Cpp as a PackageNameId (#6306)

2025-11-05 17:21:41 +00:00

token_kind.cpp

Some more edits to EnumBase and EnumMaskBase (#6054)

2025-09-12 22:59:37 +00:00

token_kind.def

Move self to the explicit () parameter list (proposal #7016) (#7272)

2026-06-10 15:30:43 +00:00

token_kind.h

Improve diagnostics and error recovery for invalid identifiers. (#7249)

2026-05-22 23:53:19 +00:00

tokenized_buffer_benchmark.cpp

Centralize benchmarking infrastructure and the toolchain-wide benchmarks (#7212)

2026-05-15 20:17:23 +00:00

tokenized_buffer_fuzzer.cpp

Switch compile functions to use options structs (#5742)

2025-06-27 22:08:47 +00:00

tokenized_buffer_test_helpers.h

Refactor value store code to use separate files. (#4477)

2024-11-04 04:00:17 +00:00

tokenized_buffer_test.cpp

Fix which tokens the lexer flags as bracket-recovery tokens. (#7457)

2026-07-06 14:39:50 +00:00

tokenized_buffer.cpp

Trailing comments (#7441)

2026-07-04 06:42:02 +00:00

tokenized_buffer.h

Trailing comments (#7441)

2026-07-04 06:42:02 +00:00