Richard SmithandJon Ross-Perkins e68e54dae4 Issue a diagnostic if we try to parse a source file that is too large. (#4429) ...

Previously in an optimized build we'd produce bogus tokens, such as
tokens with incorrect IdentifierIds, and in a debug build we would try
to CHECK-fail -- but actually wouldn't, because we're incorrectly
checking for `2 << bits` instead of `1 << bits`. I hit this while I was
trying to do some profiling and was seeing some very strange
diagnostics.

The diagnostic is pointed at the first token that is beyond the limit to
help people determine where to split their files.

---------

Co-authored-by: Jon Ross-Perkins <jperkins@google.com>

2024-10-22 23:21:35 +00:00

..

fuzzer_corpus

Rename lexer dir to lex (#3179)

2023-09-01 02:39:04 +00:00

testdata

Add tests to catch untested diagnostics. (#4426)

2024-10-21 20:16:18 +00:00

BUILD

Clean up format_provider uses (#4417)

2024-10-17 18:47:29 +00:00

character_set.h

Rename lexer dir to lex (#3179)

2023-09-01 02:39:04 +00:00

helpers.cpp

Update basic diagnostic capitalization/punctuation (#4328)

2024-09-19 21:32:53 +00:00

helpers.h

Abbreviate Integer and FloatingPoint (#3435)

2023-11-29 23:29:48 +00:00

lex.cpp

Issue a diagnostic if we try to parse a source file that is too large. (#4429)

2024-10-22 23:21:35 +00:00

lex.h

Split lexing logic and storage to separate files. (#3365)

2023-11-10 23:59:49 +00:00

numeric_literal_benchmark.cpp

Abbreviate Integer and FloatingPoint (#3435)

2023-11-29 23:29:48 +00:00

numeric_literal_fuzzer.cpp

Add -Wmissing-prototypes and fix issues it finds. (#4019)

2024-06-04 20:04:45 +00:00

numeric_literal_test.cpp

Remove irregular digit placement check from NumericLiteral. (#4150)

2024-07-19 20:46:25 +00:00

numeric_literal.cpp

Clean up format_provider uses (#4417)

2024-10-17 18:47:29 +00:00

numeric_literal.h

Abbreviate Integer and FloatingPoint (#3435)

2023-11-29 23:29:48 +00:00

string_literal_benchmark.cpp

Change StringLiteral to less frequently allocate a new string. (#3314)

2023-10-24 19:15:49 +00:00

string_literal_fuzzer.cpp

Add -Wmissing-prototypes and fix issues it finds. (#4019)

2024-06-04 20:04:45 +00:00

string_literal_test.cpp

Rename DiagnosticLocationTranslator -> DiagnosticConverter (#3804)

2024-03-21 23:35:04 +00:00

string_literal.cpp

Update basic diagnostic capitalization/punctuation (#4328)

2024-09-19 21:32:53 +00:00

string_literal.h

Remove nodiscard uses. (#3418)

2023-11-28 18:46:19 +00:00

test_helpers.h

Switch CARBON_CHECK to a format string API (#4285)

2024-09-12 16:42:08 +00:00

token_index.h

Add typed forms of TokenIndex for tokens with a known kind. (#4016)

2024-06-04 00:20:49 +00:00

token_kind_test.cpp

Move tests to the namespace of the code under test (#3244)

2023-09-18 22:05:14 +00:00

token_kind.cpp

Rename lexer dir to lex (#3179)

2023-09-01 02:39:04 +00:00

token_kind.def

Remove uses of StringLiteral in format strings. (#4416)

2024-10-21 19:39:53 +00:00

token_kind.h

Switch CARBON_CHECK to a format string API (#4285)

2024-09-12 16:42:08 +00:00

tokenized_buffer_benchmark.cpp

Support printing the diagnostic kind for verification. (#4425)

2024-10-18 22:33:56 +00:00

tokenized_buffer_fuzzer.cpp

Switch CARBON_CHECK to a format string API (#4285)

2024-09-12 16:42:08 +00:00

tokenized_buffer_test_helpers.h

Rename Carbon::StringLiteralId -> Carbon::StringLiteralValueId. (#3522)

2023-12-18 23:27:33 +00:00

tokenized_buffer_test.cpp

Issue a diagnostic if we try to parse a source file that is too large. (#4429)

2024-10-22 23:21:35 +00:00

tokenized_buffer.cpp

Stitch together adjacent comments using the indent. (#4397)

2024-10-10 22:25:41 +00:00

tokenized_buffer.h

Issue a diagnostic if we try to parse a source file that is too large. (#4429)

2024-10-22 23:21:35 +00:00