Richard Smith 1e6c7e3963 Add sentinel Eof token at the end of the tokenized buffer. (#388) ...

This has two goals:

1) It allows us to simplify and remove special cases from the parser:
   when we expect a particular token next, we can just check for it
   without needing a special case for end-of-file.

2) It gives us a token to use as a position when emitting diagnostics at
   the end of the file.

Centralize all updating of `position` to `Consume` and `SkipTo`, so that we can in a single place ensure that we never go past the EOF token.

2021-03-18 21:39:10 -07:00

..

fuzzer_corpus

Add a fresh fuzz corpus for the parse tree. (#217)

2020-12-08 01:59:27 -08:00

BUILD

Add location information to diagnostics. (#385)

2021-03-18 21:05:54 -07:00

parse_node_kind_test.cpp

Merge parser library from the toolchain repository. (#214)

2020-12-08 01:52:43 -08:00

parse_node_kind.cpp

Merge parser library from the toolchain repository. (#214)

2020-12-08 01:52:43 -08:00

parse_node_kind.def

Add sentinel Eof token at the end of the tokenized buffer. (#388)

2021-03-18 21:39:10 -07:00

parse_node_kind.h

Move to by-value friend comparison operator definitions. (#222)

2020-12-08 15:38:46 -08:00

parse_test_helpers.h

Enable most relevant clang-tidy checks and fix uncovered issues. (#220)

2020-12-08 14:43:37 -08:00

parse_tree_fuzzer.cpp

Add location information to diagnostics. (#385)

2021-03-18 21:05:54 -07:00

parse_tree_test.cpp

Add sentinel Eof token at the end of the tokenized buffer. (#388)

2021-03-18 21:39:10 -07:00

parse_tree.cpp

Add location information to diagnostics. (#385)

2021-03-18 21:05:54 -07:00

parse_tree.h

Add location information to diagnostics. (#385)

2021-03-18 21:05:54 -07:00

parser_impl.cpp

Add sentinel Eof token at the end of the tokenized buffer. (#388)

2021-03-18 21:39:10 -07:00

parser_impl.h

Add sentinel Eof token at the end of the tokenized buffer. (#388)

2021-03-18 21:39:10 -07:00