[ABNF] Add a notion of lexeme.

This is just for nomenclature. It does not change the language or anything.
This commit is contained in:
Alessandro Coglio 2021-07-28 16:33:14 -07:00
parent d2fe35c0b9
commit 6f03b9df26

View File

@ -611,6 +611,10 @@ token = keyword
/ annotation-name
/ symbol
; Tokens, comments, and whitespace are lexemes, i.e. lexical units.
lexeme = token / comment / whitespace
;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;
; Syntactic Grammar