2022-07-13 02:46:42 +03:00
|
|
|
# leo-parser
|
|
|
|
|
|
2021-07-21 00:52:35 +03:00
|
|
|
[](https://crates.io/crates/leo-parser)
|
|
|
|
|
[](../AUTHORS)
|
|
|
|
|
[](./LICENSE.md)
|
2021-07-21 11:31:20 +03:00
|
|
|
|
|
|
|
|
This directory contains the code to tokenize, lex and parse Leo files to the [Leo AST](./../ast/README.md).
|
|
|
|
|
|
|
|
|
|
## Tokenizer
|
|
|
|
|
|
|
|
|
|
The tokenizer contains all tokens in Leo.
|
|
|
|
|
It also decides which tokens are keywords.
|
|
|
|
|
Meaning that keywords are a subset of tokens.
|
|
|
|
|
The lexer goes through character by character as bytes, and converts the bytes into the tokens.
|
|
|
|
|
|
|
|
|
|
### Tokens
|
|
|
|
|
|
|
|
|
|
Bolded ones are also keywords.
|
|
|
|
|
|
|
|
|
|
#### Literals
|
|
|
|
|
- CommentLine
|
|
|
|
|
- CommentBlock
|
|
|
|
|
- StringLit
|
|
|
|
|
- Ident
|
|
|
|
|
- Int
|
|
|
|
|
- **True**
|
|
|
|
|
- **False**
|
|
|
|
|
- AddressLit
|
|
|
|
|
- CharLit
|
|
|
|
|
|
|
|
|
|
#### Symbols
|
|
|
|
|
- At
|
|
|
|
|
- Not
|
2022-01-21 23:32:09 +03:00
|
|
|
- And (`&&`)
|
|
|
|
|
- Ampersand (`&`)
|
2021-07-21 11:31:20 +03:00
|
|
|
- Or
|
|
|
|
|
- Eq
|
|
|
|
|
- NotEq
|
|
|
|
|
- Lt
|
|
|
|
|
- LtEq
|
|
|
|
|
- Gt
|
|
|
|
|
- GtEq
|
|
|
|
|
- Add
|
|
|
|
|
- Minus
|
|
|
|
|
- Mul
|
|
|
|
|
- Div
|
|
|
|
|
- Exp
|
|
|
|
|
- Assign
|
|
|
|
|
- AddEq
|
|
|
|
|
- MinusEq
|
|
|
|
|
- MulEq
|
|
|
|
|
- DivEq
|
|
|
|
|
- ExpEq
|
|
|
|
|
- LeftParen
|
|
|
|
|
- RightParen
|
|
|
|
|
- LeftSquare
|
|
|
|
|
- RightSquare
|
|
|
|
|
- LeftCurly
|
|
|
|
|
- RightCurly
|
|
|
|
|
- Comma
|
|
|
|
|
- Dot
|
|
|
|
|
- DotDot
|
|
|
|
|
- DotDotDot
|
|
|
|
|
- Semicolon
|
|
|
|
|
- Colon
|
|
|
|
|
- DoubleColon
|
|
|
|
|
- Question
|
|
|
|
|
- Arrow
|
|
|
|
|
- Underscore
|
|
|
|
|
|
|
|
|
|
#### Types
|
|
|
|
|
- **U8**
|
|
|
|
|
- **U16**
|
|
|
|
|
- **U32**
|
|
|
|
|
- **U64**
|
|
|
|
|
- **U128**
|
|
|
|
|
- **I8**
|
|
|
|
|
- **I16**
|
|
|
|
|
- **I32**
|
|
|
|
|
- **I64**
|
|
|
|
|
- **I128**
|
|
|
|
|
- **Field**
|
|
|
|
|
- **Group**
|
|
|
|
|
- **Bool**
|
|
|
|
|
- **Address**
|
|
|
|
|
- **Char**
|
|
|
|
|
- **BigSelf**
|
|
|
|
|
|
|
|
|
|
#### Words
|
|
|
|
|
- **Input**
|
|
|
|
|
- **LittleSelf**
|
|
|
|
|
- **Import**
|
|
|
|
|
- **As**
|
|
|
|
|
- **Circuit**
|
|
|
|
|
- **Console**
|
|
|
|
|
- **Const**
|
|
|
|
|
- **Else**
|
|
|
|
|
- **For**
|
|
|
|
|
- **Function**
|
|
|
|
|
- **If**
|
|
|
|
|
- **In**
|
|
|
|
|
- **Let**
|
|
|
|
|
- **Return**
|
|
|
|
|
- **Static**
|
|
|
|
|
- **String**
|
|
|
|
|
|
|
|
|
|
#### Meta
|
|
|
|
|
- Eof
|
|
|
|
|
|
|
|
|
|
## Parser
|
|
|
|
|
|
|
|
|
|
The parser converts the tokens to the [Leo AST](./../ast/README.md).
|
|
|
|
|
|
|
|
|
|
The parser is broken down to different files that correspond to different aspects of the AST:
|
|
|
|
|
|
|
|
|
|
- [File](./src/parser/file.rs) - Parses the top level nodes in Leo.
|
|
|
|
|
- [Types](./src/parser/type_.rs) - Parses the type declarations in Leo.
|
|
|
|
|
- [Statements](./src/parser/statement.rs) - Parses the different kinds of statements.
|
|
|
|
|
- [Expressions](./src/parser/expression.rs) - Parses the different kinds of expressions.
|
|
|
|
|
|
|
|
|
|
For more information on those please read the Leo AST README, linked above.
|
|
|
|
|
|
|
|
|
|
## Grammar Relation
|
|
|
|
|
|
|
|
|
|
All function and token names are as close as possible to the [Leo Grammar](./../grammar/README.md)
|
