mirror of
https://github.com/enso-org/enso.git
synced 2024-12-21 09:11:33 +03:00
0de490be24
* Text literals: Accept unpaired-surrogate escape codes. Unpaired surrogates are not allowed by Unicode, but they occur in practice because many systems accept them; for example, they may be present in filenames on Windows (which are otherwise constrained to UTF-16). Programs written in Enso should be able to work with them, if only because they represent edge cases that should be tested when converting encodings and at other system boundaries. - Generalize the representation of interpreted-text-escapes in the lexer, so that we are not tied to the strict Unicode of Rust's `str`. - Move some doc-comment code from the parser to test utilities. - Simplify token serialization. |
||
---|---|---|
.. | ||
metadata | ||
parse.rs |