You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
and maybe, we make double quotes define "tokens" instead of the special
regexes. We still need to think about what tokens are and how they get used in
grammars. Will create different issue for that.
Also we should probably eat leading whitespace on the regexes above. At least
by default. Tokenization semantic variations can be made with new Pegex
directives like: %TokenizationMethod whitespace.
The text was updated successfully, but these errors were encountered:
ie, this:
becomes:
and this:
becomes:
and maybe, we make double quotes define "tokens" instead of the special
regexes. We still need to think about what tokens are and how they get used in
grammars. Will create different issue for that.
Also we should probably eat leading whitespace on the regexes above. At least
by default. Tokenization semantic variations can be made with new Pegex
directives like:
%TokenizationMethod whitespace
.The text was updated successfully, but these errors were encountered: