This is the tokenizer that is in development but is going to be used inside skyline-editor as the tokenizing module for syntax highlightning.
This tokenizer is based of https://macromates.com/manual/en/language_grammars
skyline-editor/skyline-tokenizer
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|