lexing before parsing#42

Open

osiire wants to merge 6 commits intodjspiewak:masterfrom

Commits on Feb 7, 2019

parse by Token
Satoshi Ogasawara
committed
remove Whitespace
Satoshi Ogasawara
committed
add LexerHelper
Satoshi Ogasawara
committed
fix test.
Satoshi Ogasawara
committed
add white space to benchmark.
Satoshi Ogasawara
committed
fix benchmark as parsable.
Satoshi Ogasawara
committed