Port the library syntax to support Python v3.X

[hypnotic-frog]

The current code base has some errors when runs in Python 3.

At this point I can't think of a reason for not starting support for v3.x of the language. If you guys agree I could make a PR and work on this.

[flipchan]

would be great to see this with 3.6! change some imports and use memory view