How to support smaller RAM computers?

[rhiever]

Most of the datasets this project is meant to tackle will use a large amount of RAM. We should consider some sort of out-of-core learning algorithms for the initial feature filter as well as avoiding loading the datasets into RAM, where possible.

[rhiever]

cc @tydanielson @jfechner-foxo @marcmaxson @msiers

Please drop ideas here if anything comes to mind. This will be a brainstorm thread.

This is a public thread.