fix large csv reading #585

[majidaldo]

use file path and chain df iterators

[postelrich]

What specifically is this fixing?

[majidaldo]

#585

[brandonwillard]

toolz.concat should be able to do this, no? It's already imported, too.

[majidaldo]

there is no toolz.chain. similar functions in toolz just import itertools.
toolz source:

def concat(seqs):
    """ Concatenate zero or more iterables, any of which may be infinite.

    An infinite sequence will prevent the rest of the arguments from
    being included.

    We use chain.from_iterable rather than ``chain(*seqs)`` so that seqs
    can be a generator.

    >>> list(concat([[], [1], [2, 3]]))
    [1, 2, 3]

    See also:
        itertools.chain.from_iterable  equivalent
    """
    return itertools.chain.from_iterable(seqs)



def concatv(*seqs):
    """ Variadic version of concat

    >>> list(concatv([], ["a"], ["b", "c"]))
    ['a', 'b', 'c']

    See also:
        itertools.chain
    """
    return concat(seqs)

[brandonwillard]

Sorry, typo; I meant toolz.concat, and it looks like that was already imported.

[majidaldo]

do you want to change it?

[travisbusen]

is this still being worked?

[majidaldo]

no. it works.

[guillochon]

Any way to merge this soon? Currently preventing me from using odo.

[travisbusen]

Same here, I can’t use odo