Skip to content

Support large arrays #187

@CurtHagenlocher

Description

@CurtHagenlocher

Describe the enhancement requested

It's hard for the C# Arrow library to support large arrays. Commonly-used types like Array, Span and Memory use a 32-bit signed integer for the length, meaning that they can't have more than ~2 million elements in them. The ArrowBuffer structure that is the foundation of the core ArrayData class exposes these types directly. This may make it impossible to support large arrays in a strictly backwards-compatible fashion.

Some previously-opened items related to this feature are:

apache/arrow#23776
apache/arrow#38086
apache/arrow#38619
apache/arrow#45030

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions