Skip to content

Support Tensors in execution plans #8

@sydduckworth

Description

@sydduckworth

ella delegates handling of lazy execution/logical plans to datafusion internally. Datafusion/arrow only implements most operations for scalar arrays, which means that extension types like Tensors are unsupported.

Fully implementing support for tensors is going to be somewhat complicated. I will probably require a full set of custom physical nodes that implement all of the operations for tensors. In addition, for tensors to work in plans generated by SQL queries and not just the expressions API we would need some kind of custom planner or analyzer rule that would walk the logical plan and replace nodes as needed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions