Skip to content

Improve scalability of reads of many NetCDF files via xarray/dask #119

@tsherwen

Description

@tsherwen

A core bottleneck is the scalability of reads of many NetCDF files via xarray/dask.

This has been improved by many updates. However, this remains a core bottleneck for analysis.

Pre-xarray direct reading and handling of NetCDF files was faster and more scaleable. However, the benefits brought by using xarray/dask are very notable.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions