-
Notifications
You must be signed in to change notification settings - Fork 64
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem? Please describe.
I would like to stream to cloud storage without a local temporary file.
Describe the solution you'd like
Option 1
download target to accept a file-like object
with fsspec.open("s3://my-bucket/ecmwf/data.nc", "wb") as f:
client.retrieve(dataset, request, target=f) Option 2
download target to accept an fsspec URI
client.retrieve(dataset, request, target="s3://my-bucket/ecmwf/data.nc") Describe alternatives you've considered
No response
Additional context
related forum post from 2023: https://forum.ecmwf.int/t/download-cds-data-directly-to-aws-s3-cloud-file-using-fsspec-on-python/980
Organisation
No response
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request