Skip to content

feat: support lance blob v2 and legacy compatibility#1614

Open
chenghao-guo wants to merge 1 commit intolance-format:mainfrom
chenghao-guo:blobv2-support
Open

feat: support lance blob v2 and legacy compatibility#1614
chenghao-guo wants to merge 1 commit intolance-format:mainfrom
chenghao-guo:blobv2-support

Conversation

@chenghao-guo
Copy link
Collaborator

close #1506

@github-actions github-actions bot added the enhancement New feature or request label Mar 4, 2026
@chenghao-guo chenghao-guo marked this pull request as ready for review March 4, 2026 09:08
@chenghao-guo
Copy link
Collaborator Author

In the current design, conversion still requires take_blobs, which scans and materializes the full blob bytes in Ray memory. Consequently, invoking v1 blobs versus v2 blobs makes no functional difference at the moment. For large individual blobs, this may still result in substantial memory overhead.

In the future, once v2 blob can be simply linked with some new APIs. Better implementation will be updated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

support ray read/write lance blob v1 and v2

1 participant