Skip to content

Add bfloat16 tensor support to VoyageAI embedder#35924

Merged
thomasht86 merged 1 commit intomasterfrom
bjorncs/voyage-ai-embedder
Feb 13, 2026
Merged

Add bfloat16 tensor support to VoyageAI embedder#35924
thomasht86 merged 1 commit intomasterfrom
bjorncs/voyage-ai-embedder

Conversation

@bjorncs
Copy link
Member

@bjorncs bjorncs commented Feb 13, 2026

Summary

  • Treat bfloat16 tensor value type the same as float in VoyageAI embedder validation and output type resolution
  • Request float data from the API and create tensors with the bfloat16 value type (internally stored as float arrays via IndexedFloatTensor.BoundFloatBuilder)
  • Add tests for both AUTO and explicit FLOAT quantization modes with tensor<bfloat16> target types

- Treat BFLOAT16 same as FLOAT in validation and output type resolution
- Request float data from API and create tensor with bfloat16 value type
Copy link
Contributor

@thomasht86 thomasht86 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@thomasht86 thomasht86 merged commit bc63fcc into master Feb 13, 2026
3 checks passed
@thomasht86 thomasht86 deleted the bjorncs/voyage-ai-embedder branch February 13, 2026 18:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants