Release v0.2.7: Embedding batching/concurrency and type safety improvements

[pingSubhajit]

Summary

This release adds configurable embedding batching and concurrency controls for improved ingestion performance, along with comprehensive type safety improvements across the codebase.

Changes

Features

• Embedding batching and concurrency: The ingest pipeline now uses embedMany() for batch text embeddings when supported by the provider, with configurable concurrency limits for both text and image embeddings
• New embeddingProcessing config: Configure concurrency (default: 4) and batchSize (default: 32) via unrag.config.ts under defaults.embedding or engine.embeddingProcessing

Type Safety Improvements

• Replaced all any type assertions with properly-typed interfaces for external SDKs:
  • Typed interfaces for all 12 embedding providers (OpenAI, Azure, Bedrock, Cohere, Google, Mistral, Ollama, OpenRouter, Together, Vertex, Voyage, AI Gateway)
  • Structural types for Google Drive API (DriveFile, DriveClient, AuthClient)
  • Typed interfaces for extractors (pdfjs, audio transcription, video processing)
  • Proper QueryRow interface for Drizzle store
• New AssetMetadataFields interface and hasAssetMetadata() type guard for asset-derived chunk metadata
• Refactored mergeDeep utility to dedicated module with proper generic type signatures
• Typed requireOptional() helper now requires explicit type parameters

Internal

• Added core-embedding-batching.test.ts test suite for batching behavior
• Extracted deep-merge.ts utility with isRecord() type guard

Related PRs

• refactor: replace any type assertions with proper type system across registry #10 fix: remove any type assertions and create proper type system
• feat: improve embedding concurrency/batching and strengthen type safety #11 feat: improve embedding concurrency/batching and strengthen type safety

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Review	Updated (UTC)
unrag-web	Ready	Preview, Comment	Dec 28, 2025 7:13am