v2.2.0

Add:

• Added BasicDiskVectorDatabase to provide a basic automatically disk persistent vector database, and associated BasicDiskVectorStore and BasicDiskVocabularyStore.

v2.1.3

What's Changed

Add:

• Added IBatchEmbeddingsGenerator and .AddTextsAsync to support batch adding of texts to database.
• Added OpenAI support for IBatchEmbeddingsGenerator
• Added IVectorTextResultItem.Similarity and marked IVectorTextResultItem.VectorComparison obsolete. VectorComparison will be removed in the future.
• Added more comment metadata to code

v2.1.2

What's Changed

Fixed:

• Fixed a bug when loading saved database from file/stream where IntIdGenerator or NumericIdGenerator lose max Id, resulting in adding new texts to database causes existing texts to be overwritten. This specifically affected SharpVector.OpenAI and SharpVector.Ollama libraries but the fix is implemented within the core Build5Nines.SharpVector library.

Nuget

dotnet add package Build5Nines.SharpVector --version 2.1.2

v2.1.1

What's Changed

Added:

• Add optional filter parameter to .Search and .SearchAsync methods that is of type Func<TMetadata, bool> that is called for each text item in the database for more advanced filtering prior to performing vector similarity search and returning results. If undefined or null it's ignored.
• add Metadata documentation & LICENSE file reference change for future by @crpietschmann in #71

Full Changelog: v2.1.0...v2.1.1

Nuget

dotnet add package Build5Nines.SharpVector --version 2.1.1

v2.1.0

What's Changed

Add:

• Added VectorTextResultItem.Id property so it's easy to get the database ID for search results if necessary.
• IVectorDatabase now inherits from IEnumerable so you can easily look through the texts documents that have been added to the database.

Fixed:

• Fixed text tokenization to correctly remove special characters
• Update BasicTextPreprocessor to support Emoji characters too
• Refactorings for more Clean Code

Breaking Changes:

• The .Search and .SearchAsync methods now return a IVectorTextResultItem<TId, TDocument, TMetadata> instead of VectorTextResultItem<TDocument, TMetadata>. If you're using things like the documentation shows, then you wont see any changes or have any issues with this update.

Full Changelog: v2.0.4...v2.1.0

Nuget

dotnet add package Build5Nines.SharpVector --version 2.1.0
dotnet add package Build5Nines.SharpVector.OpenAI --version 2.0.3
dotnet add package Build5Nines.SharpVector.Ollama --version 2.0.3

v2.0.4

What's Changed

Add:

• Add Ollama support via Build5Nines.SharpVector.Ollama nuget package
• Added Build5Nines.SharpVector.Embeddings.IEmbeddingsGenerator to support creating external embeddings providers
• Added Build5Nines.OpenAI.IOpenAIMemoryVectorDatabase interface

Fixed:

• Internal refactoring of save/load database persistence file code to make more maintainable and reusable going forward.
• Implement some performance tweaks in the code; adding const string and other best practices to help overall performance for handling larger amounts of data.

Full Changelog: v2.0.2...v2.0.4

Nuget

dotnet add package Build5Nines.SharpVector --version 2.0.4
dotnet add package Build5Nines.SharpVector.OpenAI --version 2.0.3
dotnet add package Build5Nines.SharpVector.Ollama --version 2.0.3

v2.0.2

What's Changed:

Add:

• Add SerializeToBinaryStream and DeserializeFromBinaryStream methods to replace (and mark obselete) SerializeToJsonStream and DeserializeFromJsonStream methods. They read/write binary zip file data, not json, so they were named incorrectly.

Fixed:

• Fixed .LoadFromFile method that was previously inaccessible.

Nuget

dotnet add package Build5Nines.SharpVector --version 2.0.2
dotnet add package Build5Nines.SharpVector.OpenAI --version 2.0.2

v2.0.1

Added:

• Expose internal vector array of VectorTextItem from VectorTextResultItem.Vectors property, to make vector array accessible for consuming code in cases where access is required. This is mostly for more flexible usage of the library.
• Added Overlapping Window text chunking (TextChunkingMethod.OverlappingWindow) to TextDataLoader for enhanced document segmentation with overlapping content, improving metadata extraction and search result relevance.

Fixed:

• When using Data.TextDataLoader with TextChunkingMethod.FixedLength it was splitting on a space character which wouldn't work correctly with Chinese text characters. This is now fixed to work correctly with Chinese characters too.

v2.0.0

What's Changed

Added:

• Add data persistence capability to save/load from a file or to/from a Stream (Both SharpVector and SharpVector.OpenAI)
• Add Chinese language/character support

Breaking Change:

• Refactor IVocabularyStore to be used within MemoryDictionaryVectorStoreWithVocabulary. This simplifies implementation of MemoryVectorDatabaseBase, and helps to enable data persistence capability.

Notes:

• The breaking change only applies if the base classes are being used. If the BasicMemoryVectorDatabase is being used, this will likely not break applications that depend on this library. However, in some instances where explicitly depending on VectorTextResult it's properties (without using var in consuming code) there might be minor code changes needed when migrating from previous versions of the library.

Nuget

dotnet add package Build5Nines.SharpVector --version 2.0.0
dotnet add package Build5Nines.SharpVector.OpenAI --version 2.0.0

Full Changelog: v1.0.1...v2.0.0

v1.0.1

What's Changed

• Upgrade to .NET 8.x by @crpietschmann in #16
• Nuget v1.0.1 by @crpietschmann in #17

Full Changelog: https://github.com/Build5Nines/SharpVector/commits/v1.0.1

Nuget

dotnet add package Build5Nines.SharpVector --version 1.0.1

https://www.nuget.org/packages/Build5Nines.SharpVector/1.0.1