Releases: LLMSQL/llmsql-benchmark
Releases · LLMSQL/llmsql-benchmark
LLMSQL v0.1.13 Release Notes
Changelog:
- Env vars added to the vllm inference for stable results across vllm and transformers (by @RadoslawPlawecki )
- Added padding side argument to transformers inference for correct inference (by @RadoslawPlawecki )
- New git hub page added (by @ViktoriaNov )
- Chat template parameter added to vllm inference ensuring better results. (@DzmitryPihulski )
New Contributors
@RadoslawPlawecki made the first contribution in #45
@ViktoriaNov made the first contrbution in #11
Thank you! ❤️
LLMSQL v0.1.11 Release Notes: Latest
Changelog:
- Dependencies issues fixed
- vllm inference corrected
- Examples added
- Fine-tuning deleted
LLMSQL v0.1.5 Release Notes:
Changelog:
- Vllm method of inference moved to function
- Transformers method of inference added
- vllm package moved to optional dependencies (due to it's rigorous dependencies)
- cli commands for inference with both transformers and vllm added;
v0.1.4
LLMSQL v0.1.4 Release Notes:
- Tests added with code coverage:
https://app.codecov.io/gh/LLMSQL/llmsql-benchmark - Github Actions with code coverage updated
- The project is now opened for contributing. All infos in CONTRIBUTING.md!
- Some dependencies updates that will be further modified by:
The one issue still remaining in vllm library which overwrites a lot of packages, so the pip install still runs slow and uninstalls/installs a lot of packages as it goes.
The one solution for this is to add vllm as optional dependency and ask users to install pip install llmsql[vllm] if they want vllm inference. This solution would be possible after adding at least one other method to the inference setup, so at least something would work out of the box.
- Pre-commit hooks config added by
New Contributors
v0.1.3
New version with pdm dependency manager
v0.1.2
llmsql v0.1.2 Release Notes
Welcome everyone. First actual release of our package.
Thank you @DzmitryPihulski @ViktoriaNov @Quarol