Skip to content

Releases: LLMSQL/llmsql-benchmark

LLMSQL v0.1.13 Release Notes

02 Dec 07:22

Choose a tag to compare

Changelog:

  • Env vars added to the vllm inference for stable results across vllm and transformers (by @RadoslawPlawecki )
  • Added padding side argument to transformers inference for correct inference (by @RadoslawPlawecki )
  • New git hub page added (by @ViktoriaNov )
  • Chat template parameter added to vllm inference ensuring better results. (@DzmitryPihulski )

New Contributors

@RadoslawPlawecki made the first contribution in #45
@ViktoriaNov made the first contrbution in #11

Thank you! ❤️

LLMSQL v0.1.11 Release Notes: Latest

16 Oct 18:35

Choose a tag to compare

Changelog:

  • Dependencies issues fixed
  • vllm inference corrected
  • Examples added
  • Fine-tuning deleted

LLMSQL v0.1.5 Release Notes:

15 Oct 14:00

Choose a tag to compare

Changelog:

  1. Vllm method of inference moved to function
  2. Transformers method of inference added
  3. vllm package moved to optional dependencies (due to it's rigorous dependencies)
  4. cli commands for inference with both transformers and vllm added;

v0.1.4

13 Oct 09:23

Choose a tag to compare

LLMSQL v0.1.4 Release Notes:

  • Tests added with code coverage: https://app.codecov.io/gh/LLMSQL/llmsql-benchmark
  • Github Actions with code coverage updated
  • The project is now opened for contributing. All infos in CONTRIBUTING.md!
  • Some dependencies updates that will be further modified by:
The one issue still remaining in vllm library which overwrites a lot of packages, so the pip install still runs slow and uninstalls/installs a lot of packages as it goes.

The one solution for this is to add vllm as optional dependency and ask users to install pip install llmsql[vllm] if they want vllm inference. This solution would be possible after adding at least one other method to the inference setup, so at least something would work out of the box.
  • Pre-commit hooks config added by

New Contributors

v0.1.3

25 Sep 13:23
054acad

Choose a tag to compare

New version with pdm dependency manager

v0.1.2

24 Sep 12:32
a3bc2d3

Choose a tag to compare

llmsql v0.1.2 Release Notes

Welcome everyone. First actual release of our package.

Thank you @DzmitryPihulski @ViktoriaNov @Quarol