Changelog:
- Env vars added to the vllm inference for stable results across vllm and transformers (by @RadoslawPlawecki )
- Added padding side argument to transformers inference for correct inference (by @RadoslawPlawecki )
- New git hub page added (by @ViktoriaNov )
- Chat template parameter added to vllm inference ensuring better results. (@DzmitryPihulski )
New Contributors
@RadoslawPlawecki made the first contribution in #45
@ViktoriaNov made the first contrbution in #11
Thank you! ❤️
Contributors
DzmitryPihulski, RadoslawPlawecki, and ViktoriaNov