中文版本
新特性
- 增加了client模式的便捷安装脚本,并提升了文档描述
- 支持transformers分支的ep+fsdp分片
Bug修复
- 修复加载本地数据集失败的问题
- 修复服务化启动时http_options错误传递到模型的问题
English Version
New features
- Add a shell installation script to support the client mode, and improve the description of documentation
- Support ep+fsdp sharding of transformers
BugFix
- Fix a bug that causes an error on local dataset loading
- Fix an error that the
http_optionsargument was mis-transfered to the model in the server mode
What's Changed
- Fix loading local datasets by @tastelikefeet in #108
- [fix] http_options leaking to model init & NPU tensor serialization failure over HTTP by @kevssim in #109
- Fix docs and add new start scripts by @tastelikefeet in #113
- [feat]support ep_fsdp by @kevssim in #71
Full Changelog: v0.1.2...v0.1.3