Skip to content

Extend DeepSpeed inference initialization API with a 'quantize_groups' argument#3519

Open
sakogan wants to merge 7 commits intodeepspeedai:masterfrom
sakogan:quant-params
Open

Extend DeepSpeed inference initialization API with a 'quantize_groups' argument#3519
sakogan wants to merge 7 commits intodeepspeedai:masterfrom
sakogan:quant-params

Commits

Commits on May 10, 2023

Commits on May 11, 2023

Commits on May 12, 2023

Commits on Aug 30, 2023

Commits on Dec 8, 2023

Commits on Dec 11, 2023

Commits on Jan 24, 2025