SmoothQuant kv-cache quantization #104
Description
SmoothQuant is great technical. Thank you for open-sourcing it. I would like to know more about how to incorporate kvcache quantization？
{{ message }}
SmoothQuant is great technical. Thank you for open-sourcing it. I would like to know more about how to incorporate kvcache quantization？