OliVe-OPT-13b #11
Description
Hi, I was trying to quantize OPT-13B in 8bits(W/A), but there is an error--'run out of memory(128G)'. So I want to know do you have the same problem? Or do you have PPL on wikitext-2 of OPT-13B-8bit with OliVe?
{{ message }}