MED-LLAVA 4BIT #134
Description
is there anyone who uses quantization in this med-llava like 4bit because my gpu size is limited to only 15gb. If anyone has done can you please share me the resources according to this
{{ message }}
is there anyone who uses quantization in this med-llava like 4bit because my gpu size is limited to only 15gb. If anyone has done can you please share me the resources according to this