-
Notifications
You must be signed in to change notification settings - Fork 741
Open
Description
I am quite new to the A.I. world, and I spent a week testing a lot of different models in very harsh conditions (cpu only and 16 gb of ram)
This is by far the best model of them all.
Who knows me will be suprised because I rarely praise something (anything) in this way.
I wonder how much it would deteriorate by reducing it's size to around 8gb....
I tested a gguf model of 16gb (wizardlm-13b-v1.2.Q4_0.gguf) and the results were amazing.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels