Define the number of Questions-Answers pairs and q4 or q8 quantization #238
Description
🚀 The feature, motivation and pitch
Is it possible to Define the number of Questions-Answers pairs?
Also is there an option to load the models in q4 or q8 quantization?
Alternatives
none
Additional context
No response