Using official gguf package for constants#4
Conversation
|
Work isn't finish, working on it at the office, and right now it's not the priority anymore. |
|
I'd prefer if this package did not require any more dependencies. But renaming |
|
Using the official repository would make it automatically support future quantization types |
|
Yes, but why not use the official repository directly then? The goal of this library is to dequantize in Python (or NumPy, technically). |
|
I only looked at the gguf PyPi package, but apparently it is severely out of date. I just noticed that the official repository implements dequantization in NumPy now. That's great to hear! Then I do not need to maintain this repository anymore and can just redirect everyone to https://github.com/ggerganov/llama.cpp/tree/master/gguf-py |
No description provided.