Hi,
Is it possible to test other models with this repo? I'd like to test https://huggingface.co/salihfurkaan/VoxPolska-V1-GGUF. I've replaced
wget -P /app/models https://huggingface.co/lex-au/${ORPHEUS_MODEL_NAME}/resolve/main/${ORPHEUS_MODEL_NAME}
with
wget -P /app/models https://huggingface.co/salihfurkaan/VoxPolska-V1-GGUF/resolve/main/unsloth.Q5_K_M.gguf
in docker-compose.yaml, the model has been downloaded to models folder, but it's not avaliable in interface and API.
Thanks!
Hi,
Is it possible to test other models with this repo? I'd like to test https://huggingface.co/salihfurkaan/VoxPolska-V1-GGUF. I've replaced
wget -P /app/models https://huggingface.co/lex-au/${ORPHEUS_MODEL_NAME}/resolve/main/${ORPHEUS_MODEL_NAME}with
wget -P /app/models https://huggingface.co/salihfurkaan/VoxPolska-V1-GGUF/resolve/main/unsloth.Q5_K_M.ggufin docker-compose.yaml, the model has been downloaded to models folder, but it's not avaliable in interface and API.
Thanks!