Skip to content

Llama.cpp support missing #2

@dakotaplainsllc

Description

@dakotaplainsllc

Cannot use on GGUF models until you add LLama.cpp manually, which I found possible, but its missing GCC and other dependencies so its a long process

/workspace/text-generation-webui/installer_files/env/lib/python3.11/site-packages/llama_cpp_binaries/bin/llama-server: error while loading shared libraries: libgomp.so.1: cannot open shared object file: No such file or directory
16:44:41-913346 ERROR Error loading the model with llama.cpp: Server process
terminated unexpectedly with exit code: 127

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions