Skip to content

shlapfish/llama.py

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

llama.py

Python interface to llama.cpp, including GGML. Just a WIP. Maybe look to https://github.com/abetlen/llama-cpp-python for something more complete.

The writing aid example is pretty nice!

Now it also includes a full tree sampler and my WIP on a low memory LoRA trainer.

About

Python interface to llama.cpp

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages