Skip to content

Readme.md

Latest commit

 

History

History
36 lines (21 loc) · 772 Bytes

Readme.md

File metadata and controls

36 lines (21 loc) · 772 Bytes

Chatbot with Chainlit and local LLM

This is a simple chatbot that uses Chainlit and a local LLM.

Install dependencies

pip install pipenv
pipenv install

Download the model

mkdir -p models/7B
curl -L -o models/7B/llama-2-7b-chat.Q2_K.gguf https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGUF/resolve/main/llama-2-7b-chat.Q2_K.gguf?download=true

you can find other models on HuggingFace

Running the app

pipenv run python -m main

Chore: minor documentation touch (2025-08-20T23:27:58.330Z)

Chore: minor documentation touch (2025-08-20T23:36:28.269Z)

Chore: minor documentation touch (2025-08-20T23:42:44.696Z)

Chore: minor documentation touch (2025-08-21T08:35:13.013Z)