Personal LLM - a desktop ChatGPT clone that runs 100% local off of the cloud

Author

Kay Ashaolu

Description

Unlock the power of Language Models in your own hands! Personal LLM is a revolutionary desktop application that brings the capabilities of Large Language Models (LLMs) to your very own computer. With Personal LLM, you can now harness the intelligence and creativity of AI-powered language processing, without relying on internet connectivity or costly subscriptions. Simply download, install, and start leveraging the limitless potential of LLMs for free, right from your desktop

Technologies Used

• HTML
• CSS
• JavaScript
• Python
• Ollama
• LLM
• ORM Peewee
• RDBMS Sqlite3
• Python-Eel

Demo

Technical System Design

Setup Instructions

1. Please download and install the following dependencies

• Python 3.11
• Google Chrome
• Ollama
  • Ollama is a LLM model backend that lets you download and access LLMs locally and use it in your applications. NOTE: Ensure Ollama is running before doing the below

2. Clone this repository
3. Run npm run start to r the project
   • As of this writing, we are using the llama3 LLM from Meta, which is about 4.7 GB. The first run of this will take some time as Ollama downloads the llama3 LLM.