jerry

jerry is my personal ai assistant. I use this repo to play around with various ideas in AI, NLP, and chat interfaces.

Currently jerry uses the mistral 7b instruct model because it is open, high quality and not too big to run on a laptop or similar low powered computer. The "coder" verion of jerry runs best with openhermes-2.5.

You can use jerry as a simple chatbot like base ChatGPT, connect him to my personal semantic search engine Sailor for RAG or use the --coder flag to give him access to a python code interpreter.

With jerry in code interpreter mode you can also give him access to prewritten functions, just write them in the agent_functions.py file and explain them in the system prompt. Things this allows jerry to do:

• check weather
• read/update todolist
• send messages?

TODO:

• Web server and frontend web ui
• proper formatting in web ui
• css in web ui
• darkmode
• tool use ie. calculator, search engine
• memory through vector db
• rewrite
  • clean up diff prompts
  • add added tokens i.e. <|im_start|> and <|im_end|>
  • store conversation as a list of
  • actually decent socket protocol instead of just sending tokens directly over the socket
• FUNCTION CALLING - general assistant tasks
• Voice chat, similar to ChatGPT voice? obv whisper for speech to text, need to find good tts model
• swap message input for a textbox and not an html input, better for longer messages/prompts
• custom system prompts in web ui
• syntax highlighting?