Now that we have [Llama3](https://llama.meta.com/llama3/). Shall we consider supporting it? Easiest is probably connected through toolkit api like [ollama](https://ollama.com/) using it's [SDK](https://github.com/ollama/ollama-python) I'd be happy to spin off a PR soon! 😄
