Scripts for using fabric

Models

groq

gemma-7b-it

mixtral-8x7b-32768

llama3-8b-8192

llama3-70b-8192

llama3-groq-8b-8192-tool-use-preview

llama3-groq-70b-8192-tool-use-preview

llama-3.1-8b-instant

llama-3.1-70b-versatile

llama-3.1-405b-reasoning

Anthropic

claude-3-haiku-20240307

claude-3-sonnet-20240229

claude-3-5-sonnet-20240620

claude-3-opus-20240229

OpenAI

gpt-4o

gpt-4o-mini

Set the environment variables for groq or openai

# export OPENAI_BASE_URL="https://api.openai.com/v1"
export OPENAI_BASE_URL="https://api.groq.com/openai/v1/" # GROQ_BASE_URL
export DEFAULT_MODEL="<DEFAULT MODEL>"
export OPENAI_API_KEY="<APIKEY>"