🚀 Groq - Evals

Compare and evaluate different Groq models with ease

🌟 Overview

Groq Model Evaluator is a powerful web application that allows you to compare and evaluate different Groq language models side by side. Built with Next.js and FastAPI, it provides an intuitive interface for testing model performance, analyzing responses, and making data-driven decisions about which model best suits your needs.

✨ Key Features

• 🔄 Side-by-side model comparison
• 🤖 Automated reasoning about model performance
• 🎨 Beautiful, responsive UI
• 🔑 Secure API key management Yet to come:
• 📈 Visual metric representations
• 📊 Comprehensive evaluation metrics
• 🎯 Semantic similarity analysis

🚀 Getting Started

Prerequisites

• Python 3.8+
• Node.js 18+
• Groq API key (Get one here)

Installation

1. Clone the repository:

git clone https://github.com/yourusername/groq-evals.git
cd groq-evals

2. Install backend dependencies:

cd backend
python -m venv venv
source venv/bin/activate  # On Windows: .\venv\Scripts\activate
pip install -r requirements.txt

3. Install frontend dependencies:

cd frontend
npm install

Configuration

1. Create a .env file in the backend directory:

AVAILABLE_MODELS=["gemma2-9b-it", "llama-3.1-8b-instant", "mixtral-8x7b-32768"]
EVALUATION_MODELS=["deepseek-r1-distill-llama-70b"]

Running the Application

1. Start the backend server:

cd backend
uvicorn app.main:app --reload

2. Start the frontend development server:

cd frontend
npm run dev

3. Open http://localhost:3000 in your browser

📊 Features

Model Comparison

• Compare responses from different Groq models side by side
• Automatic evaluation of response quality
• Detailed reasoning for model selection

🤝 Contributing

We welcome contributions! Here's how you can help:

1. Fork the repository
2. Create a feature branch:

git checkout -b feature/amazing-feature

3. Commit your changes:

git commit -m 'Add amazing feature'

4. Push to your branch:

git push origin feature/amazing-feature

5. Open a Pull Request

Development Guidelines

• Follow the existing code style
• Add comments for complex logic
• Update documentation as needed
• Add tests for new features
• Ensure all tests pass before submitting PR

📝 License

This project is licensed under the MIT License

🙏 Acknowledgments

• Groq for their amazing API
• The open-source community for inspiration and tools
• All contributors who help improve this project

📬 Contact

Have questions? Need help? Feel free to:

• Open an issue
• Start a discussion
• Reach out to maintainers

---

Made with ❤️ by Adi