Open Source LLM Benchmark that I worked on Summer 2025 at ASPR AI, a GenAI Startup.
Benchmarked LLMS for text generation, text embeddings, and text-to-speech across providers such as AWS Bedrock, OpenAI, Gemini, and ElevenLabs. Utilized different metrics to benchmark and consider cost and latency as well, in order to provide company with recommendations best suited for their uses.
Please feel free to email @arushi9g@gmail.com if you have any questions about this project!