Skip to content

OpenAI token limit errors for Prompt Engineering Lab #2

@bendoan-db

Description

@bendoan-db

Users on the OpenAI free tier are hitting quota exceptions, despite being the free tier and sending <20 requests over the course of 3 hours. This is a known issue with OpenAI endpoints

Potential resolutions:

  1. Use llama70B hosted in Databricks
  2. Explore Bard or other managed LLM requests

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions