Rate limit reached for default-text-embedding-ada-00 #6
Description
openai.error.RateLimitError: Rate limit reached for default-text-embedding-ada-002 in organization org-foo on tokens per min. Limit: 1000000 / min. Current: 0 / min. Contact us through our help center at help.openai.com if you continue to have issues.
the media wiki code base is 130+MB
and this exceeds the rate limit.
perhaps a switch to slow down the creation of the vectordb so that we can not hit this limit would be nice for larger codebases.
although perhaps not... as a repo of this size might just go over the token limit anyways.