Rate Limit Error

[jibinmathew69]

The output breaks on hitting rate, is there a recommended tier? I have been trying on tier 1.

[hrishioa]

I'm hoping they increase their rate-limits soon. Someone's working on an OpenAI PR which should help on the other side - for now restarting should continue the generation with nothing else changed though.

What would be a good solution here? I considered adding retries, but most of Anthropic's rate limits are tiny so sometimes you're locked out for a lot longer than a few seconds.

[HebeHH]

@jibinmathew69 the latest PR #14 allows you to use OpenAI, which should have higher rate limits and make this more manageable!