robustly is a lib for doing incremental backoff for panicking goroutines. It should be a fairly straight forward to integrate to avoid the issue of a panicking goroutine going into a hotloop.
It's actually unclear if any integration is required, or if this is just something we should leave up to the user.
Importantly, the actual rate limiting code is currently a TODO