Allow configurable retry mechanism with exponential backoff #577
Description
For large-scale evals against API models we often hit rate limits, would be nice to be able to configure exponential backoff with staggered delays etc.
{{ message }}
For large-scale evals against API models we often hit rate limits, would be nice to be able to configure exponential backoff with staggered delays etc.