Support unrecovered problem e.g. rate limiting, ignore retry

[denverdino]

Type: feature request

Describe what feature you want

If recv the unrecovered problem, ignore retry

Additional context