apigateway_service.py causing "TooManyRequestsException" error

[jonathanbro]

Steps to Reproduce

1. Run Prowler as per the instructions here https://github.com/prowler-cloud/prowler/tree/master/contrib/aws/multi-account-securityhub.

Expected behavior

Prowler should successfully audit our API Gateway service.

Actual Result with Screenshots or Logs

How did you install Prowler?

Docker (docker pull toniblyx/prowler)

Environment Resource

1. ECS Fargate

OS used

N/A

Prowler version

4.5.0

Pip version

N/A

Context

You will see from the screenshots Prowler cannot successfully run apigateway_service.py. I have tried lowering the max retries to 1 but that didn't help.

[MrCloudSec]

Hi @jonathanbro, that's the way AWS manage the API throttling, you can try to avoid the with --aws-retries-max-attempts 1, more info here.
Let us know if that works for you!

[jonathanbro]

Hey @sergargar thanks for the update! Yep I tried that and it didn't help :(

[jonathanbro]

If there's nothing we feel we can do, please close the issue :)

[jfagoagas]

Hello @jonathanbro, I think this time there is little we can do since it is AWS who is rate-limiting the API. As @MrCloudSec mention, we can configure retry attempts but if the API is still rate limiting we can recommend you the following:

• Add more delay between scans focusing the rate-limited APIs
• Review your internal usage for the rate-limited APIs
• Talk with the AWS support team to see if they can increase API limits for your use case.

I apologise but at this time I can't think of more options.

[jfagoagas]

Hello @jonathanbro we are closing this issue, please feel free to reopen it if you notice the same behaviour again.

Thanks for using Prowler 🚀