You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The recursive list then delete operation adds pressure to the exchange. This can help reduce the S3 volume and likelihood of throttling by the S3 service.
S3 management lifecycle rules can clean up these files after 24h (cost is paid via management fees instead of LIST operation cost) so it's not required.
We rebuilt the trino-exchange-filesystem module with this operation disabled on aborts/cleanup and noticed a significant reduction in throttling in our production environment.
The text was updated successfully, but these errors were encountered:
The recursive list then delete operation adds pressure to the exchange. This can help reduce the S3 volume and likelihood of throttling by the S3 service.
S3 management lifecycle rules can clean up these files after 24h (cost is paid via management fees instead of LIST operation cost) so it's not required.
We rebuilt the
trino-exchange-filesystem
module with this operation disabled on aborts/cleanup and noticed a significant reduction in throttling in our production environment.The text was updated successfully, but these errors were encountered: