[stable26] fix: Properly throttle in error cases and add rate limit for public file creation

[stable26] fix: Properly throttle in error cases and add rate limit for public file creation #3306