-
Notifications
You must be signed in to change notification settings - Fork 4
Reduce cache size of CI caches #2336
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
e38ded8
to
17003d4
Compare
17003d4
to
12243fa
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For some reason we stopped using the S3 bucket, now we have GH cache which we do not need to clean at all it has it's own lifecycle.
This cleanup is needed only for S3 bucket this gh cache cleanup is done automatically
@Matovidlo I read somewhere the GitHub cache cleaner can't to remove the duplicate keys. You can set up it in the own workflow. It is not by default. |
7c7b4e6
to
d92816d
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. We need to take a look on caching using S3 as this cache is overloaded.
Typically it is 24-48 hours present
Co-authored-by: Jáchym Toušek <[email protected]>
This pull request introduces a new workflow for cleaning up GitHub Actions caches and includes documentation to explain its purpose and usage. The workflow aims to manage cache growth by removing old and duplicate entries, improving efficiency and reducing disk usage.
Workflow Implementation:
.github/workflows/gh-cache-cleanup.yml
, to automate GitHub Actions cache cleanup. It includes features such as scheduled weekly and monthly cleanups, cache deduplication, and a dry-run mode for safe testing.Documentation:
docs/github-actions-cache-cleanup.md
to describe the problem of cache growth, the solution provided by the new workflow, and detailed instructions for configuration, usage, and testing.Jira: XXXXXChanges: