Deepfreeze release#1792

Open

wortmanb wants to merge 296 commits intoelastic:deepfreeze8from

This pull request is big! We're only showing the most recent 250 commits

Commits on Jan 27, 2025

Purging old repos
Bret Wortman
committed

Commits on Jan 28, 2025

Fixed selection of the latest repo
Bret Wortman
committed
Code cleanup
Bret Wortman
committed
Trying to make Flake happy
Bret Wortman
committed
Doco & formatting fixes
Bret Wortman
committed
Added two more dataclasses
Bret Wortman
committed

Commits on Jan 29, 2025

First unit tests
Bret Wortman
committed
More tests
Bret Wortman
committed
Beginning to notate types
Bret Wortman
committed
Test suite for DF Setup
Bret Wortman
committed
Muzzling the linter
Bret Wortman
committed
test suite for Rotate
Bret Wortman
committed

Commits on Jan 30, 2025

Early work on thawing
Bret Wortman
committed
Adding ruff.toml
Bret Wortman
committed
Making Ruff happy
Bret Wortman
committed
Mostly added type hints
Bret Wortman
committed

Commits on Jan 31, 2025

Added s3client.py
Bret Wortman
committed
Refactored to use new S3Client class
Bret Wortman
committed

Commits on Feb 1, 2025

Unit test for S3Client
Bret Wortman
committed

Commits on Feb 3, 2025

Removing unit test for obsolete method
Bret Wortman
committed
Fixed some unit tests
Bret Wortman
committed
Cleaned up imports
Bret Wortman
committed
Updates to ThawedRepo
Bret Wortman
committed

Commits on Feb 4, 2025

Test code to determine earliest/latest @timestamp in repo
Bret Wortman
committed

Commits on Feb 5, 2025

Added get_timestamp_range
Bret Wortman
committed
Expanded use of new get_timestamp_range
Bret Wortman
committed
Re-templating deepfreeze integration testing
Bret Wortman
committed
rough outline of setup integration test
Bret Wortman
committed
Removing repo_time_tester.py
Bret Wortman
committed
Templated new methods in s3client.py
Bret Wortman
committed
Fix unused import in integration test
Bret Wortman
committed
Implement index thawing
Bret Wortman
committed
Doco fixes
Bret Wortman
committed

Commits on Feb 6, 2025

Updates to latest methods
Bret Wortman
committed
New tests
Bret Wortman
committed

Commits on Oct 10, 2025

Merge branch 'master' of github.com:elastic/curator
Bret Wortman
committed
Status action
Bret Wortman
committed
Refactored
Bret Wortman
committed
Add rich to the dependency list
Bret Wortman
committed
Switching to rich for interactive output
Bret Wortman
committed
Adding to .gitignore
Bret Wortman
committed
Another script of mine that doesn't need sharing
Bret Wortman
committed
Type hints
Bret Wortman
committed
Repository record-keeping
Bret Wortman
committed
Starting to flesh out thawing
Bret Wortman
committed
Adding cluster name
Bret Wortman
committed
Another script of mine that doesn't need sharing
Bret Wortman
committed
Remove stale method
Bret Wortman
committed
Removing ancient version of thaw.py
Bret Wortman
committed
Merge branch 'master' of github.com:wortmanb/curator
Bret Wortman
committed
FIxing options, testing setup
Bret Wortman
committed
Adding push to glacier
Bret Wortman
committed
Refafctored a couple utility methods
Bret Wortman
committed
Add check_restore_status method
Bret Wortman
committed
This is worth keeping
Bret Wortman
committed
Adding Remount
Bret Wortman
committed
Refactored object name
Bret Wortman
committed
Fleshing out new actions
Bret Wortman
committed
Updated unit tests for utility functions
Bret Wortman
committed
Tests now work
Bret Wortman
committed
Switching back to dictionary-like interface
Bret Wortman
committed
Added list_objects method
Bret Wortman
committed
Loads of updates
Bret Wortman
committed
Update Repository to construct from name or dictionary
Bret Wortman
committed
Add methods for use in testing, mostly
Bret Wortman
committed
Added method to update mounted repo date ranges
Bret Wortman
committed
Changes to methods with better signatures
Bret Wortman
committed
Docstring updates
Bret Wortman
committed
Merging change to modularize deepfreee
Bret Wortman
committed
Removing unneeded import
Bret Wortman
committed
Minor tweaks
Bret Wortman
committed
Adding exceptions specific to Deepfreeze
Bret Wortman
committed
Expand ensure_settings_index definition
Bret Wortman
committed
Flesh out integration tests for rotate
Bret Wortman
committed
Adding more exceptions
Bret Wortman
committed
Adding readme to track work still to be done
Bret Wortman
committed
Move the geneeration of new Repository objects outside the object
Bret Wortman
committed
Fixed issues with rotate testing
Bret Wortman
committed
Increase interval to remove race conditions
Bret Wortman
committed
Updates from expanded integration testing
Bret Wortman
committed
New test cases to better cover repo/bucket issues
Bret Wortman
committed
Removing integration test for status
Bret Wortman
committed
Templates which can give success right now
Bret Wortman
committed
Spelling matters
Bret Wortman
committed
Add snapshot count to repository status
Bret Wortman
committed
Update repos after creating the latest, not before
Bret Wortman
committed
Various testing updates
Bret Wortman
committed
Updates to Repository utilities
Bret Wortman
committed
Type hints
Bret Wortman
committed
Merge branch 'deepfreeze' of github.com:wortmanb/curator into deepfreeze
Bret Wortman
committed
Removing unused imports & assignments
Bret Wortman
committed
Restored setup functionality with boundaries
Bret Wortman
committed
Fixing isoformat error
Bret Wortman
committed
Fix repo searching
Bret Wortman
committed
Fixing some issues with repo rotation
Bret Wortman
committed
Added single-letter options to al actions
Bret Wortman
committed
Adding testing setup scripts
Bret Wortman
committed
Documentation update
Bret Wortman
committed
Fixes for date comparisons
Bret Wortman
committed
Fixed AWS code, repo removal
Bret Wortman
committed
Fixing date updating
Bret Wortman
committed
Do this query using name, not id
Bret Wortman
committed
Remove unnecessary import
Bret Wortman
committed
Fix missing base_path and bucket
Bret Wortman
committed
Fixed repo with null start/end
Bret Wortman
committed
Clean up
Bret Wortman
committed
Facilitate screening repos by mounted status
Bret Wortman
committed
Removing all but the options I've been working on most. We'll add capability in future releases. Focus on MVP for now. Also show defaults in help text.

wortmanb
authored and
Bret Wortman
committed
Bugfix; change approach to unmounting failures
Bret Wortman
committed
Merge branch 'dev' of github.com:wortmanb/curator into dev
Bret Wortman
committed
Update to ILM policy for faster testing
Bret Wortman
committed
Bugfixes
Bret Wortman
committed
Updates to reflect renaming of this function
Bret Wortman
committed
Removing actions
Bret Wortman
committed
More removals
Bret Wortman
committed
Cleaning up
Bret Wortman
committed
More aggressive ILM policy
Bret Wortman
committed
Change these warnings to infos
Bret Wortman
committed
Removing unneeded import
Bret Wortman
committed
More aggressive ILM policy for testing & demo
Bret Wortman
committed
Don't limit ourselves needlessly
Bret Wortman
committed
Removing FIXMEs and TODOs that have been handled
Bret Wortman
committed
More code removal
Bret Wortman
committed
Implement S3Client as an ABC
Bret Wortman
committed
WIP on Glacier
Bret Wortman
committed
Updating to fix problem with bucket/path contents not aging to Glacier.
Bret Wortman
committed
Removing an unnecessary import
Bret Wortman
committed
Updated to work with nginx reverse proxy
Bret Wortman
committed
Fixing misspellings of "Deepfreeze"
Bret Wortman
committed
Removing files used for local testing
Bret Wortman
committed
Fixing missing commas
Bret Wortman
committed
Unit testing
Bret Wortman
committed

Commits on Oct 12, 2025

Remove warnings, re-add actions to those who don't use filters
Bret Wortman
committed

Commits on Oct 13, 2025

Fix repo date range calculation & storage
Bret Wortman
committed
First pass at Thaw action
Bret Wortman
committed
Adding thaw id management and listing
Bret Wortman
committed
Post-rebase updates
Bret Wortman
committed
Date logic updates
Bret Wortman
committed
Add cleanup action
Bret Wortman
committed
Add --limit to status (show only _n_ repositories)
Bret Wortman
committed
Fixup cleanup CLI and tweak help messages
Bret Wortman
committed
Cleanup indices as well as repositories
Bret Wortman
committed
Added refreeze
Bret Wortman
committed
Added refreeze by thaw_id, and get confirmation before destructive actions.
Bret Wortman
committed
How to manage the various git branches
Bret Wortman
committed
Merge branch 'RC1' of github.com:wortmanb/curator into RC1
Bret Wortman
committed
Improve error messages during deepfreeze setup
Bret Wortman
committed
Improve error messages during deepfreeze setup
Bret Wortman
committed

Commits on Oct 14, 2025

[BF] Handle multiple policies during rotation
Bret Wortman
committed
Update unit tests
Bret Wortman
committed

Commits on Oct 15, 2025

Merge branch 'RC2' of github.com:wortmanb/curator into RC2
Bret Wortman
committed
Fixed detection of initial repo(s)
Bret Wortman
committed
Merge branch 'RC2' of github.com:wortmanb/curator into RC2
Bret Wortman
committed
Type hints
Bret Wortman
committed
Escape bucket paths and other fixes
Bret Wortman
committed
First pass at Thaw action
Bret Wortman
committed
Adding thaw id management and listing
Bret Wortman
committed
Post-rebase updates
Bret Wortman
committed
Date logic updates
Bret Wortman
committed
Add cleanup action
Bret Wortman
committed
Add --limit to status (show only _n_ repositories)
Bret Wortman
committed
Fixup cleanup CLI and tweak help messages
Bret Wortman
committed
Cleanup indices as well as repositories
Bret Wortman
committed
Added refreeze
Bret Wortman
committed
Improve error messages during deepfreeze setup
Bret Wortman
committed
Added refreeze by thaw_id, and get confirmation before destructive actions.
Bret Wortman
committed
[BF] Handle multiple policies during rotation
Bret Wortman
committed
Improve error messages during deepfreeze setup
Bret Wortman
committed
Update unit tests
Bret Wortman
committed
Merge branch 'RC2' of github.com:wortmanb/curator into RC2
Bret Wortman
committed
Fixed detection of initial repo(s)
Bret Wortman
committed
Merge branch 'RC2' of github.com:wortmanb/curator into RC2
Bret Wortman
committed
Type hints
Bret Wortman
committed
Escape bucket paths and other fixes
Bret Wortman
committed
Merge branch 'RC2' of github.com:wortmanb/curator into RC2
Bret Wortman
committed
Added doc to help explain the process
Bret Wortman
committed
Fail quickly if no ILM policies reference the repo
Bret Wortman
committed

Commits on Oct 16, 2025

Improve messaging during thaw operations
Bret Wortman
committed
Fix display of thawing and thawed repos in status output
Bret Wortman
committed
Add section selections & porcelain output
Bret Wortman
committed
Show full Request ID
Bret Wortman
committed

Commits on Oct 17, 2025

Print thaw ID after async creation
Bret Wortman
committed
Cleanup old thaw IDs
Bret Wortman
committed
Fix repo thaw check
Bret Wortman
committed
Restore snapshots and indices, too
Bret Wortman
committed
Speed improvements
Bret Wortman
committed
Fix thawed repo detection in status
Bret Wortman
committed
Move thawed to their own section in status
Bret Wortman
committed
Protect thawed repos during rotation
Bret Wortman
committed
Add date range to thaw --list
Bret Wortman
committed
thaw --check-status without an ID checks all
Bret Wortman
committed
Critical Bugfix
Bret Wortman
committed

Commits on Oct 18, 2025

Fixing logic for updating date ranges when thawed indices are mounted
Bret Wortman
committed
Fixup script for bad repo dates
Bret Wortman
committed
New state machine for thawed repos
Bret Wortman
committed
Implement new state machine
Bret Wortman
committed
Fix repo state issue
Bret Wortman
committed
Adding "active" state to state machine
Bret Wortman
committed
First cut at new refreeze operation
Bret Wortman
committed
Add default of refreeze all, with confirmation
Bret Wortman
committed

Commits on Oct 20, 2025

Fix mounting repos in --check-status
Bret Wortman
committed
Fixing index selection for mounting after thawing
Bret Wortman
committed
--porcelain added throughout
Bret Wortman
committed
Output consistency
Bret Wortman
committed
Fix date range update logic in rotate
Bret Wortman
committed
Start on new integration tests for thaw
Bret Wortman
committed

Commits on Oct 21, 2025

Fold & wrap text in Rich output
Bret Wortman
committed
Add short option for porcelain
Bret Wortman
committed
Improved data stream detection during thaw operations
Bret Wortman
committed
Various pre-tests and other improvements
Bret Wortman
committed
Check for plugin
Bret Wortman
committed

Commits on Oct 23, 2025

Update progress display during --check-status
Bret Wortman
committed
Change default thaw duration from 7d to 30d
Bret Wortman
committed
Updated thaw logic
Bret Wortman
committed
Updates to refreeze
Bret Wortman
committed
Updating ILM processing for thawed indices
Bret Wortman
committed
Default thaw list to only open thaws
Bret Wortman
committed
Differentiate completed & refrozen
Bret Wortman
committed

Commits on Oct 27, 2025

Fixes to cleanup
Bret Wortman
committed

Commits on Oct 28, 2025

Linting & Pylance fixes
Bret Wortman
committed
Make tests nondestructive
Bret Wortman
committed

Commits on Oct 29, 2025

Fix object key vs object usage for s3 objects.
Bret Wortman
committed
Change type hints
Bret Wortman
committed
Integration tests
Bret Wortman
committed
Documentation
Bret Wortman
committed
Unit test fixes
Bret Wortman
committed

Commits on Oct 30, 2025

Huge update after integration testing
Bret Wortman
committed

Commits on Oct 31, 2025

Fixing integration tests in FAST_MODE
Bret Wortman
committed
Parallelize integration tests
Bret Wortman
committed
Fixing repair-metadata
Bret Wortman
committed
test fix
Bret Wortman
committed
Speed improvements to thaw --check-status
Bret Wortman
committed
Implement --refrozen-retention-days on cleanup command
Bret Wortman
committed
Fixing cleanup of refrozen thaw requests
Bret Wortman
committed

Commits on Nov 3, 2025

Fixing refreeze logic
Bret Wortman
committed
Fixing error in refreeze
Bret Wortman
committed
Update legend
Bret Wortman
committed

Commits on Nov 4, 2025

Added short options
Bret Wortman
committed

Commits on Nov 10, 2025

Add fix for metadata repair
Bret Wortman
committed
Final testing notes
Bret Wortman
committed

Commits on Nov 11, 2025

Delete GIT_WORKFLOW.md
wortmanb
authored

Commits on Nov 21, 2025

docs(deepfreeze): transform README from TODO list to comprehensive user guide

Bret Wortman
and
claude
committed
Merge branch 'RC1' of github.com:wortmanb/curator into RC1
Bret Wortman
committed

Commits on Nov 26, 2025

feat(deepfreeze): add required ILM policy and index template configuration to setup

Bret Wortman
and
claude
committed
feat(deepfreeze): store ILM policy and template names in status index

Bret Wortman
and
claude
committed
chore: Update gitignore
Bret Wortman
committed

Commits on Dec 4, 2025

feat(deepfreeze): add standalone deepfreeze package

Bret Wortman
and
claude
committed
🚚 refactor(deepfreeze): move standalone CLI to separate repository

Bret Wortman
and
claude
committed
🚚 refactor(deepfreeze): remove implementation files, import from deepfreeze-core

Bret Wortman
and
claude
committed
♻️ refactor(deepfreeze): update re-export layers for external deepfreeze-core

Bret Wortman
and
claude
committed