Skip to content

Cluster Cleanup Rework #1155

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 16 commits into from
Jun 14, 2025
Merged

Cluster Cleanup Rework #1155

merged 16 commits into from
Jun 14, 2025

Conversation

ArneTR
Copy link
Member

@ArneTR ArneTR commented Apr 18, 2025

  • Cluster cleanup routine moved to Python
  • Fixed APT Package install
  • Added NTP syncing

Greptile Summary

Extensive system maintenance refactoring that migrates cluster cleanup from Bash to Python, adds NTP synchronization, and standardizes metric provider interfaces across the codebase.

  • Introduced robust Python-based cluster maintenance in /tools/cluster/cleanup_original.py with improved error handling for APT updates and NTP synchronization
  • Standardized metric provider parameter naming from 'resolution' to 'sampling_rate' across all providers in /metric_providers/ for better consistency
  • Added usage scenario variables support in /lib/job/, /api/scenario_runner.py, and related components for more flexible test configurations
  • Enhanced system checks with new NTP validation in /lib/system_checks.py and improved machine temperature management
  • Added comprehensive database schema updates in /docker/structure.sql for usage scenario variables, sampling rates, and machine changelog tracking

@ArneTR ArneTR requested a review from ribalba April 18, 2025 13:50
Copy link
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

4 file(s) reviewed, 8 comment(s)
Edit PR Review Bot Settings | Greptile

ArneTR and others added 4 commits April 18, 2025 15:53
* main:
  .github workflows yml typos
  Added removal of sudoers.d to uninstall script
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Copy link
Member

@ribalba ribalba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

ArneTR added 8 commits June 14, 2025 09:39
* main: (179 commits)
  Statistical significance is now 10 runs
  Updated Cloud Energy
  Upgraded pandas
  Bump redis from 6.1.0 to 6.2.0 (#1204)
  Bump cachetools from 5.5.2 to 6.0.0 (#1202)
  Bump uvicorn[standard] from 0.34.2 to 0.34.3 (#1210)
  Bump pytest from 8.3.5 to 8.4.0 (#1211)
  Bump python from 3.13.3-slim-bookworm to 3.13.4-slim-bookworm in /docker (#1220)
  Bump aiohttp from 3.11.18 to 3.12.12 (#1221)
  Bump requests from 2.32.3 to 2.32.4 in /docker (#1222)
  Clarified that index.html amounts of data points are user specific
  Keyboard interrupt locally does also not need to lead to error
  Keyboard Interrupt does not need to be alerted in cluster. Is either systemd or manual
  Logout now also inline message; Using dedicated login/logout icons
  Login successful more clear
  Notes sent by Eco Ci now shown in frontend (#1218)
  Sleep time cluster (#1217)
  Rounding with two digits
  Wrong branch for bakerydemo
  Updated CloudEnergy
  ...
@ArneTR
Copy link
Member Author

ArneTR commented Jun 14, 2025

@greptileai

Copy link
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

235 files reviewed, 1 comment
Edit PR Review Bot Settings | Greptile

@ArneTR ArneTR merged commit 94ebd46 into main Jun 14, 2025
@ArneTR ArneTR deleted the cluster-cleanup-rework-with-ntp branch June 14, 2025 09:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants