Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to Kubernetes + Kueue service backend #723

Open
wants to merge 219 commits into
base: main
Choose a base branch
from
Open

Conversation

cortadocodes
Copy link
Member

@cortadocodes cortadocodes commented Feb 17, 2025

Summary

This release switches to running Twined services on Kubernetes + Kueue. This brings the following features:

  • Run questions that take any amount of time (specifically opening us up to runs > 1 hour)
  • Request arbitrary compute resources per question (CPU, memory, storage etc.)
  • Stop pointless question reruns by allowing us to control when we acknowledge question events
  • Monitor running questions individually
  • Make it easier to run questions on providers other than Google in the future (i.e. on any Kubernetes cluster)

Contents (#723)

IMPORTANT: There are breaking changes.

New features

Enhancements

  • Add allow_not_found option to ServiceConfiguration.from_file
  • Add default event store ID to get_events
  • Increase default maximum heartbeat interval to 360s

Refactoring

Operations

  • Replace Terraform configuration with new terraform-octue-twined-core module

Testing

  • Move deployment test to octue/example-service-kueue repository

@cortadocodes cortadocodes changed the title Kubernetes/Kueue release candidate Switch to Kubernetes + Kueue service backend Mar 10, 2025
@cortadocodes cortadocodes linked an issue Mar 10, 2025 that may be closed by this pull request
13 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Create Kueue service backend
3 participants