Skip to content

Inference Plugin: Adds status trigger based on route krt collection #11521

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

danehans
Copy link
Contributor

Description

Motivation

E2E tests were flaky when an HTTPRoute and its referenced InferencePool were created in the same manifest.
If the HTTPRoute reconciled before the InferencePool, the pool never received Accepted/ResolvedRefs status conditions, preventing the route from becoming Accepted=True.

What Changed

  • Bidirectional reconciliation
    • Added a krt.Index that maps Route -> InferencePool so the plugin can look up all routes that reference a pool.
    • Registered a watcher on the HTTPRoute collection to re-enqueue (reconcile) the affected pool whenever any route is added, updated, or deleted.
  • Early status calculation
    • The callback runs even when the Routes collection is not yet initialized, allowing Accepted/ResolvedRefs status conditions to be set at start-up.
  • Changed code
    • endpointpicker/status.go: new reverse index and updated event handling.
    • krtcollections/policy.go: exposed HTTPRoutes() and lightweight Lookup() helper.
    • No change to public API; behaviour is internal to the Endpoint-Picker plugin.

Related issues

Fixes #11516
Fixes #11379

Change Type

/kind bug_fix  
/kind flake

Changelog

Inference EndpointPicker (EPP) plugin now recalculates InferencePool status whenever an HTTPRoute that references the pool is added, updated, or deleted.

Additional Notes

@github-actions github-actions bot added kind/fix Categorizes issue or PR as related to a bug. kind/flake release-note labels Jun 28, 2025
@danehans
Copy link
Contributor Author

xref #11503

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/fix Categorizes issue or PR as related to a bug. kind/flake release-note
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Inference: Reenlable Setup Tests Inference Extension: Extend Support for InferencePool Status
1 participant