Inference Plugin: Adds status trigger based on route krt collection #11521
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Motivation
E2E tests were flaky when an HTTPRoute and its referenced InferencePool were created in the same manifest.
If the HTTPRoute reconciled before the InferencePool, the pool never received Accepted/ResolvedRefs status conditions, preventing the route from becoming
Accepted=True
.What Changed
krt.Index
that maps Route -> InferencePool so the plugin can look up all routes that reference a pool.HTTPRoute
collection to re-enqueue (reconcile
) the affected pool whenever any route is added, updated, or deleted.Routes
collection is not yet initialized, allowingAccepted
/ResolvedRefs
status conditions to be set at start-up.endpointpicker/status.go
: new reverse index and updated event handling.krtcollections/policy.go
: exposedHTTPRoutes()
and lightweightLookup()
helper.Related issues
Fixes #11516
Fixes #11379
Change Type
Changelog
Additional Notes