Skip to content

Accessing status.url from ISVC Returns 503 #234

@bartoszmajsak

Description

@bartoszmajsak

Summary

Steps to Reproduce

  1. Deploy the latest incubation of odh-operator sources using manifests from here.
  2. This deployment uses the image referenced here.
  3. Change image to v0.12.0 to mitigate reconcile issue mentioned in Outdated images in opendatahub-operator breaks ISVC reconcile #233
  4. Run the smoke test against KServe.
  5. Observe 503

Workaround

Use .status.components.predictor.url instead. This seems to be working fine

ISVC
apiVersion: v1
items:
- apiVersion: serving.kserve.io/v1beta1
  kind: InferenceService
  metadata:
    annotations:
      kubectl.kubernetes.io/last-applied-configuration: |
        {"apiVersion":"serving.kserve.io/v1beta1","kind":"InferenceService","metadata":{"annotations":{"serving.knative.openshift.io/enablePassthrough":"true","sidecar.istio.io/inject":"true"},"name":"sklearn-v2-iris","namespace":"kserve-test"},"spec":{"predictor":{"model":{"modelFormat":{"name":"sklearn"},"protocolVersion":"v2","runtime":"kserve-sklearnserver","storageUri":"gs://kfserving-examples/models/sklearn/1.0/model"}}}}
      security.opendatahub.io/enable-auth: "true"
      serving.knative.openshift.io/enablePassthrough: "true"
      sidecar.istio.io/inject: "true"
    creationTimestamp: "2024-07-09T15:50:50Z"
    finalizers:
    - inferenceservice.finalizers
    generation: 1
    name: sklearn-v2-iris
    namespace: kserve-test
    resourceVersion: "155594"
    uid: 9e242bdf-ee5c-4522-9bd9-542dd0c84cb7
  spec:
    predictor:
      model:
        modelFormat:
          name: sklearn
        name: ""
        protocolVersion: v2
        resources: {}
        runtime: kserve-sklearnserver
        storageUri: gs://kfserving-examples/models/sklearn/1.0/model
  status:
    address:
      url: http://sklearn-v2-iris.kserve-test.svc.cluster.local
    components:
      predictor:
        address:
          url: http://sklearn-v2-iris-predictor.kserve-test.svc.cluster.local
        latestCreatedRevision: sklearn-v2-iris-predictor-00002
        latestReadyRevision: sklearn-v2-iris-predictor-00002
        latestRolledoutRevision: sklearn-v2-iris-predictor-00002
        previousRolledoutRevision: sklearn-v2-iris-predictor-00001
        traffic:
        - latestRevision: true
          percent: 100
          revisionName: sklearn-v2-iris-predictor-00002
        url: https://sklearn-v2-iris-predictor-kserve-test.apps.rosa.q2rzk-kbxfh-3tj.3r5r.p3.openshiftapps.com
    conditions:
    - lastTransitionTime: "2024-07-09T16:00:38Z"
      status: "True"
      type: IngressReady
    - lastTransitionTime: "2024-07-09T16:00:38Z"
      severity: Info
      status: "True"
      type: LatestDeploymentReady
    - lastTransitionTime: "2024-07-09T16:00:38Z"
      severity: Info
      status: "True"
      type: PredictorConfigurationReady
    - lastTransitionTime: "2024-07-09T16:00:38Z"
      status: "True"
      type: PredictorReady
    - lastTransitionTime: "2024-07-09T16:00:38Z"
      severity: Info
      status: "True"
      type: PredictorRouteReady
    - lastTransitionTime: "2024-07-09T16:00:38Z"
      status: "True"
      type: Ready
    - lastTransitionTime: "2024-07-09T16:00:38Z"
      severity: Info
      status: "True"
      type: RoutesReady
    modelStatus:
      copies:
        failedCopies: 0
        totalCopies: 1
      states:
        activeModelState: Loaded
        targetModelState: Loaded
      transitionStatus: UpToDate
    observedGeneration: 2
    url: https://sklearn-v2-iris-kserve-test.apps.rosa.q2rzk-kbxfh-3tj.3r5r.p3.openshiftapps.com
kind: List
metadata:
  resourceVersion: ""

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions