it contains Tasks that don’t exist: Couldn’t retrieve Task “resolver type cluster\nname = task-jest30-pkg-small\n”: error requesting remote resource: rpc error: code = Unknown desc = exec (try: 500): database is locked

[sibelius]

Expected Behavior

It should create the pipeline

Actual Behavior

Pipeline tekton-woovi-server/tekton-woovi-server-pipeline-prd-deploy-tests can’t be Run; it contains Tasks that don’t exist: Couldn’t retrieve Task “resolver type cluster\nname = task-jest30-pkg-small\n”: error requesting remote resource: rpc error: code = Unknown desc = exec (try: 500): database is locked

Steps to Reproduce the Problem

Create many pipelines at a time

Additional Info

• Kubernetes version:

  Output of kubectl version:

Client Version: v1.32.2
Kustomize Version: v5.5.0
Server Version: v1.32.3

• Tekton Pipeline version:

  Output of tkn version or kubectl get pods -n tekton-pipelines -l app=tekton-pipelines-controller -o=jsonpath='{.items[0].metadata.labels.version}'

Client version: 0.40.0
Chains version: v0.23.0
Pipeline version: v0.65.2
Triggers version: v0.30.0
Dashboard version: v0.52.0
Operator version: v0.74.0

[sibelius]

task usage in the pipeline

  {{- range $i, $value := .Values.small_packages }}
    - name: test-{{ $value }}
      runafter: ["install-deps"]
      taskref:
        resolver: cluster
        params:
          - name: kind
            value: task
          - name: name
            value: task-jest30-pkg-small
          - name: namespace
            value: tekton-pipelines

[sibelius]

task definition in another namespace

apiVersion: tekton.dev/v1beta1
kind: Task
metadata:
  name: task-jest30-pkg-small
  namespace: {{ .Values.projectName }}
spec:
  workspaces:
    - name: source
    - name: cache
      optional: true
  params:
    - name: pkg
      description: package to run tests from
      type: string
      default: main   
  steps:

[sibelius]

the code is here

pipeline/pkg/remote/resolution/resolver.go

Line 93 in bb8b8bb

case errors.Is(err, resolutioncommon.ErrRequestInProgress):

the database is locked error is wrong k8s ?

can we add a retry to remote resolver ?

what about caching the "remote task"?