Skip to content

[Bug]: [HELM] Only one secret can be used despite multiple servers specified #94

@zemin-piao

Description

@zemin-piao

What is your environment, configuration, and command?

In the values.yaml, it is possible to specify multiple spark history servers in different profiles, via config.servers. However, currently only one secret is created and set as environment variable, for authenticating spark history server. In case authentication credentials are different among different spark history servers, the mcp-apache-spark-history-server using helm chart can only authenticate on one spark-history server.

What did you do and What did you see instead?

In the values.yaml:

config:
  port: 18888
  debug: false

  servers:
    default:
      default: true
      url: "http://spark-history-server:18080"
    staging:
      url: "http://staging-spark-history:18080"

auth:
  enabled: true

  # secret: use Kubernetes Secret to store spark history server credentials as environment variables
  secret:
    create: true
    name: "abc"
    username: "username"
    password: "password"
    token: "token"

Given only one credential can be specified, eventually mcp-apache-spark-history-server using this helm chart can only authenticate either default or staging

Additional Information. Logs.

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinghelp wantedExtra attention is needed

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions