-
Notifications
You must be signed in to change notification settings - Fork 22
Open
Labels
bugSomething isn't workingSomething isn't workinghelp wantedExtra attention is neededExtra attention is needed
Description
What is your environment, configuration, and command?
In the values.yaml
, it is possible to specify multiple spark history servers in different profiles, via config.servers
. However, currently only one secret is created and set as environment variable, for authenticating spark history server. In case authentication credentials are different among different spark history servers, the mcp-apache-spark-history-server using helm chart can only authenticate on one spark-history server.
What did you do and What did you see instead?
In the values.yaml:
config:
port: 18888
debug: false
servers:
default:
default: true
url: "http://spark-history-server:18080"
staging:
url: "http://staging-spark-history:18080"
auth:
enabled: true
# secret: use Kubernetes Secret to store spark history server credentials as environment variables
secret:
create: true
name: "abc"
username: "username"
password: "password"
token: "token"
Given only one credential can be specified, eventually mcp-apache-spark-history-server
using this helm chart can only authenticate either default or staging
Additional Information. Logs.
No response
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workinghelp wantedExtra attention is neededExtra attention is needed