Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [Flink、Spark] Tasks such as flink and spark fail to run after kerberos authentication is enabled on Dolphinscheduler #16843

Open
2 of 3 tasks
gaotong521 opened this issue Nov 25, 2024 · 0 comments
Labels
bug Something isn't working help wanted Extra attention is needed

Comments

@gaotong521
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

When kerberos authentication is enabled, the kerberos expiration time is 7 days, and tasks such as flink and spark will fail to be run after 7 days. The kerberos code logic for periodically updating has been added and is valid, allowing the resource center to use it properly. However, the hand running flink and spark tasks still fails and the Dolphinscheduler cluster needs to be restarted

The newly added code is shown below:
image
image

After 7 days, the resource center can be used normally, as shown in the following figure
image

Running the flink live spark task will fail after 7 days, as shown below:

image
image
image

What you expected to happen

The flink and spark tasks can run properly at any time without failing when kerberos expires, and the dolphinscheduler cluster does not need to be restarted

How to reproduce

The expiration time of kerberos is 7 days, after which running tasks will fail

Anything else

no

Version

3.2.x

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@gaotong521 gaotong521 added bug Something isn't working Waiting for reply Waiting for reply labels Nov 25, 2024
@SbloodyS SbloodyS added help wanted Extra attention is needed and removed Waiting for reply Waiting for reply labels Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants