Skip to content

[Bug] [Flink、Spark] Tasks such as flink and spark fail to run after kerberos authentication is enabled on Dolphinscheduler #16843

@gaotong521

Description

@gaotong521

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

When kerberos authentication is enabled, the kerberos expiration time is 7 days, and tasks such as flink and spark will fail to be run after 7 days. The kerberos code logic for periodically updating has been added and is valid, allowing the resource center to use it properly. However, the hand running flink and spark tasks still fails and the Dolphinscheduler cluster needs to be restarted

The newly added code is shown below:
image
image

After 7 days, the resource center can be used normally, as shown in the following figure
image

Running the flink live spark task will fail after 7 days, as shown below:

image
image
image

What you expected to happen

The flink and spark tasks can run properly at any time without failing when kerberos expires, and the dolphinscheduler cluster does not need to be restarted

How to reproduce

The expiration time of kerberos is 7 days, after which running tasks will fail

Anything else

no

Version

3.2.x

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinghelp wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions