New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE REQUEST]: Spark version 3.1.3 is not supported by current dotnet on spark code. This is preventing Migration to HDI 5.0 which uses spark version 3.1.3 #1161

Open

aadithya0701 opened this issue Sep 13, 2023 · 1 comment

Labels

aadithya0701 commented Sep 13, 2023

Is your feature request related to a problem? Please describe.

Spark version 3.1.3 is not supported by current dotnet on spark code. This is preventing Migration to HDI 5.0 which uses spark version 3.1.3

Describe the solution you'd like
Adding 3.1.3 as supported verion in dotnetrunner class will help resolve this issue.

Describe alternatives you've considered
Nil

Additional context
Nil

aadithya0701 added the enhancement label

dbeavon commented Apr 17, 2024

Hi @aadithya0701 I've tested this change. It is an easy one to make. I'm on my way into HDI from Synapse as well.

We just need a committer on the project. Do you happen to know anyone that can help us commit PR's? If so I can create the PR for you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment