New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Databricks Stream job gets stuck and stops processing stream data #663

Open

abhisheksingh077a opened this issue Nov 30, 2022 · 0 comments

abhisheksingh077a commented Nov 30, 2022

Thanks for filing an issue with us! Below are some guidelines when filing an issue. In general, the more detail the better!

Stream Job Setup:

One consumer group
4 stream writes to sinks
Processing involves extracting parts of json data received from stream.

Bug Report:

Actual behavior

Databricks Job gets stuck for days and stops processing the stream data.
In Error it shows the "java.utils.concurrent.TimeoutException: Futures timed out after [5 minutes]" in spark UI active jobs section.

Expected behavior

Every futures timeout error should be retried after 5 mins, and up to 4 times. After that it should terminate and create a new compute job.

Spark version

Apache Spark 3.2.1
Scala 2.12

spark-eventhubs artifactId and version

artifactId: azure-eventhubs-spark_2.12
version: 2.3.18

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment