Replies: 1 comment
-
When
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I've upgraded Gluten to support Spark 3.5.3 and tried running TPCDS benchmark queries which use bloom filter. But, it's failing with below mentioned segmentation fault. Can someone who uses Gluten/Velox with Spark 3.5.3 help me with the issue?
Spark Conf used:
spark-shell --conf spark.gluten.sql.columnar.backend.lib=velox --conf spark.gluten.loadLibFromJar=true --conf spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager --conf "spark.driver.extraJavaOptions"="-Dio.netty.tryReflectionSetAccessible=true -XX:+ErrorFileToStderr" --conf "spark.executor.extraJavaOptions"="-Dio.netty.tryReflectionSetAccessible=true -XX:+ErrorFileToStderr" --conf "spark.plugins"="org.apache.gluten.GlutenPlugin" --conf spark.executor.memory=4g --conf spark.memory.offHeap.enabled=true --conf spark.memory.offHeap.size=22g --conf spark.sql.autoBroadcastJoinThreshold=10m
TPCDS Query q1:
Query Failure:
Beta Was this translation helpful? Give feedback.
All reactions