You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Using the attached geojson boundary for Ontario there was an error for a broadcast timeout when trying to run against about ~1b points. The points data set is parquet.
Final app status: FAILED, exitCode: 15, (reason: User class threw exception: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: execute, tree: Exchange SinglePartition
Also this seemed to result in a broadcast time out on Spark and increasing spark.sql.autoBroadcastJoinThreshold and spark.sql.broadcastTimeout did not help.
We did notice through a conversion process to create the GeoJson structure that the precision is very high >15.
Using the attached geojson boundary for Ontario there was an error for a broadcast timeout when trying to run against about ~1b points. The points data set is parquet.
Final app status: FAILED, exitCode: 15, (reason: User class threw exception: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: execute, tree: Exchange SinglePartition
Also this seemed to result in a broadcast time out on Spark and increasing spark.sql.autoBroadcastJoinThreshold and spark.sql.broadcastTimeout did not help.
We did notice through a conversion process to create the GeoJson structure that the precision is very high >15.
ontario_ca.geojson.zip
The text was updated successfully, but these errors were encountered: