You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Develop heuristics for setting spark.default.parallelism in a containerized environment and set it explicitly if a user has not set it via --conf on application launch or in spark-defaults.conf on the driver pod.
This will help ensure that the default number of partitions is a sane number related to the size of the cluster being used.
The text was updated successfully, but these errors were encountered:
Develop heuristics for setting spark.default.parallelism in a containerized environment and set it explicitly if a user has not set it via --conf on application launch or in spark-defaults.conf on the driver pod.
This will help ensure that the default number of partitions is a sane number related to the size of the cluster being used.
The text was updated successfully, but these errors were encountered: