Skip to content

Commit 6c4a047

Browse files
Updating the ExecutorGc heuristic help page and mentioning the wiki link
1 parent 08c355f commit 6c4a047

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

app/views/help/spark/helpExecutorGcHeuristic.scala.html

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,4 +17,7 @@
1717
<p>This analysis shows how much time a job is spending in GC. To normalise the results across all jobs, the ratio of the time a job spends in Gc to the total run time of the job is calculated. </p>
1818
<p>A job is flagged if the ratio is too high, meaning the job spends too much time in GC.</p>
1919
<h3>Suggestions</h3>
20-
<p>We recommend increasing the executor memory.</p>
20+
<p>We recommend increasing the executor memory.</p>
21+
<p>Enabling ParallelGC using spark.executor.extraJavaOptions could help.</p>
22+
<p>Also recommended to reduce the number of UDF calls.</p>
23+
<p>For more help refer <a href="https://iwww.corp.linkedin.com/wiki/cf/display/DWH/Big+Data+Engineering+-+Advanced+Spark+SQL+Tuning+Techniques#BigDataEngineering-AdvancedSparkSQLTuningTechniques-GCtuning" target="_blank">here</a></p>

0 commit comments

Comments
 (0)