Skip to content

Commit

Permalink
TaskSetManager is logs correctly, for executors so we can disable Log…
Browse files Browse the repository at this point in the history
…ErrorSparkListener. #897
  • Loading branch information
EmileSonneveld committed Oct 8, 2024
1 parent adecba9 commit 845323d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion openeogeotrellis/deploy/submit_batch_job_spark3.sh
Original file line number Diff line number Diff line change
Expand Up @@ -191,7 +191,7 @@ spark-submit \
--conf spark.history.store.path=/var/lib/spark2/shs_db \
--conf spark.yarn.historyServer.address=epod-ha.vgt.vito.be:18481 \
--conf spark.archives=${archives} \
--conf spark.extraListeners=org.openeo.sparklisteners.LogErrorSparkListener,org.openeo.sparklisteners.BatchJobProgressListener \
--conf spark.extraListeners=org.openeo.sparklisteners.BatchJobProgressListener \
--conf spark.sql.adaptive.coalescePartitions.parallelismFirst=false \
--conf spark.sql.adaptive.advisoryPartitionSizeInBytes=5242880 \
--files "${files}" \
Expand Down

0 comments on commit 845323d

Please sign in to comment.