Skip to content

Commit

Permalink
[SPARK-32119][FOLLOWUP][DOC] Update monitoring doc following the impr…
Browse files Browse the repository at this point in the history
…ovement in SPARK-32119

### What changes were proposed in this pull request?
Update monitoring doc following the improvement/fix in SPARK-32119.

### Why are the changes needed?
SPARK-32119 removes the limitations listed in the monitoring doc "Distribution of the jar files containing the plugin code is currently not done by Spark."

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Not relevant

Closes apache#29463 from LucaCanali/followupSPARK32119.

Authored-by: Luca Canali <[email protected]>
Signed-off-by: Kousuke Saruta <[email protected]>
  • Loading branch information
LucaCanali authored and sarutak committed Aug 18, 2020
1 parent 1ac23de commit 21e0dd0
Showing 1 changed file with 0 additions and 6 deletions.
6 changes: 0 additions & 6 deletions docs/monitoring.md
Original file line number Diff line number Diff line change
Expand Up @@ -1366,9 +1366,3 @@ Both take a comma-separated list of class names that implement the
possible for one list to be placed in the Spark default config file, allowing users to
easily add other plugins from the command line without overwriting the config file's list. Duplicate
plugins are ignored.

Distribution of the jar files containing the plugin code is currently not done by Spark. The user
or admin should make sure that the jar files are available to Spark applications, for example, by
including the plugin jar with the Spark distribution. The exception to this rule is the YARN
backend, where the <code>--jars</code> command line option (or equivalent config entry) can be
used to make the plugin code available to both executors and cluster-mode drivers.

0 comments on commit 21e0dd0

Please sign in to comment.