Skip to content

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles #2211

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles

[PySpark] Improve validation performance by enabling cache()/unpersist() toggles #2211

Job Run time
1m 23s
1m 31s
1m 27s
1m 45s
11m 32s
12m 3s
6m 23s
6m 35s
11m 51s
11m 45s
6m 16s
6m 25s
16m 39s
16m 38s
6m 3s
6m 5s
19m 21s
19m 45s
9m 54s
9m 39s
23m 29s
19m 29s
13m 51s
13m 38s
18m 26s
22m 50s
13m 39s
15m 28s
24m 54s
23m 14s
9m 33s
8m 8s
41m 20s
32m 5s
17m 31s
22m 24s
11m 32s
13m 5s
9m 5s
8m 17s
11m 34s
10m 50s
8m 32s
8m 57s
10m 42s
9m 6s
6m 53s
8m 53s
9m 53s
10m 59s
7m 41s
9m 28s
10h 58m 26s