[PySpark] Improve validation performance by enabling cache()
/unpersist()
toggles
#2211
Job | Run time |
---|---|
1m 23s | |
1m 31s | |
1m 27s | |
1m 45s | |
11m 32s | |
12m 3s | |
6m 23s | |
6m 35s | |
11m 51s | |
11m 45s | |
6m 16s | |
6m 25s | |
16m 39s | |
16m 38s | |
6m 3s | |
6m 5s | |
19m 21s | |
19m 45s | |
9m 54s | |
9m 39s | |
23m 29s | |
19m 29s | |
13m 51s | |
13m 38s | |
18m 26s | |
22m 50s | |
13m 39s | |
15m 28s | |
24m 54s | |
23m 14s | |
9m 33s | |
8m 8s | |
41m 20s | |
32m 5s | |
17m 31s | |
22m 24s | |
11m 32s | |
13m 5s | |
9m 5s | |
8m 17s | |
11m 34s | |
10m 50s | |
8m 32s | |
8m 57s | |
10m 42s | |
9m 6s | |
6m 53s | |
8m 53s | |
9m 53s | |
10m 59s | |
7m 41s | |
9m 28s | |
10h 58m 26s |