Deep Learning Climate Segmentation Benchmark

Reference implementation for the climate segmentation benchmark, based on the Exascale Deep Learning for Climate Analytics codebase here: https://github.com/azrael417/ClimDeepLearn, and the paper: https://arxiv.org/abs/1810.01993

How to get the data

For now there is a smaller dataset (~200GB total) available to get things started. It is hosted via Globus:

and also available via https:

Submission scripts are in run_scripts.

To submit to the Cori KNL system, do

# This example runs on 64 nodes.
cd run_scripts
sbatch -N 64 train_cori.sh

To submit to the Cori GPU system, do

# 8 ranks per node, 1 per GPU
module purge
module load esslurm
cd run_scripts
sbatch -N 4 train_corigpu.sh