VANDA - Spark Master Container

This image is only intended for being part of the VANDA Deap Learning Stack! Runs Spark 2.1.0 on top of the phusion/baseimage with Ubuntu 16.04 as base system.

Dockerfile

vandatud/spark-master Dockerfile

How to rebuild an extended image

After pulling this repository and changing the Dockerfile first build the new image locally to test it. Optionally specify the repository and tag at which to save the new image if the build succeeds.

$ cd /path/to/Dockerfile
$ docker build -t vandatud/spark-master:0.0.1 -t vandatud/spark-master:latest

If this Git repository is pushing back to the server, DockerHub will automatically build this image. For manually push the locally build to the DockerHub use the docker cli.

$ docker login

$ docker push vandatud/spark-master:0.0.1

How to use this image

Run a new container instance without

$ docker run -d -t -p 8080 --name vanda-spark-master_inst vandatud/spark-master:latest

or with an interactive bash session for inspecting the image.

$ docker run --rm -t -i -p 8080 --name vanda-spark-master_inst vandatud/spark-master:latest /sbin/my_init -- bash -l

$ docker ps
CONTAINER ID        IMAGE                   COMMAND             CREATED             STATUS              PORTS                     NAMES
105287df93ce        vandatud/spark-master   "/sbin/my_init"     About an hour ago   Up About an hour    0.0.0.0:32772->8080/tcp   vanda-spark-master_inst

Once the container is running you can open the web interface under the attached host port (i.e. localhost:32772)