Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cluster Master URL setting overridden #103

Open
whereswaldon opened this issue Jun 16, 2016 · 0 comments
Open

Cluster Master URL setting overridden #103

whereswaldon opened this issue Jun 16, 2016 · 0 comments

Comments

@whereswaldon
Copy link

It seems that, when running eclairjs-node against the eclairjs/minimal-gateway docker container, the URL of the spark cluster that you want to talk to can be overridden by the Scala SparkContext that Toree creates by default. This results in jobs never reaching the targeted cluster and being executed locally instead.

// Launch Spark instance
var spark = require('eclairjs');
var sparkContext = new spark.SparkContext('spark://X.X.X.X:8443', "dataframe test");

The above, when run with JUPYTER_PORT and JUPYTER_HOST pointing to the eclairjs/minimal-gateway docker container, runs locally (on the docker container) instead of on the specified cluster.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant