Rocky start with dask-ec2 - neither default ami, nor Ubuntu 14.04, 16.04, 17.04 work #99
Description
Dask-ec2 looks like a gread project! Currently the initial user experience is pretty rocky unfortunately.
Neither the default ami, nor amis for Ubuntu 14.04, 16.04, and 17.04 allow me to setup a cluster.
I'll run you through the steps I tried.
I used the current version from master 1849efc for the experiments.
Default AMI
The default ami ami-d05e75b8 is for us-east-1 and does not work for Europe. Ok, no problem, I'll just use an appropriate ami for Europe (see further down).
Maybe dask-ec2 should suggest a resonable ami based on the region?
Ubuntu 14.04 for Europe
dask-ec2 up \
--region-name eu-central-1 \
--keyname some_key_name \
--tags tag:test \
--keypair some_key_pair \
--name some_name \
--type m4.large \
--ami ami-ec832a83 \
--count 4
This runs for a while, creates 4 instances, gives me access to the dask status frontend and the jupyter notebook (via http), but the scheduler does not know about the workers.
Ubuntu 16.04
Doing the same with newer ami: ami-958128fa (Ubuntu 16.04, eu-central-1)
dask-ec2 up \
--region-name eu-central-1 \
--keyname some_key_name \
--tags tag:test \
--keypair some_key_pair \
--name some_name \
--type m4.large \
--ami ami-958128fa \
--count 4
This leads to the ssl error #98
...
ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:2171)
Ubuntu 17.04
Like 16.04, this leads to
...
ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:2171)