Mesos 0.21.1 with MR, Spark and Storm using private IPs and same security group

Use of private IP addresses and same security group for masters and slaves. Traffic does not go through the euca Head Node.
Also minor changes on not installing and monitoring Kafka and backup modules as they are currently not used.

High Availability Cluster

Zk cluster added, High availability enabled for Mesos and HDFS Namenodes

Mesos 0.21.1 with MR, Spark and Storm using public IPs and different security groups

Well tested release but attention: It uses separate security groups for masters/slaves and public IPs for some communication between them. Traffic between different security groups will go through Eucalyptus head node.

Apache Mesos, Spark, Hadoop, Storm, Kafka and Hama on Eucalyptus

Starting from a euca emi (similar to aws emi) that has hdfs, zookeeper and mesos installed. Also tar files with spark and hadoop compiled for mesos are retrieved from S3. To build spark and hadoop for Mesos you can check my blog: http://strat0sphere.wordpress.com/

Starting from this emi the scripts are installing and configuring Hadoop MR1, Spark, Hama and Storm to run on top of Mesos. Kafka is also configured and runs standalone. Mesos master is used in the role of zookeeper as well. So this cannot be used for production. For a high available cluster check next release.

Spark standalone on Eucalyptus

Ported code from spark-ec2 to run a standalone spark cluster on eucalyptus