Mesos

From Skytech
Revision as of 13:56, 29 June 2017 by Martin (talk | contribs)
Jump to navigation Jump to search


Installing mesos-master

## Installing mesos ##
apt-key adv --keyserver keyserver.ubuntu.com --recv E56151BF
DISTRO=$(lsb_release -is | tr '[:upper:]' '[:lower:]')
CODENAME=$(lsb_release -cs)
echo "deb http://repos.mesosphere.com/${DISTRO} ${CODENAME} main" | tee /etc/apt/sources.list.d/mesosphere.list

## Need java8-runtime-headless to run marathon (jessie-backports)
echo "deb http://ftp.debian.org/debian jessie-backports main" | tee  /etc/apt/sources.list.d/backports.list
apt-get update
apt-get -y install mesos marathon chronos
 
## Zookeeper
Make sure zooker has been setup and is in quorum. Create new zkpool:
Login to zookeeper ( /usr/share/zookeeper/bin/zkCli.sh ) and create:
create /mesos mesos
Created /mesos
## Edit mesos to speak to zookeeper:
$ cat /etc/mesos/zk
zk://192.168.0.61:2181,192.168.0.62:2181,192.168.0.63:2181/mesos
 
## Edit master setup to enable quorom:
Change quorum requirements from 1 -> 2
$ cat /etc/mesos-master/QUORUM
2

## Restart mesos-service
systemctl restart mesos-master.service

Installing mesos-slave nodes

## Installing mesos ##
apt-key adv --keyserver keyserver.ubuntu.com --recv E56151BF
DISTRO=$(lsb_release -is | tr '[:upper:]' '[:lower:]')
CODENAME=$(lsb_release -cs)
echo "deb http://repos.mesosphere.com/${DISTRO} ${CODENAME} main" | tee /etc/apt/sources.list.d/mesosphere.list
## Setup mesos-slave with ip for hostname+ip ##
echo "192.168.0.61" > cat /etc/mesos-slave/ip
cat ip > /etc/mesos-slave/hostname

## Edit mesos to speak to zookeeper
$ cat /etc/mesos/zk
zk://192.168.0.61:2181,192.168.0.62:2181,192.168.0.63:2181/mesos
 
## Restart mesos-service
systemctl restart mesos-slave.service

Install marathon

## Marathon ##
mkdir -p /etc/marathon/conf
cp /etc/mesos-master/hostname /etc/marathon/conf
cp /etc/mesos/zk /etc/marathon/conf/master
## Copy master (zk) config into a zk file and change endpoint to zk:/...../marathon
cp /etc/marathon/conf/master /etc/marathon/conf/zk 
 
## Choose jdk8 instead of 7 or marathon will fail and die horribly
update-alternatives --config java
 
systemctl restart marathon.service

Installing other frameworks

Spark

Note: It is advisable to install hadoop or s3 first - either is required. http://spark.apache.org/docs/latest/running-on-mesos.html

Hadoop

https://github.com/mesos/hadoop ( Preferred method) https://strat0sphere.wordpress.com/2014/10/30/hadoop-on-mesos-installation-guide/ (2014)

Mesos Links

Autoscaling mesos applications / frameworks

Howto

Retrieved from "https://wiki.skytech.dk/index.php?title=Mesos&oldid=2323"