DC/OS (Distributed Cloud Operating System) ( dcos | 14 hours )

• System administrators
• DevOps engineers

DC/OS (Distributed Cloud Operating System) is an open-source distributed operating system built upon the Apache Mesos project. Apache Mesos was built using the same principles as the Linux kernel, only at a different level of abstraction. The Mesos kernel runs on every machine and provides applications such as Hadoop, Spark, Kafka and Elasticsearch with API’s for resource management and scheduling across entire datacenter and cloud environments. Apache Mesos abstracts CPU, memory, storage, and other compute resources away from machines (physical or virtual), enabling fault-tolerant and elastic distributed systems to easily be built and run effectively.

DC/OS brings together Mesos and more than 30 applications into one coherent system, similar to how a Linux distribution packages the Linux kernel with applications to create a working operating system.

This course provides participants with an overview of Apache Mesos and DC/OS and demonstrates through hands-on practice how to deploy and manage a complete Data Center Operating System.

Audience

• System administrators
• DevOps engineers

Format of the course

• Part lecture, part discussion, heavy hands-on practice

Introduction

• The need for a DC/OS (Distributed Cloud Operating System)
• Resource Sharing
• Data Sharing
• Programming Abstractions
• Debugging and Monitoring

DC/OS's kernel space components

• Master and agents

DC/OS's user space components

• System components
  • Admin Router, an internal load balancer
  • Cosmos, an internal packaging API service
  • Exhibitor, a Java supervisor system for ZooKeeper
  • Marathon, an Apache Mesos framework for container orchestration
  • Mesos-DNS, an internal DNS service

Installing and operating DC/OS

• Working with DC/OS components and services
• Working with the CLI
• Load balancing with Marathon

Installing distributed systems (applications) with DC/OS Universe

• HDFS
• Apache Spark
• Apache Kafka
• Apache Cassandra
• Jenkins

Deploying applications in Docker containers

Deploying applications in native Mesos containers (using Linux cgroups and namespaces)

Using Marathon for native container orchestration

Ensuring high-availability and fault-tolerance for applications and services

Using the GUI-based monitoring and management system

Scheduling systems such as Kubernetes and Swarm as services

Resource management and abstraction

Exploring other ready-to-install packages

• ArangoDB, Avi Networks, Cassandra, Chronos, Confluent, Crate, DataDog, Elasticsearch, Etcd, Exhibitor, HDFS, Hue, Jenkins, Kafka, Linkerd, Marathon-lb, Marathon, MemSQL, mr-redis, Namerd, NGINIX, OpenVPN, Project Calico, Quobyte, Riak, Ruxit, Spark, Spark Notebook, Storm, Swarm, Weave and Zeppelin

Other DC/OS installation options

• Bare metal installations vs virtual machines and cloud installations

Summary and conclusion