Everything I know about Kubernetes I learned from a Raspberry Pi cluster

•

3 gefällt mir•726 views

This document discusses running Kubernetes and Drupal 8 on a cluster of Raspberry Pis. It begins by asking how well Kubernetes can run on a cluster of small, credit-card sized computers like Raspberry Pis. It then provides a brief overview of what Kubernetes is and how it manages applications and services running on multiple servers. The document goes on to describe a demo of running Kubernetes and Drupal 8 on a Raspberry Pi cluster and notes it was about 20-50% slower than a single MacBook Pro. It closes by discussing some challenges of using a Raspberry Pi cluster with Kubernetes and points to additional resources on the topic.

Software

Everything I know about
Kubernetes I learned from
a cluster of Raspberry Pis
Jeff Geerling, Senior Technical Architect @ Acquia
(geerlingguy)

http://www.shockinglydelicious.com/dorothys-fresh-raspberry-pie-recipe/

The Big Question
What can I do with my 
Raspberry Pi?

The Big Question
How well does Kubernetes run on a
cluster of credit-card sized computers?

The Big Question
How well does Drupal 8 run on Kubernetes
on a cluster of credit-card sized computers?

But BEFORE all that
What the heck is Kubernetes?

You have applications and services you need to run.
Drupal
RedisMySQL
Solr
Logs
Chat
Cron
You have a bunch of servers to run them on.

Kubernetes puts things on servers
Drupal
Redis
MySQL
Solr Logs
Chat
Cron
...and makes sure they keep running.

See also:
Return of the Clustering: Kubernetes for Drupal
(from Tess Flynn / @socketwench, yesterday!)

Source: http://uncyclopedia.wikia.com/wiki/File:OMGWTFBBQ!.jpg

Problem
How do you put Kubernetes and
Drupal on a cluster of Raspberry Pis?

“Conﬁguration management for humans.”
___________
< And cows! >
-----------
^__^
(oo)_______
(__) )/
||----w |
|| ||

For comparison:
• My (single) MacBook Pro: 20-50% slower*

! Home-as-a-Datacenter
• Where will you keep the Pi?
• 🔌 Power, 🌐 Network, 🔐 Physical security
• Who will maintain the Pi?
• What happens if you get 📈 
Slashdotted/Hacker News'ed/Reddit Hugged?

! Kubernetes
• Requires more rigor: deployment, automation
• RBAC missteps can lead to major security holes 🤦
• Stateful is still not easy (storage, DBs)
• Need a dictionary 📕
• Done well, can do amazing things
• Done poorly, "failure at web scale"

Resources
• Raspberry Pi Dramble
• Drupal for Kubernetes
• Drupal Pi (Single Pi)
• Ansible for DevOps
• Jeff Geerling's Blog

Weitere ähnliche Inhalte

Was ist angesagt?

Shifting security to the left with kubernetes, azure, and istio

Christian Melendez

Depending on your use cases you may need to access your databases which different patterns and technologies (CRUD+UI, batch, reactive, IoT, ...). At DataStax, the developer advocates team implements reference applications for developers. We had the chance to implement multiple approaches and can provide feedback. KillrVideo.com is one of this application, it has been written in 3 languages (Java, C# and Node) and implement API with REST, Grpc and GraphQL. Though live session, browsing real code, you will see implementation details, lessons learnt and get working source code in Github as takeaway.

Create API for your Databases

Cédrick Lunven

It’s hard to imagine a modern developer workflow without a sufficiently advanced build system: Make, Gradle, Maven, Rake, and many others. In this talk, we’ll discuss the evolution of build systems that leads to distributed build systems, like Google's BuildRabbit. Then, we’ll dive into how we can build a scalable system that is fast and resilient, with examples from Google. We’ll conclude with the discussion of general challenges of migrating systems from one architecture to another.

Building a Distributed Build System at Google Scale

Aysylu Greenberg

Kuberenetes SIG Jenkins

albertoariasmaestro

Fine Tuning Your GitHub Flow

Stefan Stölzle

Debug and Monitor Multi-container Apps on AKS

Nilesh Gule

GitHub Actions demo with mabl

Bertold Kolics

Comandos - Evento - Virtual Lab Despliegue de aplicaciones en Kubernetes

Julio Pari

There are many options to build and deploy machine learning models to production at scale. We’ll walk through the growing suite of tools to centralize model building and deployment at scale, with technologies like Kubeflow, Seldon and TensorRT. Finally, we’ll address techniques for monitoring these new services. You’ll walk away with an understanding of a complete development lifecycle for scalable machine learning services.

Build and Monitor Machine Learning Services in Kubernetes

KP Kaiser

Is Docker the answer to the Stack x Platform x Cloud explosion thats engulfed the Enterprise? Is IaaS really the right model? or just the one that worked? Has PaaS’s time finally arrived. Can Docker make OS, library, stack choices irrelevant to hosting and Ops? This talk looks at how Pearson is investigating and moving towards Docker, what we’ve learned so far, and what you can learn from our experiences.

Removing Environmental Differences - Simon Pearson

Outlyer

Distributed tracing for Node.js

Nikolay Stoitsev

Automating Aegir Platform builds with Git; Fabric; and Drush

Iain Houston

Earlier this month, I spoke at ContainerDays, part of the excellent DevOpsDays series of conferences -- this one in lovely Portland, Oregon. I gave a live demo of Kubernetes running directly on bare metal. I was running it on an 11-node Ubuntu Orange Box -- but I used the exact same tools Canonical's world class consulting team uses to deploy Kubernetes onto racks of physical machines. You see, the ability to run Kubernetes on bare metal, behind your firewall is essential to the yin-yang duality of Cloud Native computing. Sometimes, what you need is actually a Native Cloud. Deploying Kubernetes into virtual machines in the cloud is rather easy, straightforward, with dozens of tools now that can handle that. But there's only one tool today, that can deploy the exact same Kubernetes to AWS, Azure, GCE, as well as VMware, OpenStack, and bare metal machines. That tools is conjure-up, which acts as a command line front end to several essential Ubuntu tools: MAAS, LXD, and Juju. I don't know if the presentation was recorded, but I'm happy to share with you my slides for download, and embedded here below. There are a few screenshots within that help convey the demo.

Bare Metal Kubernetes - More Containers, Less Overhead

Dustin Kirkland

In this talk we look at the challenges of taking docker and using it as the basis for a cloud platform. We highlight the work done by one of our own Cloudsoft engineers Andrea Turli who has contributed an Apache jclouds provider for Docker and integrated this with the open source project Brooklyn. Andrea has written about this in a recent blog post AMP for Docker and so using this as a starting point we show how we are building on this to create a lightweight dynamic Docker cloud and compare and contrast this with work we are doing with our latest partner Waratek to help them create a similar lightweight dynamic Java cloud using their Java application container technology.

Amplifying Docker - Alex Heneveld 

Outlyer

CI/CD with GitHub Actions

Swaminathan Vetri

Day 2 Kubernetes - Tools for Operability (QConSF)

bridgetkromhout

Jenkins X - automated CI/CD solution for cloud native applications on Kubernetes

Ted Won

CI CD with Docker and Kubernetes

Nilesh Gule

GitHub Actions is a great addition to the GitHub toolchain, but what can you use them for beyond building the code in your GitHub repository? In this session Morten Christensen (https://twitter.com/sitereactor), dive into what a GitHub Action actually is and how it can be used through examples and demos. We will have a look at workflows related to Continuous Integration / Continuous Deployment and open source projects - and finally we will look at how you can extend your workflows with your own Actions. By the end of this session you should have a good idea of how you can utilize GitHub Actions and Workflows to automate anything and everything related to your GitHub repository. So expect to see a lot of YAML :)

Github in Action

Morten Christensen

Slides from my 2019 PyGotham talk. “The Clock” is a 2010 art installation by Christian Marclay. It is an experimental film that features over 12,000 individual shots of clocks from movies and television, edited in such a way that the film itself functions as a clock. In this talk, we’ll use modern machine learning models and video web scraping to recreate the concept behind “The Clock”. We’ll use Kubernetes to orchestrate building a modern video scraper, capable of getting around the walls of YouTube and Instagram to grab user content.

Recreating "The Clock" with Machine Learning and Web Scraping

KP Kaiser

Was ist angesagt? (20)

Shifting security to the left with kubernetes, azure, and istio

Create API for your Databases

Building a Distributed Build System at Google Scale

Kuberenetes SIG Jenkins

Fine Tuning Your GitHub Flow

Debug and Monitor Multi-container Apps on AKS

GitHub Actions demo with mabl

Comandos - Evento - Virtual Lab Despliegue de aplicaciones en Kubernetes

Build and Monitor Machine Learning Services in Kubernetes

Removing Environmental Differences - Simon Pearson

Distributed tracing for Node.js

Automating Aegir Platform builds with Git; Fabric; and Drush

Bare Metal Kubernetes - More Containers, Less Overhead

Amplifying Docker - Alex Heneveld 

CI/CD with GitHub Actions

Day 2 Kubernetes - Tools for Operability (QConSF)

Jenkins X - automated CI/CD solution for cloud native applications on Kubernetes

CI CD with Docker and Kubernetes

Github in Action

Recreating "The Clock" with Machine Learning and Web Scraping

Ähnlich wie Everything I know about Kubernetes I learned from a Raspberry Pi cluster

Docker containers & the Future of Drupal testing

Ricardo Amaro

DevOps is gericht op het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen. Om dit te realiseren staan het automatiseren van het 'software delivery process' en de bijhorende infrastructurele veranderingen centraal. Door de opkomst van 'Microservice Architecture' neemt het belang hiervan nog verder toe.

Docker and Cloud - Enables for DevOps - by ACA-IT

Stijn Wijndaele

Sprekers: Stijn Van den Enden & Stijn Wijndaele (ACA IT-Solutions) DevOps is gericht op het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen. Om dit te realiseren staan het automatiseren van het 'software delivery process' en de bijhorende infrastructurele veranderingen centraal. Door de opkomst van 'Microservice Architecture' neemt het belang hiervan nog verder toe. In deze avondconferentie werd, na een korte toelichting over DevOps, nagegaan wat Docker en de Cloud kunnen betekenen voor uw business, en hoe zij als enablers kunnen dienen voor het tot stand brengen van een DevOps-cultuur. Het container-landschap waarvan tools zoals Kubernetes, Docker Swarm, ...een belangrijk onderdeel vormen, wordt toegelicht en er wordt ingegaan op de wijze waarop deze tools aangewend kunnen worden om 'development' en 'operations' efficiënt te laten samenwerken.

'DOCKER' & CLOUD: ENABLERS For DEVOPS

ACA IT-Solutions

You’ve got kubernetes up and running, and you’re ready for it to change your life! But, all you see now is a blinking cursor. What do you do now?! This talk explains what cloud native development is, how kubernetes supports it, and give you a toolkit to start planning for how you’ll use kubernetes to improve the way your organization builds, runs, and manages your software. Drawing on case studies, you’ll get a brief introduction to what kubernetes is from a developer’s perspective and then guidance on how to use kubernetes as the basis for your organization’s development stack. Large organizations that are managing and modernizing thousands of applications are planning out their new application platform, likely to be used for the next decade. This talk covers how to start planning for that platform: 1. Understanding what kubernetes does and what you’ll need to add on. 2. Planning for large scale app modernization, like the 2,000+ apps at AirFrance-KLM. 3. Meatware re-platforming – to take advantage of your new platform, like The Home Depot & Daimler, you’ll need to change how you work. After this talk, you’ll have a better idea of what to do next once you’re faced with the blinking cursor.

stackconf 2020 | The blinking cursor or kubernetes for people who aren´t supp...

NETWAYS

6 Steps Functionality Hacks To Kubernetes - 2023 Update.pdf

Mars Devs

[RUHR] DRPSL- Drupal on kubernetes in production. What should you do_know_.pdf

Frederik Wouters

Kubernetes and CNCF Landscape 101

Giulio Roggero

DevOps with Kubernetes and Helm - Jenkins World Edition

Jessica Deen

Virtualization and containers

Douglas Landgraf

Kubernetes up running

CeoTranDang

DevOps with Kubernetes and Helm - OSCON 2018

Jessica Deen

Presented by Drew Malone, Staff Solutions Engineer Tanzu Federal VMware at Kubernetes Community Days, Washington DC, September 14, 2022 What do US Government Users Say About Kubernetes? ● Complex to manage Day Two Operations ● Disconnected Environments from Day One ● Need capability both in the cloud and at the edge (various meanings) ● Developer Experience is Lacking because of the complexity ● Ton of Hype about Kubernetes but Commanders and CIO’s want outcomes ● Everyone talks about installing and securing Kubernetes, but rarely do we see Developers pushing apps to production on kubernetes Standing up Airgapped Kubernetes is Hard Securing, Operating and Pushing Code to k8s is even Harder

Successful K8S Platforms in Airgapped Environments

KubernetesCommunityD

Global Azure Bootcamp: Container, Docker & Kubernetes Basics

Nico Meisenzahl

This 2nd version of the last year workshop will shed light on a modern solution to solve application portability, building, delivery, packaging, and system dependency issues. Containers especially Docker have seen accelerated adoption in the web, cloud and recently the enterprise. HPC environments are seeing something similar to the introduction of HPC containers Singularity and Shifter. They provide a good use case for solving software portability, not to mention ensure repeatability of results. Not to mention their ECO system provides for the better development, delivery, testing workflows that were alien to most of HPC environments. This workshop will cover the Theory and hands-on of containers and Its ecosystem. Introducing Docker and singularity containers; Docker as a general-purpose container for almost any app, Singularity as the particular container technology for HPC. The workshop will go over the foundations of the containers platform, including an overview of the platform system components: images, containers, repositories, clustering, and orchestration. The strategy is to demonstrate through "live demo, and hands-on exercises." The reuse case of containers in building a portable distributed application cluster running a variety of workloads including HPC workload.

Containers - Portable, repeatable user-oriented application delivery. Build, ...

Walid Shaari

Kubernetes day 2 Operations

Paul Czarkowski

A hands-on workshop will go over the foundations of the containers platform, including an overview of the platform system components: images, containers, repositories, clustering, and orchestration. The strategy is to demonstrate through "live demo, and hands-on exercises." The reuse case of containers in building a portable distributed application cluster running a variety of workloads including HPC workload.

Bahrain ch9 introduction to docker 5th birthday

Walid Shaari

Infrastructure design for Kubernetes

Guillaume Morini

Democratizing Data Science on Kubernetes

John Archer

If you were not at the GitLab Commit conferences in New York and London, here’s an opportunity to attend our popular talk on using chaos engineering in Gitlab pipelines for faster hardening. As cloud native applications are coming to life faster than anyone could have imagined, the explosion of microservices empowers developers while also making it increasingly difficult to build pipelines that validate changes outside of their (or their SREs') control. Chaos engineering has emerged as a way to introduce faults into systems to increase their resiliency and Litmus, part of OpenEBS Enterprise Platform, can shake out a lot of bugs. We are also glad to announce that OpenEBS 1.3 has been released and we will review the new features added.

Use GitLab with Chaos Engineering to Harden your Applications + OpenEBS 1.3 ...

MayaData Inc

Kubernetes at Google Cloud Community Copenhagen

Kevin Simper

Ähnlich wie Everything I know about Kubernetes I learned from a Raspberry Pi cluster (20)

Docker containers & the Future of Drupal testing

Docker and Cloud - Enables for DevOps - by ACA-IT

'DOCKER' & CLOUD: ENABLERS For DEVOPS

stackconf 2020 | The blinking cursor or kubernetes for people who aren´t supp...

6 Steps Functionality Hacks To Kubernetes - 2023 Update.pdf

[RUHR] DRPSL- Drupal on kubernetes in production. What should you do_know_.pdf

Kubernetes and CNCF Landscape 101

DevOps with Kubernetes and Helm - Jenkins World Edition

Virtualization and containers

Kubernetes up running

DevOps with Kubernetes and Helm - OSCON 2018

Successful K8S Platforms in Airgapped Environments

Global Azure Bootcamp: Container, Docker & Kubernetes Basics

Containers - Portable, repeatable user-oriented application delivery. Build, ...

Kubernetes day 2 Operations

Bahrain ch9 introduction to docker 5th birthday

Infrastructure design for Kubernetes

Democratizing Data Science on Kubernetes

Use GitLab with Chaos Engineering to Harden your Applications + OpenEBS 1.3 ...

Kubernetes at Google Cloud Community Copenhagen

Mehr von Jeff Geerling

The presentation uses an example and explanation from Chapter 13 in my book, Ansible for DevOps: https://www.ansiblefordevops.com Make sure you never commit a broken playbook using Molecule, Ansible, and GitHub Actions. Jeff Geerling discusses his CI workflows using GitHub Actions to manage hundreds of Ansible-based projects, including playbooks, roles, collections, and even Kubernetes Operators. Learn how Molecule makes developing and testing Ansible content easier, and how you can integrate it with GitHub Actions—or any other CI environment—for easy Ansible CI.

Continuous Testing with Molecule, Ansible, and GitHub Actions

Everything I know about Kubernetes I learned from a Raspberry Pi cluster

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Everything I know about Kubernetes I learned from a Raspberry Pi cluster

Ähnlich wie Everything I know about Kubernetes I learned from a Raspberry Pi cluster (20)

Mehr von Jeff Geerling

Mehr von Jeff Geerling (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Everything I know about Kubernetes I learned from a Raspberry Pi cluster