Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.
DevOps by Example
31.01.2018
DaemonSets and MFS on GKE - simple
implementation of distributed storage on
Kubernetes
Piotr Kowalczyk
Introduction (1)
Who am I? What is Neptune?
● Neptune is a Machine Learning Lab provided as a service for data scientists
...
Introduction (2)
AGENDA
● Very brief history of automation (what is this all about)
○ We want to have a perspective during...
Little bit of history (1)
● At the beginning… there was only SSH (no automation here).
● Then, fabric came out (it still e...
Little bit of history (2)
Then kubernetes came out and the old world and our favorite tools
became (almost) useless…
...ag...
The actual problem
● Storage is hard
● Distributed storage is even harder
● Distributed storage with distributed computing...
Moosefs storage
MooseFS is a Fault-tolerant, Highly available, Highly performing, Scaling-out,
Network distributed file sy...
Moosefs and Kubernetes
Prerequisites (not covered here):
● Working Kubernetes Cluster
● Moosefs cluster already set up
● A...
Thank you!
Piotr.Kowalczyk@neptune.ml
https://github.com/poeyashi/moosefs-kubernetes
https://neptune.ml
DevOps by Example
31.01.2018
Thanks!
Nächste SlideShare
Wird geladen in …5
×

CodiLime Tech Talk - Piotr Kowalczyk: DaemonSets and MFS on GKE - simple implementation of distributed storage on Kubernetes

76 Aufrufe

Veröffentlicht am

Tech Talk CodiLime 31.01.2018 DevOps by Example

Piotr Kowalczyk: DaemonSets and MFS on GKE - simple implementation of distributed storage on Kubernetes

You can find the recording here: https://youtu.be/Ev1b4pNfxnc

Veröffentlicht in: Technologie
  • Als Erste(r) kommentieren

CodiLime Tech Talk - Piotr Kowalczyk: DaemonSets and MFS on GKE - simple implementation of distributed storage on Kubernetes

  1. 1. DevOps by Example 31.01.2018
  2. 2. DaemonSets and MFS on GKE - simple implementation of distributed storage on Kubernetes Piotr Kowalczyk
  3. 3. Introduction (1) Who am I? What is Neptune? ● Neptune is a Machine Learning Lab provided as a service for data scientists to speed-up the development and productization of machine learning models. ● Try it at https://neptune.ml - get free 100$ for your experiments!
  4. 4. Introduction (2) AGENDA ● Very brief history of automation (what is this all about) ○ We want to have a perspective during DEMO ○ See how it was back then and how is it now ● Few words about Moosefs & Kubernetes ● Short DEMO (best part!)
  5. 5. Little bit of history (1) ● At the beginning… there was only SSH (no automation here). ● Then, fabric came out (it still exists). ● Then tools like Puppet, Chef, Ansible, Saltstack and so on started to be popular… ● { and Docker of course } ...and the world become a bit better.
  6. 6. Little bit of history (2) Then kubernetes came out and the old world and our favorite tools became (almost) useless… ...again.
  7. 7. The actual problem ● Storage is hard ● Distributed storage is even harder ● Distributed storage with distributed computing is way harder So Let’s Try to Make Things Simple. * DISCLAIMER: We’re not using cloud managed services here.
  8. 8. Moosefs storage MooseFS is a Fault-tolerant, Highly available, Highly performing, Scaling-out, Network distributed file system. It spreads data over several physical commodity servers, which are visible to the user as one virtual disk. It is POSIX compliant and acts like any other Unix-like file system. The bottom line: ● Very simple to set up and use ● POSIX compliant ● Supports multiple RW mounts ● It usually… just works. :)
  9. 9. Moosefs and Kubernetes Prerequisites (not covered here): ● Working Kubernetes Cluster ● Moosefs cluster already set up ● All sources: https://github.com/poeyashi/moosefs-kubernetes DEMO TIME
  10. 10. Thank you! Piotr.Kowalczyk@neptune.ml https://github.com/poeyashi/moosefs-kubernetes https://neptune.ml
  11. 11. DevOps by Example 31.01.2018 Thanks!

×