SlideShare ist ein Scribd-Unternehmen logo
1 von 23
Downloaden Sie, um offline zu lesen
openATTIC Technology
Overview - Ceph Management
Lenz Grimmer <lenz.grimmer@it-novum.com>
Vault Conference 2016, Raleigh (NC), USA
2
openATTIC – History / Motivation / Background
─ Development started ~5 years ago
─ Develop a free alternative to commercial / traditional
storage management systems
─ Based on Linux / OSS tools
─ Development sponsored by it-novum
─ „Traditional Storage“ and Scale-out
3
─ Modern Web UI
─ Software-Defined Storage:
RESTful API
─ Unified Storage
─ NAS (NFS, CIFS)
─ SAN (iSCSI, FC)
─ LVM, XFS, ZFS, Btrfs,
ext3/4
─ Ceph Support: CRUSH
map, Pool/RBD
management (WIP)
─ Mirroring (DRBD®)
─ Clustering
(Pacemaker/Corosync)
─ Monitoring (Nagios) built-in
─ Open Source & commercial
Support
openATTIC – Open Source Storage Management
4
openATTIC Components – Backend
─ Django (Python)
─ Django REST Framework (RESTful API)
─ Various Linux tools for storage management, e.g. LVM, LIO,
filesystem utilities, DRBD, etc.
─ Nagios/Icinga & PNP4Nagios (Monitoring and Graphing)
5
openATTIC Components – Frontend
─ AngularJS (JS framework)
─ Bootstrap (HTML, CSS, and JS framework)
─ Uses REST API exclusively
─ Bower (JS package manager, NodeJS)
─ Grunt (Automation, NodeJS)
─ Protractor / Jasmine (UI Test framework)
6
Django REST
Framework
Backend/Models
(Django)
 Client (GUI)
oA-systemd
REST API
D-Bus
Node 1
OS Commands
Django REST
Framework
Backend/Models
(Django)
 Custom App
oA-systemd
REST API
D-Bus
Node 2
OS Commands
Multinode
Interconnect
openATTIC – Architecture

DB
(PostgreSQL)
7
openATTIC – Ceph Management Challenges
─ How to find the best approach for managing Ceph
─ An ISV‘s view
─ Distributed systems vs. storing configuration data in a local
database
─ Allow external modifications / administration of the Cluster
─ How to maintain consistency of a local configuration DB?
8
openATTIC – Choosing the right Ceph API
─ Option 1: Calling CLI tools and parsing output (JSON-
format)
─ Option 2: Use existing APIs and libs, e.g.
─ librados (Python bindings)
─ Ceph-REST-API
─ Calamari Server
─ API documentation
─ Redundancy / Scalability / Dependencies
─ Which is the best choice?
9
openATTIC – Other Ceph Management Tools
─ How are others doing this?
─ Calamari Server / Romana
─ Intel VSM
─ Inkscope / Kraken / Ceph-Dash
10
openATTIC - Ceph Management Implementation
─ Based on librados Python bindings
─ Low overhead
─ Implemented “NoDB” Django Models
─ All benefits of Django models (e.g. relations, methods, pagination)
─ REST API viewsets
─ Query Ceph for the model state instead of local DB
─ Use Salt for remote execution on nodes
11
Django REST
Framework
Django Models
 Client (GUI)
REST API
openATTIC – “nodb” Django models
DB
(PostgreSQL)
nodb
Python librados django.db.models
12
openATTIC - Current Development Status
─ “Nodb” Architecture / Framework in place
─ Pool Management REST API
─ List Pools, view Pool details
─ Create/Delete/Update (WIP)
─ Pool Management Web UI (table view)
13
openATTIC – Future/ongoing Development Work
─ Ceph Cluster Status Dashboard
─ Extend Pool Management (Wizard)
─ OSD Monitoring/Management
─ RBD Management
─ CephFS Management
─ RGW Management (users, buckets keys)
14
openATTIC – Dashboard
15
openATTIC – Ceph Pool List
16
openATTIC – Ceph CRUSH map editing
17
openATTIC – Wizards
18
openATTIC - Volume View
19
openATTIC - Volume View (Performance)
20
openATTIC – API Recorder
21
 www.openattic.org
 demo.openattic.org
 blog.openattic.org
 docs.openattic.org
 bitbucket.org/openattic
 tracker.openattic.org
 @openATTIC
 openATTIC
openATTIC – Resources
22
Questions / Discussion
23
Thank you!

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (19)

openATTIC Ceph Management @ OpenSuse Con - 2016-06-23
openATTIC Ceph Management @ OpenSuse Con - 2016-06-23openATTIC Ceph Management @ OpenSuse Con - 2016-06-23
openATTIC Ceph Management @ OpenSuse Con - 2016-06-23
 
Cache Tiering and Erasure Coding
Cache Tiering and Erasure CodingCache Tiering and Erasure Coding
Cache Tiering and Erasure Coding
 
Ceph Management and Monitoring with Dashboard V2 - Cephalocon 2018-03-23
Ceph Management and Monitoring with Dashboard V2 - Cephalocon 2018-03-23Ceph Management and Monitoring with Dashboard V2 - Cephalocon 2018-03-23
Ceph Management and Monitoring with Dashboard V2 - Cephalocon 2018-03-23
 
Ceph meetup montreal
Ceph meetup montrealCeph meetup montreal
Ceph meetup montreal
 
Integrating gluster fs,_qemu_and_ovirt-vijay_bellur-linuxcon_eu_2013
Integrating gluster fs,_qemu_and_ovirt-vijay_bellur-linuxcon_eu_2013Integrating gluster fs,_qemu_and_ovirt-vijay_bellur-linuxcon_eu_2013
Integrating gluster fs,_qemu_and_ovirt-vijay_bellur-linuxcon_eu_2013
 
Red Hat Gluster Storage, Container Storage and CephFS Plans
Red Hat Gluster Storage, Container Storage and CephFS PlansRed Hat Gluster Storage, Container Storage and CephFS Plans
Red Hat Gluster Storage, Container Storage and CephFS Plans
 
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vos
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vosOSBConf 2015 | Scale out backups with bareos and gluster by niels de vos
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vos
 
GlusterD 2.0 - Managing Distributed File System Using a Centralized Store
GlusterD 2.0 - Managing Distributed File System Using a Centralized StoreGlusterD 2.0 - Managing Distributed File System Using a Centralized Store
GlusterD 2.0 - Managing Distributed File System Using a Centralized Store
 
Gluster d thread_synchronization_using_urcu_lca2016
Gluster d thread_synchronization_using_urcu_lca2016Gluster d thread_synchronization_using_urcu_lca2016
Gluster d thread_synchronization_using_urcu_lca2016
 
State of the_gluster_-_lceu
State of the_gluster_-_lceuState of the_gluster_-_lceu
State of the_gluster_-_lceu
 
Ceph Management and Monitoring with Dashboard v2 - Lenz Grimmer
Ceph Management and Monitoring with Dashboard v2 - Lenz GrimmerCeph Management and Monitoring with Dashboard v2 - Lenz Grimmer
Ceph Management and Monitoring with Dashboard v2 - Lenz Grimmer
 
Cncf meetup-rook
Cncf meetup-rookCncf meetup-rook
Cncf meetup-rook
 
Sdc 2012-challenges
Sdc 2012-challengesSdc 2012-challenges
Sdc 2012-challenges
 
Cncf meetup-rook
Cncf meetup-rookCncf meetup-rook
Cncf meetup-rook
 
Gluster for sysadmins
Gluster for sysadminsGluster for sysadmins
Gluster for sysadmins
 
A First Look at HPCC Systems 7.0, Innovation in Action
A First Look at HPCC Systems 7.0, Innovation in ActionA First Look at HPCC Systems 7.0, Innovation in Action
A First Look at HPCC Systems 7.0, Innovation in Action
 
Accessing gluster ufo_-_eco_willson
Accessing gluster ufo_-_eco_willsonAccessing gluster ufo_-_eco_willson
Accessing gluster ufo_-_eco_willson
 
Gluster technical overview
Gluster technical overviewGluster technical overview
Gluster technical overview
 
Everything you wanted to know about RadosGW - Orit Wasserman, Matt Benjamin
Everything you wanted to know about RadosGW - Orit Wasserman, Matt BenjaminEverything you wanted to know about RadosGW - Orit Wasserman, Matt Benjamin
Everything you wanted to know about RadosGW - Orit Wasserman, Matt Benjamin
 

Ähnlich wie openATTIC Technology Overview - Ceph Management

OpenNaaS Overview Complete
OpenNaaS Overview CompleteOpenNaaS Overview Complete
OpenNaaS Overview Complete
Joan Garcia
 
Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development
Ceph Community
 

Ähnlich wie openATTIC Technology Overview - Ceph Management (20)

Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07
Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07
Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07
 
openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23
openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23
openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23
 
IPMI is dead, Long live Redfish
IPMI is dead, Long live RedfishIPMI is dead, Long live Redfish
IPMI is dead, Long live Redfish
 
OpenNaaS Overview Complete
OpenNaaS Overview CompleteOpenNaaS Overview Complete
OpenNaaS Overview Complete
 
The State of Ceph, Manila, and Containers in OpenStack
The State of Ceph, Manila, and Containers in OpenStackThe State of Ceph, Manila, and Containers in OpenStack
The State of Ceph, Manila, and Containers in OpenStack
 
Ceph management and monitoring with openATTIC 3.x
Ceph management and monitoring with openATTIC 3.x Ceph management and monitoring with openATTIC 3.x
Ceph management and monitoring with openATTIC 3.x
 
Ceph Day Bring Ceph To Enterprise
Ceph Day Bring Ceph To EnterpriseCeph Day Bring Ceph To Enterprise
Ceph Day Bring Ceph To Enterprise
 
NFVO based on ManageIQ - OPNFV Summit 2016 Demo
NFVO based on ManageIQ - OPNFV Summit 2016 DemoNFVO based on ManageIQ - OPNFV Summit 2016 Demo
NFVO based on ManageIQ - OPNFV Summit 2016 Demo
 
LSC@LDAPCon 2011
LSC@LDAPCon 2011LSC@LDAPCon 2011
LSC@LDAPCon 2011
 
Post-relational databases: What's wrong with web development? v3
Post-relational databases: What's wrong with web development? v3Post-relational databases: What's wrong with web development? v3
Post-relational databases: What's wrong with web development? v3
 
Stories from running Kafka on K8S.pdf
Stories from running Kafka on K8S.pdfStories from running Kafka on K8S.pdf
Stories from running Kafka on K8S.pdf
 
Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development
 
Ceph Day Taipei - Bring Ceph to Enterprise
Ceph Day Taipei - Bring Ceph to EnterpriseCeph Day Taipei - Bring Ceph to Enterprise
Ceph Day Taipei - Bring Ceph to Enterprise
 
SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration)
SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration) SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration)
SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration)
 
Installation of LAMP Server with Ubuntu 14.10 Server Edition
Installation of LAMP Server with Ubuntu 14.10 Server EditionInstallation of LAMP Server with Ubuntu 14.10 Server Edition
Installation of LAMP Server with Ubuntu 14.10 Server Edition
 
Linux High Availability Overview - openSUSE.Asia Summit 2015
Linux High Availability Overview - openSUSE.Asia Summit 2015 Linux High Availability Overview - openSUSE.Asia Summit 2015
Linux High Availability Overview - openSUSE.Asia Summit 2015
 
"In love with Open Source : Past, Present and Future" : Keynote OSDConf 2014
"In love with Open Source : Past, Present and Future" : Keynote OSDConf 2014"In love with Open Source : Past, Present and Future" : Keynote OSDConf 2014
"In love with Open Source : Past, Present and Future" : Keynote OSDConf 2014
 
Ceph Day Tokyo - Bring Ceph to Enterprise
Ceph Day Tokyo - Bring Ceph to Enterprise Ceph Day Tokyo - Bring Ceph to Enterprise
Ceph Day Tokyo - Bring Ceph to Enterprise
 
Introduction to the Helium release of OpenDaylight
Introduction to the Helium release of OpenDaylightIntroduction to the Helium release of OpenDaylight
Introduction to the Helium release of OpenDaylight
 
How do async ap is survive in a rest world
How do async ap is survive in a rest world How do async ap is survive in a rest world
How do async ap is survive in a rest world
 

Mehr von it-novum

130213 itn webcast_sap
130213 itn webcast_sap130213 itn webcast_sap
130213 itn webcast_sap
it-novum
 

Mehr von it-novum (8)

Tweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnen
Tweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnenTweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnen
Tweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnen
 
Flexible storage management with Linux and openATTIC
Flexible storage management with Linux and openATTICFlexible storage management with Linux and openATTIC
Flexible storage management with Linux and openATTIC
 
The evolution of storage on Linux
The evolution of storage on Linux The evolution of storage on Linux
The evolution of storage on Linux
 
Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015
Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015
Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015
 
Open Cloud Storage @ OpenStack Summit Paris
Open Cloud Storage @ OpenStack Summit ParisOpen Cloud Storage @ OpenStack Summit Paris
Open Cloud Storage @ OpenStack Summit Paris
 
OpenStack Day Italy: openATTC as an open storage platform for OpenStack
OpenStack Day Italy: openATTC as an open storage platform for OpenStackOpenStack Day Italy: openATTC as an open storage platform for OpenStack
OpenStack Day Italy: openATTC as an open storage platform for OpenStack
 
Building an open source cloud storage platform for OpenStack - openATTIC
Building an open source cloud storage platform for OpenStack - openATTICBuilding an open source cloud storage platform for OpenStack - openATTIC
Building an open source cloud storage platform for OpenStack - openATTIC
 
130213 itn webcast_sap
130213 itn webcast_sap130213 itn webcast_sap
130213 itn webcast_sap
 

Kürzlich hochgeladen

Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
nirzagarg
 
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
nirzagarg
 
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
ranjankumarbehera14
 
Computer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdfComputer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdf
SayantanBiswas37
 
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
nirzagarg
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
gajnagarg
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
gajnagarg
 
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
gajnagarg
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
wsppdmt
 
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Bertram Ludäscher
 

Kürzlich hochgeladen (20)

Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
 
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
 
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
 
Computer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdfComputer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdf
 
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
 
Gulbai Tekra * Cheap Call Girls In Ahmedabad Phone No 8005736733 Elite Escort...
Gulbai Tekra * Cheap Call Girls In Ahmedabad Phone No 8005736733 Elite Escort...Gulbai Tekra * Cheap Call Girls In Ahmedabad Phone No 8005736733 Elite Escort...
Gulbai Tekra * Cheap Call Girls In Ahmedabad Phone No 8005736733 Elite Escort...
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
 
Digital Transformation Playbook by Graham Ware
Digital Transformation Playbook by Graham WareDigital Transformation Playbook by Graham Ware
Digital Transformation Playbook by Graham Ware
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
 
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
 
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
 
Top Call Girls in Balaghat 9332606886Call Girls Advance Cash On Delivery Ser...
Top Call Girls in Balaghat  9332606886Call Girls Advance Cash On Delivery Ser...Top Call Girls in Balaghat  9332606886Call Girls Advance Cash On Delivery Ser...
Top Call Girls in Balaghat 9332606886Call Girls Advance Cash On Delivery Ser...
 
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
Gomti Nagar & best call girls in Lucknow | 9548273370 Independent Escorts & D...
 
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
 
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - Almora
 
20240412-SmartCityIndex-2024-Full-Report.pdf
20240412-SmartCityIndex-2024-Full-Report.pdf20240412-SmartCityIndex-2024-Full-Report.pdf
20240412-SmartCityIndex-2024-Full-Report.pdf
 

openATTIC Technology Overview - Ceph Management

  • 1. openATTIC Technology Overview - Ceph Management Lenz Grimmer <lenz.grimmer@it-novum.com> Vault Conference 2016, Raleigh (NC), USA
  • 2. 2 openATTIC – History / Motivation / Background ─ Development started ~5 years ago ─ Develop a free alternative to commercial / traditional storage management systems ─ Based on Linux / OSS tools ─ Development sponsored by it-novum ─ „Traditional Storage“ and Scale-out
  • 3. 3 ─ Modern Web UI ─ Software-Defined Storage: RESTful API ─ Unified Storage ─ NAS (NFS, CIFS) ─ SAN (iSCSI, FC) ─ LVM, XFS, ZFS, Btrfs, ext3/4 ─ Ceph Support: CRUSH map, Pool/RBD management (WIP) ─ Mirroring (DRBD®) ─ Clustering (Pacemaker/Corosync) ─ Monitoring (Nagios) built-in ─ Open Source & commercial Support openATTIC – Open Source Storage Management
  • 4. 4 openATTIC Components – Backend ─ Django (Python) ─ Django REST Framework (RESTful API) ─ Various Linux tools for storage management, e.g. LVM, LIO, filesystem utilities, DRBD, etc. ─ Nagios/Icinga & PNP4Nagios (Monitoring and Graphing)
  • 5. 5 openATTIC Components – Frontend ─ AngularJS (JS framework) ─ Bootstrap (HTML, CSS, and JS framework) ─ Uses REST API exclusively ─ Bower (JS package manager, NodeJS) ─ Grunt (Automation, NodeJS) ─ Protractor / Jasmine (UI Test framework)
  • 6. 6 Django REST Framework Backend/Models (Django)  Client (GUI) oA-systemd REST API D-Bus Node 1 OS Commands Django REST Framework Backend/Models (Django)  Custom App oA-systemd REST API D-Bus Node 2 OS Commands Multinode Interconnect openATTIC – Architecture  DB (PostgreSQL)
  • 7. 7 openATTIC – Ceph Management Challenges ─ How to find the best approach for managing Ceph ─ An ISV‘s view ─ Distributed systems vs. storing configuration data in a local database ─ Allow external modifications / administration of the Cluster ─ How to maintain consistency of a local configuration DB?
  • 8. 8 openATTIC – Choosing the right Ceph API ─ Option 1: Calling CLI tools and parsing output (JSON- format) ─ Option 2: Use existing APIs and libs, e.g. ─ librados (Python bindings) ─ Ceph-REST-API ─ Calamari Server ─ API documentation ─ Redundancy / Scalability / Dependencies ─ Which is the best choice?
  • 9. 9 openATTIC – Other Ceph Management Tools ─ How are others doing this? ─ Calamari Server / Romana ─ Intel VSM ─ Inkscope / Kraken / Ceph-Dash
  • 10. 10 openATTIC - Ceph Management Implementation ─ Based on librados Python bindings ─ Low overhead ─ Implemented “NoDB” Django Models ─ All benefits of Django models (e.g. relations, methods, pagination) ─ REST API viewsets ─ Query Ceph for the model state instead of local DB ─ Use Salt for remote execution on nodes
  • 11. 11 Django REST Framework Django Models  Client (GUI) REST API openATTIC – “nodb” Django models DB (PostgreSQL) nodb Python librados django.db.models
  • 12. 12 openATTIC - Current Development Status ─ “Nodb” Architecture / Framework in place ─ Pool Management REST API ─ List Pools, view Pool details ─ Create/Delete/Update (WIP) ─ Pool Management Web UI (table view)
  • 13. 13 openATTIC – Future/ongoing Development Work ─ Ceph Cluster Status Dashboard ─ Extend Pool Management (Wizard) ─ OSD Monitoring/Management ─ RBD Management ─ CephFS Management ─ RGW Management (users, buckets keys)
  • 16. 16 openATTIC – Ceph CRUSH map editing
  • 19. 19 openATTIC - Volume View (Performance)
  • 21. 21  www.openattic.org  demo.openattic.org  blog.openattic.org  docs.openattic.org  bitbucket.org/openattic  tracker.openattic.org  @openATTIC  openATTIC openATTIC – Resources