SlideShare ist ein Scribd-Unternehmen logo
1 von 16
Downloaden Sie, um offline zu lesen
KIDS
ON
THE
BLOCK
NEW
THE
presented by mike perez
MIKE
PEREZ
senior developer for DreamHost
cinder core developer
WHAT
http://www.flickr.com/photos/neilhinchley/294337822/
• project exists since Folsom
release, spun off Nova-volume
• cinder manages block storage
• not object storage
• not file level storage
• volumes attach toVM Instances
• boot from volume
• volumes have a lifecycle
independent ofVM instance
VOLUME
TYPES•Admin can create tiers of storage. e.g. two LVM
backends, one with SSD’s and the other with HDD’s.
•Users can specify a tier they want when creating a
volume.
ARCHITECTURAL
OVERVIEW
Cinder Client
Cinder API
CinderVolume Cinder BackupCinder Scheduler
SQL DB
AMPQAMPQ
AMPQ
CINDER
API
•Volume create/delete/list/show
•Create from image, snapshot
•Snapshot create/delete/list/show
•Backups create/restore/list/delete/show
•Volume attach/detach (called by Nova)
•Volume types (more later)
•Quotas
CINDER
SCHEDULER•Chooses which back-end to place a new volume on
•Configurable plugins for schedulers
•Filter scheduler has plugins for filters and weights: chance, simple and filter.
•Filter scheduler Flow Example:
•Starts with list of all back-ends
•Filters according to capabilities
•Drivers report capabilities and state (e.g., free space)
•Default filters
•Volume types
•Sorts according to weights e.g., available free space
•Returns best candidate
CINDER
VOLUME•Drivers: Called by Manager, contains back-end-specific code
to communicate with various storage types (e.g., Linux LVM,
storage controllers from various vendors, distributed file
systems, etc.)
•Admin can run multiple cinder-volume instances, each with
its own configuration file describing settings and the storage
back-end
•As of Grizzly, one cinder-volume instance can manage
multiple back-ends
•Each back-end driver is generally configured to interact with
one storage pool
•Multi-threading
CINDER
BACKUP•A backup is an archived copy of aVolume stored in a
object store.
•A backup is just the data that was written, unlike a
snapshot which is the entire block.
HIGH
LEVEL
Nova Cinder
VM Instance
LinuxVolume
Manager
KVM
ISCSI
Initiator
Legend
Persistent Volume Data
Persistent Volume Control
/dev/hda
/dev/vda
ISCSI
Initiator
ATTACH
THAT
• Nova calls Cinder via its API, passing connection information.
e.g., host name, iSCSI initiator name, FC WWPNs
• Cinder API passes message to Cinder Volume.
• Manager does initial error checking and calls volume driver.
• Volume driver does any necessary preparation to allow the connection.
e.g., give the nova host permissions to access the volume.
• Volume driver returns connection information, which is passed to Nova.
e.g., iSCSI iqn and portal, FC WWPN.
• Nova creates the connection to the storage using the returned information.
• Nova passes the volume device/file to the hypervisor.
VOLUME
THE
GRID
DRIVER
REQUIREMENTS
•Volume Create/Delete
•Volume Attach/Detach
•Snapshot Create/Delete
•CreateVolume from Snapshot
•GetVolume Stats
•Copy Image toVolume
•CopyVolume to Image
•CloneVolume
CURRENT
DRIVERS
•Coraid (AoE)
•EMCVMAX/VNX (iSCSI)
•GlusterFS (GlusterFS)
•HP 3PAR (iSCSI/FC)
•HP LeftHand (iSCSI)
•Huawei T-series/Dorado (iSCSI)
•IBM Storwize family/SVC
(iSCSI/FC)
•IBM XIV (iSCSI), LVM (iSCSI)
•NetApp (iSCSI/NFS)
•Nexenta (iSCSI)
•NFS (NFS)
•RBD (Ceph)
•Scality SOFS (scality)
•Sheepdog (sheepdog)
•Solaris (iSCSI)
•SolidFire (iSCSI)
•Windows Server 2012 (iSCSI)
•Zadara (iSCSI)
HAVANA
BOUNDGeneral Features
•Code cleanup and reorganization
•Attach volume to multiple hosts
•Read-only volumes
•Disk encryption
•FC SAN Zone / Access Control
management
•Transfer volume ownership
•Volume Migration
•Work towards locality between
instances and volumes
•State machine
•Volume rate limiting
New Drivers:
•IBM GPFS
•IBM zVM
•EMC Isilon (iSCSI)
•Local disk partitions
•Hitachi HUS (DF850) (iSCSI)
•Dell Equalogic
•Violin Memory v6000 (iSCSI)
THANK
YOU!•Get started with Cinder:
•https://wiki.openstack.org/wiki/Cinder
•Source Code:
•http://github.com/openstack/cinder
•REST API Docs:
•http://docs.openstack.org/api/openstack-block-
storage/2.0
•Thanks Avishay Traeger from IBM for letting me
copy things out of his slides.
Twitter: @thingee
IRC: thingee
email: thingee@gmail.com

Weitere ähnliche Inhalte

Was ist angesagt?

Oscon 2012 : From Datacenter to the Cloud - Featuring Xen and XCP
Oscon 2012 : From Datacenter to the Cloud - Featuring Xen and XCPOscon 2012 : From Datacenter to the Cloud - Featuring Xen and XCP
Oscon 2012 : From Datacenter to the Cloud - Featuring Xen and XCP
The Linux Foundation
 
Virtualization - Kernel Virtual Machine (KVM)
Virtualization - Kernel Virtual Machine (KVM)Virtualization - Kernel Virtual Machine (KVM)
Virtualization - Kernel Virtual Machine (KVM)
Wan Leung Wong
 
XPDS14 - Xen as High-Performance NFV Platform - Jun Nakajima, Intel
XPDS14 - Xen as High-Performance NFV Platform - Jun Nakajima, IntelXPDS14 - Xen as High-Performance NFV Platform - Jun Nakajima, Intel
XPDS14 - Xen as High-Performance NFV Platform - Jun Nakajima, Intel
The Linux Foundation
 

Was ist angesagt? (18)

Dave Gilbert - KVM and QEMU
Dave Gilbert - KVM and QEMUDave Gilbert - KVM and QEMU
Dave Gilbert - KVM and QEMU
 
LF Collaboration Summit: Xen Project 4 4 Features and Futures
LF Collaboration Summit: Xen Project 4 4 Features and FuturesLF Collaboration Summit: Xen Project 4 4 Features and Futures
LF Collaboration Summit: Xen Project 4 4 Features and Futures
 
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...
 
XPDS13: Xen on ARM Update - Stefano Stabellini, Citrix
XPDS13: Xen on ARM Update - Stefano Stabellini, CitrixXPDS13: Xen on ARM Update - Stefano Stabellini, Citrix
XPDS13: Xen on ARM Update - Stefano Stabellini, Citrix
 
Openvz booth
Openvz boothOpenvz booth
Openvz booth
 
KVM tools and enterprise usage
KVM tools and enterprise usageKVM tools and enterprise usage
KVM tools and enterprise usage
 
Nested Virtualization Update from Intel
Nested Virtualization Update from IntelNested Virtualization Update from Intel
Nested Virtualization Update from Intel
 
Xen Project: Windows PV Drivers
Xen Project: Windows PV DriversXen Project: Windows PV Drivers
Xen Project: Windows PV Drivers
 
Oscon 2012 : From Datacenter to the Cloud - Featuring Xen and XCP
Oscon 2012 : From Datacenter to the Cloud - Featuring Xen and XCPOscon 2012 : From Datacenter to the Cloud - Featuring Xen and XCP
Oscon 2012 : From Datacenter to the Cloud - Featuring Xen and XCP
 
Xenserver Networking
Xenserver NetworkingXenserver Networking
Xenserver Networking
 
LCEU13: Securing your cloud with Xen's advanced security features - George Du...
LCEU13: Securing your cloud with Xen's advanced security features - George Du...LCEU13: Securing your cloud with Xen's advanced security features - George Du...
LCEU13: Securing your cloud with Xen's advanced security features - George Du...
 
XS Boston 2008 Quantitative
XS Boston 2008 QuantitativeXS Boston 2008 Quantitative
XS Boston 2008 Quantitative
 
Xen Project for ARM Servers
Xen Project for ARM ServersXen Project for ARM Servers
Xen Project for ARM Servers
 
Virtualization - Kernel Virtual Machine (KVM)
Virtualization - Kernel Virtual Machine (KVM)Virtualization - Kernel Virtual Machine (KVM)
Virtualization - Kernel Virtual Machine (KVM)
 
The sexy world of Linux kernel pvops project
The sexy world of Linux kernel pvops projectThe sexy world of Linux kernel pvops project
The sexy world of Linux kernel pvops project
 
XPDS16: Xen Development Update
XPDS16: Xen Development UpdateXPDS16: Xen Development Update
XPDS16: Xen Development Update
 
Xen architecture q1 2008
Xen architecture q1 2008Xen architecture q1 2008
Xen architecture q1 2008
 
XPDS14 - Xen as High-Performance NFV Platform - Jun Nakajima, Intel
XPDS14 - Xen as High-Performance NFV Platform - Jun Nakajima, IntelXPDS14 - Xen as High-Performance NFV Platform - Jun Nakajima, Intel
XPDS14 - Xen as High-Performance NFV Platform - Jun Nakajima, Intel
 

Ähnlich wie Cinder: The new kids on the block

Intro to OpenStack Cinder and IceHouse Bound!
Intro to OpenStack Cinder and IceHouse Bound!Intro to OpenStack Cinder and IceHouse Bound!
Intro to OpenStack Cinder and IceHouse Bound!
thingee
 
Gordonh0945deepdive openstackcompute-140417174059-phpapp02
Gordonh0945deepdive openstackcompute-140417174059-phpapp02Gordonh0945deepdive openstackcompute-140417174059-phpapp02
Gordonh0945deepdive openstackcompute-140417174059-phpapp02
Công TÔ
 
Windows Server Containers
Windows Server ContainersWindows Server Containers
Windows Server Containers
Sri Kanth
 
Cloud stack overview
Cloud stack overviewCloud stack overview
Cloud stack overview
howie YU
 
Hacking apache cloud stack
Hacking apache cloud stackHacking apache cloud stack
Hacking apache cloud stack
Nitin Mehta
 

Ähnlich wie Cinder: The new kids on the block (20)

Intro to OpenStack Cinder and IceHouse Bound!
Intro to OpenStack Cinder and IceHouse Bound!Intro to OpenStack Cinder and IceHouse Bound!
Intro to OpenStack Cinder and IceHouse Bound!
 
OpenStack Cinder Overview - Havana Release
OpenStack Cinder Overview - Havana ReleaseOpenStack Cinder Overview - Havana Release
OpenStack Cinder Overview - Havana Release
 
Cinder havana-131111230629-phpapp02
Cinder havana-131111230629-phpapp02Cinder havana-131111230629-phpapp02
Cinder havana-131111230629-phpapp02
 
OpenStack Cinder
OpenStack CinderOpenStack Cinder
OpenStack Cinder
 
Introduction to docker
Introduction to dockerIntroduction to docker
Introduction to docker
 
User Transparent Service Migration to the Cloud
User Transparent Service Migration to the CloudUser Transparent Service Migration to the Cloud
User Transparent Service Migration to the Cloud
 
Introduction to Cinder
Introduction to CinderIntroduction to Cinder
Introduction to Cinder
 
Introduction to OpenStack Cinder
Introduction to OpenStack CinderIntroduction to OpenStack Cinder
Introduction to OpenStack Cinder
 
Open stack cinder
Open stack cinderOpen stack cinder
Open stack cinder
 
2017.06.19 Paul Woodward - ExploreVM VMware 101
2017.06.19   Paul Woodward - ExploreVM VMware 1012017.06.19   Paul Woodward - ExploreVM VMware 101
2017.06.19 Paul Woodward - ExploreVM VMware 101
 
Gordonh0945deepdive openstackcompute-140417174059-phpapp02
Gordonh0945deepdive openstackcompute-140417174059-phpapp02Gordonh0945deepdive openstackcompute-140417174059-phpapp02
Gordonh0945deepdive openstackcompute-140417174059-phpapp02
 
SCUGBE_Lowlands_Unite_2017_Managing Windows Containers with Docker
SCUGBE_Lowlands_Unite_2017_Managing Windows Containers with DockerSCUGBE_Lowlands_Unite_2017_Managing Windows Containers with Docker
SCUGBE_Lowlands_Unite_2017_Managing Windows Containers with Docker
 
WebSphere and Docker
WebSphere and DockerWebSphere and Docker
WebSphere and Docker
 
Windows Server Containers
Windows Server ContainersWindows Server Containers
Windows Server Containers
 
Cloud stack overview
Cloud stack overviewCloud stack overview
Cloud stack overview
 
Making IT Easier to Manage Your Virtualized Environment - David Babbitt, Spic...
Making IT Easier to Manage Your Virtualized Environment - David Babbitt, Spic...Making IT Easier to Manage Your Virtualized Environment - David Babbitt, Spic...
Making IT Easier to Manage Your Virtualized Environment - David Babbitt, Spic...
 
Deploying to Ubuntu on Linode
Deploying to Ubuntu on LinodeDeploying to Ubuntu on Linode
Deploying to Ubuntu on Linode
 
Presentation citrix cloud platform for infrastructure as a service
Presentation   citrix cloud platform for infrastructure as a servicePresentation   citrix cloud platform for infrastructure as a service
Presentation citrix cloud platform for infrastructure as a service
 
Hacking apache cloud stack
Hacking apache cloud stackHacking apache cloud stack
Hacking apache cloud stack
 
Instant ColdFusion with Vagrant
Instant ColdFusion with VagrantInstant ColdFusion with Vagrant
Instant ColdFusion with Vagrant
 

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 

Cinder: The new kids on the block

  • 2. MIKE PEREZ senior developer for DreamHost cinder core developer
  • 3. WHAT http://www.flickr.com/photos/neilhinchley/294337822/ • project exists since Folsom release, spun off Nova-volume • cinder manages block storage • not object storage • not file level storage • volumes attach toVM Instances • boot from volume • volumes have a lifecycle independent ofVM instance
  • 4. VOLUME TYPES•Admin can create tiers of storage. e.g. two LVM backends, one with SSD’s and the other with HDD’s. •Users can specify a tier they want when creating a volume.
  • 5. ARCHITECTURAL OVERVIEW Cinder Client Cinder API CinderVolume Cinder BackupCinder Scheduler SQL DB AMPQAMPQ AMPQ
  • 6. CINDER API •Volume create/delete/list/show •Create from image, snapshot •Snapshot create/delete/list/show •Backups create/restore/list/delete/show •Volume attach/detach (called by Nova) •Volume types (more later) •Quotas
  • 7. CINDER SCHEDULER•Chooses which back-end to place a new volume on •Configurable plugins for schedulers •Filter scheduler has plugins for filters and weights: chance, simple and filter. •Filter scheduler Flow Example: •Starts with list of all back-ends •Filters according to capabilities •Drivers report capabilities and state (e.g., free space) •Default filters •Volume types •Sorts according to weights e.g., available free space •Returns best candidate
  • 8. CINDER VOLUME•Drivers: Called by Manager, contains back-end-specific code to communicate with various storage types (e.g., Linux LVM, storage controllers from various vendors, distributed file systems, etc.) •Admin can run multiple cinder-volume instances, each with its own configuration file describing settings and the storage back-end •As of Grizzly, one cinder-volume instance can manage multiple back-ends •Each back-end driver is generally configured to interact with one storage pool •Multi-threading
  • 9. CINDER BACKUP•A backup is an archived copy of aVolume stored in a object store. •A backup is just the data that was written, unlike a snapshot which is the entire block.
  • 10. HIGH LEVEL Nova Cinder VM Instance LinuxVolume Manager KVM ISCSI Initiator Legend Persistent Volume Data Persistent Volume Control /dev/hda /dev/vda ISCSI Initiator
  • 11. ATTACH THAT • Nova calls Cinder via its API, passing connection information. e.g., host name, iSCSI initiator name, FC WWPNs • Cinder API passes message to Cinder Volume. • Manager does initial error checking and calls volume driver. • Volume driver does any necessary preparation to allow the connection. e.g., give the nova host permissions to access the volume. • Volume driver returns connection information, which is passed to Nova. e.g., iSCSI iqn and portal, FC WWPN. • Nova creates the connection to the storage using the returned information. • Nova passes the volume device/file to the hypervisor. VOLUME
  • 13. DRIVER REQUIREMENTS •Volume Create/Delete •Volume Attach/Detach •Snapshot Create/Delete •CreateVolume from Snapshot •GetVolume Stats •Copy Image toVolume •CopyVolume to Image •CloneVolume
  • 14. CURRENT DRIVERS •Coraid (AoE) •EMCVMAX/VNX (iSCSI) •GlusterFS (GlusterFS) •HP 3PAR (iSCSI/FC) •HP LeftHand (iSCSI) •Huawei T-series/Dorado (iSCSI) •IBM Storwize family/SVC (iSCSI/FC) •IBM XIV (iSCSI), LVM (iSCSI) •NetApp (iSCSI/NFS) •Nexenta (iSCSI) •NFS (NFS) •RBD (Ceph) •Scality SOFS (scality) •Sheepdog (sheepdog) •Solaris (iSCSI) •SolidFire (iSCSI) •Windows Server 2012 (iSCSI) •Zadara (iSCSI)
  • 15. HAVANA BOUNDGeneral Features •Code cleanup and reorganization •Attach volume to multiple hosts •Read-only volumes •Disk encryption •FC SAN Zone / Access Control management •Transfer volume ownership •Volume Migration •Work towards locality between instances and volumes •State machine •Volume rate limiting New Drivers: •IBM GPFS •IBM zVM •EMC Isilon (iSCSI) •Local disk partitions •Hitachi HUS (DF850) (iSCSI) •Dell Equalogic •Violin Memory v6000 (iSCSI)
  • 16. THANK YOU!•Get started with Cinder: •https://wiki.openstack.org/wiki/Cinder •Source Code: •http://github.com/openstack/cinder •REST API Docs: •http://docs.openstack.org/api/openstack-block- storage/2.0 •Thanks Avishay Traeger from IBM for letting me copy things out of his slides. Twitter: @thingee IRC: thingee email: thingee@gmail.com