2. Outline
â˘âŻ Brief History of Time: Hypervisor Requests
â˘âŻ 2011, 2012, 2013
â˘âŻ Trends in Different Segments
â˘âŻ Opportunities and Challenges
Š
 MIRANTIS
 2012
Â
PAGE
 2
Â
5. 2013
â˘âŻ Hypervisors
â˘âŻ KVM
â˘âŻ Maintains lead (around 90%+ for Mirantis)
â˘âŻ Vmware
â˘âŻ Emerges as a surprising second choice
â˘âŻ Containers (LXC, Parallels, Docker)
â˘âŻ Web Hosting and SAS focused
â˘âŻ Xen and HyperV
â˘âŻ Infrequent requests
Š
 MIRANTIS
 2012
Â
PAGE
 5
Â
6. Trends
â˘âŻ Telco/ISP public clouds
â˘âŻ Single hypervisor
â˘âŻ KVM
â˘âŻ Internet focused companies
â˘âŻ Single hypervisor
â˘âŻ KVM
â˘âŻ Web Hosting and SAS sub-segments
â˘âŻ Single or multi hypervisors
â˘âŻ Containers (LXC, Parallels, Docker)
â˘âŻ KVM
â˘âŻ Enterprise
â˘âŻ Multi hypervisors
â˘âŻ KVM and vCenter/ESXi
Š
 MIRANTIS
 2012
Â
PAGE
 6
Â
7. Opportunities and Challenges
â˘âŻ Multi-hypervisor use cases
â˘âŻ Advantages and Issues
â˘âŻ KVM
â˘âŻ vCenter/ESXi
â˘âŻ Containers (LXC, Docker, Parallels)
Š
 MIRANTIS
 2012
Â
PAGE
 7
Â
8. Multi Hypervisor Use Cases
â˘âŻ Existing virtualization infrastructure
â˘âŻ Extend instead of replace
â˘âŻ Provide a common API
â˘âŻ Hedge bets against bugs and vendor pricing
â˘âŻ Utilize additional features
â˘âŻ Virtual appliances not supported by other platforms
â˘âŻ Advanced features not directly supported by OpenStack
Š
 MIRANTIS
 2012
Â
PAGE
 8
Â
9. KVM
â˘âŻ Currently about 90%+ of requests, 95%+ of
deployments
â˘âŻ Type 2 hypervisor
â˘âŻ Relies on a distro
â˘âŻ Relatively easy to add new devices
â˘âŻ Easy to tune to get good performance
â˘âŻ Flexibility creates speedup opportunities
â˘âŻ Mellanox e-switch
â˘âŻ Intel DPDK vswitch
â˘âŻ Few issues
â˘âŻ Mostly distro related
Š
 MIRANTIS
 2012
Â
PAGE
 9
Â
10. KVM Tuning
â˘âŻ We use KVM for HPC and NFV
â˘âŻ Extensive set of tunings
â˘âŻ Short Summary
â˘âŻ
â˘âŻ
â˘âŻ
â˘âŻ
â˘âŻ
â˘âŻ
â˘âŻ
BIOS to max performance
Enable huge pages
On RHEL tune for virtualization
Libvirt conďŹgure host pass-through for CPU ďŹags
Increase TCP buffers and processor input queue
Congestion control to htcp
Enable jumbo frames
Š
 MIRANTIS
 2012
Â
PAGE
 10
Â
11. KVM performance results
â˘âŻ KVM with OVS
â˘âŻ With tuning 7-8 Gbits/s VM throughput (jumbo frames)
â˘âŻ KVM with Mellanox
â˘âŻ Throughput host to host: 19.4 Gbit/s
â˘âŻ VM to VM on same host: 13.9 Gbit/s
â˘âŻ VM to VM on different hosts: 23.1 Gbit/s
â˘âŻ KVM with Intel OVS DPDK
â˘âŻ Alternative to dedicated hardware
â˘âŻ Good performance even for small packets
â˘âŻ 7Gbit/s for 64 byte packets
â˘âŻ 9.6Gbit/s for 512 byte packets
Š
 MIRANTIS
 2012
Â
PAGE
 11
Â
12. KVM Features and Issues
â˘âŻ Widest set of OpenStack Features
â˘âŻ https://wiki.openstack.org/wiki/HypervisorSupportMatrix
â˘âŻ Issues
â˘âŻ DifďŹcult to transfer images from other hypervisors
â˘âŻ Older versions of QEMU in RHEL/CentOS require virtio
drivers
â˘âŻ SCSI emulation in Ubuntu
â˘âŻ Updated CentOS with latest QEMU
Š
 MIRANTIS
 2012
Â
PAGE
 12
Â
13. VMware ESXi
â˘âŻ Currently about 8-10% of requests, 5%+ of
deployments
â˘âŻ Primarily vCenter
â˘âŻ Type 1 hypervisor
â˘âŻ Does not need a linux distro
â˘âŻ VMware controls the code, 3rd party packages must be
signed.
â˘âŻ VMware is supporting both ESXi and vCenter
APIs
Š
 MIRANTIS
 2012
Â
PAGE
 13
Â
14. VMware OpenStack Compatibility
â˘âŻ Good compatibility with OpenStack Features
â˘âŻ https://wiki.openstack.org/wiki/HypervisorSupportMatrix
â˘âŻ Pause, Un-Pause and Resize missing
â˘âŻ Caveats (Grizzly)
â˘âŻ Network integration
â˘âŻ Nova-net no security groups
â˘âŻ Neutron requires Nicira commercial plugin
â˘âŻ
â˘âŻ
â˘âŻ
â˘âŻ
Glance integration inefďŹcient
Only a single datastore is supported
With Cinder only iSCSI type volumes are supported
Only linked clones are supported
Š
 MIRANTIS
 2012
Â
PAGE
 14
Â
15. Vmware OpenStack Havana
â˘âŻ Linked and Full clones are supported
â˘âŻ Multiple VC clusters can be managed by a single
driver
â˘âŻ ConďŹg drive support
â˘âŻ Cinder support for VMDK based Volumes
â˘âŻ vShield Edge Driver support for NVP plugin
(FWaaS, LBaaS)
Š
 MIRANTIS
 2012
Â
PAGE
 15
Â
16. VMware Networking
â˘âŻ Nicira NVP/NSX
â˘âŻ Cisco 1000V (future)
â˘âŻ Accelerated Options
â˘âŻ NVP using STT
â˘âŻ VN-Tag, SR-IOV & Cisco Switches (VM-FEX)
Š
 MIRANTIS
 2012
Â
PAGE
 16
Â
17. Containers
â˘âŻ Currently about 5%+ of requests, 0 deployments
â˘âŻ Low overhead alternative
â˘âŻ Hundreds of guests
â˘âŻ All Apps belong to a single tenant
â˘âŻ Fragmented space
â˘âŻ LXC
â˘âŻ Parallels
â˘âŻ Docker
â˘âŻ Limited OpenStack support but interest is growing
Š
 MIRANTIS
 2012
Â
PAGE
 17
Â
18. LXC OpenStack Support
â˘âŻ VM â only launch, reboot and terminate
â˘âŻ Networking â basic VLANs
â˘âŻ Possible to get Neutron/OVS to work
â˘âŻ Volumes â ofďŹcially no Cinder support
â˘âŻ Possible to hack something
Š
 MIRANTIS
 2012
Â
PAGE
 18
Â