Virtualization Technology and Directions ( EMC World 2010 )

Virtualization Technology and
Directions

David L. Black, Ph.D.
Distinguished Engineer

© Copyright 2010 EMC Corporation. All rights reserved. 1

Roadmap Information Disclaimer

EMC makes no representation and undertakes no obligations with
regard to product planning information, anticipated product
characteristics, performance specifications, or anticipated release dates
(collectively, “Roadmap Information”).

Roadmap Information is provided by EMC as an accommodation to the
recipient solely for purposes of discussion and without intending to be
bound thereby.

Roadmap information is EMC Restricted Confidential and is provided
under the terms, conditions and restrictions defined in the EMC Non-
Disclosure Agreement in place with your organization.


Business Challenges

Data growing at 62% annually to 800,000 Petabytes
Mandates to reduce OPEX and CAPEX
Hardware underutilized or overutilized
Reduce power consumption and footprint
Faster response to business changes

In addition – deal with all of this across multiple data centers

Virtualization is not an option, it is a requirement


Defining Virtualization

Virtualization provides logical views of
physical resources while preserving the
usage interfaces for those resources.

Virtualization removes physical resource
limits and improves resource utilization.


Virtualization Comes in Many Forms

Virtual Virtual
Virtual
Memory Servers
Servers

Each application sees its own Each application sees its own logical
logical memory, independent of server, independent of physical
physical memory servers

Virtual Virtual
Networks Storage

Each application sees its own logical Each application sees its own logical
network, independent of physical storage, independent of physical
network storage


Virtual
Memory

Physical Memory
Each application sees its own
logical memory, independent of App
physical memory
App

App
Benefits of Virtual Memory
Swap Space
Remove physical memory limits
Run multiple applications at once



Virtual Virtual
Virtual
Memory Servers

logical memory, independent of server, independent of physical
physical memory servers

Virtual Virtual
Networks Storage

network storage
disks


Benefits of Virtual Networks

Common network links with access VLAN A VLAN B VLAN C
control properties of separate links.
Manage logical networks instead of
physical networks.
Virtual SANs provide similar benefits
for storage area networks.

VLAN Trunk
Virtual Switch Switch
Networks

Each application sees its own logical
network, independent of physical
network

Virtual Networks Unify Network Traffic

VLANs: different classes of traffic share network
– iSCSI, FCoE, NFS, CIFS, web, etc. Ethernet LAN
– Unification: Reduce cables, interfaces, etc.

Limited interaction among traffic classes
– Controls (access and QoS) for each traffic class

FCoE
switches iSCSI/FCoE
Storage

Switch A Switch B

FC SAN

Ethernet Servers
FC

Distributed Virtual Networks:
Virtualization across Locations
OTV [Overlay Transport Virtualization] (Cisco)
Overlay network extends VLANs over arbitrary network connectivity
– Works over any WAN type – dark fiber, MPLS, IP
– No network architecture change in datacenter – just add OTV edge devices

Seamless add/ drop of edge nodes w/o reconfiguring other edge notes
Distributed network virtualization
– VLANs based on physical network resources across multiple locations

Core

IP A IP B
West East

IP C

South


Defining Distributed Virtualization

Distributed Virtualization provides
logical views of distributed physical
resources while preserving the usage
interfaces for those resources.

Distributed Virtualization removes location
barriers and physical resource limits,
improving resource utilization.


OTV Use Case

Data Center Growth Constraints
Problem: Primary data center maxed out (space, cooling and power)
Requirement: Seamlessly extend clusters & workload across datacenters
Challenge: Rapidly establish network interconnect between data centers

Deploy over One Logical Data Center
existing network 4 configuration
commands per site

Ethernet Overlay
No Re‐design Automatic Fault
Required Isolation

Solution: OTV!
• No new transport provisioning required (Dark fiber, MPLS, etc)
• Eliminate months of re-design effort
• Significant operations and provisioning cost savings

Flexible Infrastructure

Virtual Virtual
Virtual
Servers
Memory Servers

Server Virtualization
App logical App App independent of
App memory, App App server, independent of physical
physical memory OS servers
OS OS OS OS OS

Virtual Benefits of Virtual Machines
Virtual
Networks Storage
OS OS
Run multiple apps on a single server.
OS
Increase server utilization.
Each application sees its own logical Move applications nondisruptively.
.
network
network. storage.

Anatomy of a Virtual Machine

A complete system encapsulated in a set of software files

Unmodified Virtual Machines / Guests
Application

Server OS
Hypervisor

(X86) Physical Server
Virtual
Hardware

Virtual Appliance:
Virtual Machine stored in one file –
Can be used anywhere

Comparison of Virtual Machine Approaches

Multiple virtual machine abstraction layer locations

Application Application

Virtualization Layer

High-Level Operating System Hardware Level
Language Level


Hypervisor Architecture Comparison

VMware vSphere Architecture Microsoft Hyper-V / Xen Architecture
Thin hypervisor, no general-purpose OS Hypervisor extends general purpose OS
I/O subsystem is in hypervisor OS I/O subsystem shared with hypervisor
Hypervisor owns resources Resources shared with primary OS
Support functions: hypervisor processes OS support functions extended to hypervisor


Provided by:
OS
Hyper-V Architecture ISV / IHV / OEM
Microsoft Hyper-V
Microsoft / XenSource

Parent Worker Process
Partition = VM “proxy”
Child Partitions
(management)
VM Worker
Processes
Applications Applications Applications Applications
WMI Provider
WMI Provider User
VM Service
VM Service Mode
Windows Windows Server Non- Xen-Enabled
Server 2008 2003, 2008 Hypervisor Linux Kernel
Aware OS Linux
Windows Windows Linux
Kernel VSP
VSP VSC VSC
Kernel VSC
Device
Drivers VMBus Kernel
VMBus VMBus Emulation
Emulation Hypercall Adapter
Hypercall Adapter Mode

Windows hypervisor Ring -1
I/O Virtualization
and Optimization
Server Hardware

vSphere ESX Server: I/O Virtualization

Each Virtual Machine has its own virtual I/O interfaces
Network: Virtual NIC with its own MAC address
– ESX contains Ethernet switches implemented in software
– Actual hardware Ethernet port behaves like a switch port
Network operates transparently

Storage: Virtual disk controller
– ESX maps OS volumes (LUNs) to
storage resources
– ESX contains a volume manager
and a cluster file system (VMFS)
Can use storage from many places
• SAN, iSCSI, internal storage
• NAS - Can store volume as a file
Storage operates transparently


Pooling of Servers, Storage, and Networking

Aggregate and share resources across servers

Enterprise Virtualization
Benefits
Virtual
Virtual Machines / Guests
Machines • Partition CPU and
memory across
multiple Virtual
ESX
Hypervisor Hypervisor Hypervisor Hypervisor Hypervisor Hypervisor Hypervisor
Machines
Server
• Aggregate hardware
Server Server Farm
resources into
unified logical
resource pools
• Utilize local or
Network shared storage
Storage


VMware vNetwork Distributed Switch

• Aggregated datacenter level
virtual networking
APP APP APP APP APP APP APP APP APP
OS OS OS OS OS OS OS OS OS
• Simplified setup and change
vSwitch vSwitch vSwitch
vNetwork Distributed Switch
Cisco Nexus 1000V • Easy troubleshooting,
VMware vSphere™ monitoring and debugging
• Enables transparent third
party management of virtual
environments


VMotion

Move Virtual Machines across physical servers – while running

Preserve transactional integrity during movement
Eliminate downtime and provide continuous service
Shift underlying hardware resources dynamically
Balance workloads to optimize computing resources

Storage VMotion

• Live migration of virtual
machine disk files across
storage arrays
– Relocate virtual machine disk files
across shared storage live using
Storage vMotion
– Complete transaction integrity
– Full GUI administration
– Supports NFS, FC and iSCSI
• Benefits
– Zero-downtime migration
– Eases array maintenance
– Refresh to new arrays
– Migrate to different class of
storage
Zero-downtime migration – Upgrades, space mgmt
– VM granularity, LUN Independent

Evolution of Server Virtualization

Separate Consolidate Aggregate Automate Liberate

Test and Server Capacity Self-Managing Computing Clouds On
Development Consolidation On Demand Datacenter and Off Premise




Virtual
Infrastructure

Management

Hypervisor



Capacity on Demand: Rapid Provisioning

Without VMware Virtualization
Locate or
Determine purchase Rack and Install/ config Install/ config Boot
server spec system(s) cable system OS application system

Timeline
With VMware Virtualization

Determine Choose Choose Boot
server spec host template VM Time for other productive tasks
system

"We can deploy servers in a pinch. With VirtualCenter, it takes 10 minutes. It's
absolutely fantastic to be able to deliver a server and have the applications up, have
them tested and then put them in production in a matter of four or five hours."
-- Robert Buchwald, Technical Lead, Systems Assurance Team, Moen




Automation

Virtual
Infrastructure

Management

Hypervisor



Resource Optimization: DRS & DPM

Dynamic and intelligent allocation of hardware resources
Distributed Resource Scheduler
– Dynamic balancing of computing resources
Business Demand across resource pools
– Intelligent resource allocation based on
predefined rules

Distributed Power Management
– Dynamic optimization of computing resources
– Place unneeded servers into standby mode
– Common framework, different set of rules

DRS and DPM Customer Impact
– Align IT resources with business priorities
– Operational simplicity; dramatically increase
Resource Pool administrator productivity
– Add hardware dynamically to avoid over-
provisioning to peak load
– Reduce power consumption without reducing
service levels


Flexible Infrastructure

Storage Virtualization:
Virtual Virtual
Virtual
Memory Block Level Servers Benefits of Virtual Storage

Nondisruptive data migrations,
logical memory, independent of simplify storage management, and
server, independent of physical
physical memory increase storage utilization
servers
Storage IP
Network Network

Virtual Virtual
Networks Storage

network storage

Storage Virtualization: Centralized Aggregation

Inband storage system pools storage
resources
– Underlying storage systems hidden from
servers

– Extends useful life of storage assets by
creating virtualized storage pools

Streamlines storage refreshes,
consolidations and migrations within the Storage Pool
Data Center

Simplifies multi-array storage allocation,
provisioning, and tiering via common
management

Multi-Array Data Center

Distributed Federation:
Distributed Storage Virtualization

EMC VPLEX Technology
Federated Information Access: VPLEX Metro
“AccessAnywhere” enables
geographic data distribution
Scale Out Cluster Architecture:
Start small and grow big with Access
anywhere
predictable service levels
Distributed Cache Coherency:
Load balancing and transparent
failover of storage domains within
and across Data Centers
EMC and non-EMC EMC and non-EMC
arrays arrays


VPLEX System Architecture

Site A
Site A Site B
Site B Distributed Mirroring
Active-Active Access A A

Aggregation of Storage devices
Volume management

VPLEX Metro
VPLEX Cluster VPLEX Cluster
FC Remote Access A
A
Diskless access to non-local storage

Array Failure Protection
Local mirroring

Heterogeneous Geographically
Distributed Storage
Non Disruptive Data Mobility
Inter-array migrations


VPLEX I/O Virtualization Stack

Director
FE
Storage View
Virtual volumes are exported out of front-
… end ports and exposed to hosts
Cache
Distributed Coherent Cache Caching leverages local and global cache,
maintains consistency between all VPLEX
directors

Device Virtualization The device virtualization layer creates
Virtual Volumes composite devices from storage volumes,
providing slicing, striping, concatenation,
… and mirroring
BE Storage volumes represent claimed
Storage Volumes devices from back-end arrays
…

Scale Out Cluster Architecture

Centralized Aggregation Distributed Federation

+ + + + + +

Add additional appliances or Larger engine cluster scales out
controllers to scale up capacity performance and/or capacity as
and/or performance needed
Independent virtual storage Storage resources aggregated
pools (management) into a single virtual storage pool
Workloads isolated within each Workloads dynamically
cluster (usually two nodes) distributed across engines


Scale Out Cluster Architecture: Availability

Centralized Aggregation Distributed Federation
Dual node Better
architecture: predictability
Availability in Higher
+ the event of a availability
single node More
performance
failure

Single node failure: lose half of High availability and predictable
storage I/O resources performance in the event of a
component failure
Performance impact can be
significant for active storage pools Failover redistributes workloads
across all remaining engines
Data is unavailable in the event of
a dual nodes failure Add additional engines to
increase resiliency


Distributed Cache Coherency: Write

Directory based distributed cache coherence efficiently
maintains cache state consistency across all Engines
Engine Cache Coherency Directory
Block Address 1 2 3 4 5 6 7 8 9 10 11 12 13 …
Cache A

New Write: Cache C

Block 3 Cache E
Cache G

Cache Directory B Cache Directory D Cache Directory F Cache Directory H
Cache Directory A Cache Directory C Cache Directory E Cache Directory G

Cache Cache Cache Cache


Distributed Cache Coherency: Read

Directory based distributed cache coherence efficiently
maintains cache state consistency across all Engines
Engine Cache Coherency Directory
Block Address 1 2 3 4 5 6 7 8 9 10 11 12 13 …
Cache A
Cache C Read:
Cache E
Block 3
Cache G

Cache Directory B Cache Directory D Cache Directory F Cache Directory H
Cache Directory A Cache Directory C Cache Directory E Cache Directory G

Cache Cache Cache Cache


Online Workload Migration

Site A
Site A Site B
Site B

VMotion over Distance
HyperV Live Migration
OVM Live Migrator
VPLEX Metro
VPLEX Cluster VPLEX Cluster

Heterogeneous
Distributed Storage


VPLEX Metro Use Case
EMC solution

VPLEX Metro
Share, access, and relocate data
between sites over distance VMware VMotion over distance
Microsoft SQL, SharePoint, SAP, Oracle
ESX Cluster A ESX Cluster B
Symmetrix VMAX and CLARiiON CX4 to
Vblock Type 1
Nondisruptive migrations and relocations
to 100 km
Synchronous
Access Anywhere

Migrate and relocate VMs, applications, and
data with support for VMotion over distance
Transparently share and balance resources
between data centers


Putting it all Together:
Unified Virtualization and
The Journey to the Private Cloud


Key Attributes for Enterprise Virtualization

Scalable, high-performance
architecture
– Infrastructure that grows with the business

Supports heterogeneous
environments
Continuous availability
– No single point of failure
– Nondisruptive upgrades

Disaster recovery
Enterprise management
– Reduce risk and operational costs

Incremental deployment
– Easy physical-to-virtual migration
– Deploy as problems and opportunities arise


App Provisioning: Selective Virtualization

Install operating systems

OS OS
Authenticate users or Effect
applications
OS Online:
Allocate server resources

Storage IP Set up storage environments
Network Network (disk, SAN, or NAS)
Effect
Configure networks
Online:

Allocate storage resources –
leading reason for forcing
systems offline
Point virtualization technologies
Effect
can accomplish near-term goals Online:
but create long-term problems.

App Provisioning: All Resources Virtualized

Install operating systems
Authenticate users or Effect
OS OS applications
Online:
OS
Allocate server resources

Set up storage environments
Unified
Network (disk, SAN, or NAS)
Effect
Configure networks
Online:

Allocate storage resources
to and from the available
pool
Effect
Online:
Virtualization of all resources:
continuous online operation.

A Unified Virtualization Infrastructure

Virtual Virtual
Networks Servers

OS OS
OS
server, independent of physical
servers

Unified
Network
Virtual
Storage

storage, independent of physical
disks

A Unified Virtualization Infrastructure

Virtual Virtual
Networks Servers

OS
Virtual Managing and Securing
OS
OS
Storage Virtualization
Consistent models of the entire
virtual infrastructure
Unified
Network Management: Enables end-to-end
dynamic provisioning,
troubleshooting, and optimization
Security: Enables transparent
consistent security policy
application, monitoring and
compliance reporting


Journey to the Private Cloud

Trusted Flexible

Control Dynamic

Reliable On-demand

Secure Efficient

Virtualization
Virtualized Information Cloud
Data Center Computing
Security
Internal Cloud External Cloud


Private
Cloud

Federation

Virtualization
Security


Virtual Client
Virtual Client Virtual Client

Private
Cloud Distributed
Virtual App App App App App Virtualization:
Applications Loads Loads Loads Loads Loads Foundation for
Private Clouds
Federation

Virtualization
Security

Moving a Virtual Machine over Distance:
Distributed Virtualization in Action

4 4
VM Movement Requirements
1. Preserve Shared Storage Access
Example: VPLEX
2
Network A Network B
2. Preserve Network Connectivity
Example: OTV
Site A
Site A Site B
Site B 3. Move the Virtual Machine
VMotion
Example: VMotion
3
4. Optimize External Network Access
VPLEX VPLEX Metro VPLEX Example: DNS based route optimization
Cluster Cluster
Very useful, not an absolute requirement

1 Distributed Virtualization used to
meet first three requirements
Heterogeneous
Distributed Storage


Private Cloud: Mobility Vision

Non-disruptive movement:

Private
1. Any Workload Cloud

2. Any Where
3. Any Time Virtualized
Data Center
Cloud
Computing

Reality Check: Can’t repeal the laws of physics
– But magic (sufficiently advanced technology) is still possible


Conclusions and Recommendations

Conclusions:
– Server, network, and storage virtualization
Virtualization benefits increase with extent of deployment
– Virtualization can be distributed
Virtualization benefits extend across multiple locations
– Distributed Virtualization: Key enabler of Private Cloud
Enables application mobility among locations

Recommendations:
– Virtualization is a strategic decision
Don’t let short-term tactics disrupt your long-term strategy
– Pick your partners wisely – virtualization is not a technology you implement
and then remove – it’s around for the long haul
Technology, services, and support


Related EMC World Sessions
(selected subset)

Server Virtualization
– Microsoft Corporation: Microsoft Virtualization - A Technical Look Into Microsoft
Hyper-V and Microsoft Systems Center
– Vision Into the Future of Desktop Virtualization (VMware)
– vSphere vStorage Technologies

Unified Virtualization: Mobility
– Cisco: Workload Mobility across Data Centers with innovations from VMware, Cisco
and EMC – includes Cisco OTV and VMware VMotion across data centers;

Unified Networks (storage)
– Converged Data Center: FCoE, iSCSI and the Future of Storage Networking

VPLEX (sessions TBA)


Virtualization Technology and Directions ( EMC World 2010 )

Virtualization Technology and Directions ( EMC World 2010 )

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (20)

Ähnlich wie Virtualization Technology and Directions ( EMC World 2010 )

Ähnlich wie Virtualization Technology and Directions ( EMC World 2010 ) (20)

Mehr von EMC

Mehr von EMC (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Virtualization Technology and Directions ( EMC World 2010 )