Enterprises are asking their architects and integrators to find the most robust, cost-effective, scalable, easy-to-manage infrastructure for their vCloud environments. NetApp integrations with VMware vCloud Director make efficiency, data agility and integrated data protection a native part of vCloud environments. This session will show how integrations with vCloud Director make provisioning and cloning, session orchestration and automation, resource creation and management easier and smarter on NetApp storage.
What Are The Drone Anti-jamming Systems Technology?
VMware PEX Boot Camp - Reaching the Clouds with NetApp Integrations with VMware vCloud Director
1. vCloud Director on
NetApp
Building Your Beanstalk Into the
Clouds
NetApp Confidential - Internal Use Only 1
2. Agenda
The Clouds: The vCloud
Director Cloud Suite
The Castle: Storage in
vCD
The Golden Egg:
NetApp Integrations with
vCD
The Story: Demo vCloud
Director on NetApp
2
3. Once Upon a Time….
Practical understanding of vCloud Director
Insight into storage consumption and
storage practices in a vCloud solution
Understand NetApp integration points with
vCloud Director
3
5. vCloud Suite Overview
Management Cloud Infrastructure Extensibility
VMware vCloud Director 5.1
VMware vCloud
APIs
VMware vCenter Software Defined Software Defined
Operations Networking and Security Storage and Availability
Management Suite
VMware vCloud VMware vCenter VMware vCloud
Networking and Security Site Recovery Manager Connector
VMware vFabric
Application VMware vCenter
Director Virtualization Orchestrator
VMware vSphere 5.1
Physical Infrastructure
(Server, Storage, Network)
5
6. vCD: A Software-Defined Datacenter
Software Defined Datacenter
Management Cloud Infrastructure Extensibility
VMware vCloud Director 5.1
VMware vCloud
APIs
VMware vCenter Software Defined Software Defined
Operations Networking and Security Storage and Availability
Management Suite
VMware vCloud VMware vCenter VMware vCloud
Networking and Security Site Recovery Manager Connector
VMware vFabric
Application VMware vCenter
Director Virtualization Orchestrator
VMware vSphere 5.1
Physical Infrastructure
(Server, Storage, Network)
6
7. vCD – Hierarchy of Resource
Management
Provider vDC
Organization
OrgVDC
vApp
VM
7
8. Provider vDC Overview
Collects and abstracts vSphere resources
Uses resource pools and datastores
Subdivides resources into organizations
8
9. Provider vDC Storage Profiles
Storage Profiles presented from vCenter
Used to specify specific types of storage
vCD uses datastores from storage profiles
9
10. Organization and OrgVDC
Subdivision of PvDC resources
Divided into three allocation models
10
11. vCD – Hierarchy of Resource
Management
Provider vDC
Happy Clouds Incorporated 400GHz CPU
396GB RAM
4 Storage Profiles
Rainpole Nuesoft • Gold
• Silver
• Bronze
Finance HR Test Dev • Platinum
1
12. vCD – Hierarchy of Resource
Management
Happy Clouds Incorporated Organization
Nuesoft
• 150GHz CPU
• 200GB RAM
Rainpole Nuesoft • 2 Storage
Profiles
• Silver
Finance HR Test Dev • Bronze
12
13. vCD – Hierarchy of Resource
Management
OrgVDC
Happy Clouds Incorporated
Dev
• 75GHz CPU
• 125GB RAM
Rainpole Nuesoft • 2 Storage
Profiles
• Silver
Finance HR Test Dev • Bronze
• 25% Guarantee
13
14. vCD – Hierarchy of Resource
Management
Happy Clouds Incorporated OrgVDC
vApp2
• 25GHz CPU
• 50GB RAM
Rainpole Nuesoft • 1 Datastores
• Bronze
Finance HR Test Dev
vApp vApp
1 2
14
22. vCloud Director Storage Implications
Software Defined Storage
VMware vCloud Director 5.1
VMware vSphere 5.1
Storage
Storage DRS
Profiles
NetApp Data ONTAP™
22
23. Storage Profiles
Software Defined Storage
VMware vCloud Director 5.1
VMware vSphere 5.1
Storage
Storage DRS
Profiles
NetApp Data ONTAP™
23
24. Profile Driven Storage Functionality
Leveraged to create classes
of storage in vCenter
Profiles consumed by
vCloud Director 5.1
How are they defined
− System Defined
− User Defined
24
26. Storage DRS in vCD
Software Defined Storage
VMware vCloud Director 5.1
VMware vSphere 5.1
Storage
Storage DRS
Profiles
NetApp Data ONTAP™
26
27. Storage DRS
Used to load balance storage usage for vCloud
environments
SRM does not support Storage vMotion /
Storage DRS
vCloud Director does support Storage DRS in
5.1
27
28. Storage DRS Constraints and Cautions
NetApp NetApp Migration
Product Recommendations Recommendations
SnapMirror Supported Manual: I/O and Space
SnapShots Moves invalidate Manual: I/O and Space
Snapshots
Deduplication During move VMs Manual: I/O and Space
Rehydrated
Thin Ensure datastores Fully Automated:
Provisioning have I/O and Space
enough actual space
FlexClones Supported Fully Automated:
I/O and Space
28
30. NetApp and VMware vCD Intergration
Cloud Management & Orchestration
NetApp On Command Insight
vCenter Operations Management Suite
NetApp On Command Balance
VMware vCloud Automation Center NetApp Power Shell
VMware vCenter Orchestrator NetApp Workflow Automation
Clustered Data ONTAP
Cloud Infrastructure
NetApp VSC
VMware vCloud Director
VAAI
VMware vCloud Connector
NetApp Snap Creator
VMware vCloud
vServer with Full Stack Multi-tenancy
Networking and Security
VMware vCenter Storage Replicator Adapter for
Site Recovery Manager NetApp SnapMirror
NetApp Virtual Storage Console
VMware vSphere
VAAI
NetApp Snap Creator
30
31. Clustered Data ONTAP and vCD
Unified
Storage
Architecture
Efficiency
VAAI Snapshots
VMware vCloud Director
Accelerated
Continuous Performance
Operations
31
32. vCD and NetApp Storage Efficiency
Thin Provisioning
– Hardware vs.
Software
Deduplication
Fast Provisioning
– VAAI Clone Offload
32
33. VAAI Integration and vCD
Full Copy Offload vStorage APIs
What: 10x faster VM for Array Integration
deployment, clone, snapshot,
and Storage VMotion
VMware vSphere
How: Leveraging array ability
to mass copy, snapshot,
and move blocks via SCSI API
commands
Why: Replaces Fast
Provisioning with FlexClones
33
34. Full Copy – Without VAAI
ESX Cluster
VM VM VM
Datastore
SCSI CMDs
over I/O I/O
FC, FCoE, iS
CSI
VM VM VM
Flexible Volume
NetApp FAS Array
34
35. Full Copy – With VAAI for SAN
ESX Cluster
VM VM VM
Datastore
Copy Instructions
VM VM VM
Flexible Volume
NetApp FAS Array
35
36. NFS Full Copy Cloning – with VAAI
ESX Server
CopyOffload
VAAI NAS Plugin
(Src_file,
Dest_file, size) Copy Offload NFS Datastore
(Src
file, Dest_file, size)
Saves Network
Bandwidth & ESX CPU
by offloading Copy
Done!
1100
1100
0110
0110
1101
1101
FlexVol®
NetApp FAS System
36
37. NetApp and VMware vCD Intergration
Cloud Management & Orchestration
NetApp On Command Insight
vCenter Operations Management Suite
NetApp On Command Balance
VMware vCloud Automation Center NetApp Power Shell
VMware vCenter Orchestrator NetApp Workflow Automation
Clustered Data ONTAP
Cloud Infrastructure
NetApp VSC
VMware vCloud Director
VAAI
VMware vCloud Connector
NetApp Snap Creator
VMware vCloud
vServer with Full Stack Multi-tenancy
Networking and Security
VMware vCenter Storage Replicator Adapter for
Site Recovery Manager NetApp SnapMirror
NetApp Virtual Storage Console
VMware vSphere
NetApp Virtual Storage Console
VAAI
NetApp Snap Creator
37
38. NetApp VSC with vCD
vCloud Director 5.1
vCloud
Manage storage plug-in
VMware ESX
Auto-configure plug-in
VMware vCenter Server
VMware vCenter Server
vCompute
vNetwork
Provisioning plug-in
Backup & Restore plug-in
vStorage
V2P monitoring plug-in
VSC API’s for vCD
Software Defined Datacenter
38
39. Are You in the Band?
Virtual Storage Console vCloud Roadmap
Use any orchestrator or automation tool = shipping
Build custom and powerful workflows = committed
= planned
= planning
Yesterday Today 1H CY’13 2H CY’13
VSC 4.0 (Duran VSC 4.1 (Eagles) VSC Foreigner VSC Genesis
Duran) vCloud vApp vCloud backup vCloud datastore
vSphere datastore provisioning and and recovery provisioning
provisioning cloning vSphere backup
vSphere VM and recovery
cloning
39
40. NetApp and VMware vCD Intergration
Cloud Management & Orchestration
NetApp On Command Insight
vCenter Operations Management Suite
NetApp On Command Balance
VMware vCloud Automation Center NetApp Power Shell
VMware vCenter Orchestrator NetApp Workflow Automation
Clustered Data ONTAP
Cloud Infrastructure
NetApp VSC API
VMware vCloud Director
VMware vCloud Connector NetApp Snap Creator
VAAI
NetApp Snap Creator
VMware vCloud
vServer with Full Stack Multi-tenancy
Networking and Security
VMware vCenter Storage Replicator Adapter for
Site Recovery Manager NetApp SnapMirror
NetApp Virtual Storage Console
VMware vSphere
VAAI
NetApp Snap Creator
40
41. Snap Creator for the Cloud
Snap Creator is a framework
– Focus on backup functions vCD
– Offers restore, cloning, & mount
vSphere
functionality
Transforming for the cloud
– Tiering of multiple configurations Backup
Admin NetApp
– Provides VMware vCloud®
capabilities for XaaS
NetApp
– Protects applications inside vCD Snapshots
41
42. NetApp and VMware vCD Intergration
Cloud Management & Orchestration
NetApp On Command Insight
vCenter Operations Management Suite
NetApp On Command Balance
VMware vCloud Automation Center NetApp Power Shell
VMware vCenter Orchestrator NetApp Workflow Automation
Clustered Data ONTAP
Cloud Infrastructure
NetApp VSC
VMware vCloud Director
VAAI
VMware vCloud Connector
NetApp Snap Creator
VMware vCloud
vServer with Full Stack Multi-tenancy
Networking and Security
VMware vCenter Storage Replicator Adapter for
Site Recovery Manager NetApp SnapMirror
NetApp Virtual Storage Console
VMware vSphere
VAAI
NetApp Snap Creator
42
43. OnCommand Workflow Automation (WFA)
Delivering Automation and Flexibility
Automate manual processes
Enable storage experts to define and
adjust processes
Allow customized resource selection and
integration with other IT systems
Flexible execution of storage processes
based on customer needs
Integrates with other OnCommand® products
to improve resource selection and automation
4
44. Key Aspects of Workflow Automation
Define your storage layout and needs
Design your resource selection criteria
Integrate your process into the overall
delivery of storage
Accelerate your storage
provisioning
4
45. Easy-to-Use Storage Operator Portal
Simple, easy to use,
and easy to execute
workflows
Organized by
categories
Execute
immediately or
scheduled
Authorize Access to
Workflows
4
49. And They Lived Happily Ever After…
Practical understanding of vCloud Director
Insight into storage consumption and
storage practices in a vCloud solution
Understand NetApp integration points with
vCloud Director
49
In 1842 Henry Cole published a series of short stories called The Home Treasury.In the collection was a story about a boy who found magic beans that allowed him to journey to a castle in the clouds and then find a goose that laid a golden egg. This goose eventually allowed him to lead a life of luxury. Just like that boy, my name is Jack, and I’m here to show you how to build your beanstalk into the clouds with NetApp and vCloud director.With the introduction of vCloud Director 5.1 a host of new questions have poppped up. I’m here to give you an overview of vcloud director and how it relates to storage and hopefully answer some of those questions for you that deal with how vCloud director and NetApp integrate.What will be coveredPractical understanding of vCloud Director Insight into storage consumption and storage practices in a vCloud solutionUnderstand NetApp integration points with vCloud Director
A vApp is a container for a VM or multiple VM’s. Inside the vApp separate networking and storage can be used to house the VMs living there. vApps are the base container level of vCD as well as the base resource distribution level. vApp’s can be cloned, made into templates, and redeployed over and over again. Also, an expiration date can be set on vApps. If a vApp is only needed for a specific period of time, this can be set and the vApp will then expire. At that point its resources it has consumed are given back to the OrgVDC that it lives in.
Much like a castle is the foundation upon which many fairy tale stories are built upon, storage is the foundation upon which successful cloud deployments are built. A solid understanding of how storage is used in vCloud director is needed to understand the integration points we will discuss later.I’m going to cover how vCloud Director uses storage as a resource. I will cover how this resource is consumed and moved around. In doing so I will give you an understanding of overall resource consumption in vCloud Director.
Deduplication: Moving data [i.e. vmdk's] between volumes will “un-dedupe” that data being moved, and you will have to re-run the original deduplication scan on that new volume in order to re-coop those savings after the move. While this is not the end of the world, it is a nuissance, and you should be aware of it as a caveat to StorageDRS, or generally moving VMDK’s between datastores.Thin Provisioning. Nothing really “breaks” with thin provisioning, but you’re allowing an outside construct to control placement of data on what it “thinks” is a 1TB volume that you’ve thinly provisioned, when in actuality there is only 100GB truly available to write to. What happens when Storage DRS moves something there? I think most of you know what happens when a thin provisioned LUN exceeds it’s available space.Side note: This is another brilliant feature of NetApp that often goes unnoticed, or untalked about. We have certains settings you can turn on that Autogrow both Volumes as well as the LUNs inside them.Snapshots. When we snapshot volumes, or the data inside, we store the initial tier of snaps within that same volume. What happens when you [or some outside construct] begin to move the items inside the volume to another volume? Those snaps (i.e. Your Backups) become invalid.Overall Statement: Using SDRS ultimately requires a lot of management oversight which complicates an environment.
When Jack got his first golden egg, life became much easier for him. NetApp’s golden eggs are our integration points with vCD, each designed to make an administrators life easier.
Accelerated Performance: Intelligent Caching, FlashPools, FlashAccel all increase performance in vCloud DirectorSnapshots: Backup and recovery is key and NetApp Snapshot technologies will form the basis for our backup and recovery offering for vCDUnified Architecture: One storage OS across all our FAS Platforms combined with ease of addition and subtraction from a cluster make this a time and money saving feature.Storage Efficiency: Thin Provisioning, Deduplication, and FlexClones provide the same benefit with vCD as they do with vSphere. vStorage APIs for Array Integration (VAA)I: Offloading of important processes from vCenter to the storage makes for increased performance.Continuous Operations: with clustered ontap a cloud environment will stay up even in the event of a hardware failure. The ability to move volumes / datastore between clusters while keeping the same IP addressing and accessibility makes the pain of maintenance a thing of the past.
vStorageAPIs for Array Integration A set of APIs and commands to offload certain functions to the storage array to : Increase scalability and performance Free server and network resources VAAI is a joint development between VMware and NetAppIn vCloud Director a “linked clone” like functionality called fast provisioning exists. Its designed for rapid, space efficient provisioning. Copy offload makes like much easier in that it offloads the cloning to the storage controller and uses FlexClones instead of fast provisioning.One other really cool aspect from VAAI Copy Offload is the ability to offload the vApp Snapshot found in vCloud Director 5.1. Instead of using a vSphere Snapshot, this functionality is offloaded to the NetApp controller and a NetApp Snapshot is taken. There are immediate advantages to this offload. First, the NetApp Snapshot is extremely space efficient. The NetApp Snapshot is faster as well. Finally, this SnapShot is treated just like a standard NetApp Snapshot and integrates with NetApp SnapMirror and SnapVault. Essentially, it behaves and is treated like (and is) a NetApp Snapshot but vCloud Director thinks of it as one of its own Snapshots.
Current VM cloning and migrations require data to be copied within ESX/ESXi host Copy process consumes host CPU and network bandwidth
With API VM cloning and migrations are instruction sets from ESX/ESXi hosts Copy process occurs on arrayCopy process is offloaded from host and networkGo to Organization vDC >Properties > Storage tab. In the following window, click the Storage tab. Ensure “Enable Fast Provisioning” is unchecked.Requirements:SAN 7-Mode: vSphere 4.1, Data ONTAP 8.0.1; require version 8.1.0 for improved performance (cloning); Data ONTAP 8.0.1 uses full copy.SAN Cluster-Mode: currently not available.
Go to Organization vDC >Properties > Storage tab. In the following window, click the Storage tab. Check “Enable Fast Provisioning”.You will also need to install the NetApp NFS VIB on each ESX host. This functionality is automated inside of vCenterRequirements:NFS 7-Mode: vSphere 5, Data ONTAP 8.1.1; require vCloud Director 5.1 and vSphere 5.1 for Fast Provisioning (Linked Clone) Copy-Offload.NFS Cluster-Mode: vSphere 5, Data ONTAP 8.1.0; require vCloud Director 5.1 and vSphere 5.1 for Fast Provisioning (Linked Clone) Copy-Offload.
Not one-size-fits-one but one-size-fits-allIdentify Organization, vDCs and/or vAppsEnd-to-end mapping of vCD objects to vSphere objectsSave datastore and VM objects and create mapping to NetApp volumes for SnapshotsCreate NetApp SnapshotsRestore vApps back into OrgvDC’sIntegrated with SnapMirror. SnapMirror integrated with SRM with Netapp SRA. SRM now supports vCD. We have a happy world for DR for vCD.
Goal of slide: Overview of the OnCommand Workflow Automation operator portalKey points:A simple portal for operators to execute workflow; little training is required.Workflows are organized by categories.Workflows prompt for required input parameters when executed.Execute workflows immediately or schedule for later.