1. HDS Basic Operating
System V
John Harker & Larry Korbus (HDS)
Ken OwWing (Sun)
1
2. Agenda
• Basic Operating System and Basic Operating
System V Overview
• Features and Benefits
• A Layered Approach
• Basic Operating System Components
• Further Information and Resources
Sun Confidential: Internal Only 2
3. ST9900 Basic Operating System
Basic Operating System
Basic Operating System V *
* Please note that BOS V is also referred to as BOS-E for External Virtualization
Sun Confidential: Internal Only 3
4. Introducing ST9900 Basic Operating System
& Basic Operating System V
> ST9900 Basic Operating System is the basic mandatory
software license that gives you the tools to take advantage of the
power of the ST9990V storage platform
> With Sun ST9900 storage systems, as is true with many
technological products, over time more functionality is added to
the base system, adding to it’s value. Substantial value has been
added over the comparable previously available Device
Manager/Resource Manager bundle.
> Every ST9990V now comes standard with unique Storage
Virtualization capabilities unmatched in the industry.
> A ST9900 Basic Operating System license must be
sold/purchased with every system. This is important for customer
satisfaction and also for ISV partners such as Oracle, Veritas and
Microsoft who count on it to enable their products full functionality.
Sun Confidential: Internal Only 4
5. Customer Problems
• Large storage consolidation with the ST9900, particularly with:
> multiple tiers of storage
> multiple applications
• Multiple “user communities”
> Multiple customers
> Multiple divisions/departments
> Diverse applications
> Decentralized IT organizations
• Diverse applications with varying, and possibly conflicting,
requirements for
> Capacity
> Throughput
> Priority
> Tiers
> Access
• Concerns about Costs, Service Levels, and Risk
Sun Confidential: Internal Only 5
6. ST9900 Basic Operating System
ST9900 Basic Operating System software features:
> One set of common management tools that covers the full range of Sun
ST9900 storage systems. This includes everything previously included in:
– Device Manager
– Resource Manager
– Server Priority Manager
– in addition you get…
> Virtual Partitions which are dynamically changeable cache and storage logical
partitions. This capability was previously sold separately as Virtual Partition
Manager
– With Basic Operating System you can create up to 4 virtual storage systems
on a ST9900V so that shared storage can be securely compartmentalized
where needed
– With Basic Operating System you can also create up to 4 virtual cache
partitions to control and adjust the QOS of your most critical applications
based on changing business needs or fluctuations in workloads
Sun Confidential: Internal Only 6
7. ST9900 Basic Operating System Solves
Complex Challenges
• Enables the full power of the ST9990V
storage platform
• Simplifies management of individual or
multiple ST9900 storage systems
• Empowers existing resources to manage
significantly more storage
• Individually aligns storage assets and QoS
with business and applications
requirements
• Helps optimize Storage System
Performance
• Mitigates risk through automation of manual
error-prone processes and proactive alerts
to prevent outages
• Reports enterprise storage capacity
chargebacks by logical group or line of
business
Sun Confidential: Internal Only 7
8. ST9900 Basic Operating System V
Basic Operating System V is an upgrade to Basic
Operating System that adds:
> Unique storage controller-based virtualization layer
supporting externally-attached storage
– Enables heterogeneous storage solutions with pooled tiered
storage.
– Simplifies storage management, increases efficiency,
improves service levels and helps meet compliance demands.
– This capability was previously sold separately as Universal
Volume Manager
> and Virtual Partitions are expanded from 4 up to 32
storage partitions and from 4 up to 32 cache partitions.
Sun Confidential: Internal Only 8
9. What is External Storage Virtualization?
SAN
ST9900
AMS IBM EMC
SATA
Benefits of External Storage Virtualization
• View the entire SAN as one pool of storage independent of physical location
• Mask the differences between heterogeneous devices, create storage tiers
• Simplify control and management under a single interface.
• Dynamically allocate capacity & storage QoS to the applications that need it
• Enhanced data mobility - easy transparent migration of data
• Simplified & unified volume replication between storage tiers and platforms
• Facilitate matching storage resources to business requirements
Sun Confidential: Internal Only 9
10. Basic Operating System Benefits
Business Agility
• Organizes and manage storage
from a logical perspective, along Partition 1
lines of business, departments, Partition 2
criticality or storage class
• Consolidated control of Hitachi FC/IP
storage as well as externally- SAN
attached Universal Storage
Platform or Network Storage Universal
Controller storage Storage
• Dynamically configurable virtual Platform
storage and cache partitions for
performance and security Physical Storage Pool
• Immediate view of available
storage and current usage, rapid High Perf. 99.99% 100%
General
Backup Archive
provisioning Thunder
9500V
Lightning Purpose
9900V
Thunder 9500
SATA
• Enables deployment of storage
resources to meet business and
application needs
Sun Confidential: Internal Only 10
11. Basic Operating System Benefits
Operational Excellence
Operations Integration
> Consolidate and rationalize storage and storage management
points - use a single management system for all your Hitachi
storage. Access from anywhere using secure protocols
> Allows storage system configuration for mixed Microsoft, UNIX,
Linux, and IBM mainframe environments, simplifying administrative
work and enabling storage consolidation.
> Improve IT productivity through consistent administrative operations
across storage and operating systems - simplifies everything else
including data replication, migration, and storage tiering
> Supports business continuity and disaster recovery capabilities by
configuring Hitachi replication software
> Integrate Hitachi Storage with other management systems through
SNMP or CIM/SMI-S
> Automate repeated tasks via CLI or XML requests to reduce
administrative expense and risk of error from manual processes
Sun Confidential: Internal Only 11
12. Basic Operating System Benefits
Optimum Performance
Optimize Storage System Performance
> Ensure storage service levels to individual
servers or applications
> Allows workload balancing and troubleshooting
of performance problems.
> Accelerates application performance by locking
key data into cache in real time
> Allows tuning to minimize unnecessary I/Os,
logical device contention, and operating system
queuing
> Cache Logical Partitions and per-port bandwidth
reservation ensures tunable performance on a
per-server or application basis
Sun Confidential: Internal Only 12
13. Success Example:
Large Brokerage Firm
Problem
• Needs to revamp data storage/record management
strategy for compliance and best practices
• New strategy calls for tiered storage with SATAand
archiving onto online WORM storage
Solution
• Basic Operating System and Basic Operating System V
pull together their disparate storage into a pool that could
be structured and allocated based on requirements.
> High performance for trade records and accounting
> Externally attached SATAfor file systems for Excel based-budgeting
process
> WORM for regulatory compliance
Sun Confidential: Internal Only 13
14. Success Example:
Medium-sized Manufacturing Company
Problem
• New government contract creates urgent need for IT director to
simultaneously scale up and come up with a system to predict
storage and archiving requirements and costs 24 months out
Solution
• He can easily determine from a single point how much total capacity
he has and how much is unused
• Pooled storage allows him to optimize use of increasing capacity
• Path provisioning improves his system administrators efficiencies
• CLI allows automation, reducing steps and improving reliability
• Automated reports helped him track utilization and document by
department
Sun Confidential: Internal Only 14
15. ST9900 Storage Management Software –
A layered approach
• Hitachi Basic Operating System Components (Resource Manager , Universal Volume
Manager and Server Priority Manager)
– Foundation for Device Manager
– Individual management of Hitachi storage systems
– Different for modular vs. enterprise storage systems
– No path awareness
• Hitachi Basic Operating System Device Manager
– Encompasses Basic Operating System components
– Path aware
– Centralized management of all Hitachi storage systems
– Storage pool manager used by other Hitachi software products
• Hitachi Storage Services Manager
– Add-on product
– Encompasses Device Manager
– Fully Path aware
– Manage heterogeneous SANs and storage systems using CIM and SMI-S open
standard protocols
Sun Confidential: Internal Only 15
16. Basic Operating System
Foundation for Higher Level Capabilities
Business Global Link Availability Manager
QoS Application Modules QoS for Protection Manager
Application Oracle - Exchange - Sybase - SQL File Servers
Server – NetApp Option Dynamic Link Manager Exchange - SQL Server
Modules SRM
Path failover and failback load balancing
Path
Storage Chargeback
Provisioning Global Reporter
Operations
Modules Backup Replication Tiered Storage
Services Tuning Manager Monitor Manager
• Path Management Manager
Storage Services Manager
• Capacity Monitoring
• Performance Monitoring
Device Manager
Hitachi API – CIM/SMI-S Provisioning Configuration
Replication Reporting
Basic Configuration
Operating
System
Resource Manager Virtual Partition Manager Universal Volume Manager Performance Monitor Server Priority Manager
Heterogeneous Hitachi Storage Specific
Sun Confidential: Internal Only 16
17. Hitachi Basic Operating System
What’s in it? What’s important? “tag-cloud” view of components
• Device Manager • Performance Monitor
• Storage Navigator • Server Priority Manager
• Virtual Partition Manager • Data Retention Utility for Open and
• LUN Manager for z/OS
• LUSE • Volume Shredder
• VLVI Manager
• SNMP Agent
• Customized Volume Size and Open
Customized Volume Size • VSS provider
• SANtinel and Volume Security Port • NDMP Agent
Option
• Cache Residency Manager and Cache
Management Host Agent
Sun Confidential: Internal Only 17
18. Basic Operating System Features #1
• Storage Navigator obtains system configuration and status information and sends user-requested commands to the
Universal Storage Platform and Lightning-class storage systems. It is the front-end interface to the other components
listed. With included Java agents it can be run from most browsers.
• Virtual Partition Manager enables the logical partitioning of ports, cache and disk (parity groups) into independently-
managed virtual machines on the Sun ST9900 products. With Basic Operating System, you are limited to a maxmium
of four of any combination of physical and cache partitions. Up to 32 are available with Basic Operating System V.
• LUN Manager software streamlines configuration management processes by enabling you to define, configure, add,
delete, revise and reassign LUNs to specific paths without having to re-boot your system. Because LUN Manager can
assign multiple paths to a single LUN, you gain the necessary infrastructure to support alternative path failover, path
load balancing and clustered systems.
• LUSE allows LUN expansion by creating virtual expanaible LUs out of groups of physical ones.
• VLVI Manager software optimizes storage system capacity utilization by allowing users to create custom sized logical
volumes of information. The VLVI Manager software improves performance by reducing logical device contention and
operating system queuing. It also boosts remote copy performance by eliminating the need to copy large volumes of
information that are only partially used.
• Customized Volume Size and Open Customized Volume Size (OCVS) are facilities that allows the creation of small
high-performance LUNs in mainframe and open environments
• SANtinel SAN security software helps ensure security in open systems storage area networking environments through
restricted server access. With SANtinel you can deny access to unauthorized users and safeguard your mission-critical
information.
• Volume Security Port Option performs the same function for Mainframe environments
• Retention Utility for Open and for z/OS - Data Retention Utility software provides virtual WORM (Write Once Read
Many) on ST9900 disk storage systems in open systems and mainframe environments. With the Data Retention Utility,
you can lock down archived data, making it non-erasable and non-rewritable for prescribed periods, facilitating
compliance with governmental or industry regulations.
• Volume Shredder - The Hitachi Volume Shredder option enables the volume shredding engine in the ST9990/85
Controller microcode for use by other ST9900 products such asTiered Storage Manager.
Sun Confidential: Internal Only 18
19. Basic Operating System Features #2
• Performance Monitor replaces GraphTrack and offers an efficient, reliable and centralized way to manage
performance. This unique tool monitors hardware performance and supplies complete ST9900 system storage
information through a graphical interface.
• Server Priority Manager. Server Priority Manager allows customers to meet application performance SLAs by
prioritizing server port access, assuring that critical applications are not adversely affected by non-critical applications.
• Cache Residency Manager allows users to "lock" and "unlock" data into cache in real time to optimize access to your
most frequently accessed data.
• Cache Management Host Agent provides a flexible facility for mainframe environments to place data in or remove data
from storage array cache.
• VSS provider - The ST9900 Volume Replication Service hardware provider supports direct array-based point-in-time
copies for Microsoft VSS enabled applications using In-System Replication software or Remote Replication software.
The benefit is that the copy takes place inside the array and data is not required to move through the sever or Storage
Area Network. This frees-up valuable server cache and I/O resources and allows your application environment to
continue without impacting overall system performance.
• NDMP agents - NDMP agents add support to ST9900 arrays for the open standard Network Data Management
Protocol (NDMP) for enterprise-wide backup of heterogeneous network-attached storage.
• SNMP Agent includes ST9900 specific MIBs and enables SNMP-based reporting on status and alerts for ST9900
storage systems
Basic Operating System V adds
• Universal Volume Manager virtualizes multi-tiered storage systems of heterogeneous devices into a common storage
pool and provides common storage management, data migration and lifecycle management tools.
• Up to 32 Virtual Partition Manager partitions
Sun Confidential: Internal Only 19
20. Further Resources and Information
• BOS and BOS V Product Brochure
• BOS and BOS V Product Quickbrief
• BOS and BOS V FAQ
• For the next level of detail on BOS and BOS V functionality,
refer to the following individual component product pages on
hds.com, the intranet and PartnerXchange:
> Device Manager
> Resource Manager
> Universal Volume Manager
> Virtual Partition Manager
> Server Priority Manager
• Each of these products has an individual brochure and
detailed product presentation, along with other resources
such as FAQs and system requirements information
Sun Confidential: Internal Only 20
21. ST9900 Basic Operating System
Problems Solved
• Who Benefits from Hitachi Basic Operating System
Software? Companies who:
> Have a storage infrastructure which is growing in
complexity and requires a simpler, less time-
intensive method of managing their storage
environment
> Need to be able to deliver defined storage quality
of service at the individual application level
> Would like to prepare for deploying other ST9900
software modules for business continuity and
storage resource management
> Use open systems environment and a standards-
based approach to storage management
Sun Confidential: Internal Only 21
23. Hitachi Basic Operating System and
Hitachi Basic Operating System Virtualization
es
EXTRA SLIDES id
Sl
r a
E xt
May 1, 2007
Sun Confidential: Internal Only 23
24. ST9990V
Ideal Customer Profile ILLU
STR
Dimension Ideal Customer Characteristic ATIV
E
Size Enterprise customers seeking “high-end” performance with very high reliability and availability
characteristics for mission critical applications
Structure & Existing Sun ST9900 Storage customers looking to reduce storage costs by increasing
Evolution overall storage utilization.
Customers who seek a technology refresh but wish to protect the investment in their current
storage systems.
Business
Customers with heterogeneous storage systems who wish to reduce their storage
management complexity and cost
Customers who want to match application data requirements to storage attributes throughout
its useful life.
Complexity Multiple businesses, divisions or departments, multiple user communities with divergent
storage needs and security requirements
Industry* Financial Services; Telecommunications; Transportation; Healthcare; Federal, State, and
Local Governments; Life Sciences
IT Locations Centralized IT organizations and / or consolidating data centers
IT / Storage-
Specific
IT Mix of open systems and mainframes, e.g., inherited via M&A or business consolidations
Environment Mix of enterprise and mid-range storage systems
Mix of storage connectivity technologies, e.g., Fibre Channel, ESCON, FICON, NAS, etc.
Growth Exponential growth of data in excess of 30% / yr with rising constraints on IT resources
* Solutions are horizontal, but manifest themselves differently
by vertical industry, through varying pains of Key Players
Sun Confidential: Internal Only 24
25. Key Players List ILLU
STR
Generic IT Department/Service Provider ATIV
E
Key Players Potential Pains
Chief Unable to meet SLA requirements of multiple and differing constituencies
Information Cost per I.T. Service Delivered is flat or increasing
Officer Difficulty providing an overall Business Continuity platform across multiple applications
Insufficient availability of mission critical applications
Increasing pressure to reduce IT costs, tightening budget restrictions, flat IT headcount
Most Unable to adapt IT capabilities to rapidly changing business requirements
Likely Unable to meet regulatory compliance and/or internal governance requirements
Power Difficulty providing support to consolidate newly acquired or existing businesses / systems / data centers
Sponsor
IT Vice Rapid growth in volume of data being stored and total storage costs
President Increasing costs due to ineffective utilization of storage capacity
Operations Managing increasing storage capacity with limited or decreasing staff
Multiplicity of storage software products with similar function is driving up cost
Unable to cost-effectively integrate and manage mainframe, open systems and multi-vendor environments
Decreasing available space, power, and cooling capacity in the data center
Difficulty providing advanced storage capabilities with legacy storage devices still on books or leased
Manager, Unable to meet application development project deadlines
Application Unable to ensure the quality of new applications due to the lack of adequate test data
Development Difficulty incorporating advanced disaster recovery capability into application design
IT Storage Unable to align storage assets cost trends and cost / performance characteristics with varying business needs
Director Slow and costly diagnosis and recovery from storage disruptions
Increasing storage capital expenditures and operational costs, including leases, manpower, and training
Unable to fully utilize existing storage assets yet simultaneously need for excessive storage inventory
Unable to centralize and simplify management of a wide range of diverse storage assets
Most Likely Unable to meet the storage demands of the business in a timely fashion due to a difficult storage device procurement
Sponsor process
Storage Difficulty planning for and migrating data from displaced equipment to new storage devices
Administrator Difficulty limiting storage growth due to departmental storage capacity requests being out of line with reality
Difficulty administrating changing storage requirements due to frequent changes in requirements
Unable to provisioning capacity across disparate NAS, SAN, and Mainframe islands
Provisioning processes are complex and error prone
Difficulty expanding capacity on existing file systems and adding additional storage capacity without impacting users
Sun Confidential: Internal Only 25
26. ST9900 Basic Operating System and Basic
Operating System V pricing
• Basic Operating System replaces Device & Resource Manager Suite (bundle)
> Simplified license keys
> Comparably priced
> Pricing is set to be very competitive
• Start with Basic Operating System License Base license
> Seven size based tiers priced per TB
> according to Internal Raw Capacity only
• Add Basic Operating System V License Base license
> Basic Operating System is a prerequisite
> Seven size based tiers priced per TB
> According to External Usable Capacity only
Sun Confidential: Internal Only 26
27. Mainframe Support
• The following Basic Operating System components support mainframe storage
> Device Manager
> Storage Navigator
> Virtual Partition Manager (cache partitions only)
> LUN Manager
> Logical Unit Size Expansion (LUSE)
> Virtual LVI/LUN Manager (VLVI)
> Customized Volume Size
> Volume Security Port Option performs the same function as SANtinel, but for
mainframe environments.
> Cache Management Host Agent
> Performance Monitor
> Data Retention Utility for Open Systems and IBM® z/OS®
> Volume Shredder
Sun Confidential: Internal Only 27
28. Device Manager and Storage Navigator
Hitachi Storage
Device Manager, Navigator
Path Provisioning,
Tiered Storage Manager,
Replication Monitor
Daily Operations
Backup Configuration Performance
Management Management Management
Performance Monitor
and Tuning Manager
Protection Manager,
Backup Services
Manager,
Data Protection Suite
Storage Navigator
Sun Confidential: Internal Only 28
30. Agenda
• Background
• Overview of Dynamic Provisioning software
• Services
• Technical Overview
Sun Confidential: Internal Only 2
31. Gartner – Future of Storage
December 2006 Data Center Conference
Sun Confidential: Internal Only 3
32. ComputerWorld
January 7, 2007
Oracle DB Users Wrestle With Storage Demand
Capacity shortfalls affecting database speeds and availability, survey finds
In September 2006, 366 members of the Independent Oracle Users
Group (IOUG) reported:
• 60% said that a lack of available storage has affected data base
performance
• 10% said performance has been significantly affected.
•46% said availability of their databases has been affected by storage
capacity issues.
•43% said they have delayed application rollouts because of a lack of
storage resources.
•31% of the respondents now manage data bases larger than 1TB which
is up 13% from previous year
According to the survey, some Oracle users are seeing such rapid data growth that
when budgeting for storage needs, they often make their best guesses and then tack on
10% to 25% as a safety margin.
Source: The IOUG and Unisphere Research
Sun Confidential: Internal Only 4
33. Thin Provisioning - Past and Present
From Wikipedia
Thin Provisioning* is a mechanism that applies to large-scale centralized
computer disk storage systems. Thin Provisioning allows space to be easily
allocated to servers, on a just-enough and just-in-time basis.
Over Allocation* is a mechanism that allows server applications to allocate
more storage capacity than has been physically reserved on the storage array
itself. This allows leeway in growth of application storage volumes, without
having to accurately predict which volumes will grow by how much. Physical
storage capacity on the array is only dedicated when data is actually written by
the application, not when the storage volume is initially allocated.
The STK SVA (“Iceberg”) was a successful storage device that did both in a mainframe
environment
•But note that Open Environments add complexities, which is why it is new.
Sun Confidential: Internal Only 5
34. Dynamic Provisioning
• To avoid future service interruptions, today it is common to over-allocate storage by
75% or more
• With Dynamic Provisioning you will be able to easily add disk capacity as needed,
when needed…
Purchase
capacity
As needed, at
future $/GB
Initial Disks are added
non-disruptively Thin Provisioning
Purchased, purchase when needed Warning messages
when additional storage
Allocated required
Allocation
Allocation
BUT UNUSED
Purchased, Allocated
BUT UNUSED Initial
purchase
Actual DATA Actual DATA
DP
Sun Confidential: Internal Only 6
35. Goals of Dynamic Provisioning
• Management cost reduction
> Remove the guess work of capacity planning
• Ease of maintenance
> Simpler administration, fewer outages
• Performance optimization
> Stripe using all available spindles
• Physical Capacity reduction
> Install what is needed when it is needed
• Existing product programs and applications interoperability
> DR/BC, migration and performance
• Predictive tool
> Sizing, monitoring and reporting
Sun Confidential: Internal Only 7
36. Dynamic Provisioning
Major Benefit: Simplified Management
• With Dynamic Provisioning software, application storage provisioning is
much simpler, faster, and less demanding on the administrator.
> To configure additional storage for an application, the administrator can
draw from the Dynamic Provisioning pool without immediately adding
physical disks.
> When a larger (virtual) volume is defined in the beginning, you do not
have to increase the volume capacity and change the configuration as
often.
> Separately, when more physical storage is needed you only need to
install additional physical disks into the Dynamic Provisioning disk pool
and you do not have to stop any hosts or applications during the
process.
• This decoupling of physical resource provisioning from application
provisioning simplifies storage management, reduces application outages,
saves time, and keeps costs down.
Sun Confidential: Internal Only 8
37. Dynamic Provisioning
Making Adding Storage Easy and Painless
Current planned yearly
Dynamic Provisioning
HDD addition points
Capacity
• Easy non-disruptive Pool
Volume expansion
Actual Physical Consumption
• Eliminate application
service interruptions to
install additional storage
capacity Time
• Use of physical disk space 4-6M later 1Y later 2Y later
is optimized, less over-
Benefit of Dynamic Provisioning
provisioning.
Easy Pool Volume expansion using Dynamic Provisioning
Allows shifting to a 4 month interval
Sun Confidential: Internal Only 9
38. Dynamic Provisioning
Performance Optimization Benefits
Optimizing Storage Servers
Performance
• Dynamic Provisioning
effectively combines many HDP Volume
applications I/O patterns and (Virtual LUN)
evenly spreads the I/O activity
across available physical HDP Pool
resources.
• This avoids particular parity LDEVs
LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV
groups from becoming Array Groups/Disk Drives
performance bottlenecks.
• Before Dynamic Provisioning,
this had to be done manually
by a storage expert
Sun Confidential: Internal Only 10
39. Dynamic Provisioning
Additional Benefits
• Increased flexibility in allocating storage
volumes for replication
> For Virtual Volumes, since the desired
capacity of volume can be defined
regardless of the physical disk capacity,
large volumes can be defined from the
start and LUSE is not necessary.
• The benefits of Dynamic Provisioning are
enhanced in replication environments
because the savings are greater
Sun Confidential: Internal Only 11
40. Dynamic Provisioning
Financial Benefits
What are the financial savings?
Reduce storage administration and related costs
Reduce capacity purchases and related
expenses
Reduce power consumption & heat in the data
center
Reclaim floor space in the data center
Sun Confidential: Internal Only 12
41. Dynamic Provisioning
Best Fits
> Best Fit on larger systems where the usage aggregation of a storage pool
across many spindles will demonstrate largest performance optimization.
• Each user gets access to a larger number of spindles
> Best Fit for stable environments and large consistently growing files or
volumes. It’s best used for applications such as enterprise databases and
archival applications where capacity growth rates are understood.
• Oracle and other databases that can grow and automatically expand
> Deferred storage purchase benefits will be limited with applications or file
systems that rapidly write in a sparse fashion over all their volume’s
allocation.
• Some Open Systems applications and file systems do just that, so the
benefits can be application-dependent.
Sun Confidential: Internal Only 13
42. Dynamic Provisioning
Summary of Benefits
• Simplified administration by separating the addition
of storage to an application from the installation of
physical disk capacity
• Eliminate application service interruptions to install
additional storage capacity
• Enhanced performance optimization for diversified
workloads
• Reduce Total Cost of Ownership by deferring storage
acquisitions and improve overall storage utilization
• Reduce Floor Space, Power and Cooling
requirements due to fewer physical disks
Sun Confidential: Internal Only 14
44. Dynamic Provisioning
How does it work?
Host Servers
Thin Provisioned
Volumes
Dynamic
Provisioning
Volume
(Virtual LUN)
Dynamic
Provisioning Actual storage capacity
is assigned when host
Pool
writes data to a LUN
LDEVs LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV
Array Groups/Disk Drives
Sun Confidential: Internal Only 16
45. What is Dynamic Provisioning
• Dynamic Provisioning - Provision “Virtual Capacity” to hosts/application.
> Virtual maximum capacity specified and provisioned
– Real capacity provisioned from Dynamic Provisioning pool as host ‘writes’ are
received
– Real capacity provisioned from Dynamic Provisioning pool in 42MB
chunks
V-VOL
DP Real Capacity POOL
Just in Time Space Allocation
Sun Confidential: Internal Only 17
46. Dynamic Provisioning
How does it work?
• The Storage Controller presents virtual volumes to hosts into which it maps storage from a
single physical pool as needed
• Technical Implementation:
> Logical volume: Virtual volume - same as snapshot V-Vol. Logical volumes are assigned
Pool Volume storage as needed
> Pool Volume: Physical volumes to store the actual data for logical volumes. Uses the same
technology as Snapshot Pool volumes.
> Dynamic Mapping Table: Dynamic access table between logical volumes and Pool
volumes.
Reporting
Logical/Virtual
Volumes
Physical Capacity
Dynamic
Mapping
Table
Sun Confidential: Internal Only 18
47. Dynamic Provisioning
Over-subscription Thresholds
How does it work?
DP POOL
The Storage Controller continuously monitors both the Fixed Threshold at 80%
DP POOL
“used” capacity and “virtual” capacity and has extensive User Settable Threshold.
Range is 5% to 95%
threshold-setting and alerting capabilities
Logical Vol. Alert
Set from 5% - 300%
Logical Volume A Logical Volume B Logical Volume C Logical Volume D DP POOL
Sun Confidential: Internal Only 19
48. Dynamic Provisioning
Over-subscription Thresholds
• Two thresholds for Dynamic Provisioning Pool capacity shortage management
– Fixed threshold at 80%
– Variable threshold to be set between 5% and 95%
– If either threshold exceeded an alert (SIM/SNMP Trap) is reported
• For each Dynamic Provisioning volume a single variable threshold is provided.
– Variable threshold to be set between 5% and 300% for each DP V-Volume
– Represent x% times the current unallocated capacity
– If free capacity in the DP Pool for this DP V-Volume falls below this threshold (in capacity) then alert
(SIM/SNMP Trap) reported
Free capacity
DP volume capacity
Fixed Threshold 80 %
Variable Threshold 5%-95% Pool
Allocated Capacity
Allocated
Sun Confidential: Internal Only 20
49. Benefit Quick Summary
Benefit Contents
(1) Simplify Volume Quick volume creation w/o formatting or physical installation
Creation and Freedom from volume expansion w/o physical configuration changes
Configuration Freedom of drives additions w/o logical configuration changes
(1) Easier Performance Automatic workload leveling across Pool.
Optimization
(1) Optimize Capacity Allow large logical volume size with minimum physical capacity usage.
Usage Dependent upon OS, filesystem, DB, and use characteristics.
Host FS Benefit(1) Benefit(2) Benefit(3) Note
JFS X X X
HP UX
HFS X X No Data is written every 10MB
Windows Server2003 NTFS X X X
XFS X X X
Linux
ext2/ext3 X X Some Data written every 128MB
UFS X X No Data is written every 52MB
Solaris VxFS X X X
ZFS X X X
JFS X X No Data is written every 8MB
AIX JFS2 X X X
VxFS X X X
Any OPEN-V supported Host, OS, and FS is supported by Dynamic Provisioning.
Sun Confidential: Internal Only 21
50. Dynamic Provisioning used with
ShadowImage multiplies savings
DP VVOL DP VVOL
Maximum Savings
SI PVOL SI SVOL
ShadowImage PAIR
DP VVOL Normal VOL
Normal VOL DP VVOL
SI PVOL SI SVOL SI PVOL SI SVOL
ShadowImage PAIR
ShadowImage PAIR
SI PVOL SI SVOL ShadowImage Pair notes
DP Virtual Volume DP Virtual Volume Supported, but Quick Restore is not supported.
DP Pool Volume DP Pool Volume Not Supported
Sun Confidential: Internal Only 22
51. Dynamic Provisioning Virtual Volumes
Specifications
Virtual Volumes Specification
Emulation type OPEN-V
RAID level Same as Pool Volumes
Capacity 46GB to 2.0TB
Number of volumes per pool 1 to 4096 (64K-8 total per RAID600)
Must be same SLPR and CLPR as the Pool.
Threshold Virtual Volume maximum potential Page consumption
compared to remaining available Pool space
Pool consumption unit 42MB (Page size)
Recommend that HDP volume size = n*42MB
Sizing Virtual Volumes Size of Virtual Volume limits amount of Pool space
potentially required. Application and File System behavior
controls reference patterns across the virtual volume
space.
Delete Virtual Volume Allowed. Pages returned as free Pool space.
Supported Program Products ShadowImage (P and S-Vol), LUNM, LUN Security, CVS,
SPM, DRU
Restrictions Not supported: ShadowImage S-Vol to a P-Vol on a
Normal volume, ShadowImage Quick Restore, TrueCopy,
UR, CoW, Volume Migration, and Flash Access.
Sun Confidential: Internal Only 23
52. Dynamic Provisioning Virtual Volumes
Specifications - continued
Virtual Volumes Specification
Performance Overhead exists in resolving DMT activities which will
increase response time. Impact on Host operation should
be minimal. DP performance has measured better than
USP.
Sequential performance is slightly disrupted due to Pages
not being contiguous. Estimated at about 90% of a normal
volume with sequential IO.
Performance is improved by spreading IO across a large
number of spindles.
Sun Confidential: Internal Only 24
53. Dynamic Provisioning Pool Volumes
Specifications
Pool Volumes Specification
Emulation type OPEN-V
RAID level All RAID600 supported levels. Recommended that all
volumes in a pool are the same RAID level.
Parity Group concatenation supported.
HDD type All RAID600 HDD types
Capacity 8GB to 2.0TB per Pool LDEV.
8GB to 286TB maximum aggregate Pool size.
Number of volumes in a pool 1 to 256
Volumes can be added dynamically.
Must be same SLPR and CLPR
Recommendations Dedicated parity groups
Number of Pools 1 – 32.
Allocation unit (page size) 42MB
Thresholds 2 thresholds: 80% and one user definable
Sun Confidential: Internal Only 25
54. Dynamic Provisioning Pool Volumes
Specifications - continued
Pool Volumes Specification
Sizing – Number of Parity Sizing tools can help determine approximate number of
Groups Parity Groups required based on a Normal I/O model.
RAID Level best practices apply.
Sizing – Cache Sizing tools can help determine approximate Cache
requirement based on a Normal I/O model.
Sizing Pool Space Cautious approach with Pool size being near equal to sum
of Virtual Volume capacities. Short term and long term
behavior of applications & file systems need to be known.
More aggressive Pool size to Virtual size can develop after
initial monitoring.
Delete Pool volume Must delete entire Pool after all virtual volumes deleted.
Restrictions Not supported: LUSE, ShadowImage, TrueCopy, HUR,
CoW, Volume Migration, LDEV Guard and Flash Access.
External Storage LDEVs.
Pool volumes can not be directly accessed from hosts.
Sun Confidential: Internal Only 26
55. Dynamic Provisioning
Planned support for HDS/Sun Software Products
Pogram Product HDP VVOL Planned Support
LUN Manager YES
Logical Unit Size Expansion NO
LUN Security YES
Customized Volume Size YES
Server Priority Manager YES
Data Retention Utility YES
Virtual Partition Manager YES
TrueCopy Sync PVOL/SVOL NO In Plan for Phase 3 (TBD)
Universal Replicator PVOL/SVOL NO In Plan for Phase 3 (TBD)
Universal Replicator Journal Volume NO
Copy on Write PVOL/SVOL NO In Plan for Phase 2 (TBD)
Copy on Write POOL volume NO
Cache Residency NO
UVM (HDP pool on external storage) NO In Plan for phase 2 (TBD)
Tiered Storage Manager NO In Plan for Phase 2 (TBD)
Sun Confidential: Internal Only 27