© 2006 Hitachi Data Systems
Consolidation of Storage
Infrastructures
by using Virtualization Solutions
Sascha Oehl
Hitachi...
2© 2006 Hitachi Data Systems
Agenda
What is
Storage
Virtualisation
Business
Driver
Q&A
Summary
How it works
3© 2006 Hitachi Data Systems
SNIA: The Customers Speak
4© 2006 Hitachi Data Systems
Virtualization Overview
- SNIA Storage Virtualization Definition
“An act of integrating one o...
5© 2006 Hitachi Data Systems
How to manage a data avalanche?
Appropriate Virtualisation techniques could support you
manag...
6© 2006 Hitachi Data Systems
Application Optimized Storage™
definiert
Application Optimized Storage ist:
A family of integ...
7© 2006 Hitachi Data Systems
The AOS Storagesystmes:
Tagmastore™
What is Tagmastore:
(tagma) = to groupΤάγμα
A family of i...
8© 2006 Hitachi Data Systems
Standard Approach
Thunder
9500v
Lightning
9960
Lightning
9980v
Other
Data
Value
Data
Mining
E...
9© 2006 Hitachi Data Systems
USP Virtualisation Approach
Thunder
9500v
Lightning
9960
Lightning
9980v
OtherUSP
Data
Value
...
10© 2006 Hitachi Data Systems
SNIA Storage Virtualisation
11© 2006 Hitachi Data Systems
Solution Requirements
- IT View
• The existing Storage Infrastructure should be reused in th...
12© 2006 Hitachi Data Systems
Solution Requirements
- DR View
• Extended similar function usage for all storage infrastruc...
13© 2006 Hitachi Data Systems
Solution Requirements
- Business View
• Changing Service Level Objectives
should be reflecte...
14© 2006 Hitachi Data Systems
Tiered Storage and Virtualization
Understanding “Storage Virtualization”
• Integrates a grou...
15© 2006 Hitachi Data Systems
Example of a current data centre
16© 2006 Hitachi Data Systems
17© 2006 Hitachi Data Systems
Example of a virtualised data centre
18© 2006 Hitachi Data Systems
The Engine
• Up to 192 FC Ports
• Up to 256 GB Cache
• Up to 1152 Internal Disks
• Internal ...
19© 2006 Hitachi Data Systems
• One physical port can
support multiple virtual ports
– Also called Host Storage Domains
– ...
20© 2006 Hitachi Data Systems
Virtualisation
The Concept
ELUN is a LUN which is
mapped to a LUN in an
external storage dev...
21© 2006 Hitachi Data Systems
• Volume Migration:
– Volume Migration allows a seamless migration of data between different...
22© 2006 Hitachi Data Systems
Volume Migration
between storage Tiers works
Vol
Online
Volume
Migration
LUN 00
Intern I0
Da...
23© 2006 Hitachi Data Systems
Hitachi Virtual Partition Manager
The Concept
• Cache Logical Partition (CLPR)
– Assigned sp...
24© 2006 Hitachi Data Systems
Hitachi Virtual Partition Manager
An example
FED
Front
End
BED
Back
End
Cache
Disk
Back
End
...
25© 2006 Hitachi Data Systems
Hitachi Virtual Partition Manager
An example
FED
Front
End
BED
Back
End
Cache
Disk
Back
End
...
26© 2006 Hitachi Data Systems
Correct data location
Relocate an Application
Consolidate
Retire an Array
Add an Array
Archi...
27© 2006 Hitachi Data Systems
The Management Interface
28© 2006 Hitachi Data Systems
Trend: Evolution of Storage Goes
Toward Consolidation and Automation
29© 2006 Hitachi Data Systems
Global Cache with separation of
control and data
Lightning: Introduction of first scalable
c...
30© 2006 Hitachi Data Systems
• Using Hitachi’s External Storage Virtualisation allows
changing the storage location of da...
31© 2006 Hitachi Data Systems
Tiered Storage
Externally Reference Customers
32© 2006 Hitachi Data Systems
Summary
• High reliable and stable platform
• Coverage of FC and FICON
• Easy integration of...
33© 2006 Hitachi Data Systems
Is your data in the right place?
Questions/Discussion
© 2006 Hitachi Data Systems
Thank you for your attention !
sascha.oehl@hds.com
Linux world   consolidation of storage infrastructures 2006
Nächste SlideShare
Wird geladen in …5
×

Linux world consolidation of storage infrastructures 2006

637 Aufrufe

Veröffentlicht am

Linux world consolidation of storage infrastructures 2006

Veröffentlicht in: Business
0 Kommentare
0 Gefällt mir
Statistik
Notizen
  • Als Erste(r) kommentieren

  • Gehören Sie zu den Ersten, denen das gefällt!

Keine Downloads
Aufrufe
Aufrufe insgesamt
637
Auf SlideShare
0
Aus Einbettungen
0
Anzahl an Einbettungen
451
Aktionen
Geteilt
0
Downloads
0
Kommentare
0
Gefällt mir
0
Einbettungen 0
Keine Einbettungen

Keine Notizen für die Folie
  • The Storage Networking Industry Association (SNIA) recently surveyed a number of end users on their main concerns with storage. These are the top five, in order of priority. There aren’t any surprises here.
    Tiered storage, as part Application Optimized Storage Solutions, addresses these pain points head on. But in order to understand the specific role tiered storage plays, we need to look at what Hitachi Data Systems means by Application Optimized Storage solutions.
  • The key message is that HDS is creating solutions that enable organizations to optimize storage infrastructure based upon application requirements. It is important to differentiate between optimizing applications with storage vs. optimizing storage to match application requirements. HDS does not claim to optimize applications, as that falls outside the core competencies of a storage company.
    Our core competency is optimizing storage based upon application requirements, in support of top line business objectives.
  • The key message is that HDS is creating solutions that enable organizations to optimize storage infrastructure based upon application requirements. It is important to differentiate between optimizing applications with storage vs. optimizing storage to match application requirements. HDS does not claim to optimize applications, as that falls outside the core competencies of a storage company.
    Our core competency is optimizing storage based upon application requirements, in support of top line business objectives.
  • If we look at a typical enterprise system we would find data stored on potentially inappropriate hardware, the graph here shows data storage in decreasing order of reliability (and therefore value) and data in terms of organisational value, maximum at the top {CLICK} In most systems today some of the important Data is in the most appropriate storage. In this example we have the Billing and Data Mining Data on the current most sophisticated solution, the Lightning 9980v - but the ERP system, despite being potentially the most important current data asset, is on the least appropriate system, either because it was the first system to be placed in the SAN or because of the complexities of moving it elsewhere. By introducing USP {CLICK}
  • We can use the USP’s management system to move the high value data immediately onto the fastest most reliable storage hardware in the system {CLICK} but, perhaps more importantly, we can tell the USP to over time realign the complete data centre against the most appropriate storage solution {CLICK}. Thus USP allows the experienced Data manager to move for the first time towards a Tiered Storage Solution, vastly improving the SAN performance and maximising the return on this considerable corporate asset {CLICK}
  • The Storage Networking Industry Association defines virtualization as:
    “An act of integrating one or more (back end) services or functions with additional (front end) functionality for the purpose of providing useful abstractions. Typically virtualization hides some of the back end complexity, or adds or integrates new functionality with existing back end services.”
    Okay, maybe a bit clinical, but it does highlight the point that virtualization is suppose to hide some of the complexity of storage. It is a key enabler to implementing and managing tiered storage.
    Virtualization overall:
    Allows for all multidimensional tiers to be consolidated into one pool
    Enables management of storage as one pool rather than separate tiers from a central console
    Enables such tasks as adjusting tiers and moving data without affecting the SAN, hosts, or applications
    Simplifies the implementation and management of storage tiers
    The Universal Storage Platform and Network Storage Controller offer a unique implementation of virtualization within the storage array. Not only does the Universal Storage Platform and Network Storage Controller offer virtualization, but it has a unique capability to logically attach additional storage arrays and virtualize those volumes and present them to the SAN as one storage pool, both to Open Systems hosts via the SAN and to mainframe hosts.
    To understand the need for tiered storage, customers should know the problems this solution will solve.
  • Hitachi Virtual Partition Manager
    Logical partitioning’s main enhancement is the partitioning of cache which is required to provide QoS. It prevents a heavy cache user from impacting other users who share the same TagmaStore Universal Storage Platform. With the Lightning 9900 V Series and Thunder 9500 V Series we could guarantee safe multi tenancy with Host Storage Domains. Multi tenancy means that multiple users can share the same storage port without over writing or seeing each other’s address space. Multi tenancy alone can not guarantee QoS unless the cache is also partitioned.
    This allows mission critical applications to share the same TagmaStore Universal Storage Platform. Critical applications used to require their own storage systems, since you would not want one application to do a data base re org while another critical application is going through peak processing. The logical partitions also have virtual serial numbers for chargeback.
  • Linux world consolidation of storage infrastructures 2006

    1. 1. © 2006 Hitachi Data Systems Consolidation of Storage Infrastructures by using Virtualization Solutions Sascha Oehl Hitachi Data Systems
    2. 2. 2© 2006 Hitachi Data Systems Agenda What is Storage Virtualisation Business Driver Q&A Summary How it works
    3. 3. 3© 2006 Hitachi Data Systems SNIA: The Customers Speak
    4. 4. 4© 2006 Hitachi Data Systems Virtualization Overview - SNIA Storage Virtualization Definition “An act of integrating one or more (back end) services or functions with additional (front end) functionality for the purpose of providing useful abstractions. Typically virtualization hides some of the back end complexity, or adds or integrates new functionality with existing back end services.” The SNIA Dictionary http://www.snia.org/education/dictionary/v/ Defines Virtualization as Contrary to this definition the competition adds complexity and reduces functionality
    5. 5. 5© 2006 Hitachi Data Systems How to manage a data avalanche? Appropriate Virtualisation techniques could support you managing the data avalanche!
    6. 6. 6© 2006 Hitachi Data Systems Application Optimized Storage™ definiert Application Optimized Storage ist: A family of integrated storage solutions that enable alignment of IT and business objectives by providing application-centric optimization of storage performance, availability, cost, and protection.
    7. 7. 7© 2006 Hitachi Data Systems The AOS Storagesystmes: Tagmastore™ What is Tagmastore: (tagma) = to groupΤάγμα A family of integrated storage solutions built upon a common framework of comprehensive storage, data, content, and application services providing the appropriate infrastructure, management, and data delivery to optimize all application storage requirements A key element of this philosophy is the integration of different vendor’s storage systems and the integration of these systems into a unique approach for tiered storage. This includes a fundamental cross system and cross vendor management.
    8. 8. 8© 2006 Hitachi Data Systems Standard Approach Thunder 9500v Lightning 9960 Lightning 9980v Other Data Value Data Mining ERP File Service Billing Order System Email Print Service
    9. 9. 9© 2006 Hitachi Data Systems USP Virtualisation Approach Thunder 9500v Lightning 9960 Lightning 9980v OtherUSP Data Value Data Mining ERP File Service Billing Order System Email Print Service USP
    10. 10. 10© 2006 Hitachi Data Systems SNIA Storage Virtualisation
    11. 11. 11© 2006 Hitachi Data Systems Solution Requirements - IT View • The existing Storage Infrastructure should be reused in the new concept. • Standard Tasks should be eased up. • Secure consolidation between Vendorspaces and Customers • Usage of Storage Space regardless which vendor has supplied the Space. • A single user interface for the total storage infrastructure. • Less work on weekends. • Simplified storage management.
    12. 12. 12© 2006 Hitachi Data Systems Solution Requirements - DR View • Extended similar function usage for all storage infrastructure • Replication from data between different vendor storage infrastructures. • Extended Distance Replication with old or modular storage systems. • Less impact to operational IT due to replication tasks. • Usage of storage space rather than vendor space.
    13. 13. 13© 2006 Hitachi Data Systems Solution Requirements - Business View • Changing Service Level Objectives should be reflected in storage infrastructure. • The IT has to meet the Service Level Agreements. • Data should reside on value equivalent storage quality. • Different Regulations should be covered which requires e.g. replication of data to a data centre in a wide distance.
    14. 14. 14© 2006 Hitachi Data Systems Tiered Storage and Virtualization Understanding “Storage Virtualization” • Integrates a group of independent storage devices into a single pool of storage capacity independent of their physical location • Facilitates the use of storage tiers to match data life cycle needs • Simplify and Unify heterogeneous control and management under a single interface – Common volume management, security, replication and copy services for all heterogeneous storage • Dynamically allocate capacity as needed to any class of storage – Enable the matching of the storage resources to the business requirements with assurance of QOS
    15. 15. 15© 2006 Hitachi Data Systems Example of a current data centre
    16. 16. 16© 2006 Hitachi Data Systems
    17. 17. 17© 2006 Hitachi Data Systems Example of a virtualised data centre
    18. 18. 18© 2006 Hitachi Data Systems The Engine • Up to 192 FC Ports • Up to 256 GB Cache • Up to 1152 Internal Disks • Internal Raid 5, Raid 6 + Raid 10 Support • Up to 32 PB managed Storage • No port down for code upgrades B E D P A I R B E D P A I R B E D P A I R B E D P A I R Shared Memory Cache Side Processor Side Cache Side Processor Side CACHE FED Shared Memory Cache Side Processor Side Cache Side Processor Side CACHE FED Shared Memory Cache Side Processor Side Cache Side Processor Side CACHE FED Shared Memory Cache Side Processor Side Cache Side Processor Side CACHE FED
    19. 19. 19© 2006 Hitachi Data Systems • One physical port can support multiple virtual ports – Also called Host Storage Domains – Enables consolidation of mixed workloads – Reduction of number of ports – Higher port utilization can be achieved – Investment protection • Server Priority Manager – Allocates bandwidth to virtual ports based on QoS requirements • IOPS or MB/s • No port down for code upgrades Port Virtualisation The Basics
    20. 20. 20© 2006 Hitachi Data Systems Virtualisation The Concept ELUN is a LUN which is mapped to a LUN in an external storage device
    21. 21. 21© 2006 Hitachi Data Systems • Volume Migration: – Volume Migration allows a seamless migration of data between different Storage spaces. Every internal or attached Storage space could be used as Migration source or target. – Migration is done without interfering the server. – The Server is up an running during migration. – Volume Migration could be used for data movement for migration purposes or for realignment to storage classes. Volume Migration Example Migrating existing Storage LUN 00 LUN 00 Intern E0 Server LUN 00 Intern I0 Existing Storage USP Storagesystem Volume Migration Single Server Downtime
    22. 22. 22© 2006 Hitachi Data Systems Volume Migration between storage Tiers works Vol Online Volume Migration LUN 00 Intern I0 Data Access Data Access Online
    23. 23. 23© 2006 Hitachi Data Systems Hitachi Virtual Partition Manager The Concept • Cache Logical Partition (CLPR) – Assigned specific cache capacity – Assigned one or more Parity Groups to use the cache • Storage Logical Partition (SLPR) – Assigned one or more CLPRs – Assigned one or more Target Ports to use the CLPRs
    24. 24. 24© 2006 Hitachi Data Systems Hitachi Virtual Partition Manager An example FED Front End BED Back End Cache Disk Back End 32 FC 32 FC 32 FC 16 FC 16 Ficon BED BED BED BED USP Storagesystem 256 GB Virtualised Storage System
    25. 25. 25© 2006 Hitachi Data Systems Hitachi Virtual Partition Manager An example FED Front End BED Back End Cache Disk Back End 32 FC 32 FC 32 FC 16 FC 16 Ficon 160 GB BED BED BED BED 16 GB USP Storagesystem 256 GB 24 GB56 GB Virtualised Storage System
    26. 26. 26© 2006 Hitachi Data Systems Correct data location Relocate an Application Consolidate Retire an Array Add an Array Archive volumes … Exchange DB Exchange Log Order Entry DB Web Commerce Appl. Development Transaction logs Reservation Sys Manufacturing DB Help Desk Food Distribution Scheduling Logistics Mapping USP mit externen Speicher Storage-Infrastructur appears as a Storage Pool Applicationdata is stored in the approperiate Storage Tier / Class Simplification HiCommand Tiered Storage Manager in Action
    27. 27. 27© 2006 Hitachi Data Systems The Management Interface
    28. 28. 28© 2006 Hitachi Data Systems Trend: Evolution of Storage Goes Toward Consolidation and Automation
    29. 29. 29© 2006 Hitachi Data Systems Global Cache with separation of control and data Lightning: Introduction of first scalable crossbar switch architecture Lightning V: Introduction of Virtual Storage Ports and Host Storage Domains with second generation of crossbar switch architecture HiCommand Storage Services Manager: Introduction of Storage Area Management and heterogeneous (external) storage management Cross-System Copy is introduced to move data between Lightning V and Thunder V without host intervention Universal Storage Platform enables large-scale virtualization of externally attached storage behind third generation crossbar switch architecture 1995 2000 2002 2003 2003 2004 Hitachi Storage Virtualisation An Evolutionary Approach
    30. 30. 30© 2006 Hitachi Data Systems • Using Hitachi’s External Storage Virtualisation allows changing the storage location of data without changing the appearance to the server. • The Fibre Channel Addressing, Source ID, Target ID, in the Frame Header and the FCP_LUN Information in the Payload field are not changed by the migration of the data between storage level. • The device files in the Operating System are still the same. There is no impact to the server‘s IO Subsystem. • The data is unmodified. A devirtualisation is easy achievable. No vendor lock-in. Freedom for Data
    31. 31. 31© 2006 Hitachi Data Systems Tiered Storage Externally Reference Customers
    32. 32. 32© 2006 Hitachi Data Systems Summary • High reliable and stable platform • Coverage of FC and FICON • Easy integration of existing storage and server infrastructure • Storage Pooling across different Vendorspace • Single Management Interface • Single Replication Tool • Manages Storagespace rather then Vendorspace • Excellent Price / Value • Changing SLO are easy implementable • Consolidation tools between different vendor and customer
    33. 33. 33© 2006 Hitachi Data Systems Is your data in the right place?
    34. 34. Questions/Discussion © 2006 Hitachi Data Systems Thank you for your attention ! sascha.oehl@hds.com

    ×