Werner Eggli präsentiert Trends und Lösungen für Flash Storage im Enterprise Einsatz.

1. Osys AG | Hofwiesenstrasse 350 | 8050 Zürich
Telefon +41 44 317 18 19 | Fax +41 44 317 18 20 | office@osys.ch | www.osys.ch
© 2012
Flash Storage Trends
Osys Techtalk
Werner Eggli
Senior IT Specialist | werner.eggli@osys.ch
September 2013

2. - Überblick Storage Technologie
- IBM Flash Systems
- Einsatz von Flash Technologie in IBM Storage Systemen

3. - Überblick Storage Technologie

4. Seite 4
Capacity Growth

5. Seite 5
Disk History
 1956 IBM RAMAC
 first disk drive in the world
 approx. 5 MB storage,
 1200 rpm
 access time > 600ms
 weight > 1ooo kg
 1956 to 2013
 12.5 times increase in RPM
 240‘000 times increase in capacity (vs. SAS/1.2TB)

6. Seite 6
Hard Disk
RPM Latency
(ms)
Seek (ms) IO/s *
FC/SAS 15000 2 4 167
FC/SAS 10000 3 5 125
SATA/SAS 7200 4.2 9 76
- Performance Entwicklung
- Performance heute:
* 100% Random
IO Rate per GB und
Hard Disk Drive Generation
0.1
1
10
100
1000
1985 1990 1995 2000 2005 2010
IOPS/GB
15k RPM
10k RPM
Desktop
5400 & 7200
<= 7200 RPM
Seit 1990 um Faktor 100
schlechter

7. Seite 7
Annual Areal Density Growth Disk

8. Seite 8
- ATA, SATA, FATA, SAS (2.0), FC-Platten
- 3 ½ Zoll vs. 2 ½ Zoll Formfaktor
- GMR (Giant Magneto-Resistance) stark ausgereizt
Hard Disk
Heat Assisted
Magnetic
Recording (HAMR)
Bit Patterned Media
(BPM)
Hard Disk - Roadmap
Disk Technologie

9. Seite 9
Annual Areal Density Growth Rate Scenarios

10. Seite 10
Demo Hardware Platform
Press release on Jan 22, 2010: http://www.zurich.ibm.com/news/10/storage.html
 Perpendicular Recording (senkrechte Bitanordnung)
 Ultrafeine Barium-Ferrit-Medien ohne Metallaufdampfen
 Reduktion der Spurabweichung auf unter 25 nm
 Spurbreite auf unter 0.45 µm (Faktor 25)
 Erhöhung S/L-Geschwindigkeit um Faktor 38
 Archivierung und Langzeitdatenspeicherung
 riesige Kassettenkapazitäten
 stromloser austauschbarer Datenträger
 Linear Tape File System LTFS
Tape Demonstration – 35 TB Kassette

11. Seite 11
Entwicklung der letzten 10 Jahre
In the last 10 years:
CPU Performance 8 - 10x increase
DRAM Speed 7- 9x
Network Speed 100x
Bus Speed 20x
Disk Speed 1.2X …and everything waits
Source: IBM and Industry Estimates

12. Seite 12
 SLC = Single Level Cell
 1 Bit per Zelle
 100.000 Schreibzyklen
 eMLC = Enterprise MLC
 2 Bit per Zelle
30.000 Schreibzyklen
MLC = Multi Level Cell
 2 Bit per Zelle
 3.000 Schreibzyklen
 TLC = Triple Level Cell
 3 Bit per Zelle
 1.000 Schreibzyklen
Aufbau einer Flash Speicherzelle mit Floating Gate
Oxydschicht Control Gate Floating Gate
DrainSource
P-Schicht
N-SchichtN-Schicht
0
10
20
30
40
50
60
70
80
90
100
MLC eMLC SLC
P/ECycles(Thousands)
Flash Type
Typical Chip Endurance
Flash Technologie

13. Seite 13
Reale Haltbarkeit ist Device abhängig
Kalkulierbare Haltbarkeit:
 SLC Flash Konfiguration 10 TB, 1 GBps Schreiben
 eMLC Flash Konfiguration 10 TB, 1 GBps Schreiben
 MLC Flash Konfiguration 10 TB, 1GBps Schreiben
EnduranceYears
GBps
TB
7.31
1
000,10010


EnduranceYears
GBps
TB
5.9
1
000,3010


yearathanLess
GBps
TB


1
000,310

14. Seite 14
Flash Preisentwicklung per GB
• SLC Chips halten 35 x länger vs. MLC und 3 x länger vs. eMLC
• Preis SLC vs. eMLC 2:1
• Preis SLC vs. MLC 8:1
• eMLC Chips halten 10 x länger vs. MLC
• Preis 4:1 vs. MLC

15. Seite 15ibm.comstorageflash
Solid State Disk Drive Performance Comparison

16. Seite 16
Flash V-NAND
(Samsung Announcement 13. AUG 2013)

17. Seite 17
Leistungsklasse Flash
Antwortzeiten
1ns
500µs
1000ns
1µs
500ns
1ms
1000µs
DRAM
L1 L2 .. LX
Kosten
Leistungsklasse „Flash“
Storage Class Memory
SCM
(PCM, Phase Change Memory)
Flashspeicher

18. Seite 18
• Magnetic Pattern auf Nano-Drähten
• Permalloy (FeNi-Legierung)
• Leistung im Nano-Sekunden Bereich
• Fast keinen Stromverbrauch
• Dreidimensionale Chip Technologie
• 100 Bits per Draht, mehrere
...Millionen.Drähte per Chip
• 100-1000 fach höhere Kapazitäten zu
...Flash Memories
Stuart Parkin
•Louis Neel Medaille (2009)
•IUPAP-Award (2009)
(International Union of Pure and Applied Physics-magnetism)
Racetrack Memory Chips

19. Seite 19
Neuordnung der Speicherhierarchie
Storage Class Memory (SCM)
Archivierung
CPU RAM DISK
CPU SCM (PCM)
TAPE
RAM
CPU DISK
FC, SATA, SAS
TAPE2013
1980
2018+
Aktiver SpeicherMemoryLogik
TAPE
DISK
SATA/SAS
FLASHRAM
Memory like … storage like

20. Seite 20
• Consumer disk and enterprise tape will persist for the foreseeable future
• Flash will come into its own
• Flash may drive out enterprise disk, and if it doesn’t, SCM will
• When will SCM arrive?
That will depend on the path the NAND industry takes after the 16-20nm node…
• 3-D NAND succeeds: new NVMs (such as PCM, RRAM, STT-RAM) will develop
slowly, driven only by SCM/embedded market
• 3-D NAND fails or is late: one new NVM will be driven rapidly by NAND market
• If the latter, SCM could become the dominant storage technology by 2020
• The application software stack will be redesigned to utilize SCM-enabled
persistent memory
What does the future hold?

21. - Überblick Storage Technologie
- IBM Flash Systems

22. Seite 22
Tape-Libraries
Jaguar
LTO
V7000 / V7000U
XIV
VTL-Systeme
SVCV3700
DS8870
ManagementTivoli SW
Flex-Systems
Infrastrukutur
und Software
Storwize
Familiy
Enterprise
Systeme
Data Protection-
Retention
IBM Storage Portfolio Q2 2013

23. Seite 23
300+ Customers
In over 50
countries
30+ Patents
Strong IP Base
34 Year History
Deep Expertise
Recognized
by IBM Research
PROVEN FLASH TECHNOLOGY LEADER
Why TMS?

24. Seite 24
Accelerate critical applications and unleash the power of performance
IBM FlashSystem
offers extreme performance, low latency
and enterprise attributes to handle fast
moving operational data in real time
Completing the Flash Pyramid with All-Flash Arrays

25. Seite 25
•Shipped over 72 Petabytes
of Flash storage in 2012
•Broad array of products to fit
a wide variety of client needs
•Varying capacity and
performance to match
client workloads
•Several form factors to fit
into varying needs of
datacenter real estate
EXP30 Ultra SSD Drawer eXFlash IBM High IOPS Adapters
Storwize
V7000/3700
DS8000
IBM Delivers Flash-Based Products in all Segments
IBM FlashSystem
XIV
IBM Flash Portfolio

26. Seite 26
Tape
HDD
Form Factor
SSD
PCIe SSD
Seconds
5-15 milliseconds
~1 milliseconds
< 1 millisecond
IBM FlashSystem
100 microseconds
…consistent latency
1U up to 20TB
1 second =
1 million microseconds
Systems Comparison

27. Seite 27
I/O Serviced by Disk
1. Issue I/O request ~ 100 μs
2. Wait for I/O to be serviced ~ 5,000 μs
3. Process I/O ~ 100 μs
 Time to process 1 I/O request = 200 μs + 5,000 μs = 5,200 μs
 CPU Utilization = Wait time / Processing time = 200 / 5,200 = ~4%
Time
Processing
~100 µs ~100 µs
Waiting
~5,000 µs
1 I/O Request
CPU State
I/O Serviced by IBM FlashSystem
1. Issue I/O request ~ 100 μs
2. Wait for I/O to be serviced ~ 200 μs
3. Process I/O ~ 100 μs
 Time to process 1 I/O request = 200 μs + 200 μs = 400 μs
 CPU Utilization = Wait time / Processing time = 200 / 400 = 50% Time
Processing
~100 µs ~100 µs
Waiting
~200 µs
1 I/O Request
CPU State
12X Application benefit: CPU and
Application Efficiency Gain
Microsecond latency maximizes CPU utilization
and efficiency

28. Seite 30
SLC Flash eMLC Flash
Model 710 720 810 820
Usable
Capacity
1-5 TB
(1 TB increments)
5 or 10 TB
(6 or 12 TB RAID 0)
2-10 TB
(2 TB increments)
10 or 20 TB
(12 or 24 TB RAID 0)
Latency
(R/W)
90/25 us 90/25 us 110/25 us 110/25 us
IOPS 450K 500K 400K 450K
Bandwidth 4 GB/s 5 GB/s 4 GB/s 4 GB/s
Interfaces 4x 8Gbit FC or 4x 40Gbit IB 4x 8Gbit FC or 4x 40Gbit IB
Data
Protection
VSR™
2D Flash
RAID™
(inc. VSR™)
VSR™
2D Flash
RAID™
(inc. VSR™)
All units 1U form factor, less than 500 Watts
IBM/TMS Shared Flash Systems

29. Seite 31
• 1 Petabyte: 1 Floor Tile
• 100 microsecond latency
• 22 Million IOPS
• 210 GB/s
• 12.6 KW power
Less power than the
average 200TB array
22 Million IOPS Alternative
1 Rack
1 Petabyte, 1 rack. What it means

30. - Überblick Storage Technologie
- IBM Flash Systems
- Einsatz von Flash Technologie in IBM Storage Systemen

31. Seite 33
Delivered with IBM on-site Integration
Extreme Performance Enterprise Capabilities
SAN Volume Controller
Extreme Performance with IBM MicroLatency™
All Flash 20 TB RAIDed data capacity
Macro Efficiency 1U form factor
Variable Stripe RAID and 2-D RAID for Enterprise Reliability
IBM FlashSystem 820
Business Continuity with Copy Services
Flash Copy for Backup & Optimal Workload Availability
$/TB Value with Thin Provisioning & Real Time
Compression
Drive Storage Efficiency with Easy Tier
High performance enterprise class featured solution
Skalierbar bis 1.3M IOPs für höchste Anforderungen an Performance, Funktionalität und Zuverlässigkeit
IBM FlashSystem Solution

32. Seite 34
OLTP Databases
– Financial, gaming, real-time billing, trading, real-time monitoring, query
acceleration (DB2/Oracle), etc.
Analytical applications (OLAP)
– Business intelligence, batch processing, ERP systems, reporting,
massive data feeds, etc.
Virtual Infrastructures
– VDI, Consolidated virtual infrastructures, user profiles, etc.
HPC/Computational Applications
– Simulation, modeling, rendering, FS metadata, scratch space, video on
demand, thread efficiency, etc.
Cloud-scale Infrastructures
– On-demand computing, content distribution, web, caching, metadata,
GPFS, active file management, etc.
Financial Government E-Commerce HPC Telecom
Application Sweet Spots: Do More, Do it Faster!

33. Seite 35
Manual Data Placement
• Best performance
Easy Tier
• Best capacity efficiency
Preferred Read
• Massive acceleration and
preserves storage investment
IBM Flash Deployment Strategies Review

34. Seite 36
Vollautomatisches Verfahren, das die Zugriffe auf
jeden Datenblock fortwährend analysiert und
zwischen den vorhandenen Speicher-Klassen
verschiebt und so eine optimale Verteilung der
gespeicherten Daten über die vorhandenen
Speicher-Ressourcen sicherstellt.
Steht sowohl für Speichersysteme als auch für
die IBM Speicher-Virtualisierungs-Lösung zur
Verfügung so dass auch ein Tiering zwischen
verschiedenen Speichersystemen möglich wird.
Für Easy Tier/DS8870 stehen Schnittstellen
zur Verfügung, mit denen Administratoren
und Applikationen Einfluß auf die Daten-
platzierung nehmen und so die Leistungs-
fähigkeit der Systeme zusätzlich optimieren
können.
SSD RAID Array(s)
FC/SAS RAID Array(s)
SATA RAID Array(s)
Easy Tier
Application
Data Placement
IBM Easy Tier
Selbstoptimierende Speicher-Infrastrukturen

35. Seite 37
IBM Storwize Family

36. Seite 38
 Benefits – performance, high availability
 SVC stores two copies of a volume (copy0/copy1)
– Reads from primary copy (c0) - “Preferred Read”
– Writes to both copies (c0 and c1)
– Primary copy may be dynamically changed
– Easy to use – just add a copy to an existing volume
 Single volume presented to host server
 A local high availability function
– Each copy of the volume is on a separate storage system
– If disk supporting one copy is unavailable, SVC provides
continuous data access from the other copy
– Copies are automatically resynchronized when disk is
available again
 Copies can be split
– Either copy can continue as production copy
 Either or both copies may be thin-provisioned
– Efficient utilization of FlashSystem
Write to both copies
SVC
IBM FlashSystem 820
Legacy or new
disk storage in
SVC
environment
Server
SVC Volume Mirroring & Preferred Read

37. “The IBM FlashSystem solution also allows us to identify and
address potential customer issues faster, helping us to
maintain and build our subscriber numbers—which is
absolutely the most critical metric in our industry.”
-Karim Abdullah, Director of IT Operations Enterprise Data
Center Shared Services, Sprint Nextel
Sprint drives 45-times performance improvement!
The need
Sprint Nextel call-center
operatives need fast,
reliable access to data on
accounts, usage and
billing.
The solution
Sprint Nextel deployed
nine IBM® FlashSystem™
820 solutions with a total
of 150 TB of eMLC flash,
virtualized and managed
through IBM System
Storage® SAN Volume
Controller.
The benefit
• Cut latency by 10x
• Reduced Energy
Consumption
• Easy integration into
existing environment
Click here to read full story.

38. Seite 4040
XIV SSD Read Cache
 SSD field upgrade
– XIV Gen3 hardware is SSD ready
– In order to activate SSD feature, all
modules must have SSD feature
installed
– XIV Gen3 v11.1 required, no downtime
required
 SSD maintenance - no data loss
– Can be phased out, tested, replaced
and phased in
– Only contains read data
• XIV redundant data scheme unchanged
– We do not protect this data in any way - no
need
– Reads are redirected
RAM
SSD as
CACHE
Non-SSD
Drives
System Module

39. Seite 41
Core ERP (IOPS)
 CRM and Financial DB Workload
 70/30/8k
Medical Record App Server (RT)
 Healthcare EMR Workload
 100% random IO
DB2 Brokerage (IOPS)
Heavy Random Brokerage
90/10, Mixed block IO
84% Random Read Miss
Websphere Datastore (IOPS)
 Web 2.0 OLTP Workload
 80/20/4k
Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending
upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can
be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
Outstanding Applications Performance with SSD Caching
41

40. Seite 43
Greater Exploitation of Flash
All-HDD
Hybrid with
Easy Tier
All-flash
5-15 milliseconds
~ 1 millisecond
< 1 millisecond
Enterprise-class DS8000 flash evolution

41. Seite 44
IBM Power p / DS8000 integration
Easy Tier Server is an architecture:
 A Host flash-cache based on IBM research technology
using IBM flash hardware (Easy Tier Caching Client)
 Easy Tier based algorithms for automatic application
aware system-wide optimization (Easy Tier / Easy Tier
Caching Server)
 A proprietary protocol provides in band (SAN)
communication and coherency
Hosts (Caching Clients)
 Work independently to cache their applications IO
streams providing real-time performance enhancement
 Use the Cooperative Caching protocol to have
cooperative system-aware caching that interfaces with
IBM Storage running the Cooperative Caching Server
Host
Caching
Client
IBM Server IBM Server
Host
Caching
Client
Easy Tier
Caching
Server
DS8870
Flash
Cache
SAN
Flash
Cache
SSD
HDD
Easy Tier 5 - Easy Tier Server Overview

42. Seite 45
1,056 15k hard disk drives
(today)
224 flash drives (today)
146GB 15k
(RAID 10)
2Q13All-Flash
(RAID 5)
YE13 All-Flash
(RAID 5)
Usable Capacity 72TB usable performance optimized comparison point
Raw Capacity 1.72x 1x 1x
Response Time ~ 1ms ~ 0.3ms ~ 0.1ms
Floor space 1.33x 1X 0.66x
Energy Usage 13.9kw 5.7kw ~ 5.0kw
¢ / GB / IOP 1x ~ 1x < 1x
224 flash drives
(4Q13)
DS8800 All Flash: Today and Tomorrow

43. Seite 46
 Tape tier storage:
– Improve cost structure of Easy Tier
storage
– Maximize performance / cost benefit
– Automatically migrate idle extents to tape
tier
– Extents restore to disk when accessed
– Perfect for medical photos, digital library,
Cloud, & video streaming applications
 Benefits
– Eliminate the management cost of
archive/restore process
• Tape data appear as online to users
– Reduce $/GB
– Reduce energy expense
– Reduce floor space usage
Performance and Efficiency- 1H14
SSD
Enterprise Disk
Nearline Disk
Tape
EasyTierDataMovement
DS8000
Tape Storage for Easy Tier (planned)

44. Seite 47