The latest from IBM Spectrum Storage

1. © Copyright IBM Corporation 2015
Spectrum Scale 4.2
Elastic Storage Server 3.5
Name
Title

2. © Copyright IBM Corporation 2015 2
• Family of Software-Defined-Storage
– Common management and user experience
– Deployment flexibility as software, appliance or cloud service
– High-performance, enterprise storage
• Securely manage the explosive growth of data
– Unified analytics-driven management for any storage
– Advanced data placement to maximize
performance, availability, and cost efficiency
– Built upon proven, flexible and scalable solutions from IBM
FlashSystemAny
Storage
Private, Public
or Hybrid Cloud
Control
Virtualize Accelerate Scale
Family of Storage Management
and Optimization Software
Protect Archive

3. © Copyright IBM Corporation 2015
IBM Spectrum Storage Family
FlashSystem
Any Storage
Private, Public
or Hybrid Cloud
IBM Spectrum Control
IBM Spectrum Protect
IBM Spectrum Archive
IBM Spectrum Virtualize
IBM Spectrum Accelerate
IBM Spectrum Scale
Storage and data optimization to reduce
storage costs by up to 73 percent
Optimized data protection to reduce
backup costs by up to 53 percent
Fast data retention that reduces TCO
for active archive data by up to 90%
Virtualization of mixed environments
stores up to 5x more data
Enterprise storage for cloud deployed in
minutes instead of months
High-performance, highly scalable storage
for file, object and analytics
3

4. © Copyright IBM Corporation 2015
FlashSystem
Any Storage
Private, Public
or Hybrid Cloud
IBM Spectrum Control
IBM Spectrum Protect
IBM Spectrum Archive
IBM Spectrum Virtualize
IBM Spectrum Accelerate
IBM Spectrum Scale
Storage and data optimization to reduce
storage costs by up to 73 percent
Optimized data protection to reduce
backup costs by up to 53 percent
Fast data retention that reduces TCO
for active archive data by up to 90%
Virtualization of mixed environments
stores up to 5x more data
Enterprise storage for cloud deployed in
minutes instead of months
High-performance, highly scalable storage
for file, object and analytics
IBM Spectrum Scale: Store everywhere. Run anywhere.
4

5. © Copyright IBM Corporation 2015
• Remove data-related bottlenecks
Demonstrated 400 GB/s throughput
• Enable global collaboration
Data Lake serving HDFS, files & object across sites
• Optimize cost and performance
Up to 90% cost savings & 6x flash acceleration
• Ensure data availability, integrity and security
End-to-end checksum, Spectrum Scale RAID, NIST/FIPS certification
6
Introducing IBM Spectrum Scale
Highly scalable high-performance unified storage
for files and objects with integrated analytics

6. © Copyright IBM Corporation 2015
The History of Spectrum Scale
This infographic is the genealogy of IBM Spectrum Scale, from it’s birth as a digital
media server and HPC research project to it’s place as a foundational element in the
IBM Spectrum Storage family. It highlights key milestones in the product history,
usage, and industry to convey that Spectrum Scale may have started as GPFS, but it
is so much more now. IBM has invested in the enterprise features that make it easy
to use, reliable and suitable for mission critical storage of all types.
8

7. © Copyright IBM Corporation 2015 11
What’s New in
IBM Spectrum Scale 4.2 and IBM Elastic Storage Server 3.5
• Reduce capital and operating expense for storage supporting cognitive applications
– Enable a common pool of storage for modern workloads with unified file and object storage
– Policy-driven compression and QoS
• Accelerate analytics applications
– Eliminate need to move data back and forth from Hadoop/HDFS storage silos with integrated HDFS
– Automate Big Data deployment with Apache Ambari support
• Speed and simplify deployment
– New Spectrum Scale GUI modeled on IBM Spectrum Storage family and improved ESS setup
– Expand management options with Spectrum Control integration
– Fully functional virtual machine demonstration lowers barriers to adoption

8. © Copyright IBM Corporation 2015 12
Reduce Expenses: Redefining Unified Storage
• Challenge
– Managing data growth
o Lowering costs with archive
o Managing data retrieval & app support
o Data movement & translation overhead
• Unified Scale-out Content Repository
– File In/Out, Object In/Out, Integrated Analytics
– High-performance native protocols
– Single Management Plane
– Enterprise storage features across file and object
SSD Fast
Disk
Slow
Disk
Tape
Spectrum Scale
NFS SMBPOSIX Swift/S3HDFS

9. © Copyright IBM Corporation 2015 13
Accelerate Analytics: Native HDFS Transparency
• Challenge
– Separate storage systems for ingest, analysis, results
o HDFS requires locality aware storage (namenode)
o Data transfer slows time to results
o Different frameworks & analytics tools use data differently
• Native HDFS support
– Map/Reduce on shared, or shared nothing storage
– No waiting for data transfer between storage systems
– Immediately share results
– Single ‘Data Lake’ for all applications

10. © Copyright IBM Corporation 2015
• Reduce administration overhead
– Graphical User Interface for common tasks
• Easy to adopt
– Base interface on common IBM Storage Framework
• Integrated into Spectrum Control
– Storage portfolio visibility
o Consolidated management
o Multiple clusters
14
Speed and Simplicity: Graphical User Interface

11. © Copyright IBM Corporation 2015
• System Health
• Node performance
• Network traffic
• Historical Trends
Speed and Simplicity: Performance Monitoring Highlights

12. © Copyright IBM Corporation 2015 16
Reduce Costs: Compression
• Improved storage efficiency
– Typically 2x improvement in storage efficiency
• Improved i/o bandwidth
– Read/write compressed data reduces load on storage backend
• Improved client side caching
– Caching compressed data increases apparent cache size
• Compression is controlled per file
– By administrator defined policy rules
Vision
• Which files to compress
• When to compress the file data
• How to compress the file data

13. © Copyright IBM Corporation 2015 17
Remove Data Bottlenecks
• Quality of Service
– Throttle background functions such as rebuild or async replication
– Set by flexible policy, such as day-of-week and time-of-day
• Highly Available Write Cache (HAWC)
– Improves performance of small synchronous writes
– Small synch writes are written to the log. As log fills, rewrite to home.
• Local Read Only Cache (LROC)
– Extend the page pool memory to include local SSD for read caching
• Distributed and flash accelerated metadata
– Metadata includes directories, inodes, indirect blocks
• Lift data to the highest tiers based on the file’s “heat”

14. © Copyright IBM Corporation 2015 18
New Feature Benefit
Client Experience
Focus •Common interface across Spectrum Portfolio
•GUI Phase 1
Easy to learn UI and integration across
Spectrum Storage portfolio
Simplify common management functions, including
•Enabling protocols
•Policy driven placement and ILM
•Monitoring
•Troubleshooting
Object Storage •Unified File and Object
•Extended S3 API support
Single view of data with wither file or object read and write
Enable applications originally written for AWS
Big Data & Analytics
•Native Hadoop Support
•Ambari Integration
Higher performance and broader integration with HDFS applications
to go beyond Hadoop and embrace Map/
Reduce ecosystem
General
•Quality of Service for File
•Compression for File and Object
•z Linux Asynch DR and Backup
Expanding functionality in Spectrum Scale data aware
policy engine:
•Performance reservations to meet SLAs – even by time of day
•Efficiently reduce data size by up to 50% based upon business or technical
policy
•Extending multi-site resiliency features to z-Linux
Spectrum Scale RAID •Expanding erasure code support on
Elastic Storage Server
Higher resiliency and faster rebuild times for
Elastic Storage Server
New in Spectrum Scale 4.2

15. © Copyright IBM Corporation 2015 19
Software Cloud serviceAppliance
Get it your way

16. © Copyright IBM Corporation 2015
IBM Elastic Storage Server (ESS)
Integrated scale out data management for file and object data
• Optimal building block for high-performance, scalable,
reliable enterprise storage
– Faster data access with choice to scale-up or out
– Easy to deploy clusters with unified system GUI
– Simplified storage administration with IBM Spectrum Control integration
• One solution for all your data needs
– Single repository of data with unified file and object support
– Anywhere access with multi-protocol support:
NFS 4.0, SMB, OpenStack Swift, Cinder, and Manila
– Ideal for Big Data Analytics with full Hadoop transparency with 4.2
• Ready for business critical data
– Disaster recovery with synchronous or asynchronous replication
– Ensure reliability and fast rebuild times using Spectrum Scale RAID’s
dispersed data and erasure code
20

17. © Copyright IBM Corporation 2015 21
Advantages of Spectrum Scale RAID
JBODs
Elastic Storage Server• Use of standard and inexpensive disk drives
– Erasure Code software implemented in Spectrum Scale
• Faster rebuild times
– More disks are involved during rebuild
– Approx. 3.5 times faster than RAID-5
• Minimal impact of rebuild on system performance
– Rebuild is done by many disks
– Rebuilds can be deferred with sufficient protection
• Better fault tolerance
– End to end checksum
– Much higher mean-time-to-data-loss (MTTDL)
o 8+2P: ~ 200 Years
o 8+3P: ~ 200 Million Years
Spectrum Scale RAID

18. © Copyright IBM Corporation 2015
Integrates with local
and cloud storage
22
“Big Storage” technology preview
Easy to use enterprise-class cloud-based storage service tier,
suitable for very large archives with occasional retrieval needs
that offers very low cost storage with affordable and predictable
retrieval costs
 Intuitive interface with manual or
policy-based archival
 Fast retrieval and global
namespace across all tiers
 Enterprise level security
 Supports large archives
(TBs - PBs) with retrieval times
in minutes (versus hours)
 Storage for large amounts of data
at $0.005 per GB peak / month
 Future releases will provide
the ability to run analytics on
the archived data
Easy
to use
Enterprise
grade
Price/Perf.Analytics
 Data retrieval at $0.09 per GB
Big Storage
Spectrum Scale
Swift
Spectrum Scale

19. © Copyright IBM Corporation 2015
Spectrum Scale virtual machine
• Turn-key Spectrum Scale VM available for download
– Try the latest Spectrum Scale enhancements
– Full functionality on laptop, desktop or server
– Incorporate external storage
• Use for live demonstrations, proof of concepts, education,
validate application interoperability
– Scripted demonstrations
• Limitations
– VirtualBox hypervisor only
– Type-2 Hypervisor limits performance
– Not supported for production workloads
– Can not be migrated to bare metal

20. © Copyright IBM Corporation 2015
IBM Spectrum Scale Value
24
Storage management
at scale
• New GUI & health
monitoring
• Unified File, Object &
HDFS
• Distributed metadata &
high-speed scanning
• QoS management
• 1 Billion files & yottabytes
• Multi-cluster management
with Spectrum Control
Store everywhere.
Run anywhere.
• Advanced routing with
latency awareness
• Read or Write Caching
• Active File Management
for WAN deployments
• File Placement
Optimization
• End-to-end data integrity
• Snapshots
• Sync or Async DR
Improve data
economics
• Tier seamlessly
• Incorporate and share
flash
• Policy driven compression
• Data protection with
erasure code and
replication
• Native Encryption and
Secure Erase compliance
• Leading performance for
Backup and Archive
Software Defined
Open Platform
• Heterogeneous
commodity storage
• Software, appliance
or Cloud
• Data driven migration to
practically any target
• OpenStack SWIFT
and S3
• Transparent native HDFS
• Integration with Cloud

21. © Copyright IBM Corporation 2015
Client
workstations
Users and
applications
Compute
farm
25
Spectrum Scale: Redefining Unified Storage
Traditional
applications
Powered by
Single name space
Spectrum Scale
SMB NFS POSIX
Transparent HDFS
Disk Tape Shared Nothing
Cluster
Flash
Off Premise
OpenStack Object
Swift S3
Cinder Swift
Glance Manilla

22. © Copyright IBM Corporation 2015
Questions?

23. © Copyright IBM Corporation 2015
Technical Features v4.2 (planned delivery 4Q15)
27
IBM and Business Partner Use Only
Express Edition Standard Edition Advanced Edition
Support for maximum file system size, number of files, file systems and number
of nodes
  
Node roles: Collector node, Admin node Free Free Free
Node roles: Cluster Config Server, Manager, quorum, tie-breaker, NSD server   
Multi-cluster   
Quotas (user and group only)   
Snapshots  (file system)  (file set)  (file set)
Management GUI  
Compression (2:1 to 5:1 ratio)   
Quality of Service   
Filesets  
Multi Protocol access  
Storage Pools  
ILM Placement and Management policies  
HSM with TSM or LTFS  
MC Store cloud gateway [Tech Preview only] 
AFM caching and Asynchronous DR (gateway nodes) 
Encryption of data at rest and secure erase 