SlideShare ist ein Scribd-Unternehmen logo
1 von 15
Downloaden Sie, um offline zu lesen
IBM General Parallel File System (GPFS™) 3.5
and GSS Introduction

Karl Hansen, Nordic HPC/Technical Computing Sales Manager
IBM Systems & Technology Group
A New Era in Technical Computing: Powerful. Comprehensive. Intuitive.
IBM Confidential
Technical Computing: Powerful. Comprehensive. Intuitive

The IBM General Parallel File SystemTM (GPFSTM)
Shipping since 1998

Extreme Scalability
File system
263 files per file system
Maximum file system
size: 299 bytes
Production 19PB file
system
Number of nodes

1 to 8192

Proven Reliability

Manageability

No special nodes
Add/remove nodes
and storage on the fly
Rolling upgrades
Administer from any
node
Data replication
Snapshots

Integrated tiered storage
Storage pools
Quotas
Policy-Driven automation
Clustered NFS
SNMP monitoring
TSM / HPSS (DMAPI)

File system journaling
© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

IBM General Parallel File System (GPFS)

IBM General Parallel File
System (GPFS) is
a scalable highperformance file
management
infrastructure for
AIX®, Linux® and
Windows™ systems.

3

A highly available cluster architecture

Concurrent shared disk access to
a global namespace

Capabilities for high performance
parallel workloads

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

File data infrastructure optimization

Databases

GPFS enables:
A global namespace
across platforms
High performance
common storage
Eliminating copies
of data
Improved storage
utilization
Simplified file
management

4

Connections
SAN TCP/IP
InfiniBand
File servers

Management
Centralized
Monitoring
Automated
File Mgmt
Availability
Data Migration
Replication
Backup

Backup
and
archive

Application
servers

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

How is GPFS different?

Massive namespace support

GPFS
SAN

Centrally deployed, managed,
backed up and grown.

Seamless capacity and
performance scaling
All features are included. All software features: snapshots, replication and multi-site
connectivity are included in the GPFS license. With no license keys except for client and
server to add on, you get all of the features up front.

5

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

Network-based block input output

Application data access on network
attached nodes is exactly the same as
a SAN attached node. GPFS
transparently sends the block level IO
request over a TCP/IP network.

NSD clients

LAN

NSD
servers

GPFS
SAN

SAN

Why?
Enable virtually seamless multi-site operations
Reduce costs for data administration
Provide flexibility of file system access
Establish highly scalable and reliable data storage
Future protection by supporting mixed technologies

6

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

IBM General Parallel File System (GPFS™) – History & Evolution
GPFS 2.1-2.3

First
called
GPFS
HPC
GPFS
General File
Serving
Standards
Portable
operating
system
interface
(POSIX)
semantics
-Large block
Directory and
small file perf
Data
management

1998

Linux®
Clusters
(Multiple
architectures)
IBM AIX®
Loose Clusters

GPFS 3.3

GPFS 3.4

GPFS 3.5

HPC

Virtual
Tape Server
(VTS)

GPFS 3.1-3.2
Information
lifecycle
management (ILM)

Restricted
admin functions

Enhanced
Windows cluster
support
- Homogenous
Windows server

Caching via
Active File
Management
(AFM)

Research
Visualization
Digital media
Seismic
Weather
Life sciences
32 bit /64 bit
Inter-op (IBM AIX
& Linux)
GPFS Multicluster

Storage pools
File sets
Policy engine
Ease of
administration
Multiplenetworks/ RDMA
Distributed token
management

GPFS over wide
area networks
(WAN)
Large scale
clusters
thousands of
nodes

2002

Windows 2008

Improved
installation
New license
model
Improved
snapshot and
backup
Improved ILM
policy engine

GSS - GPFS
Storage Server
Performance and
scaling
improvements

GPFS File
Placement
Optimizer (FPO)

Enhanced
migration and
diagnostics
support

NFS v4 support

2005

Multiple NSD
servers

Small file
performance

2006

2009

2010

2012
© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

A Disruptive HPC Play - GPFS Storage Server (GSS) At a Glance
The New High Capacity, High PerformanceStorage Solution

New Storage Solution fulfilled exclusively through IBM Intelligent
Cluster
High capacity, High performance, High Value offering

Product importance
Single, integrated, fully supported IBM solution
Built to leverage a strong GPFS software market
High capacity, scalable building-block approach - performance and
capacity increases as you add multiple building blocks
Cost competitive
Extreme data integrity and reduced latency with faster rebuild times

8

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

GPFS Storage Server - Product Description
GSS is a new storage solution fulfilled exclusively through the IBM Intelligent Cluster

Two x3650 servers combined with either four or six JBODs
Two models: GSS 24 and GSS 26
– GSS 24 (Entry): 4 JBODs – starts at nearly 500TB of storage
space
– GSS 26 (Main): 6 JBODs – starts at over 700TB of storage
space

Data
striped
across
all disks

2 and 3 TB options
10GbE or FDR Infiniband interconnects, or both!
Scalable Building Block approach to HPC Storage - performance
and capacity increase as you add multiple building blocks
Complete Storage Solution with no Storage controllers

GSS 24 Model

De-Clustered RAID Techniques
Built on GPFS software
Industry standard components
– Leverages standard components including x3650s, NetApp
JBODs, LSI SAS cards and lots of HDDs, and Intelligent
Cluster fulfillment as a single, integrated, fully supported IBM

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

IBM System x GPFS Storage Server provides a comprehensive
storage solution with a scalable building block approach
Storage solution includes Data Servers,
Disk (2TB or 3TB NL-SAS, SSD), Software,
InfiniBand / Ethernet with no Storage Controllers

x3650 M4 Server

JBOD
Disk Enclosure

GSS 24: Light and Fast

GSS 26: HPC Workhorse

High-Density HPC Option

2 3650 servers +
4 JBOD 20U rack
10 GB/Sec

2 3650 servers +
6 JBOD Enclosures, 28U
12 GB/sec

6 3650 servers + 18 JBOD
2 - 42U Standard Racks
36 GB/sec

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

Why you should care…
Affordably Scalable Building Block
approach to HPC Storage

Performance and capacity increases as you add
multiple buidling blocks
Start Small and Scale via incremental additions
Add capacity AND bandwidth

Cost competitive

Extreme data integrity and reduced
latency

Built on GPFS

Fewer parts means lower cost
Leverages System x servers and Commercial JBODs
• Fast rebuild times and industry-leading performance
• Better sustained performance
• Industry-leading throughput using efficient DeClustered RAID Techniques
• The Infrastructure for Global Technical Computing
Data Management

Single, integrated, fully supported IBM solution

Fully integrated, fully supported

Complete Storage Solution with no Storage
controllers
Easy to order through Intelligent Cluster

11

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

A data management portfolio for Technical Computing
Focus:
Managed Building
Block
Focus:
Ease of Use
Reliability

Focus:
Raw Raw Performance
I/O Bandwidth

IBM Data
Management
Leadership

Government

High
GPFS
Petroleum Storage Server End
Research
Media/Ent.
Financial

SONAS
Bio/Life Science
CAE

Services
Higher End
University
DCS3700
DCS3700+

Direct Attached
Smaller
(DS3500 + V3700)
Installations

IBM Tape, Tivoli Storage Manager, and HPSS

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

What makes this different
Clients
Clients

FDR IB
10 GbE
File/Data Servers

NSD File Server 1
x3650
NSD File Server 2

Custom Dedicated
Disk Controllers

JBOD Disk Enclosures

NSD File Server 1
GPFS Native RAID

Migrate RAID
and Disk
Management to
Standard File
Servers!

NSD File Server 2
GPFS Native RAID

JBOD Disk Enclosures

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

System x
Smarter Systems for a Smarter Planet

14

© 2012 IBM Corporation
Technical Computing: Powerful. Comprehensive. Intuitive

For more information
ibm.com/systems/software/gpfs

Email gpfs@us.ibm.com or contact your IBM Representative

© 2012 IBM Corporation

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Distributed Computing and Big Data
Distributed Computing and Big DataDistributed Computing and Big Data
Distributed Computing and Big Data
 
Distributed Database System
Distributed Database SystemDistributed Database System
Distributed Database System
 
Course outline of parallel and distributed computing
Course outline of parallel and distributed computingCourse outline of parallel and distributed computing
Course outline of parallel and distributed computing
 
Introduction to HDFS
Introduction to HDFSIntroduction to HDFS
Introduction to HDFS
 
Memory management
Memory managementMemory management
Memory management
 
Case study windows
Case study windowsCase study windows
Case study windows
 
Parallel Database
Parallel DatabaseParallel Database
Parallel Database
 
Memory management
Memory managementMemory management
Memory management
 
Distributed computing
Distributed computingDistributed computing
Distributed computing
 
Hadoop Installation presentation
Hadoop Installation presentationHadoop Installation presentation
Hadoop Installation presentation
 
Unit 4 lecture2
Unit 4 lecture2Unit 4 lecture2
Unit 4 lecture2
 
Chapter 4
Chapter 4Chapter 4
Chapter 4
 
GFS & HDFS Introduction
GFS & HDFS IntroductionGFS & HDFS Introduction
GFS & HDFS Introduction
 
Distributed shred memory architecture
Distributed shred memory architectureDistributed shred memory architecture
Distributed shred memory architecture
 
CDW: SAN vs. NAS
CDW: SAN vs. NASCDW: SAN vs. NAS
CDW: SAN vs. NAS
 
Database backup and recovery
Database backup and recoveryDatabase backup and recovery
Database backup and recovery
 
Distributed file system
Distributed file systemDistributed file system
Distributed file system
 
RAID LEVELS
RAID LEVELSRAID LEVELS
RAID LEVELS
 
Connection Machine
Connection MachineConnection Machine
Connection Machine
 
Storage Area Network (San)
Storage Area Network (San)Storage Area Network (San)
Storage Area Network (San)
 

Ähnlich wie IBM GPFS Storage Server Introduction

Technical Comuting Solutions Made Simple - ISC13 IBM System x Solution
Technical Comuting Solutions Made Simple - ISC13 IBM System x SolutionTechnical Comuting Solutions Made Simple - ISC13 IBM System x Solution
Technical Comuting Solutions Made Simple - ISC13 IBM System x SolutionIntel IT Center
 
Ibm spectrum virtualize 101
Ibm spectrum virtualize 101 Ibm spectrum virtualize 101
Ibm spectrum virtualize 101 xKinAnx
 
IBM Platform Computing Elastic Storage
IBM Platform Computing  Elastic StorageIBM Platform Computing  Elastic Storage
IBM Platform Computing Elastic StoragePatrick Bouillaud
 
Gpfs introandsetup
Gpfs introandsetupGpfs introandsetup
Gpfs introandsetupasihan
 
Storage Cloud and Spectrum presentation
Storage Cloud and Spectrum presentationStorage Cloud and Spectrum presentation
Storage Cloud and Spectrum presentationJoe Krotz
 
Hadoop and Spark Analytics over Better Storage
Hadoop and Spark Analytics over Better StorageHadoop and Spark Analytics over Better Storage
Hadoop and Spark Analytics over Better StorageSandeep Patil
 
IBM Special Announcement session Intel #IDF2013 September 10, 2013
IBM Special Announcement session Intel #IDF2013 September 10, 2013IBM Special Announcement session Intel #IDF2013 September 10, 2013
IBM Special Announcement session Intel #IDF2013 September 10, 2013Cliff Kinard
 
Introducing IBM Spectrum Scale 4.2 and Elastic Storage Server 3.5
Introducing IBM Spectrum Scale 4.2 and Elastic Storage Server 3.5Introducing IBM Spectrum Scale 4.2 and Elastic Storage Server 3.5
Introducing IBM Spectrum Scale 4.2 and Elastic Storage Server 3.5Doug O'Flaherty
 
Storage cloud and spectrum update February 2016
Storage cloud and spectrum update February 2016Storage cloud and spectrum update February 2016
Storage cloud and spectrum update February 2016Joe Krotz
 
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMFGestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMFSUSE Italy
 
Ibm symp14 referent_marcus alexander mac dougall_ibm x6 und flex system
Ibm symp14 referent_marcus alexander mac dougall_ibm x6 und flex systemIbm symp14 referent_marcus alexander mac dougall_ibm x6 und flex system
Ibm symp14 referent_marcus alexander mac dougall_ibm x6 und flex systemIBM Switzerland
 
Introducing StorNext5 and Lattus
Introducing StorNext5 and LattusIntroducing StorNext5 and Lattus
Introducing StorNext5 and Lattusinside-BigData.com
 
RedisConf17 - Redis Enterprise on IBM Power Systems
RedisConf17 - Redis Enterprise on IBM Power SystemsRedisConf17 - Redis Enterprise on IBM Power Systems
RedisConf17 - Redis Enterprise on IBM Power SystemsRedis Labs
 
Sirius ibm storage & platform computing solutions 080515 eh
Sirius ibm storage & platform computing solutions 080515 ehSirius ibm storage & platform computing solutions 080515 eh
Sirius ibm storage & platform computing solutions 080515 ehEric Herzog
 
Db2 analytics accelerator on ibm integrated analytics system technical over...
Db2 analytics accelerator on ibm integrated analytics system   technical over...Db2 analytics accelerator on ibm integrated analytics system   technical over...
Db2 analytics accelerator on ibm integrated analytics system technical over...Daniel Martin
 
The Future of Data Warehousing, Data Science and Machine Learning
The Future of Data Warehousing, Data Science and Machine LearningThe Future of Data Warehousing, Data Science and Machine Learning
The Future of Data Warehousing, Data Science and Machine LearningModusOptimum
 
IBM Storage solutions for VMWare environments - 2010 #Vintage
IBM Storage solutions for VMWare environments - 2010 #VintageIBM Storage solutions for VMWare environments - 2010 #Vintage
IBM Storage solutions for VMWare environments - 2010 #VintageKlemen Bacak
 

Ähnlich wie IBM GPFS Storage Server Introduction (20)

Technical Comuting Solutions Made Simple - ISC13 IBM System x Solution
Technical Comuting Solutions Made Simple - ISC13 IBM System x SolutionTechnical Comuting Solutions Made Simple - ISC13 IBM System x Solution
Technical Comuting Solutions Made Simple - ISC13 IBM System x Solution
 
Ibm spectrum virtualize 101
Ibm spectrum virtualize 101 Ibm spectrum virtualize 101
Ibm spectrum virtualize 101
 
IBM Platform Computing Elastic Storage
IBM Platform Computing  Elastic StorageIBM Platform Computing  Elastic Storage
IBM Platform Computing Elastic Storage
 
Gpfs introandsetup
Gpfs introandsetupGpfs introandsetup
Gpfs introandsetup
 
Storage Cloud and Spectrum presentation
Storage Cloud and Spectrum presentationStorage Cloud and Spectrum presentation
Storage Cloud and Spectrum presentation
 
Hadoop and Spark Analytics over Better Storage
Hadoop and Spark Analytics over Better StorageHadoop and Spark Analytics over Better Storage
Hadoop and Spark Analytics over Better Storage
 
IBM Special Announcement session Intel #IDF2013 September 10, 2013
IBM Special Announcement session Intel #IDF2013 September 10, 2013IBM Special Announcement session Intel #IDF2013 September 10, 2013
IBM Special Announcement session Intel #IDF2013 September 10, 2013
 
Introducing IBM Spectrum Scale 4.2 and Elastic Storage Server 3.5
Introducing IBM Spectrum Scale 4.2 and Elastic Storage Server 3.5Introducing IBM Spectrum Scale 4.2 and Elastic Storage Server 3.5
Introducing IBM Spectrum Scale 4.2 and Elastic Storage Server 3.5
 
Storage cloud and spectrum update February 2016
Storage cloud and spectrum update February 2016Storage cloud and spectrum update February 2016
Storage cloud and spectrum update February 2016
 
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMFGestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
 
IBM Pure Systems
IBM Pure SystemsIBM Pure Systems
IBM Pure Systems
 
Ibm symp14 referent_marcus alexander mac dougall_ibm x6 und flex system
Ibm symp14 referent_marcus alexander mac dougall_ibm x6 und flex systemIbm symp14 referent_marcus alexander mac dougall_ibm x6 und flex system
Ibm symp14 referent_marcus alexander mac dougall_ibm x6 und flex system
 
Apresentação Storage v3700 IBM® Storwize V3700
Apresentação Storage  v3700 IBM® Storwize V3700 Apresentação Storage  v3700 IBM® Storwize V3700
Apresentação Storage v3700 IBM® Storwize V3700
 
Introducing StorNext5 and Lattus
Introducing StorNext5 and LattusIntroducing StorNext5 and Lattus
Introducing StorNext5 and Lattus
 
RedisConf17 - Redis Enterprise on IBM Power Systems
RedisConf17 - Redis Enterprise on IBM Power SystemsRedisConf17 - Redis Enterprise on IBM Power Systems
RedisConf17 - Redis Enterprise on IBM Power Systems
 
Sirius ibm storage & platform computing solutions 080515 eh
Sirius ibm storage & platform computing solutions 080515 ehSirius ibm storage & platform computing solutions 080515 eh
Sirius ibm storage & platform computing solutions 080515 eh
 
Db2 analytics accelerator on ibm integrated analytics system technical over...
Db2 analytics accelerator on ibm integrated analytics system   technical over...Db2 analytics accelerator on ibm integrated analytics system   technical over...
Db2 analytics accelerator on ibm integrated analytics system technical over...
 
The Future of Data Warehousing, Data Science and Machine Learning
The Future of Data Warehousing, Data Science and Machine LearningThe Future of Data Warehousing, Data Science and Machine Learning
The Future of Data Warehousing, Data Science and Machine Learning
 
IBM Storage solutions for VMWare environments - 2010 #Vintage
IBM Storage solutions for VMWare environments - 2010 #VintageIBM Storage solutions for VMWare environments - 2010 #Vintage
IBM Storage solutions for VMWare environments - 2010 #Vintage
 
EasyHSM Overview
EasyHSM OverviewEasyHSM Overview
EasyHSM Overview
 

Mehr von IBM Danmark

DevOps, Development and Operations, Tina McGinley
DevOps, Development and Operations, Tina McGinleyDevOps, Development and Operations, Tina McGinley
DevOps, Development and Operations, Tina McGinleyIBM Danmark
 
Velkomst, Universitetssporet 2013, Pia Rønhøj
Velkomst, Universitetssporet 2013, Pia RønhøjVelkomst, Universitetssporet 2013, Pia Rønhøj
Velkomst, Universitetssporet 2013, Pia RønhøjIBM Danmark
 
Smarter Commerce, Salg og Marketing, Thomas Steglich-Andersen
Smarter Commerce, Salg og Marketing, Thomas Steglich-AndersenSmarter Commerce, Salg og Marketing, Thomas Steglich-Andersen
Smarter Commerce, Salg og Marketing, Thomas Steglich-AndersenIBM Danmark
 
Mobile, Philip Nyborg
Mobile, Philip NyborgMobile, Philip Nyborg
Mobile, Philip NyborgIBM Danmark
 
IT innovation, Kim Escherich
IT innovation, Kim EscherichIT innovation, Kim Escherich
IT innovation, Kim EscherichIBM Danmark
 
Echo.IT, Stefan K. Madsen
Echo.IT, Stefan K. MadsenEcho.IT, Stefan K. Madsen
Echo.IT, Stefan K. MadsenIBM Danmark
 
Big Data & Analytics, Peter Jönsson
Big Data & Analytics, Peter JönssonBig Data & Analytics, Peter Jönsson
Big Data & Analytics, Peter JönssonIBM Danmark
 
Social Business, Alice Bayer
Social Business, Alice BayerSocial Business, Alice Bayer
Social Business, Alice BayerIBM Danmark
 
Numascale Product IBM
Numascale Product IBMNumascale Product IBM
Numascale Product IBMIBM Danmark
 
Intel HPC Update
Intel HPC UpdateIntel HPC Update
Intel HPC UpdateIBM Danmark
 
NeXtScale HPC seminar
NeXtScale HPC seminarNeXtScale HPC seminar
NeXtScale HPC seminarIBM Danmark
 
Future of Power: PowerLinux - Jan Kristian Nielsen
Future of Power: PowerLinux - Jan Kristian NielsenFuture of Power: PowerLinux - Jan Kristian Nielsen
Future of Power: PowerLinux - Jan Kristian NielsenIBM Danmark
 
Future of Power: Power Strategy and Offerings for Denmark - Steve Sibley
Future of Power: Power Strategy and Offerings for Denmark - Steve SibleyFuture of Power: Power Strategy and Offerings for Denmark - Steve Sibley
Future of Power: Power Strategy and Offerings for Denmark - Steve SibleyIBM Danmark
 
Future of Power: Big Data - Søren Ravn
Future of Power: Big Data - Søren RavnFuture of Power: Big Data - Søren Ravn
Future of Power: Big Data - Søren RavnIBM Danmark
 
Future of Power: IBM PureFlex - Kim Mortensen
Future of Power: IBM PureFlex - Kim MortensenFuture of Power: IBM PureFlex - Kim Mortensen
Future of Power: IBM PureFlex - Kim MortensenIBM Danmark
 
Future of Power: IBM Trends & Directions - Erik Rex
Future of Power: IBM Trends & Directions - Erik RexFuture of Power: IBM Trends & Directions - Erik Rex
Future of Power: IBM Trends & Directions - Erik RexIBM Danmark
 
Future of Power: Håndtering af nye teknologier - Kim Escherich
Future of Power: Håndtering af nye teknologier - Kim EscherichFuture of Power: Håndtering af nye teknologier - Kim Escherich
Future of Power: Håndtering af nye teknologier - Kim EscherichIBM Danmark
 
Future of Power - Lars Mikkelgaard-Jensen
Future of Power - Lars Mikkelgaard-JensenFuture of Power - Lars Mikkelgaard-Jensen
Future of Power - Lars Mikkelgaard-JensenIBM Danmark
 
Future of Power: IBM Power - Lars Johanneson
Future of Power: IBM Power - Lars JohannesonFuture of Power: IBM Power - Lars Johanneson
Future of Power: IBM Power - Lars JohannesonIBM Danmark
 

Mehr von IBM Danmark (20)

DevOps, Development and Operations, Tina McGinley
DevOps, Development and Operations, Tina McGinleyDevOps, Development and Operations, Tina McGinley
DevOps, Development and Operations, Tina McGinley
 
Velkomst, Universitetssporet 2013, Pia Rønhøj
Velkomst, Universitetssporet 2013, Pia RønhøjVelkomst, Universitetssporet 2013, Pia Rønhøj
Velkomst, Universitetssporet 2013, Pia Rønhøj
 
Smarter Commerce, Salg og Marketing, Thomas Steglich-Andersen
Smarter Commerce, Salg og Marketing, Thomas Steglich-AndersenSmarter Commerce, Salg og Marketing, Thomas Steglich-Andersen
Smarter Commerce, Salg og Marketing, Thomas Steglich-Andersen
 
Mobile, Philip Nyborg
Mobile, Philip NyborgMobile, Philip Nyborg
Mobile, Philip Nyborg
 
IT innovation, Kim Escherich
IT innovation, Kim EscherichIT innovation, Kim Escherich
IT innovation, Kim Escherich
 
Echo.IT, Stefan K. Madsen
Echo.IT, Stefan K. MadsenEcho.IT, Stefan K. Madsen
Echo.IT, Stefan K. Madsen
 
Big Data & Analytics, Peter Jönsson
Big Data & Analytics, Peter JönssonBig Data & Analytics, Peter Jönsson
Big Data & Analytics, Peter Jönsson
 
Social Business, Alice Bayer
Social Business, Alice BayerSocial Business, Alice Bayer
Social Business, Alice Bayer
 
Numascale Product IBM
Numascale Product IBMNumascale Product IBM
Numascale Product IBM
 
Mellanox IBM
Mellanox IBMMellanox IBM
Mellanox IBM
 
Intel HPC Update
Intel HPC UpdateIntel HPC Update
Intel HPC Update
 
NeXtScale HPC seminar
NeXtScale HPC seminarNeXtScale HPC seminar
NeXtScale HPC seminar
 
Future of Power: PowerLinux - Jan Kristian Nielsen
Future of Power: PowerLinux - Jan Kristian NielsenFuture of Power: PowerLinux - Jan Kristian Nielsen
Future of Power: PowerLinux - Jan Kristian Nielsen
 
Future of Power: Power Strategy and Offerings for Denmark - Steve Sibley
Future of Power: Power Strategy and Offerings for Denmark - Steve SibleyFuture of Power: Power Strategy and Offerings for Denmark - Steve Sibley
Future of Power: Power Strategy and Offerings for Denmark - Steve Sibley
 
Future of Power: Big Data - Søren Ravn
Future of Power: Big Data - Søren RavnFuture of Power: Big Data - Søren Ravn
Future of Power: Big Data - Søren Ravn
 
Future of Power: IBM PureFlex - Kim Mortensen
Future of Power: IBM PureFlex - Kim MortensenFuture of Power: IBM PureFlex - Kim Mortensen
Future of Power: IBM PureFlex - Kim Mortensen
 
Future of Power: IBM Trends & Directions - Erik Rex
Future of Power: IBM Trends & Directions - Erik RexFuture of Power: IBM Trends & Directions - Erik Rex
Future of Power: IBM Trends & Directions - Erik Rex
 
Future of Power: Håndtering af nye teknologier - Kim Escherich
Future of Power: Håndtering af nye teknologier - Kim EscherichFuture of Power: Håndtering af nye teknologier - Kim Escherich
Future of Power: Håndtering af nye teknologier - Kim Escherich
 
Future of Power - Lars Mikkelgaard-Jensen
Future of Power - Lars Mikkelgaard-JensenFuture of Power - Lars Mikkelgaard-Jensen
Future of Power - Lars Mikkelgaard-Jensen
 
Future of Power: IBM Power - Lars Johanneson
Future of Power: IBM Power - Lars JohannesonFuture of Power: IBM Power - Lars Johanneson
Future of Power: IBM Power - Lars Johanneson
 

Kürzlich hochgeladen

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 

Kürzlich hochgeladen (20)

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 

IBM GPFS Storage Server Introduction

  • 1. IBM General Parallel File System (GPFS™) 3.5 and GSS Introduction Karl Hansen, Nordic HPC/Technical Computing Sales Manager IBM Systems & Technology Group A New Era in Technical Computing: Powerful. Comprehensive. Intuitive. IBM Confidential
  • 2. Technical Computing: Powerful. Comprehensive. Intuitive The IBM General Parallel File SystemTM (GPFSTM) Shipping since 1998 Extreme Scalability File system 263 files per file system Maximum file system size: 299 bytes Production 19PB file system Number of nodes 1 to 8192 Proven Reliability Manageability No special nodes Add/remove nodes and storage on the fly Rolling upgrades Administer from any node Data replication Snapshots Integrated tiered storage Storage pools Quotas Policy-Driven automation Clustered NFS SNMP monitoring TSM / HPSS (DMAPI) File system journaling © 2012 IBM Corporation
  • 3. Technical Computing: Powerful. Comprehensive. Intuitive IBM General Parallel File System (GPFS) IBM General Parallel File System (GPFS) is a scalable highperformance file management infrastructure for AIX®, Linux® and Windows™ systems. 3 A highly available cluster architecture Concurrent shared disk access to a global namespace Capabilities for high performance parallel workloads © 2012 IBM Corporation
  • 4. Technical Computing: Powerful. Comprehensive. Intuitive File data infrastructure optimization Databases GPFS enables: A global namespace across platforms High performance common storage Eliminating copies of data Improved storage utilization Simplified file management 4 Connections SAN TCP/IP InfiniBand File servers Management Centralized Monitoring Automated File Mgmt Availability Data Migration Replication Backup Backup and archive Application servers © 2012 IBM Corporation
  • 5. Technical Computing: Powerful. Comprehensive. Intuitive How is GPFS different? Massive namespace support GPFS SAN Centrally deployed, managed, backed up and grown. Seamless capacity and performance scaling All features are included. All software features: snapshots, replication and multi-site connectivity are included in the GPFS license. With no license keys except for client and server to add on, you get all of the features up front. 5 © 2012 IBM Corporation
  • 6. Technical Computing: Powerful. Comprehensive. Intuitive Network-based block input output Application data access on network attached nodes is exactly the same as a SAN attached node. GPFS transparently sends the block level IO request over a TCP/IP network. NSD clients LAN NSD servers GPFS SAN SAN Why? Enable virtually seamless multi-site operations Reduce costs for data administration Provide flexibility of file system access Establish highly scalable and reliable data storage Future protection by supporting mixed technologies 6 © 2012 IBM Corporation
  • 7. Technical Computing: Powerful. Comprehensive. Intuitive IBM General Parallel File System (GPFS™) – History & Evolution GPFS 2.1-2.3 First called GPFS HPC GPFS General File Serving Standards Portable operating system interface (POSIX) semantics -Large block Directory and small file perf Data management 1998 Linux® Clusters (Multiple architectures) IBM AIX® Loose Clusters GPFS 3.3 GPFS 3.4 GPFS 3.5 HPC Virtual Tape Server (VTS) GPFS 3.1-3.2 Information lifecycle management (ILM) Restricted admin functions Enhanced Windows cluster support - Homogenous Windows server Caching via Active File Management (AFM) Research Visualization Digital media Seismic Weather Life sciences 32 bit /64 bit Inter-op (IBM AIX & Linux) GPFS Multicluster Storage pools File sets Policy engine Ease of administration Multiplenetworks/ RDMA Distributed token management GPFS over wide area networks (WAN) Large scale clusters thousands of nodes 2002 Windows 2008 Improved installation New license model Improved snapshot and backup Improved ILM policy engine GSS - GPFS Storage Server Performance and scaling improvements GPFS File Placement Optimizer (FPO) Enhanced migration and diagnostics support NFS v4 support 2005 Multiple NSD servers Small file performance 2006 2009 2010 2012 © 2012 IBM Corporation
  • 8. Technical Computing: Powerful. Comprehensive. Intuitive A Disruptive HPC Play - GPFS Storage Server (GSS) At a Glance The New High Capacity, High PerformanceStorage Solution New Storage Solution fulfilled exclusively through IBM Intelligent Cluster High capacity, High performance, High Value offering Product importance Single, integrated, fully supported IBM solution Built to leverage a strong GPFS software market High capacity, scalable building-block approach - performance and capacity increases as you add multiple building blocks Cost competitive Extreme data integrity and reduced latency with faster rebuild times 8 © 2012 IBM Corporation
  • 9. Technical Computing: Powerful. Comprehensive. Intuitive GPFS Storage Server - Product Description GSS is a new storage solution fulfilled exclusively through the IBM Intelligent Cluster Two x3650 servers combined with either four or six JBODs Two models: GSS 24 and GSS 26 – GSS 24 (Entry): 4 JBODs – starts at nearly 500TB of storage space – GSS 26 (Main): 6 JBODs – starts at over 700TB of storage space Data striped across all disks 2 and 3 TB options 10GbE or FDR Infiniband interconnects, or both! Scalable Building Block approach to HPC Storage - performance and capacity increase as you add multiple building blocks Complete Storage Solution with no Storage controllers GSS 24 Model De-Clustered RAID Techniques Built on GPFS software Industry standard components – Leverages standard components including x3650s, NetApp JBODs, LSI SAS cards and lots of HDDs, and Intelligent Cluster fulfillment as a single, integrated, fully supported IBM © 2012 IBM Corporation
  • 10. Technical Computing: Powerful. Comprehensive. Intuitive IBM System x GPFS Storage Server provides a comprehensive storage solution with a scalable building block approach Storage solution includes Data Servers, Disk (2TB or 3TB NL-SAS, SSD), Software, InfiniBand / Ethernet with no Storage Controllers x3650 M4 Server JBOD Disk Enclosure GSS 24: Light and Fast GSS 26: HPC Workhorse High-Density HPC Option 2 3650 servers + 4 JBOD 20U rack 10 GB/Sec 2 3650 servers + 6 JBOD Enclosures, 28U 12 GB/sec 6 3650 servers + 18 JBOD 2 - 42U Standard Racks 36 GB/sec © 2012 IBM Corporation
  • 11. Technical Computing: Powerful. Comprehensive. Intuitive Why you should care… Affordably Scalable Building Block approach to HPC Storage Performance and capacity increases as you add multiple buidling blocks Start Small and Scale via incremental additions Add capacity AND bandwidth Cost competitive Extreme data integrity and reduced latency Built on GPFS Fewer parts means lower cost Leverages System x servers and Commercial JBODs • Fast rebuild times and industry-leading performance • Better sustained performance • Industry-leading throughput using efficient DeClustered RAID Techniques • The Infrastructure for Global Technical Computing Data Management Single, integrated, fully supported IBM solution Fully integrated, fully supported Complete Storage Solution with no Storage controllers Easy to order through Intelligent Cluster 11 © 2012 IBM Corporation
  • 12. Technical Computing: Powerful. Comprehensive. Intuitive A data management portfolio for Technical Computing Focus: Managed Building Block Focus: Ease of Use Reliability Focus: Raw Raw Performance I/O Bandwidth IBM Data Management Leadership Government High GPFS Petroleum Storage Server End Research Media/Ent. Financial SONAS Bio/Life Science CAE Services Higher End University DCS3700 DCS3700+ Direct Attached Smaller (DS3500 + V3700) Installations IBM Tape, Tivoli Storage Manager, and HPSS © 2012 IBM Corporation
  • 13. Technical Computing: Powerful. Comprehensive. Intuitive What makes this different Clients Clients FDR IB 10 GbE File/Data Servers NSD File Server 1 x3650 NSD File Server 2 Custom Dedicated Disk Controllers JBOD Disk Enclosures NSD File Server 1 GPFS Native RAID Migrate RAID and Disk Management to Standard File Servers! NSD File Server 2 GPFS Native RAID JBOD Disk Enclosures © 2012 IBM Corporation
  • 14. Technical Computing: Powerful. Comprehensive. Intuitive System x Smarter Systems for a Smarter Planet 14 © 2012 IBM Corporation
  • 15. Technical Computing: Powerful. Comprehensive. Intuitive For more information ibm.com/systems/software/gpfs Email gpfs@us.ibm.com or contact your IBM Representative © 2012 IBM Corporation