High Performance Cyberinfrastructure Enabling Data-Driven Science Supporting Stem Cell Research

High Performance Cyberinfrastructure Enabling Data-Driven Science Supporting Stem Cell Research Invited Presentation Sanford Consortium for Regenerative Medicine Salk Institute, La Jolla Larry Smarr, Calit2 & Phil Papadopoulos, SDSC/Calit2 May 13, 2011

Academic Research OptIPlanet Collaboratory: A 10Gbps “End-to-End” Lightpath Cloud National LambdaRail Campus Optical Switch Data Repositories & Clusters HPC HD/4k Video Repositories End User OptIPortal 10G Lightpaths HD/4k Live Video Local or Remote Instruments

“ Blueprint for the Digital University”--Report of the UCSD Research Cyberinfrastructure Design Team ,[object Object],research.ucsd.edu/documents/rcidt/RCIDTReportFinal2009.pdf No Data Bottlenecks--Design for Gigabit/s Data Flows April 2009

UCSD Campus Investment in Fiber Enables Consolidation of Energy Efficient Computing & Storage Source: Philip Papadopoulos, SDSC, UCSD OptIPortal Tiled Display Wall Campus Lab Cluster Digital Data Collections N x 10Gb/s Triton – Petascale Data Analysis Gordon – HPD System Cluster Condo WAN 10Gb: CENIC, NLR, I2 Scientific Instruments DataOasis (Central) Storage GreenLight Data Center

Moving to Shared Enterprise Data Storage & Analysis Resources: SDSC Triton Resource & Calit2 GreenLight http://tritonresource.sdsc.edu UCSD Research Labs Campus Research Network Calit2 GreenLight N x 10Gb/s Source: Philip Papadopoulos, SDSC, UCSD ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],x28 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],x256 ,[object Object],[object Object],[object Object],[object Object],[object Object]

NCMIR’s Integrated Infrastructure of Shared Resources Source: Steve Peltier, NCMIR Local SOM Infrastructure Scientific Instruments End User Workstations Shared Infrastructure

The GreenLight Project: Instrumenting the Energy Cost of Computational Science ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Source: Tom DeFanti, Calit2; GreenLight PI

Next Generation Genome Sequencers Produce Large Data Sets Source: Chris Misleh, SOM

The Growing Sequencing Data Load Runs over RCI Connecting GreenLight and Triton ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Source: Chris Misleh, SOM

Community Cyberinfrastructure for Advanced Microbial Ecology Research and Analysis http://camera.calit2.net/

Calit2 Microbial Metagenomics Cluster- Next Generation Optically Linked Science Data Server 4000 Users From 90 Countries 512 Processors ~5 Teraflops ~ 200 Terabytes Storage 1GbE and 10GbE Switched/ Routed Core ~200TB Sun X4500 Storage 10GbE Source: Phil Papadopoulos, SDSC, Calit2

Fully Integrated UCSD CI Manages the End-to-End Lifecycle of Massive Data from Instruments to Analysis to Archival UCSD CI Features Kepler Workflow Technologies

NSF Funds a Data-Intensive Track 2 Supercomputer: SDSC’s Gordon-Coming Summer 2011 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Source: Mike Norman, Allan Snavely SDSC

Data Mining Applications will Benefit from Gordon ,[object Object],[object Object],[object Object],[object Object],Source: Mike Norman, SDSC

IF Your Data is Remote, Your Network Better be “Fat” Data Oasis (100GB/sec) OptIPuter Quartzite Research 10GbE Network OptIPuter Partner Labs 50 Gbit/s (6GB/sec) Campus Production Research Network Campus Labs 20 Gbit/s (2.5 GB/sec) 1TB @ 10 Gbit/sec = ~20 Minutes 1TB @ 10 Mbit/sec = ~10 Days >10 Gbit/s each 1 or 10 Gbit/s each

Calit2 Sunlight OptIPuter Exchange Contains Quartzite Maxine Brown, EVL, UIC OptIPuter Project Manager

Rapid Evolution of 10GbE Port Prices Makes Campus-Scale 10Gbps CI Affordable 2005 2007 2009 2010 $80K/port Chiaro (60 Max) $ 5K Force 10 (40 max) $ 500 Arista 48 ports ~$1000 (300+ Max) $ 400 Arista 48 ports ,[object Object],[object Object],[object Object],Source: Philip Papadopoulos, SDSC/Calit2

10G Switched Data Analysis Resource: SDSC’s Data Oasis – Scaled Performance 2 12 OptIPuter 32 Co-Lo UCSD RCI CENIC/NLR Trestles 100 TF 8 Dash 128 Gordon Oasis Procurement (RFP) ,[object Object],[object Object],[object Object],40  128 Source: Philip Papadopoulos, SDSC/Calit2 Triton 32 Radical Change Enabled by Arista 7508 10G Switch 384 10G Capable 8 Existing Commodity Storage 1/3 PB 2000 TB > 50 GB/s 10Gbps 5 8 2 4

Data Oasis – 3 Different Types of Storage

Campus Now Starting RCI Pilot (http://rci.ucsd.edu)

High Performance Cyberinfrastructure Enabling Data-Driven Science Supporting Stem Cell Research

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to High Performance Cyberinfrastructure Enabling Data-Driven Science Supporting Stem Cell Research

Similar to High Performance Cyberinfrastructure Enabling Data-Driven Science Supporting Stem Cell Research (20)

More from Larry Smarr

More from Larry Smarr (20)

Recently uploaded

Recently uploaded (20)

High Performance Cyberinfrastructure Enabling Data-Driven Science Supporting Stem Cell Research

Editor's Notes