10.04.07 Presentation by Larry Smarr to the NSF Campus Bridging Workshop University Place Conference Center Title: A High-Performance Campus-Scale Cyberinfrastructure for Effectively Bridging End-User Laboratories to Data-Intensive Sources Indianapolis, IN

1. A High-Performance Campus-Scale
Cyberinfrastructure
For Effectively Bridging End-User Laboratories
to Data-Intensive Sources
Presentation by Larry Smarr to the NSF Campus Bridging Workshop
April 7, 2010
University Place Conference Center
Indianapolis, IN
Philip Papadopoulos, SDSC
Larry Smarr, Calit2
University of California, San Diego

2. Academic Research “OptIPlatform” Cyberinfrastructure:
An End-to-End 10Gbps Lightpath Cloud
HD/4k Video Cams
HD/4k Telepresence
Instruments
End User HPC
OptIPortal
10G
Lightpaths
National LambdaRail
Campus Data
Optical Repositories
Switch & Clusters
HD/4k Video Images

3. “Blueprint for the Digital University”--Report of the
UCSD Research Cyberinfrastructure Design Team
• Focus on Data Storage and Data Curation
– These Become the Centralized Components
– Other Common Elements “Plug In”
April 24, 2009
research.ucsd.edu/documents/rcidt/RCIDTReportFinal2009.pdf

4. Campus Bridging Preparations Needed
to Accept CENIC CalREN Handoff to Campus
Source: Jim Dolgonas, CENIC

5. Current UCSD Prototype Optical Core:
Bridging End-Users to CENIC L1, L2, L3 Services
Quartzite Communications
To 10GigE cluster
node interfaces
Core Year 3
Enpoints:
Quartzite Wavelength
>= 60 endpoints at 10 GigE
Core
Selective
.....
Switch
>= 32 Packet switched Lucent To 10GigE cluster
node interfaces and
>= 32 Switched wavelengths other switches
To cluster nodes
.....
>= 300 Connected endpoints
Glimmerglass
To cluster nodes
.....
Production
GigE Switch with
OOO
Dual 10GigE Upliks
Switch
To cluster nodes
Approximately 0.5 TBit/s
32 10GigE
.....
Arrive at the “Optical” GigE Switch with
Force10 Dual 10GigE Upliks
Center of Campus.
...
GigE Switch with
Switching is Packet Switch
To
a Hybrid of: CalREN-HPR
Research
Dual 10GigE Upliks
Packet, Lambda, Circuit --
other
nodes
Cloud
GigE
OOO and Packet Switches
10GigE
Campus Research
4 GigE
4 pair fiber
Cloud
Juniper T320
Source: Phil Papadopoulos, SDSC/Calit2
(Quartzite PI, OptIPuter co-PI)
Quartzite Network MRI #CNS-0421555;
OptIPuter #ANI-0225642

6. Calit2 Sunlight Optical Exchange
Contains Quartzite 3-Level Switch
10:45 am
Feb. 21,
2008

7. UCSD Campus Investment in Fiber and Networks
Enables High Performance Campus Bridging CI
CENIC, NLR, I2DCN
Nx
10Gbe
Gordon –
HPC System
Cluster
Condo
DataOasis
(Central) Storage
Triton – Petadata
Analysis
Scientific
Instruments
Digital Data Campus Lab OptIPortal
Collections Cluster Tile Display Wall
Source: Philip Papadopoulos, SDSC, UCSD

8. Rapid Evolution of 10GbE Port Prices
Makes Campus-Scale 10Gbps CI Affordable
• Port Pricing is Falling
• Density is Rising – Dramatically
• Cost of 10GbE Approaching Cluster HPC Interconnects
$80K/port
Chiaro
(60 Max)
$ 5K
Force 10
(40 max) ~$1000
(300+ Max)
$ 500
Arista $ 400
48 ports Arista
48 ports
2005 2007 2009 2010
Source: Philip Papadopoulos, SDSC, UCSD