07.03.22 Distinguished Lecturer Technology for a Changing World Series Baskin School of Engineering, UCSC Title: How Global-Scale Personal Lighwaves are Transforming Scientific Research Santa Cruz, CA

1. How Global-Scale Personal Lighwaves are Transforming Scientific Research Distinguished Lecturer Technology for a Changing World Series Baskin School of Engineering UC Santa Cruz March 22, 2007 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD

2. Abstract During the last few years, a radical restructuring of optical networks supporting e-Science projects is beginning to occur around the world. U.S. universities are beginning to acquire access to high-bandwidth lightwaves (termed “lambdas”) on fiber optics through the National LambdaRail and the Global Lambda Integrated Facility. These user-controlled 1- or 10- Gbps lambdas are providing direct access to global data repositories, scientific instruments, and computational resources from the researchers’ Linux clusters in their campus laboratories. These dedicated connections have a number of significant advantages over shared Internet connections, including high bandwidth, controlled performance (no jitter), lower cost-per-unit bandwidth, and security. These lambdas enable the Grid program to be completed, in that they add the network elements to the compute and storage elements which can be discovered, reserved, and integrated by the Grid middleware to form global LambdaGrids. I will describe how LambdaGrids enable new capabilities in medical imaging, Earth sciences, interactive ocean observatories, and marine microbial metagenomics.

3. Great to be Back in Slug Land! Source: Benjamin Smarr, UCSC ‘04

5. Calit2--A Systems Approach to the Future of the Internet and its Transformation of Our Society www.calit2.net Calit2 Has Assembled a Complex Social Network of Over 350 UC San Diego & UC Irvine Faculty Working in Multidisciplinary Teams With Staff, Students, Industry, and the Community Integrating Technology Consumers and Producers Into “Living Laboratories”

6. Calit2 is Experimenting with Open Reconfigurable Work Spaces to Enhance Collaboration Photos by John Durant; Barbara Haynor, Calit2

7. Calit2 Materials and Devices Laboratory: “Nano3”–NanoScience, NanoEngineering, NanoMedicine Nano3 Facility CALIT2.UCSD 10,000 sq. feet State-of-the-Art Materials and Devices Laboratory Source: Bernd Fruhberger, Calit2 Similar Clean Rooms at UCI

8. Calit2 “Lives in the Future” By Building Systems of Emerging Disruptive Technologies Co-Evolution of Personal Automobile and Highway/Petroleum Infrastructure Source: Harry Dent, The Great Boom Ahead Technologies Diffuse Into Society Following an S-Curve Calit2 Works Here {

9. The Calit2@UCSD Building is Designed for Prototyping Extremely High Bandwidth Applications 1.8 Million Feet of Cat6 Ethernet Cabling 150 Fiber Strands to Building; Experimental Roof Radio Antenna Farm Ubiquitous WiFi Photo: Tim Beach, Calit2 Over 10,000 Individual 1 Gbps Drops in the Building ~10G per Person UCSD has one 10G CENIC Connection for ~30,000 Users 24 Fiber Pairs to Each Lab

10. Dedicated Optical Channels Makes High Performance Cyberinfrastructure Possible Parallel Lambdas are Driving Optical Networking The Way Parallel Processors Drove 1990s Computing 10 Gbps per User ~ 200x Shared Internet Throughput ( WDM) Source: Steve Wallach, Chiaro Networks “ Lambdas”

11. e-Science Data Intensive Science Will Require LambdaGrid Cyberinfrastructure

12. High Energy and Nuclear Physics A Terabit/s WAN by 2013! Source: Harvey Newman, Caltech

14. First Remote Interactive High Definition Video Exploration of Deep Sea Vents Source John Delaney & Deborah Kelley, UWash Canadian-U.S. Collaboration

15. High Definition Still Frame of Hydrothermal Vent Ecology 2.3 Km Deep White Filamentous Bacteria on 'Pill Bug' Outer Carapace Source: John Delaney and Research Channel, U Washington 1 cm.

17. iGrid Lambda Digital Cinema Streaming Services: Telepresence Meeting in Calit2 Digital Cinema Auditorium Lays Technical Basis for Global Digital Cinema Sony NTT SGI Keio University President Anzai UCSD Chancellor Fox

18. Emerging CineGrid Infrastructure Los Angeles Seattle CineGrid Cisco 6506 10GigE Cisco NLR Wave 1& 10 GigE CENIC Waves IEEAF Wave via PNWGP/TLEX CAVEwave (CENIC and NLR via PNWGP JGN2 CA*net4 Sunnyvale CalIT2 San Diego Cisco is building two 10 GigE "Cisco Waves” on NLR on the West Coast and switches for access points in San Diego, Los Angeles, Sunnyvale, & Seattle for CineGrid CENIC is making available persistent 1 GigE access ports in San Diego, Los Angeles, Sunnyvale, & San Francisco for CineGrid and the fiber for 2x10GigE between UCSD and LA Via GLIF, CineGrid extends to Japan via Seattle & Chicago; to Canada via Seattle & Chicago; to Europe via Chicago & Amsterdam. Further extension likely to China, Korea, Singapore, India, New Zealand, Australia, others. Tokyo Chicago Toronto Europe

19. The Synergy of Digital Art and Science Visualization of JPL Simulation of Monterey Bay Source: Donna Cox, Robert Patterson, NCSA Funded by NSF LOOKING Grant 4k Resolution

20. National Lambda Rail (NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout Links Two Dozen State and Regional Optical Networks NLR Is to Merge With Internet2 San Francisco Pittsburgh Cleveland San Diego Los Angeles Portland Seattle Pensacola Baton Rouge Houston San Antonio Las Cruces / El Paso Phoenix New York City Washington, DC Raleigh Jacksonville Dallas Tulsa Atlanta Kansas City Denver Ogden/ Salt Lake City Boise Albuquerque UC-TeraGrid UIC/NW-Starlight Chicago International Collaborators NSF’s TeraGrid Has 4 x 10Gb Lambda Backbone

22. OptIPuter Software Architecture--a Service-Oriented Architecture Integrating Lambdas Into the Grid GTP XCP UDT LambdaStream CEP RBUDP Globus XIO GRAM GSI Source: Andrew Chien, UCSD DVC Configuration Distributed Virtual Computer (DVC) API DVC Runtime Library Distributed Applications/ Web Services Telescience Vol-a-Tile SAGE JuxtaView Visualization Data Services LambdaRAM DVC Services DVC Core Services DVC Job Scheduling DVC Communication Resource Identify/Acquire Namespace Management Security Management High Speed Communication Storage Services IP Lambdas Discovery and Control PIN/PDC RobuStore

23. OptIPuter / OptIPortal Demonstration of SAGE Applications MagicCarpet Streaming Blue Marble dataset from San Diego to EVL using UDP. 6.7Gbps JuxtaView Locally streaming the aerial photography of downtown Chicago using TCP. 850 Mbps Bitplayer Streaming animation of tornado simulation using UDP. 516 Mbps SVC Locally streaming HD camera live video using UDP. 538Mbps ~ 9 Gbps in Total. SAGE Can Simultaneously Support These Applications Without Decreasing Their Performance Source: Xi Wang, UIC/EVL

25. Showing your Science at Meetings-- The Portable Mini-Mac Wall ANL’s Rick Stevens Studying Deep Sea Vent Ecology at Supercomputing ‘06

26. PI Larry Smarr Paul Gilna Ex. Dir. Announced January 17, 2006 $24.5M Over Seven Years

27. Most of Evolutionary Time Was in the Microbial World Source: Carl Woese, et al Tree of Life Derived from 16S rRNA Sequences You Are Here Slug is Here

28. Marine Genome Sequencing Project – Measuring the Genetic Diversity of Ocean Microbes Sorcerer II Data Will Double Number of Proteins in GenBank! Need Ocean Data

29. The First Science Results of Have Been Published from the Global Ocean Sampling Expedition March 2007

31. The Calit2 CAMERA Microbial Metagenomics Server is Open to the Community PLOS Biology March 2007

33. Calit2 CAMERA Production Compute and Storage Complex 512 Processors ~5 Teraflops ~ 200 Terabytes Storage

34. The Calit2 CAMERA Metagenomics Site is Now Active http://camera.calit2.net/

36. Interactive Exploration of Marine Genomes Using 100 Million Pixels Ginger Armburst (UW), Terry Gaasterland (UCSD SIO)

37. Use of Tiled Display Wall OptIPortal to Interactively View Microbial Genome Acidobacteria bacterium Ellin345 Soil Bacterium 5.6 Mb

38. Use of Tiled Display Wall OptIPortal to Interactively View Microbial Genome Source: Raj Singh, UCSD

39. Use of Tiled Display Wall OptIPortal to Interactively View Microbial Genome Source: Raj Singh, UCSD

40. Calit2 is Now OptIPuter Connecting Remote OptIPortal Moore-Funded Microbial Researchers via NLR NW! CICESE UW JCVI MIT SIO UCSD SDSU UIC EVL UCI OptIPortals OptIPortal CAMERA Servers

41. How Do You Get From Your Lab to the National LambdaRail? www.ctwatch.org “ Research is being stalled by ‘information overload,’ Mr. Bement said, because data from digital instruments are piling up far faster than researchers can study. In particular, he said, campus networks need to be improved. High-speed data lines crossing the nation are the equivalent of six-lane superhighways, he said. But networks at colleges and universities are not so capable. “Those massive conduits are reduced to two-lane roads at most college and university campuses,” he said. Improving cyberinfrastructure, he said, “will transform the capabilities of campus-based scientists.” -- Arden Bement, the director of the National Science Foundation

42. 2007

43. OptIPuter@UCI is Up and Working Created 09-27-2005 by Garrett Hildebrand Modified 02-28-2009 by Smarr/Hildebrand 10 GE SPDS Catalyst 3750 in CSI ONS 15540 WDM at UCI campus MPOE (CPL) 10 GE DWDM Network Line Engineering Gateway Building, Catalyst 3750 in 1 st floor IDF Catalyst 6500, 1 st floor MDF Wave-2 : layer-2 GE. 67.58.33.0/25 using 11-126 at UCI. GTWY is .1 Floor 2 Catalyst 6500 Floor 3 Catalyst 6500 Floor 4 Catalyst 6500 Wave-1 : layer-2 GE 67.58.21.128/25 UCI using 141-254. GTWY .128 ESMF Catalyst 3750 in NACS Machine Room (Optiputer) Kim Jitter Measurements Lab E1127 Wave 1 1GE Wave 2 1GE Berns’ Lab-- Remote Microscopy Beckman Laser Institute Bldg. Calit2 Building UCInet HIPerWall Los Angeles 1 GE DWDM Network Line Tustin CENIC CalREN POP UCSD Optiputer Network

44. Calit2/SDSC Proposal to Create a UC Cyberinfrastructure of OptIPuter “On-Ramps” to TeraGrid Resources UC San Francisco UC San Diego UC Riverside UC Irvine UC Davis UC Berkeley UC Santa Cruz UC Santa Barbara UC Los Angeles UC Merced OptIPuter + CalREN-XD + TeraGrid = “OptiGrid” Source: Fran Berman, SDSC , Larry Smarr, Calit2 Creating a Critical Mass of End Users on a Secure LambdaGrid

45. Great Opportunity to Bring Gigabit Fiber to Monterey Bay Research & Education Institutions