SlideShare ist ein Scribd-Unternehmen logo
1 von 2
Downloaden Sie, um offline zu lesen
SEARCH Computing Sciences ABOUT US RESEARCH CAREER AWARDS MEDIA CENTER CONTACT US
Organization Chart
Jobs and Fellowships
Berkeley CSE
Safety and Health
CS Newsletters
News & Publications
Image Gallery
Annual Reports
News & Publications
Visualization Gallery
ESnet News
Publications
Map of DOE's Energy Sciences Network
Berkeley Lab Team Develops Flexible Reservation Algorithm for
Advance Network Provisioning
December 13, 2010
Media Contact: Jon Bashor, jbashor@lbl.gov, 510-486-5849
Scientific research is becoming increasingly dependent
on data-intensive analysis as larger teams of scientists
are generating, sharing and analyzing very large
datasets. Due to the geographical dispersion of the
researchers, networking support is critical to advancing
these efforts. Many applications need networking
support that provides predictable performance, which in
turn requires effective algorithms for bandwidth
reservations.
To address this need, the U.S. Department of Energy's
Energy Sciences Network (ESnet) developed and
deploys a network reservation system called OSCARS
(On-Demand Secure Circuits and Advance Reservation
System). The system establishes guaranteed bandwidth
of secure virtual circuits for a certain bandwidth and
length of time. However, OSCARS currently only gives a
yes or no response to reservation requests. Users
currently cannot inquire about bandwidth availability, nor receive alternative suggestions when reservation requests
fail.
To address this, Mehmet Balman, Arie Shoshani and Alex Sim of Berkeley Lab's Scientific Data Management (SDM)
Group and Evangelos Chaniotakis of ESnet developed a flexible reservation algorithm for advance network
provisioning. A paper describing the work was one of 51 technical papers accepted by the SC10 conference (out
of 253 submissions) and was presented by Balman at the conference in New Orleans in November.
The SDM Group develops new methods and tools for moving and analyzing massive scientific datasets, while ESnet
is DOE's network connecting more than 40 major research sites and peers with more than 100 other research and
commercial networks around the world.
The authors describe the algorithm as "a novel approach for pathfinding in time-dependent networks taking
advantage of user-provided parameters of total volume of data to be tranfered and time constraints for moving the
data." The algorithm's flexibility can be likened to looking for airline flights. While travelers can usually specify their
exact times and dates, many reservation systems can offer a number of options and lower fares if the traveler can be
flexible regarding departures and arrivals.
Currently, when a scientist enlists OSCARS, the system checks network availability and capacity for the specified
duration of time, and allocates it for the user if it is available. Otherwise, it reports that it is unable to provide the
requested allocation. When this happens, it falls upon the user to use a trial-and-error approach to finding an
available time for the required bandwidth. The new algorithm presents the user with a variety of possible reservation
options and alternatives. For example, if a research team is up against a deadline for presenting findings, they may
opt for the earliest completion time of the data transfer. On the other hand, they may be able to wait for a time when
the highest bandwidth is available, allowing the data to be transferred in the shortest duration. Users can then
choose the option that best fits their needs.
Balman began working on the project as a summer student at Berkeley Lab in the summer of 2009 while he was
working on his doctorate at Louisiana State University. He has since graduated and is now a staff member of the
Scientific Data Management Group at Berkeley Lab.
"It is an interesting problem that has come about with the development of bandwidth reservation systems such as
Berkeley Lab Team Develops Flexible Reservation Algorithm f... http://www.lbl.gov/cs/CSnews/CSnews121310.html
1 of 2 7/25/13 4:26 PM
OSCARS," Balman said. "Although we have implemented our algorithm for testing and incorporation into a future
version of OSCARS, the algorithm is not specific to OSCARS, and can be used with any network reservation
framework."
In the paper, Balman and his co-authors point to a couple of examples of next generation research networks that will
be increasingly important. In the area of high energy physics, the Large Hadron Collider (LHC) in Switzerland is
expected to generate 100 gigabits of data per second in the near future. This data is then quickly distributed to tiers
of data facilities around the world for analysis by thousands of scientists in dozens of countries. Similarly, in the field
of global climate research, the Earth System Grid (ESG) currently contains 35 terabytes of data shared by more than
16,000 users worldwide; while the next generation climate data archive is expected to be hold than 5 petabyte of
climate data.
Supporting such data-intensive science requires a communication infrastructure which enables large-scale data
replication, high performance remote data analysis and visualization, and provides access to computational
resources, in addition to reliably transferring the data across networks.
When they first looked into the issue of flexible bandwidth provisioning, Balman and his co-authors thought the
problem would be hard in terms of complexity. But on further examination, they realized that it can be solved in
polynomial time, and it can be implemented and integrated into the current network reservation frameworks in a very
effective manner. The algorithm produces results in less than a second for current network configurations, and it is
quite practical even if applied to future very large networks with hundreds or even thousands of routers and links, a
critical factor as nearly all end-to-end network connections traverse multiple links across different networks.
Now that the algorithm has been implemented as a new service extending the current underlying mechanisms, the
team is integrating the algorithm into the next version of ESnet OSCARS, due out in early 2011. Additionally, they are
working on the coordination of storage and network resource provisioning.
Read the full paper.
For more information about computing sciences at Berkeley Lab, please visit: www.lbl.gov/cs
BERKELEY LAB A-Z INDEX | BERKELEY LAB PHONE BOOK | BERKELEY LAB JOBS | SEARCH BERKELEY LAB
U.S. DEPARTMENT OF ENERGY · OFFICE OF SCIENCE · SCIDAC · ASCR · UNIVERSITY OF CALIFORNIA
Berkeley Lab Team Develops Flexible Reservation Algorithm f... http://www.lbl.gov/cs/CSnews/CSnews121310.html
2 of 2 7/25/13 4:26 PM

Weitere ähnliche Inhalte

Was ist angesagt?

Document clustering for forensic analysis an approach for improving computer ...
Document clustering for forensic analysis an approach for improving computer ...Document clustering for forensic analysis an approach for improving computer ...
Document clustering for forensic analysis an approach for improving computer ...JPINFOTECH JAYAPRAKASH
 
An efficeient privacy preserving ranked keyword search
An efficeient privacy preserving ranked keyword searchAn efficeient privacy preserving ranked keyword search
An efficeient privacy preserving ranked keyword searchredpel dot com
 
Distributed processing of probabilistic top k queries in wireless sensor netw...
Distributed processing of probabilistic top k queries in wireless sensor netw...Distributed processing of probabilistic top k queries in wireless sensor netw...
Distributed processing of probabilistic top k queries in wireless sensor netw...JPINFOTECH JAYAPRAKASH
 
Optimizing queries via search server ElasticSearch: a study applied to large ...
Optimizing queries via search server ElasticSearch: a study applied to large ...Optimizing queries via search server ElasticSearch: a study applied to large ...
Optimizing queries via search server ElasticSearch: a study applied to large ...Alex Camargo
 
Tutorial ESWC2011 Building Semantic Sensor Web - 04 - Querying_semantic_strea...
Tutorial ESWC2011 Building Semantic Sensor Web - 04 - Querying_semantic_strea...Tutorial ESWC2011 Building Semantic Sensor Web - 04 - Querying_semantic_strea...
Tutorial ESWC2011 Building Semantic Sensor Web - 04 - Querying_semantic_strea...Jean-Paul Calbimonte
 
Parallel and distributed system projects for java and dot net
Parallel and distributed system projects for java and dot netParallel and distributed system projects for java and dot net
Parallel and distributed system projects for java and dot netredpel dot com
 
CCCORE: Cloud Container for Collaborative Research
CCCORE: Cloud Container for Collaborative Research CCCORE: Cloud Container for Collaborative Research
CCCORE: Cloud Container for Collaborative Research IJECEIAES
 
2016 BE Final year Projects in chennai - 1 Crore Projects
2016 BE Final year Projects in chennai - 1 Crore Projects 2016 BE Final year Projects in chennai - 1 Crore Projects
2016 BE Final year Projects in chennai - 1 Crore Projects 1crore projects
 
Ingredients for Semantic Sensor Networks
Ingredients for Semantic Sensor NetworksIngredients for Semantic Sensor Networks
Ingredients for Semantic Sensor NetworksOscar Corcho
 
Protein-protein interactions-graph-theoretic-modeling
Protein-protein interactions-graph-theoretic-modelingProtein-protein interactions-graph-theoretic-modeling
Protein-protein interactions-graph-theoretic-modelingRangarajan Chari
 
Record matching
Record matchingRecord matching
Record matchingNishna Ma
 
Data Science Solutions by Materials Scientists: The Early Case Studies
Data Science Solutions by Materials Scientists: The Early Case StudiesData Science Solutions by Materials Scientists: The Early Case Studies
Data Science Solutions by Materials Scientists: The Early Case StudiesTony Fast
 
Distributed processing of probabilistic top k queries in wireless sensor netw...
Distributed processing of probabilistic top k queries in wireless sensor netw...Distributed processing of probabilistic top k queries in wireless sensor netw...
Distributed processing of probabilistic top k queries in wireless sensor netw...IEEEFINALYEARPROJECTS
 

Was ist angesagt? (18)

Document clustering for forensic analysis an approach for improving computer ...
Document clustering for forensic analysis an approach for improving computer ...Document clustering for forensic analysis an approach for improving computer ...
Document clustering for forensic analysis an approach for improving computer ...
 
50120130405014 2-3
50120130405014 2-350120130405014 2-3
50120130405014 2-3
 
An efficeient privacy preserving ranked keyword search
An efficeient privacy preserving ranked keyword searchAn efficeient privacy preserving ranked keyword search
An efficeient privacy preserving ranked keyword search
 
Distributed processing of probabilistic top k queries in wireless sensor netw...
Distributed processing of probabilistic top k queries in wireless sensor netw...Distributed processing of probabilistic top k queries in wireless sensor netw...
Distributed processing of probabilistic top k queries in wireless sensor netw...
 
Optimizing queries via search server ElasticSearch: a study applied to large ...
Optimizing queries via search server ElasticSearch: a study applied to large ...Optimizing queries via search server ElasticSearch: a study applied to large ...
Optimizing queries via search server ElasticSearch: a study applied to large ...
 
Tutorial ESWC2011 Building Semantic Sensor Web - 04 - Querying_semantic_strea...
Tutorial ESWC2011 Building Semantic Sensor Web - 04 - Querying_semantic_strea...Tutorial ESWC2011 Building Semantic Sensor Web - 04 - Querying_semantic_strea...
Tutorial ESWC2011 Building Semantic Sensor Web - 04 - Querying_semantic_strea...
 
IJET-V2I6P33
IJET-V2I6P33IJET-V2I6P33
IJET-V2I6P33
 
Parallel and distributed system projects for java and dot net
Parallel and distributed system projects for java and dot netParallel and distributed system projects for java and dot net
Parallel and distributed system projects for java and dot net
 
CCCORE: Cloud Container for Collaborative Research
CCCORE: Cloud Container for Collaborative Research CCCORE: Cloud Container for Collaborative Research
CCCORE: Cloud Container for Collaborative Research
 
2016 BE Final year Projects in chennai - 1 Crore Projects
2016 BE Final year Projects in chennai - 1 Crore Projects 2016 BE Final year Projects in chennai - 1 Crore Projects
2016 BE Final year Projects in chennai - 1 Crore Projects
 
Journals analysis ppt
Journals analysis pptJournals analysis ppt
Journals analysis ppt
 
Ingredients for Semantic Sensor Networks
Ingredients for Semantic Sensor NetworksIngredients for Semantic Sensor Networks
Ingredients for Semantic Sensor Networks
 
Protein-protein interactions-graph-theoretic-modeling
Protein-protein interactions-graph-theoretic-modelingProtein-protein interactions-graph-theoretic-modeling
Protein-protein interactions-graph-theoretic-modeling
 
Pronet Public Presentation v1 2
Pronet Public Presentation v1 2Pronet Public Presentation v1 2
Pronet Public Presentation v1 2
 
Ijcatr04071003
Ijcatr04071003Ijcatr04071003
Ijcatr04071003
 
Record matching
Record matchingRecord matching
Record matching
 
Data Science Solutions by Materials Scientists: The Early Case Studies
Data Science Solutions by Materials Scientists: The Early Case StudiesData Science Solutions by Materials Scientists: The Early Case Studies
Data Science Solutions by Materials Scientists: The Early Case Studies
 
Distributed processing of probabilistic top k queries in wireless sensor netw...
Distributed processing of probabilistic top k queries in wireless sensor netw...Distributed processing of probabilistic top k queries in wireless sensor netw...
Distributed processing of probabilistic top k queries in wireless sensor netw...
 

Andere mochten auch

Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1
Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1
Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1balmanme
 
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010balmanme
 
Presentation summerstudent 2009-aug09-lbl-summer
Presentation summerstudent 2009-aug09-lbl-summerPresentation summerstudent 2009-aug09-lbl-summer
Presentation summerstudent 2009-aug09-lbl-summerbalmanme
 
Balman stork cw09
Balman stork cw09Balman stork cw09
Balman stork cw09balmanme
 
Dynamic adaptation balman
Dynamic adaptation balmanDynamic adaptation balman
Dynamic adaptation balmanbalmanme
 
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...balmanme
 

Andere mochten auch (6)

Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1
Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1
Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1
 
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010
 
Presentation summerstudent 2009-aug09-lbl-summer
Presentation summerstudent 2009-aug09-lbl-summerPresentation summerstudent 2009-aug09-lbl-summer
Presentation summerstudent 2009-aug09-lbl-summer
 
Balman stork cw09
Balman stork cw09Balman stork cw09
Balman stork cw09
 
Dynamic adaptation balman
Dynamic adaptation balmanDynamic adaptation balman
Dynamic adaptation balman
 
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...
 

Ähnlich wie Berkeley lab team develops flexible reservation algorithm for advance network provisioning

Iaetsd survey on big data analytics for sdn (software defined networks)
Iaetsd survey on big data analytics for sdn (software defined networks)Iaetsd survey on big data analytics for sdn (software defined networks)
Iaetsd survey on big data analytics for sdn (software defined networks)Iaetsd Iaetsd
 
M phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projectsM phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projectsVijay Karan
 
M phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projectsM phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projectsVijay Karan
 
M.Phil Computer Science Secure Computing Projects
M.Phil Computer Science Secure Computing ProjectsM.Phil Computer Science Secure Computing Projects
M.Phil Computer Science Secure Computing ProjectsVijay Karan
 
M phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projectsM phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projectsVijay Karan
 
M.E Computer Science Secure Computing Projects
M.E Computer Science Secure Computing ProjectsM.E Computer Science Secure Computing Projects
M.E Computer Science Secure Computing ProjectsVijay Karan
 
Network Lifespan Maximization For Wireless Sensor Networks Using Nature-Inspi...
Network Lifespan Maximization For Wireless Sensor Networks Using Nature-Inspi...Network Lifespan Maximization For Wireless Sensor Networks Using Nature-Inspi...
Network Lifespan Maximization For Wireless Sensor Networks Using Nature-Inspi...IOSR Journals
 
International Journal of Engineering and Science Invention (IJESI)
International Journal of Engineering and Science Invention (IJESI)International Journal of Engineering and Science Invention (IJESI)
International Journal of Engineering and Science Invention (IJESI)inventionjournals
 
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...Tal Lavian Ph.D.
 
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)ijceronline
 
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...IJCNCJournal
 
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...IJCNCJournal
 
IRJET- Secure Data Access on Distributed Database using Skyline Queries
IRJET- Secure Data Access on Distributed Database using Skyline QueriesIRJET- Secure Data Access on Distributed Database using Skyline Queries
IRJET- Secure Data Access on Distributed Database using Skyline QueriesIRJET Journal
 
WhatIF-Driven-Multi-Constrained-OSCARS
WhatIF-Driven-Multi-Constrained-OSCARSWhatIF-Driven-Multi-Constrained-OSCARS
WhatIF-Driven-Multi-Constrained-OSCARSBharath H Ramaprasad
 
WhatIF-Driven-Multi-Constrained-OSCARS
WhatIF-Driven-Multi-Constrained-OSCARSWhatIF-Driven-Multi-Constrained-OSCARS
WhatIF-Driven-Multi-Constrained-OSCARSBharath H Ramaprasad
 
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...Tal Lavian Ph.D.
 
IEEE Datamining 2016 Title and Abstract
IEEE  Datamining 2016 Title and AbstractIEEE  Datamining 2016 Title and Abstract
IEEE Datamining 2016 Title and Abstracttsysglobalsolutions
 
Wireless Networks Projects, Network Security Projects, Networking Project
Wireless Networks Projects, Network Security Projects, Networking ProjectWireless Networks Projects, Network Security Projects, Networking Project
Wireless Networks Projects, Network Security Projects, Networking Projectncct
 
Polytechnic Projects
Polytechnic ProjectsPolytechnic Projects
Polytechnic Projectsncct
 

Ähnlich wie Berkeley lab team develops flexible reservation algorithm for advance network provisioning (20)

Iaetsd survey on big data analytics for sdn (software defined networks)
Iaetsd survey on big data analytics for sdn (software defined networks)Iaetsd survey on big data analytics for sdn (software defined networks)
Iaetsd survey on big data analytics for sdn (software defined networks)
 
M phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projectsM phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projects
 
M phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projectsM phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projects
 
M.Phil Computer Science Secure Computing Projects
M.Phil Computer Science Secure Computing ProjectsM.Phil Computer Science Secure Computing Projects
M.Phil Computer Science Secure Computing Projects
 
M phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projectsM phil-computer-science-secure-computing-projects
M phil-computer-science-secure-computing-projects
 
M.E Computer Science Secure Computing Projects
M.E Computer Science Secure Computing ProjectsM.E Computer Science Secure Computing Projects
M.E Computer Science Secure Computing Projects
 
Reducing delays in wireless networks
Reducing delays in wireless networksReducing delays in wireless networks
Reducing delays in wireless networks
 
Network Lifespan Maximization For Wireless Sensor Networks Using Nature-Inspi...
Network Lifespan Maximization For Wireless Sensor Networks Using Nature-Inspi...Network Lifespan Maximization For Wireless Sensor Networks Using Nature-Inspi...
Network Lifespan Maximization For Wireless Sensor Networks Using Nature-Inspi...
 
International Journal of Engineering and Science Invention (IJESI)
International Journal of Engineering and Science Invention (IJESI)International Journal of Engineering and Science Invention (IJESI)
International Journal of Engineering and Science Invention (IJESI)
 
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...
 
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)
 
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...
 
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...
Multi Objective Salp Swarm based Energy Efficient Routing Protocol for Hetero...
 
IRJET- Secure Data Access on Distributed Database using Skyline Queries
IRJET- Secure Data Access on Distributed Database using Skyline QueriesIRJET- Secure Data Access on Distributed Database using Skyline Queries
IRJET- Secure Data Access on Distributed Database using Skyline Queries
 
WhatIF-Driven-Multi-Constrained-OSCARS
WhatIF-Driven-Multi-Constrained-OSCARSWhatIF-Driven-Multi-Constrained-OSCARS
WhatIF-Driven-Multi-Constrained-OSCARS
 
WhatIF-Driven-Multi-Constrained-OSCARS
WhatIF-Driven-Multi-Constrained-OSCARSWhatIF-Driven-Multi-Constrained-OSCARS
WhatIF-Driven-Multi-Constrained-OSCARS
 
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...
 
IEEE Datamining 2016 Title and Abstract
IEEE  Datamining 2016 Title and AbstractIEEE  Datamining 2016 Title and Abstract
IEEE Datamining 2016 Title and Abstract
 
Wireless Networks Projects, Network Security Projects, Networking Project
Wireless Networks Projects, Network Security Projects, Networking ProjectWireless Networks Projects, Network Security Projects, Networking Project
Wireless Networks Projects, Network Security Projects, Networking Project
 
Polytechnic Projects
Polytechnic ProjectsPolytechnic Projects
Polytechnic Projects
 

Mehr von balmanme

Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...balmanme
 
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...balmanme
 
Experiences with High-bandwidth Networks
Experiences with High-bandwidth NetworksExperiences with High-bandwidth Networks
Experiences with High-bandwidth Networksbalmanme
 
Lblc sseminar jun09-2009-jun09-lblcsseminar
Lblc sseminar jun09-2009-jun09-lblcsseminarLblc sseminar jun09-2009-jun09-lblcsseminar
Lblc sseminar jun09-2009-jun09-lblcsseminarbalmanme
 
Presentation southernstork 2009-nov-southernworkshop
Presentation southernstork 2009-nov-southernworkshopPresentation southernstork 2009-nov-southernworkshop
Presentation southernstork 2009-nov-southernworkshopbalmanme
 
Balman dissertation Copyright @ 2010 Mehmet Balman
Balman dissertation Copyright @ 2010 Mehmet BalmanBalman dissertation Copyright @ 2010 Mehmet Balman
Balman dissertation Copyright @ 2010 Mehmet Balmanbalmanme
 
Aug17presentation.v2 2009-aug09-lblc sseminar
Aug17presentation.v2 2009-aug09-lblc sseminarAug17presentation.v2 2009-aug09-lblc sseminar
Aug17presentation.v2 2009-aug09-lblc sseminarbalmanme
 
Pdcs2010 balman-presentation
Pdcs2010 balman-presentationPdcs2010 balman-presentation
Pdcs2010 balman-presentationbalmanme
 
Analyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation NetworksAnalyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation Networksbalmanme
 
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...balmanme
 
Opening ndm2012 sc12
Opening ndm2012 sc12Opening ndm2012 sc12
Opening ndm2012 sc12balmanme
 
Sc10 nov16th-flex res-presentation
Sc10 nov16th-flex res-presentation Sc10 nov16th-flex res-presentation
Sc10 nov16th-flex res-presentation balmanme
 
Balman climate-c sc-ads-2011
Balman climate-c sc-ads-2011Balman climate-c sc-ads-2011
Balman climate-c sc-ads-2011balmanme
 
Welcome ndm11
Welcome ndm11Welcome ndm11
Welcome ndm11balmanme
 
2011 agu-town hall-100g
2011 agu-town hall-100g2011 agu-town hall-100g
2011 agu-town hall-100gbalmanme
 
Rdma presentation-kisti-v2
Rdma presentation-kisti-v2Rdma presentation-kisti-v2
Rdma presentation-kisti-v2balmanme
 
Streaming exa-scale data over 100Gbps networks
Streaming exa-scale data over 100Gbps networksStreaming exa-scale data over 100Gbps networks
Streaming exa-scale data over 100Gbps networksbalmanme
 
APM project meeting - June 13, 2012 - LBNL, Berkeley, CA
APM project meeting - June 13, 2012 - LBNL, Berkeley, CAAPM project meeting - June 13, 2012 - LBNL, Berkeley, CA
APM project meeting - June 13, 2012 - LBNL, Berkeley, CAbalmanme
 
HPDC 2012 presentation - June 19, 2012 - Delft, The Netherlands
HPDC 2012 presentation - June 19, 2012 -  Delft, The NetherlandsHPDC 2012 presentation - June 19, 2012 -  Delft, The Netherlands
HPDC 2012 presentation - June 19, 2012 - Delft, The Netherlandsbalmanme
 

Mehr von balmanme (19)

Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...
 
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...
 
Experiences with High-bandwidth Networks
Experiences with High-bandwidth NetworksExperiences with High-bandwidth Networks
Experiences with High-bandwidth Networks
 
Lblc sseminar jun09-2009-jun09-lblcsseminar
Lblc sseminar jun09-2009-jun09-lblcsseminarLblc sseminar jun09-2009-jun09-lblcsseminar
Lblc sseminar jun09-2009-jun09-lblcsseminar
 
Presentation southernstork 2009-nov-southernworkshop
Presentation southernstork 2009-nov-southernworkshopPresentation southernstork 2009-nov-southernworkshop
Presentation southernstork 2009-nov-southernworkshop
 
Balman dissertation Copyright @ 2010 Mehmet Balman
Balman dissertation Copyright @ 2010 Mehmet BalmanBalman dissertation Copyright @ 2010 Mehmet Balman
Balman dissertation Copyright @ 2010 Mehmet Balman
 
Aug17presentation.v2 2009-aug09-lblc sseminar
Aug17presentation.v2 2009-aug09-lblc sseminarAug17presentation.v2 2009-aug09-lblc sseminar
Aug17presentation.v2 2009-aug09-lblc sseminar
 
Pdcs2010 balman-presentation
Pdcs2010 balman-presentationPdcs2010 balman-presentation
Pdcs2010 balman-presentation
 
Analyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation NetworksAnalyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation Networks
 
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...
 
Opening ndm2012 sc12
Opening ndm2012 sc12Opening ndm2012 sc12
Opening ndm2012 sc12
 
Sc10 nov16th-flex res-presentation
Sc10 nov16th-flex res-presentation Sc10 nov16th-flex res-presentation
Sc10 nov16th-flex res-presentation
 
Balman climate-c sc-ads-2011
Balman climate-c sc-ads-2011Balman climate-c sc-ads-2011
Balman climate-c sc-ads-2011
 
Welcome ndm11
Welcome ndm11Welcome ndm11
Welcome ndm11
 
2011 agu-town hall-100g
2011 agu-town hall-100g2011 agu-town hall-100g
2011 agu-town hall-100g
 
Rdma presentation-kisti-v2
Rdma presentation-kisti-v2Rdma presentation-kisti-v2
Rdma presentation-kisti-v2
 
Streaming exa-scale data over 100Gbps networks
Streaming exa-scale data over 100Gbps networksStreaming exa-scale data over 100Gbps networks
Streaming exa-scale data over 100Gbps networks
 
APM project meeting - June 13, 2012 - LBNL, Berkeley, CA
APM project meeting - June 13, 2012 - LBNL, Berkeley, CAAPM project meeting - June 13, 2012 - LBNL, Berkeley, CA
APM project meeting - June 13, 2012 - LBNL, Berkeley, CA
 
HPDC 2012 presentation - June 19, 2012 - Delft, The Netherlands
HPDC 2012 presentation - June 19, 2012 -  Delft, The NetherlandsHPDC 2012 presentation - June 19, 2012 -  Delft, The Netherlands
HPDC 2012 presentation - June 19, 2012 - Delft, The Netherlands
 

Berkeley lab team develops flexible reservation algorithm for advance network provisioning

  • 1. SEARCH Computing Sciences ABOUT US RESEARCH CAREER AWARDS MEDIA CENTER CONTACT US Organization Chart Jobs and Fellowships Berkeley CSE Safety and Health CS Newsletters News & Publications Image Gallery Annual Reports News & Publications Visualization Gallery ESnet News Publications Map of DOE's Energy Sciences Network Berkeley Lab Team Develops Flexible Reservation Algorithm for Advance Network Provisioning December 13, 2010 Media Contact: Jon Bashor, jbashor@lbl.gov, 510-486-5849 Scientific research is becoming increasingly dependent on data-intensive analysis as larger teams of scientists are generating, sharing and analyzing very large datasets. Due to the geographical dispersion of the researchers, networking support is critical to advancing these efforts. Many applications need networking support that provides predictable performance, which in turn requires effective algorithms for bandwidth reservations. To address this need, the U.S. Department of Energy's Energy Sciences Network (ESnet) developed and deploys a network reservation system called OSCARS (On-Demand Secure Circuits and Advance Reservation System). The system establishes guaranteed bandwidth of secure virtual circuits for a certain bandwidth and length of time. However, OSCARS currently only gives a yes or no response to reservation requests. Users currently cannot inquire about bandwidth availability, nor receive alternative suggestions when reservation requests fail. To address this, Mehmet Balman, Arie Shoshani and Alex Sim of Berkeley Lab's Scientific Data Management (SDM) Group and Evangelos Chaniotakis of ESnet developed a flexible reservation algorithm for advance network provisioning. A paper describing the work was one of 51 technical papers accepted by the SC10 conference (out of 253 submissions) and was presented by Balman at the conference in New Orleans in November. The SDM Group develops new methods and tools for moving and analyzing massive scientific datasets, while ESnet is DOE's network connecting more than 40 major research sites and peers with more than 100 other research and commercial networks around the world. The authors describe the algorithm as "a novel approach for pathfinding in time-dependent networks taking advantage of user-provided parameters of total volume of data to be tranfered and time constraints for moving the data." The algorithm's flexibility can be likened to looking for airline flights. While travelers can usually specify their exact times and dates, many reservation systems can offer a number of options and lower fares if the traveler can be flexible regarding departures and arrivals. Currently, when a scientist enlists OSCARS, the system checks network availability and capacity for the specified duration of time, and allocates it for the user if it is available. Otherwise, it reports that it is unable to provide the requested allocation. When this happens, it falls upon the user to use a trial-and-error approach to finding an available time for the required bandwidth. The new algorithm presents the user with a variety of possible reservation options and alternatives. For example, if a research team is up against a deadline for presenting findings, they may opt for the earliest completion time of the data transfer. On the other hand, they may be able to wait for a time when the highest bandwidth is available, allowing the data to be transferred in the shortest duration. Users can then choose the option that best fits their needs. Balman began working on the project as a summer student at Berkeley Lab in the summer of 2009 while he was working on his doctorate at Louisiana State University. He has since graduated and is now a staff member of the Scientific Data Management Group at Berkeley Lab. "It is an interesting problem that has come about with the development of bandwidth reservation systems such as Berkeley Lab Team Develops Flexible Reservation Algorithm f... http://www.lbl.gov/cs/CSnews/CSnews121310.html 1 of 2 7/25/13 4:26 PM
  • 2. OSCARS," Balman said. "Although we have implemented our algorithm for testing and incorporation into a future version of OSCARS, the algorithm is not specific to OSCARS, and can be used with any network reservation framework." In the paper, Balman and his co-authors point to a couple of examples of next generation research networks that will be increasingly important. In the area of high energy physics, the Large Hadron Collider (LHC) in Switzerland is expected to generate 100 gigabits of data per second in the near future. This data is then quickly distributed to tiers of data facilities around the world for analysis by thousands of scientists in dozens of countries. Similarly, in the field of global climate research, the Earth System Grid (ESG) currently contains 35 terabytes of data shared by more than 16,000 users worldwide; while the next generation climate data archive is expected to be hold than 5 petabyte of climate data. Supporting such data-intensive science requires a communication infrastructure which enables large-scale data replication, high performance remote data analysis and visualization, and provides access to computational resources, in addition to reliably transferring the data across networks. When they first looked into the issue of flexible bandwidth provisioning, Balman and his co-authors thought the problem would be hard in terms of complexity. But on further examination, they realized that it can be solved in polynomial time, and it can be implemented and integrated into the current network reservation frameworks in a very effective manner. The algorithm produces results in less than a second for current network configurations, and it is quite practical even if applied to future very large networks with hundreds or even thousands of routers and links, a critical factor as nearly all end-to-end network connections traverse multiple links across different networks. Now that the algorithm has been implemented as a new service extending the current underlying mechanisms, the team is integrating the algorithm into the next version of ESnet OSCARS, due out in early 2011. Additionally, they are working on the coordination of storage and network resource provisioning. Read the full paper. For more information about computing sciences at Berkeley Lab, please visit: www.lbl.gov/cs BERKELEY LAB A-Z INDEX | BERKELEY LAB PHONE BOOK | BERKELEY LAB JOBS | SEARCH BERKELEY LAB U.S. DEPARTMENT OF ENERGY · OFFICE OF SCIENCE · SCIDAC · ASCR · UNIVERSITY OF CALIFORNIA Berkeley Lab Team Develops Flexible Reservation Algorithm f... http://www.lbl.gov/cs/CSnews/CSnews121310.html 2 of 2 7/25/13 4:26 PM