SlideShare ist ein Scribd-Unternehmen logo
1 von 32
Downloaden Sie, um offline zu lesen
Software-Defined Simulations for
Continuous Development of
Cloud and Data Center Networks
Pradeeban Kathiravelu, Lu´ıs Veiga
INESC-ID Lisboa
Instituto Superior T´ecnico, Universidade de Lisboa
Lisbon, Portugal
24th
International Conference on Cooperative Information Systems (CoopIS 2016)
28th
October 2016, Rhodes, Greece.
Pradeeban Kathiravelu Software-Defined Simulations 1 / 32
Introduction
Introduction
Software-Defined Networking (SDN) is extending its scope.
Separating and unifying the networking control plane from data plane.
Programmable networks → continuous development.
Very high scalability.
Pradeeban Kathiravelu Software-Defined Simulations 2 / 32
Introduction
Introduction
Software-Defined Networking (SDN) is extending its scope.
Separating and unifying the networking control plane from data plane.
Programmable networks → continuous development.
Very high scalability.
Network architectures and algorithms simulated or emulated at early
stages of development.
Native integration of network emulators into SDN controllers.
Pradeeban Kathiravelu Software-Defined Simulations 3 / 32
Motivation
How well the SDN simulators fare?
Network simulators supporting SDN and emulation capabilities.
NS-3.
Cloud simulators extended for cloud networks with SDN.
CloudSim → CloudSimSDN.
Pradeeban Kathiravelu Software-Defined Simulations 4 / 32
Motivation
How well the SDN simulators fare?
Network simulators supporting SDN and emulation capabilities.
NS-3.
Cloud simulators extended for cloud networks with SDN.
CloudSim → CloudSimSDN.
However..
Lack of “SDN-Native” network simulators.
Simulators not following the Software-Defined Systems paradigm.
Policy/algorithmic code locked in simulator-imperative code.
Need for easy migration and programmability.
Pradeeban Kathiravelu Software-Defined Simulations 5 / 32
Motivation
Goals
A simulator for Software-Defined Networking Systems.
Run the control plane code in the actual controller (portability).
Simulate the data plane (scalability, resource efficiency).
by programmatically invoking the southbound of SDN controller.
Extend and leverage the SDN controllers in simulations.
Bring the benefits of SDN to its own simulations!
Reusability, Scalability, Easy migration, . . .
Pradeeban Kathiravelu Software-Defined Simulations 6 / 32
Motivation
“Software-Defined Simulations”
Separation of control plane and (simulated) data plane.
Integration with SDN controllers.
Pradeeban Kathiravelu Software-Defined Simulations 7 / 32
SDNSim Architecture
SDNSim
A Framework for Software-Defined Simulations.
1 Network system to be simulated.
Expressed in “descriptors”.
XML-based description language.
Parsed and executed in SDNSim simulation sandbox.
A Java middleware.
2 Simulated application logic.
Deployed into controller.
Pradeeban Kathiravelu Software-Defined Simulations 8 / 32
SDNSim Architecture
Contributions and SDNSim Approach
1. Reusable simulation building blocks.
Pradeeban Kathiravelu Software-Defined Simulations 9 / 32
SDNSim Architecture
Contributions and SDNSim Approach
1. Reusable simulation building blocks.
Simulating complex and large-scale SDN systems.
Service Function Chaining.
Pradeeban Kathiravelu Software-Defined Simulations 10 / 32
SDNSim Architecture
Contributions and SDNSim Approach
1. Reusable simulation building blocks.
Simulating complex and large-scale SDN systems.
Service Function Chaining.
As a case of Network Function Virtualization (NFV).
Pradeeban Kathiravelu Software-Defined Simulations 11 / 32
SDNSim Architecture
Contributions and SDNSim Approach
2. Support for continuous development and iterative deployment.
Checkpointing and versioning of simulated application logic.
Incremental updates: changesets as OSGi bundles in the control plane.
Pradeeban Kathiravelu Software-Defined Simulations 12 / 32
SDNSim Architecture
Contributions and SDNSim Approach
3. State-aware simulations.
Adaptive scaling through shared state.
Horizontal scalability through In-Memory Data Grids.
State of the simulations for scaling decisions.
Pause-and-resume simulations.
Multi-tenanted parallel executions.
Pradeeban Kathiravelu Software-Defined Simulations 13 / 32
SDNSim Architecture
Contributions and SDNSim Approach
4. Expressiveness.
Data plane: XML-based representations of the network.
Control plane: Java API.
Pradeeban Kathiravelu Software-Defined Simulations 14 / 32
SDNSim Prototype
Prototype Implementation
Oracle Java 1.8.0 - Development language.
Apache Maven 3.1.1 - Build the bundles and execute the scripts.
Infinispan 7.2.0.Final - Distributed cluster.
Apache Karaf 3.0.3 - OSGi run time.
OpenDaylight Beryllium - Default controller.
Multiple deployment options:
As a stand-alone simulator.
Distributed execution with an SDN controller.
As a bundle in an OSGi-based SDN controller.
Pradeeban Kathiravelu Software-Defined Simulations 15 / 32
Evaluation
Evaluation Deployment Configurations
Intel R CoreTM i7-4700MQ
CPU @ 2.40GHz 8 processor.
8 GB memory.
Ubuntu 14.04 LTS 64 bit operating system.
A cluster of up to 5 identical computers.
Pradeeban Kathiravelu Software-Defined Simulations 16 / 32
Evaluation
Evaluation Strategy
Benchmark against
CloudSimSDN.
Cloud2
Sim for distributed
execution.
Simulating routing algorithms in
fat-tree topology.
Experiments repeated 6 times.
Data center simulations of up to
100,000 nodes.
Pradeeban Kathiravelu Software-Defined Simulations 17 / 32
Evaluation
Performance and Problem Size
Higher performance in larger simulations.
Pradeeban Kathiravelu Software-Defined Simulations 18 / 32
Evaluation
Horizontal scalability
Smart scale-out.
Higher horizontal scalability.
Pradeeban Kathiravelu Software-Defined Simulations 19 / 32
Evaluation
Performance with Incremental Updates
Smaller simulations: up to 1000 nodes.
SDNSim: controller and middleware execution completion time.
Pradeeban Kathiravelu Software-Defined Simulations 20 / 32
Evaluation
Performance with Incremental Updates
Initial execution takes longer - Initializations.
Pradeeban Kathiravelu Software-Defined Simulations 21 / 32
Evaluation
Performance with Incremental Updates
Faster executions once the system is initialized.
Pradeeban Kathiravelu Software-Defined Simulations 22 / 32
Evaluation
Incremental Updates: Test-driven development
Faster executions once the system is initialized.
Pradeeban Kathiravelu Software-Defined Simulations 23 / 32
Evaluation
Incremental Updates: Test-driven development
Even faster executions for subsequent simulations.
Pradeeban Kathiravelu Software-Defined Simulations 24 / 32
Evaluation
Incremental Updates: Test-driven development
No change in simulated environment - Deploy changesets to
controller.
Pradeeban Kathiravelu Software-Defined Simulations 25 / 32
Evaluation
Incremental Updates: Test-driven development
No change in simulated environment - Revert changeset.
Pradeeban Kathiravelu Software-Defined Simulations 26 / 32
Evaluation
Performance with Incremental Scaling
No change in controller - scale the simulated environment.
Pradeeban Kathiravelu Software-Defined Simulations 27 / 32
Conclusion
Conclusion
Conclusions
SDNSim is an SDN-aware network simulator
Built following the SDN paradigm
Separation of data layer from the control layer and application logic.
Enabling an incremental modelling of cloud networks.
Performance and scalability.
Complex network systems simulations.
Reuse the same controller code algorithm developers created to
simulate much larger scale deployments.
Adaptive parallel and distributed simulations.
Future Work
Extension points for easy migrations.
More emulator and controller integrations.
Pradeeban Kathiravelu Software-Defined Simulations 28 / 32
Conclusion
Conclusion
Conclusions
SDNSim is an SDN-aware network simulator
Built following the SDN paradigm
Separation of data layer from the control layer and application logic.
Enabling an incremental modelling of cloud networks.
Performance and scalability.
Complex network systems simulations.
Reuse the same controller code algorithm developers created to
simulate much larger scale deployments.
Adaptive parallel and distributed simulations.
Future Work
Extension points for easy migrations.
More emulator and controller integrations.
Thank you!
Questions?
Pradeeban Kathiravelu Software-Defined Simulations 29 / 32
Additional Slides
Additional Slides
Pradeeban Kathiravelu Software-Defined Simulations 30 / 32
Additional Slides
Network Construction with Mininet and SDNSim
Adaptive Emulation and Simulation.
Simulate when resources are scarce for emulation.
Pradeeban Kathiravelu Software-Defined Simulations 31 / 32
Additional Slides
Automated Code Migration: Simulation → Emulation
Time taken to progreammatically convert an SDNSim simulation
script into a Mininet script.
Pradeeban Kathiravelu Software-Defined Simulations 32 / 32

Weitere ähnliche Inhalte

Was ist angesagt?

Standardising the compressed representation of neural networks
Standardising the compressed representation of neural networksStandardising the compressed representation of neural networks
Standardising the compressed representation of neural networks
Förderverein Technische Fakultät
 
Introduction to National Supercomputer center in Tianjin TH-1A Supercomputer
Introduction to National Supercomputer center in Tianjin TH-1A SupercomputerIntroduction to National Supercomputer center in Tianjin TH-1A Supercomputer
Introduction to National Supercomputer center in Tianjin TH-1A Supercomputer
Förderverein Technische Fakultät
 
RL-Cache: Learning-Based Cache Admission for Content Delivery
RL-Cache: Learning-Based Cache Admission for Content DeliveryRL-Cache: Learning-Based Cache Admission for Content Delivery
RL-Cache: Learning-Based Cache Admission for Content Delivery
Förderverein Technische Fakultät
 
Moldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devicesMoldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devices
LEGATO project
 

Was ist angesagt? (20)

Standardising the compressed representation of neural networks
Standardising the compressed representation of neural networksStandardising the compressed representation of neural networks
Standardising the compressed representation of neural networks
 
IEEE Parallel and distributed system 2016 Title and Abstract
IEEE Parallel and distributed system 2016 Title and AbstractIEEE Parallel and distributed system 2016 Title and Abstract
IEEE Parallel and distributed system 2016 Title and Abstract
 
M tech-2015 vlsi-new
M tech-2015 vlsi-newM tech-2015 vlsi-new
M tech-2015 vlsi-new
 
Networking Articles Overview
Networking Articles OverviewNetworking Articles Overview
Networking Articles Overview
 
Rain technology seminar
Rain technology seminar Rain technology seminar
Rain technology seminar
 
Prediction System for Reducing the Cloud Bandwidth and Cost
Prediction System for Reducing the Cloud Bandwidth and CostPrediction System for Reducing the Cloud Bandwidth and Cost
Prediction System for Reducing the Cloud Bandwidth and Cost
 
Update on the Mont-Blanc Project for ARM-based HPC
Update on the Mont-Blanc Project for ARM-based HPCUpdate on the Mont-Blanc Project for ARM-based HPC
Update on the Mont-Blanc Project for ARM-based HPC
 
Introduction to National Supercomputer center in Tianjin TH-1A Supercomputer
Introduction to National Supercomputer center in Tianjin TH-1A SupercomputerIntroduction to National Supercomputer center in Tianjin TH-1A Supercomputer
Introduction to National Supercomputer center in Tianjin TH-1A Supercomputer
 
Netsim webinar-iitm-sep-17
Netsim webinar-iitm-sep-17Netsim webinar-iitm-sep-17
Netsim webinar-iitm-sep-17
 
Device Data Directory and Asynchronous execution: A path to heterogeneous com...
Device Data Directory and Asynchronous execution: A path to heterogeneous com...Device Data Directory and Asynchronous execution: A path to heterogeneous com...
Device Data Directory and Asynchronous execution: A path to heterogeneous com...
 
RL-Cache: Learning-Based Cache Admission for Content Delivery
RL-Cache: Learning-Based Cache Admission for Content DeliveryRL-Cache: Learning-Based Cache Admission for Content Delivery
RL-Cache: Learning-Based Cache Admission for Content Delivery
 
Fast aggregation scheduling in wireless sensor networks
Fast aggregation scheduling in wireless sensor networksFast aggregation scheduling in wireless sensor networks
Fast aggregation scheduling in wireless sensor networks
 
Pack prediction based cloud bandwidth and cost reduction system
Pack prediction based cloud bandwidth and cost reduction systemPack prediction based cloud bandwidth and cost reduction system
Pack prediction based cloud bandwidth and cost reduction system
 
Moldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devicesMoldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devices
 
OpenACC Monthly Highlights Summer 2019
OpenACC Monthly Highlights Summer 2019OpenACC Monthly Highlights Summer 2019
OpenACC Monthly Highlights Summer 2019
 
Rc maca receiver-centric mac protocol for event-driven wireless sensor networks
Rc maca receiver-centric mac protocol for event-driven wireless sensor networksRc maca receiver-centric mac protocol for event-driven wireless sensor networks
Rc maca receiver-centric mac protocol for event-driven wireless sensor networks
 
Pack prediction based cloud bandwidth and cost reduction system
Pack prediction based cloud bandwidth and cost reduction systemPack prediction based cloud bandwidth and cost reduction system
Pack prediction based cloud bandwidth and cost reduction system
 
Rain Technology
Rain TechnologyRain Technology
Rain Technology
 
A Novel Approach in Scheduling Of the Real- Time Tasks In Heterogeneous Multi...
A Novel Approach in Scheduling Of the Real- Time Tasks In Heterogeneous Multi...A Novel Approach in Scheduling Of the Real- Time Tasks In Heterogeneous Multi...
A Novel Approach in Scheduling Of the Real- Time Tasks In Heterogeneous Multi...
 
Paper sharing_resource optimization scheduling and allocation for hierarchica...
Paper sharing_resource optimization scheduling and allocation for hierarchica...Paper sharing_resource optimization scheduling and allocation for hierarchica...
Paper sharing_resource optimization scheduling and allocation for hierarchica...
 

Ähnlich wie Software-Defined Simulations for Continuous Development of Cloud and Data Center Networks

Software-Defined Networking(SDN):A New Approach to Networking
Software-Defined Networking(SDN):A New Approach to NetworkingSoftware-Defined Networking(SDN):A New Approach to Networking
Software-Defined Networking(SDN):A New Approach to Networking
Anju Ann
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache Spark
Databricks
 

Ähnlich wie Software-Defined Simulations for Continuous Development of Cloud and Data Center Networks (20)

WWT Software-Defined Networking Guide
WWT Software-Defined Networking GuideWWT Software-Defined Networking Guide
WWT Software-Defined Networking Guide
 
IEEE HPSR 2017 Keynote: Softwarized Dataplanes and the P^3 trade-offs: Progra...
IEEE HPSR 2017 Keynote: Softwarized Dataplanes and the P^3 trade-offs: Progra...IEEE HPSR 2017 Keynote: Softwarized Dataplanes and the P^3 trade-offs: Progra...
IEEE HPSR 2017 Keynote: Softwarized Dataplanes and the P^3 trade-offs: Progra...
 
Modeling and Simulation of Parallel and Distributed Computing Systems with Si...
Modeling and Simulation of Parallel and Distributed Computing Systems with Si...Modeling and Simulation of Parallel and Distributed Computing Systems with Si...
Modeling and Simulation of Parallel and Distributed Computing Systems with Si...
 
Innovation with ai at scale on the edge vt sept 2019 v0
Innovation with ai at scale  on the edge vt sept 2019 v0Innovation with ai at scale  on the edge vt sept 2019 v0
Innovation with ai at scale on the edge vt sept 2019 v0
 
Lecture 1 - Introduction.pptx
Lecture 1 - Introduction.pptxLecture 1 - Introduction.pptx
Lecture 1 - Introduction.pptx
 
Software-Defined Networking(SDN):A New Approach to Networking
Software-Defined Networking(SDN):A New Approach to NetworkingSoftware-Defined Networking(SDN):A New Approach to Networking
Software-Defined Networking(SDN):A New Approach to Networking
 
System mldl meetup
System mldl meetupSystem mldl meetup
System mldl meetup
 
SDN in CloudStack
SDN in CloudStackSDN in CloudStack
SDN in CloudStack
 
SDN Multi-Controller Domain.pptx
SDN Multi-Controller Domain.pptxSDN Multi-Controller Domain.pptx
SDN Multi-Controller Domain.pptx
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache Spark
 
Microsoft Azure in HPC scenarios
Microsoft Azure in HPC scenariosMicrosoft Azure in HPC scenarios
Microsoft Azure in HPC scenarios
 
Software_Defined_Networking.pptx
Software_Defined_Networking.pptxSoftware_Defined_Networking.pptx
Software_Defined_Networking.pptx
 
Bridging Concepts and Practice in eScience via Simulation-driven Engineering
Bridging Concepts and Practice in eScience via Simulation-driven EngineeringBridging Concepts and Practice in eScience via Simulation-driven Engineering
Bridging Concepts and Practice in eScience via Simulation-driven Engineering
 
Software Defined Networks
Software Defined NetworksSoftware Defined Networks
Software Defined Networks
 
Introduction to AirWave 10
Introduction to AirWave 10Introduction to AirWave 10
Introduction to AirWave 10
 
OpenDayLight Load Balanced Switching
OpenDayLight Load Balanced SwitchingOpenDayLight Load Balanced Switching
OpenDayLight Load Balanced Switching
 
cncf overview and building edge computing using kubernetes
cncf overview and building edge computing using kubernetescncf overview and building edge computing using kubernetes
cncf overview and building edge computing using kubernetes
 
Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep...
 Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep... Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep...
Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep...
 
TFI2014 Session I - State of SDN - Sam K. Aldrin
TFI2014 Session I - State of SDN - Sam K. AldrinTFI2014 Session I - State of SDN - Sam K. Aldrin
TFI2014 Session I - State of SDN - Sam K. Aldrin
 
SDN 101: Software Defined Networking Course - Sameh Zaghloul/IBM - 2014
SDN 101: Software Defined Networking Course - Sameh Zaghloul/IBM - 2014SDN 101: Software Defined Networking Course - Sameh Zaghloul/IBM - 2014
SDN 101: Software Defined Networking Course - Sameh Zaghloul/IBM - 2014
 

Mehr von Pradeeban Kathiravelu, Ph.D.

Mehr von Pradeeban Kathiravelu, Ph.D. (20)

Google Summer of Code_2023.pdf
Google Summer of Code_2023.pdfGoogle Summer of Code_2023.pdf
Google Summer of Code_2023.pdf
 
Google Summer of Code (GSoC) 2022
Google Summer of Code (GSoC) 2022Google Summer of Code (GSoC) 2022
Google Summer of Code (GSoC) 2022
 
Google Summer of Code (GSoC) 2022
Google Summer of Code (GSoC) 2022Google Summer of Code (GSoC) 2022
Google Summer of Code (GSoC) 2022
 
Niffler: A DICOM Framework for Machine Learning and Processing Pipelines.
Niffler: A DICOM Framework for Machine Learning and Processing Pipelines.Niffler: A DICOM Framework for Machine Learning and Processing Pipelines.
Niffler: A DICOM Framework for Machine Learning and Processing Pipelines.
 
Google summer of code (GSoC) 2021
Google summer of code (GSoC) 2021Google summer of code (GSoC) 2021
Google summer of code (GSoC) 2021
 
A DICOM Framework for Machine Learning Pipelines against Real-Time Radiology ...
A DICOM Framework for Machine Learning Pipelines against Real-Time Radiology ...A DICOM Framework for Machine Learning Pipelines against Real-Time Radiology ...
A DICOM Framework for Machine Learning Pipelines against Real-Time Radiology ...
 
Google Summer of Code (GSoC) 2020 for mentors
Google Summer of Code (GSoC) 2020 for mentorsGoogle Summer of Code (GSoC) 2020 for mentors
Google Summer of Code (GSoC) 2020 for mentors
 
Google Summer of Code (GSoC) 2020
Google Summer of Code (GSoC) 2020Google Summer of Code (GSoC) 2020
Google Summer of Code (GSoC) 2020
 
Data Services with Bindaas: RESTful Interfaces for Diverse Data Sources
Data Services with Bindaas: RESTful Interfaces for Diverse Data SourcesData Services with Bindaas: RESTful Interfaces for Diverse Data Sources
Data Services with Bindaas: RESTful Interfaces for Diverse Data Sources
 
The UCLouvain Public Defense of my EMJD-DC Double Doctorate Ph.D. degree
The UCLouvain Public Defense of my EMJD-DC Double Doctorate Ph.D. degreeThe UCLouvain Public Defense of my EMJD-DC Double Doctorate Ph.D. degree
The UCLouvain Public Defense of my EMJD-DC Double Doctorate Ph.D. degree
 
My Ph.D. Defense - Software-Defined Systems for Network-Aware Service Compos...
 My Ph.D. Defense - Software-Defined Systems for Network-Aware Service Compos... My Ph.D. Defense - Software-Defined Systems for Network-Aware Service Compos...
My Ph.D. Defense - Software-Defined Systems for Network-Aware Service Compos...
 
My Ph.D. Defense - Software-Defined Systems for Network-Aware Service Composi...
My Ph.D. Defense - Software-Defined Systems for Network-Aware Service Composi...My Ph.D. Defense - Software-Defined Systems for Network-Aware Service Composi...
My Ph.D. Defense - Software-Defined Systems for Network-Aware Service Composi...
 
UCL Ph.D. Confirmation 2018
UCL Ph.D. Confirmation 2018UCL Ph.D. Confirmation 2018
UCL Ph.D. Confirmation 2018
 
Software-Defined Systems for Network-Aware Service Composition and Workflow P...
Software-Defined Systems for Network-Aware Service Composition and Workflow P...Software-Defined Systems for Network-Aware Service Composition and Workflow P...
Software-Defined Systems for Network-Aware Service Composition and Workflow P...
 
Moving bits with a fleet of shared virtual routers
Moving bits with a fleet of shared virtual routersMoving bits with a fleet of shared virtual routers
Moving bits with a fleet of shared virtual routers
 
Software-Defined Data Services: Interoperable and Network-Aware Big Data Exec...
Software-Defined Data Services: Interoperable and Network-Aware Big Data Exec...Software-Defined Data Services: Interoperable and Network-Aware Big Data Exec...
Software-Defined Data Services: Interoperable and Network-Aware Big Data Exec...
 
On-Demand Service-Based Big Data Integration: Optimized for Research Collabor...
On-Demand Service-Based Big Data Integration: Optimized for Research Collabor...On-Demand Service-Based Big Data Integration: Optimized for Research Collabor...
On-Demand Service-Based Big Data Integration: Optimized for Research Collabor...
 
Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...
Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...
Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...
 
Software-Defined Inter-Cloud Composition of Big Services
Software-Defined Inter-Cloud Composition of Big ServicesSoftware-Defined Inter-Cloud Composition of Big Services
Software-Defined Inter-Cloud Composition of Big Services
 
Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...
Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...
Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...
 

Kürzlich hochgeladen

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Kürzlich hochgeladen (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 

Software-Defined Simulations for Continuous Development of Cloud and Data Center Networks

  • 1. Software-Defined Simulations for Continuous Development of Cloud and Data Center Networks Pradeeban Kathiravelu, Lu´ıs Veiga INESC-ID Lisboa Instituto Superior T´ecnico, Universidade de Lisboa Lisbon, Portugal 24th International Conference on Cooperative Information Systems (CoopIS 2016) 28th October 2016, Rhodes, Greece. Pradeeban Kathiravelu Software-Defined Simulations 1 / 32
  • 2. Introduction Introduction Software-Defined Networking (SDN) is extending its scope. Separating and unifying the networking control plane from data plane. Programmable networks → continuous development. Very high scalability. Pradeeban Kathiravelu Software-Defined Simulations 2 / 32
  • 3. Introduction Introduction Software-Defined Networking (SDN) is extending its scope. Separating and unifying the networking control plane from data plane. Programmable networks → continuous development. Very high scalability. Network architectures and algorithms simulated or emulated at early stages of development. Native integration of network emulators into SDN controllers. Pradeeban Kathiravelu Software-Defined Simulations 3 / 32
  • 4. Motivation How well the SDN simulators fare? Network simulators supporting SDN and emulation capabilities. NS-3. Cloud simulators extended for cloud networks with SDN. CloudSim → CloudSimSDN. Pradeeban Kathiravelu Software-Defined Simulations 4 / 32
  • 5. Motivation How well the SDN simulators fare? Network simulators supporting SDN and emulation capabilities. NS-3. Cloud simulators extended for cloud networks with SDN. CloudSim → CloudSimSDN. However.. Lack of “SDN-Native” network simulators. Simulators not following the Software-Defined Systems paradigm. Policy/algorithmic code locked in simulator-imperative code. Need for easy migration and programmability. Pradeeban Kathiravelu Software-Defined Simulations 5 / 32
  • 6. Motivation Goals A simulator for Software-Defined Networking Systems. Run the control plane code in the actual controller (portability). Simulate the data plane (scalability, resource efficiency). by programmatically invoking the southbound of SDN controller. Extend and leverage the SDN controllers in simulations. Bring the benefits of SDN to its own simulations! Reusability, Scalability, Easy migration, . . . Pradeeban Kathiravelu Software-Defined Simulations 6 / 32
  • 7. Motivation “Software-Defined Simulations” Separation of control plane and (simulated) data plane. Integration with SDN controllers. Pradeeban Kathiravelu Software-Defined Simulations 7 / 32
  • 8. SDNSim Architecture SDNSim A Framework for Software-Defined Simulations. 1 Network system to be simulated. Expressed in “descriptors”. XML-based description language. Parsed and executed in SDNSim simulation sandbox. A Java middleware. 2 Simulated application logic. Deployed into controller. Pradeeban Kathiravelu Software-Defined Simulations 8 / 32
  • 9. SDNSim Architecture Contributions and SDNSim Approach 1. Reusable simulation building blocks. Pradeeban Kathiravelu Software-Defined Simulations 9 / 32
  • 10. SDNSim Architecture Contributions and SDNSim Approach 1. Reusable simulation building blocks. Simulating complex and large-scale SDN systems. Service Function Chaining. Pradeeban Kathiravelu Software-Defined Simulations 10 / 32
  • 11. SDNSim Architecture Contributions and SDNSim Approach 1. Reusable simulation building blocks. Simulating complex and large-scale SDN systems. Service Function Chaining. As a case of Network Function Virtualization (NFV). Pradeeban Kathiravelu Software-Defined Simulations 11 / 32
  • 12. SDNSim Architecture Contributions and SDNSim Approach 2. Support for continuous development and iterative deployment. Checkpointing and versioning of simulated application logic. Incremental updates: changesets as OSGi bundles in the control plane. Pradeeban Kathiravelu Software-Defined Simulations 12 / 32
  • 13. SDNSim Architecture Contributions and SDNSim Approach 3. State-aware simulations. Adaptive scaling through shared state. Horizontal scalability through In-Memory Data Grids. State of the simulations for scaling decisions. Pause-and-resume simulations. Multi-tenanted parallel executions. Pradeeban Kathiravelu Software-Defined Simulations 13 / 32
  • 14. SDNSim Architecture Contributions and SDNSim Approach 4. Expressiveness. Data plane: XML-based representations of the network. Control plane: Java API. Pradeeban Kathiravelu Software-Defined Simulations 14 / 32
  • 15. SDNSim Prototype Prototype Implementation Oracle Java 1.8.0 - Development language. Apache Maven 3.1.1 - Build the bundles and execute the scripts. Infinispan 7.2.0.Final - Distributed cluster. Apache Karaf 3.0.3 - OSGi run time. OpenDaylight Beryllium - Default controller. Multiple deployment options: As a stand-alone simulator. Distributed execution with an SDN controller. As a bundle in an OSGi-based SDN controller. Pradeeban Kathiravelu Software-Defined Simulations 15 / 32
  • 16. Evaluation Evaluation Deployment Configurations Intel R CoreTM i7-4700MQ CPU @ 2.40GHz 8 processor. 8 GB memory. Ubuntu 14.04 LTS 64 bit operating system. A cluster of up to 5 identical computers. Pradeeban Kathiravelu Software-Defined Simulations 16 / 32
  • 17. Evaluation Evaluation Strategy Benchmark against CloudSimSDN. Cloud2 Sim for distributed execution. Simulating routing algorithms in fat-tree topology. Experiments repeated 6 times. Data center simulations of up to 100,000 nodes. Pradeeban Kathiravelu Software-Defined Simulations 17 / 32
  • 18. Evaluation Performance and Problem Size Higher performance in larger simulations. Pradeeban Kathiravelu Software-Defined Simulations 18 / 32
  • 19. Evaluation Horizontal scalability Smart scale-out. Higher horizontal scalability. Pradeeban Kathiravelu Software-Defined Simulations 19 / 32
  • 20. Evaluation Performance with Incremental Updates Smaller simulations: up to 1000 nodes. SDNSim: controller and middleware execution completion time. Pradeeban Kathiravelu Software-Defined Simulations 20 / 32
  • 21. Evaluation Performance with Incremental Updates Initial execution takes longer - Initializations. Pradeeban Kathiravelu Software-Defined Simulations 21 / 32
  • 22. Evaluation Performance with Incremental Updates Faster executions once the system is initialized. Pradeeban Kathiravelu Software-Defined Simulations 22 / 32
  • 23. Evaluation Incremental Updates: Test-driven development Faster executions once the system is initialized. Pradeeban Kathiravelu Software-Defined Simulations 23 / 32
  • 24. Evaluation Incremental Updates: Test-driven development Even faster executions for subsequent simulations. Pradeeban Kathiravelu Software-Defined Simulations 24 / 32
  • 25. Evaluation Incremental Updates: Test-driven development No change in simulated environment - Deploy changesets to controller. Pradeeban Kathiravelu Software-Defined Simulations 25 / 32
  • 26. Evaluation Incremental Updates: Test-driven development No change in simulated environment - Revert changeset. Pradeeban Kathiravelu Software-Defined Simulations 26 / 32
  • 27. Evaluation Performance with Incremental Scaling No change in controller - scale the simulated environment. Pradeeban Kathiravelu Software-Defined Simulations 27 / 32
  • 28. Conclusion Conclusion Conclusions SDNSim is an SDN-aware network simulator Built following the SDN paradigm Separation of data layer from the control layer and application logic. Enabling an incremental modelling of cloud networks. Performance and scalability. Complex network systems simulations. Reuse the same controller code algorithm developers created to simulate much larger scale deployments. Adaptive parallel and distributed simulations. Future Work Extension points for easy migrations. More emulator and controller integrations. Pradeeban Kathiravelu Software-Defined Simulations 28 / 32
  • 29. Conclusion Conclusion Conclusions SDNSim is an SDN-aware network simulator Built following the SDN paradigm Separation of data layer from the control layer and application logic. Enabling an incremental modelling of cloud networks. Performance and scalability. Complex network systems simulations. Reuse the same controller code algorithm developers created to simulate much larger scale deployments. Adaptive parallel and distributed simulations. Future Work Extension points for easy migrations. More emulator and controller integrations. Thank you! Questions? Pradeeban Kathiravelu Software-Defined Simulations 29 / 32
  • 30. Additional Slides Additional Slides Pradeeban Kathiravelu Software-Defined Simulations 30 / 32
  • 31. Additional Slides Network Construction with Mininet and SDNSim Adaptive Emulation and Simulation. Simulate when resources are scarce for emulation. Pradeeban Kathiravelu Software-Defined Simulations 31 / 32
  • 32. Additional Slides Automated Code Migration: Simulation → Emulation Time taken to progreammatically convert an SDNSim simulation script into a Mininet script. Pradeeban Kathiravelu Software-Defined Simulations 32 / 32