How is the open source community using SDN/NFV to create truly heterogeneous, inter-operable, multi-tenant cloud data centers? We’ll present results from our independent testing of cloud orchestration, middleware, SaaS, and Iaas multi-vendor solutions, including SDN’s inroads to the telecommunication world and how networking influences emerging trends like Docker virtual containers in the cloud.
2. Automated Management using SDN/NFV
DevNet 1114
Casimer DeCusatis, Ph.D., Assistant Professor, Marist College
@Dr_Casimer casimer.decusatis@marist.edu
3. • How can we use SDN/NFV to create automated,
dynamically provisioned networks within and
between cloud data centers ?
• Results from the New York State Center for Cloud
Computing & Analytics (CCAC) Open SDN Test Bed
Agenda - Automation
4. The New York State Cloud Computing & Analytics Center
at Marist College, Poughkeepsie, NY
5. Cisco white paper, “Simplify and Automate for Enhanced Service Agility”
5
An Unsustainable Operations Model
6. Fixed Wavelengths Are Under-utilized
Uniform node-to-node traffic
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
00:00
01:00
02:00
03:00
04:00
05:00
06:00
07:00
08:00
09:00
10:00
11:00
12:00
13:00
14:00
15:00
16:00
17:00
18:00
19:00
20:00
21:00
22:00
23:00
NetworkUtilization
Time
base
traffic
excess
traffic
Currently, enterprises must contract for over-provisioned fixed
capacity to meet the multi-gigabit peaks, which results in costly,
underutilized capacity during sustained quiescent periods
N node ring
7. 7
Application Aware Network Orchestration
Daytime Config:
Workload balanced across sites Nighttime Config:
Backup jobs between selected sites
Disaster Alert !
Emergency Recovery between sites
C. DeCusatis, T. Bundy, R. Cannistra, “Dynamic software-defined networking (SDN) testbed”,
Proc. 2013 Internet2 Annual Meeting, Arlington, VA (April 2013)
9. Hypervisor
Platforms
Policy Management API
Cloud Orchestration
Load
Balancing
Firewall
IDS/IPS
Other
Application
Security &
Authentication
Congress
Content
Delivery
Configuration
Cinder
drivers
Nova
Compute
drivers
storage
Storage
Servers
drivers
Network
Neutron
Virtual
Overlay
Control Plane
Physical
Flow Control
Plane
Storage
Virtualization
Platforms
Network
Zone 1
Forwarding
Layer
Application
Managem
entLayer
Services
Managem
entLayer
Adaptation
Layer
Network
Zone 2
Virtual
Overlay
Control Plane
Physical
Flow Control
Plane
Zone Controller
SDN VE
10. Storage
VM Cluster
IBM V7000
Storage
single 10G
IBM G8264
OF Switch
SDN
Controller (VM)
ADVA Network
Hypervisor (VM)
Site A
IBM G8264
OF Switch
ADVA XG210
Storage
dual 10G
IBM G8264
OF Switch
Site C Storage
dual 10G
IBM G8264
OF Switch
Site B
ADVA XG210
CCM-40-8
2-14
8ROADM
2-10
8ROADM
2-3
8ROADM
2-6
2WCA
2WCA
2WCA
CCM-40-8
2-14
8ROADM
2-10
8ROADM
2-3
8ROADM
2-6
2WCA
2WCA
2WCA
CCM-40-8
2-14
8ROADM
2-10
8ROADM
2-3
8ROADM
2-6
2WCA
2WCA
2WCA
ADVA XG210
ADVA FSP 3000
NMS
single 10G
DCN
Link Utilization Monitor, Traffic Generator, PRO-NID VM (NFV)
SDN Network Automation Configuration
12. Service Provider Business Transformation
Automated
Management
Orchestration
Policy
Applications
Physical &
Virtual
Infrastructure
Evolved Services Platform (ESP)
Service Broker
Catalog of Physical
& Virtual Functions
Service
Profiles
Evolved Programmable Network (EPN)
VNFs with network compute, storage
Orchestration
Engine
Mobility Enterprise Consumer Video
13. Service Provider Business Transformation
Automated
Management
Orchestration
Policy
Applications
Physical &
Virtual
Infrastructure
Evolved Services Platform (ESP)
Service Broker
Catalog of Physical
& Virtual Functions
Service
Profiles
Evolved Programmable Network (EPN)
VNFs with network compute, storage
Orchestration
Engine
Mobility Enterprise Consumer Video
APIC, VTSAPIC-EM ML-SDN, WAE,
EPNM
Network Service Orchestrator
14.
15.
16. Telefonica – A Multi-Layer, Mulit-Domain SDN
Network Control Architecture
Optimization Visibility
Multi-Layer App Platform (MAP)
Orchestrator
ML Controller ControllerController
HuaweiCienaInfineraCisco
Spain
What-If analysis
USA
China
Multi-layer, multi-domain SDN with Telefonica
Juan Pedro Frenandez-Palacios, OFC 2015
17. Job Roles Are Shifting for the Network Practitioner
17
Do LESS of… Do MORE of…
• Device configurations
• Continuous operations
• Problem resolution
• Hardware deployments
• Monitoring and reporting
• CLI entries and scripting
• Hands-on repairs/deployments
• Reactive management tasks
• Business/IT innovation
• Architectural (End-to-End) design
• Network analytics & optimization
• Programming – API versus CLI
• Software administration
• Comprehensive policy mgmt
• Systems Integration/validation
• Proactive management tasks
18. • Details of the migration
methods used in some
commercial products are not
readily available
• Typical values:
– Minimum 1028 MB per VM
– 4 KB per memory page
– Sustainable 1 Gbps
• Migration algorithms can be
highly nonlinear; application
awareness is key
Predictive Analytics Driving SDN
Page Dirty Rate (pages/second)
VMmigrationtime(seconds)
19. Security Intelligence
Real-time Processing
• Real-time data correlation
• Anomaly detection
• Event and flow normalization
• Security context & enrichment
• Distributed architecture
Security Operations
• Pre-defined rules and reports
• Offense scoring & prioritization
• Activity and event graphing
• Compliance reporting
• Workflow management
Big Data Warehouse
• Long-term, multi storage
• Unstructured and structured
• Distributed infrastructure
• Preservation of raw data
• Hadoop-based backend
Big Data
Analytics and Forensics
• Advanced visuals and interaction
• Predictive & decision modeling
• Ad hoc queries
• Spreadsheet UI for analysts
• Collaborative sharing tools
• Pluggable UI
Security
Intelligence
with
Big Data
Creative,
exploratory,
intuitive
Structured,
analytical,
repeatable
20. • Dynamic, Automated Provisioning
• 1 minute vs days or weeks, without manual intervention
• Multi-Layer (IP and Optical) using Open Daylight
• Potential response to cloud bursts & other real time events
• Bbandwidth monitoring for QoS
• Enabling next generation functions
• Analytics for Load Balancing, Security, OPNFV
Key Results
22. • C. DeCusatis, J. Ziskin, T. Bundy, “The rise of SDN optical networks; has automated provisioning arrived?“, invited
presentation, Pacific Telecom Conference, Honolulu, Hawaii (January 2014)
• C. DeCusatis, R. Cannistra, B. Carle, M. Johnson, J. Kapadia, Z. Meath, M. Miller, D. Young, T. Bundy , G. Zussman,
K. Bergman, A. Carranza, C. Sher-DeCusatis, A. Pletch, R. Ransom, “Dynamic orchestration test bed for SDN and
NFV at the New York State Center for Cloud Computing & Analytics”, OFC 2014 annual meeting, San Francisco, CA
(accepted & to be published, March 2014)
• C. DeCusatis et.al., “Developing a software defined networking curriculum through industry partnership”, Proc. ASEE
Annual Meeting, Hartford, CT (April 3-5, 2014) ** named among top 10 conference papers ** http://asee-
ne.org/proceedings/2014/index.htm
• Internet2 Global Summit, April 6-10, 2014, Denver, Colorado
http://meetings.internet2.edu/2014-global-summit/detail/10003109/
• C. DeCusatis, “SDN, NFV, and the cloud disruption: the next generation open data center interoperable network
(ODIN)”, BrightTalk webinar, April 17, 2014 https://www.brighttalk.com/search?q=DeCusatis
• C. DeCusatis, R. Cannistra, T. Bundy, “Software Defined Environments and Next Generation Networks: a tutorial”,
Proc. Keystone Initiative for Network Based Education and Research (KINBER) 2014 annual meeting (an Internet2
affiliate), Harrisburg, PA, April 23-25, 2014
• C. DeCusatis and L. Miano, “Cloud computing and software defined environments”, Pace University college of
computer science and engineering seminar series, April 30, 2014
• C. DeCusatis and R. Cannistra, “Dynamic management and provisioning of software defined cloud data centers”, Proc.
NSF Enterprise Computing Conference (ECC), paper SC3101, June 8-10, Marist College, Poughkeepsie, NY (2014)
Recent Research Publications from the Marist CCAC
Hinweis der Redaktion
Former IBM DE, 24 years industry experience
History of Marist: Marist Poll & NCAA Women Bball, founded 1905 (national historic landmarks), privatizes 60 years ago, 6000 undergrads, 1000 grads, Forbes top schools for high value education
Todd
Storage Bursts create the need for 45% growth in bandwidth costs per year.
customers will need a better solution for storage back-up.
Next Slide: Lets look at the different solutions for sync mirroring
REST APIs to third party application ecosystems
Configuration (modeled with NSO/Tail-F)
Netconf/YANG
Service models, Device models, Service to Device Mapping
Extensble, Multi-Vendor
Intelligence (powered by WAE)
Path Computation and Optimization, Failure Analysis
Restoration, Planning
IP and Optical
MPLS, BGP, Segment Routing (Open SDN, ODL Compliant)
Physical (DWDM) or Virtual Infrastructure
Cisco hybrid architecture (map to my slide of Marist stack)
Application layer – Cisco or 3rd party SW apps
Orchestration between domain controllers
Unified ML control, vendor and layer agnostic
Ip, OTN, DWDM elements
REST APIs to third party application ecosystems
Configuration (modeled with NSO/Tail-F) Tail f manages/orchestrates multi-vendor environments fix OSS
Netconf/YANG
Service models, Device models, Service to Device Mapping
Extensble, Multi-Vendor
Intelligence (powered by WAE)
Path Computation and Optimization, Failure Analysis
Restoration, Planning
IP and Optical
MPLS, BGP, Segment Routing (Open SDN, ODL Compliant)
Physical (DWDM) or Virtual Infrastructure