SlideShare ist ein Scribd-Unternehmen logo
1 von 10
Downloaden Sie, um offline zu lesen
SURVEY ON BIG DATA ANALYTICS FOR SDN
(SOFTWARE DEFINED NETWORKS)
Pavithra.K,
Student, Department of Computer Science and Engineering,
Velammal Institute of Technology, Anna University, Chennai, India.
cpavithrababu@gmail.com
Ravivarma.A.K
Student,Department of Computer Science and Engineering
Velammal Institute of Technology, Anna University, Chennai, India
ravivarma753@gmail.com
Abstract— It is challenging to architect, build and
support IT infrastructure to deal with the data
deluge in university campuses, supercomputer
centers and R&E networks. Hybrid network
architecture, multi-domain bandwidth
reservations, performance monitoring and GLIF
Open Light path Exchanges (GOLE) are
examples of network architectures that have been
proposed, championed and implemented
successfully to meet the needs of science. Most
recently, Science DMZ, a campus design pattern
that bypasses traditional performance hotspots in
typical campus network implementation, has
been gaining momentum. In this paper and
corresponding demonstration, we build upon the
SC11 SC inet Research Sandbox demonstrator
with Software-Defined networking to explore new
architectural approaches. A virtual switch
network abstraction is explored, that when
combined with software-defined networking
concepts provides the science users a simple,
adaptable network framework to meet their
upcoming application requirements.
Keywords-Network Virtualization; Open Flow;
Software-
Defined Networking; Multi-Domain; OSCARS;
Science DMZ
I. INTRODUCTION
Science research has been increasingly data-driven as
well as conducted in large collaborative partnerships
involving researchers, instruments and high
performance computing centers. Large-scale
instruments like Large Hadron Collider or Square
Kilometer Array and simulations produce petabytes
of data that is likely to be shared and analyzed by tens
to thousands of scientists. Due to a variety of reasons,
including political and funding constraints, data is
typically not processed, analyzed and visualized at
the location it is produced, but moved to more
convenient regional locations for the geographically
distributed researchers. The larger the science
collaboration, the higher the dependence on a
functioning distributed architecture. Efficient tools
and high-performance network architectures that
seamlessly move data between locations have
quickly become the backbone of state-of-the-art
science collaborations. For example, ESnet alone has
ISBN:978-1534910799
www.iaetsd.in
Proceedings of ICAER-2016
©IAETSD 201629
observed approximately 60%+ annual growth in
scientific data traffic for over 20 years. The LHC
ATLAS and CMS experiments are examples of large
science collaborations that rely heavily on networks
to distribute petabytes of data across the globe every
year. Similar paradigms are now rapidly emerging
across many scientific disciplines from genomics to
climate research to material sciences. For many of
these disciplines, new experimental facilities are
coming online like the Belle 2 High Energy Physics
experiment in Japan that is expecting to collect at
least 250 Petabytes (PB) in its first five years of
operation. In addition, existing facilities like X-ray
synchrotrons are being upgraded with new detectors
that are collecting data at unprecedented resolution
and refresh rates. The current detectors can now
produce raw data of petabytes per second or more,
and the next generation is expected to produce data
volumes many times higher. All told, the data
intensity of many disciplines is projected to increase
by a factor of ten or more over the next few years.
As the amount of traffic increases, there is a greater
need for simple, scalable end-to-end network
architectures and implementations that enable
applications to use the network most efficiently. The
Research and Education network community has
successfully abstracted current networking
technologies, like MPLS and SONET, to develop a
multi-domain, automated, guaranteed bandwidth
service. This capability has enabled scientists to
build guaranteed bandwidth virtual circuits from
their campus to a destination end point, which could
be another campus or a supercomputing data center
across the country or continents. Multi-domain
performance testing, championed and developed by
the same community, ensures that any end-to- end
network glitches like packet-loss are quickly
identified and resolved.
As this architecture has been widely adopted, new
challenges have emerged. First, the bottleneck for
scientific productivity has shifted from the WAN to
the campus and data center networks. Enterprise
network architectures supporting a wide-variety of
organizational missions has not been architected to
support automated provisioning tools such as
dynamic provisioning of guaranteed virtual circuits,
end-to-end. In most cases, campus networks
optimized for business operations are neither
designed for nor capable of supporting the data
movement requirements of science Second, even
though a lot of manual interaction has been
automated, important actions still need to be
manually configured for end-to-end connectivity.
Network topology (including service end-points) and
VLAN translation at the borders between WAN and
LAN are extremely important but maintained
manually. Third, supporting large science
collaborations with point-to -point circuits still
requires active management or creation of long-term
circuits (equivalent to a statically configured circuit).
Fourth, dynamic exchange of policy and
authorization between the source campuses an
Destination campus is critical for any automated
system to work. Before a wide area connection is
setup or used, both campuses need to agree to
authorize and allocate the local resources for data
movement.
Software-defined networking, using the Open Flow
protocol, provides interesting and novel capabilities
that can be leveraged, not only to solve the new
challenges described above, but also to potentially
simplify the implementation of existing solutions.
This paper will examine the various architectural
models of leveraging Open Flow based switches and
the software-defined networking model within the
ISBN:978-1534910799
www.iaetsd.in
Proceedings of ICAER-2016
©IAETSD 201630
science-networking context and will describe a
couple of demonstration scenarios that will be
implemented for SC12 SCinet Research Sandbox.
II. BACKGROUND
A. Software-defined networking (SDN) and Open
Flow (OF)
The flow of data packets that constitute
communication between any two devices connected
over the network has been largely controlled by
standard protocols defined for the different
abstraction layers. These abstraction layers and their
standard interfaces has been the root cause of highly
successful scaling of the Internet. With this model,
whenever a data packet arrives at a network device,
the packets are switched based on standard
forwarding rules which neither the network operator
nor application have full control over. Even though
this standard packet or flow routing model has scaled
for the general purpose Internet, some applications
and network operators would like better and more
granular control over the treatment of packets on a
per application flow. This paradigm of providing an
API for application or network management
programs to programmatically control the hardware
forwarding of packet flows is known as "Software-
Defined Networking". Open Flow is one of the
control protocols specified by the Open Networking
Foundation (ONF) 1
that enables the network
hardware to provide such an API to the application
programs and specifies a framework through which
centralized control of flow forwarding rules can be
orchestrated. Even though the traffic isolation with
dynamic, automated, virtual circuits has been
standardized and is being actively deployed by wide-
area R&E network providers, the end-to- end path for
a high-performance data flow typically traverses
portions of the campus and data- center infrastructure
that do not have any automated control to isolate the
large data flows. With the adoption of Software -
defined Networking paradigm and Open Flow, the
campus and data-center operators can provide a
programmatic interface that can be leveraged to build
an end-to-end network service with the same traffic
isolation characteristics that is needed to meet the
requirements of the big-data movers.
Even though Software-Defined Networking and
Open Flow are different, they are sometimes used
interchangeably.
.
B. ScienceDMZ2
A laboratory or university campus network typically
supports multiple organizational missions. First, it
must provide infrastructure for network traffic
associated with the organization’s normal business
operations including email, procurement systems,
and web browsing, among others. The network must
also be built with security features that protect the
financial and personnel data of the organization. At
the same time, these networks are also supposed to
be used as the foundation for the scientific research
process as scientists depend on this infrastructure to
share, store, and analyze research data from many
different external sources.
In most cases, however, networks optimized for these
business and security operations are neither designed
for nor capable of supporting the requirements of
data intensive science. Multi-gigabit data flows over
paths that have 100-200 millisecond RTT, as
required by most international science
collaborations, cannot be supported by typical LAN
equipment and are explicitly impeded by state ful
firewalls at domain boundaries. When scientists
attempt to run data intensive applications over these
so-called “general purpose” networks, the result is
often poor performance - in many cases so poor that
the science mission is significantly impeded.
By defining a separate part of the network that is
designed to support data-intensive science flow, the
Science DMZ model provides a framework for
building a scalable, extensible network infrastructure
that aims to eliminate the packet loss that causes poor
TCP performance, to implement appropriate use
policies so that high-performance applications are
ISBN:978-1534910799
www.iaetsd.in
Proceedings of ICAER-2016
©IAETSD 201631
not hampered by unnecessary constraints, to create
an effective on-ramp for local science resources to
access wide area network services and to provide
mechanisms for ensuring consistent performance.
C. XSP: Extensible Service Protocol:
Applications can refer back to that state, make
changes, and signal the network to suit their
particular requirements.
In order to implement XSP as part of a high-
performance, end-to-end, data transfer mechanism,
we leveraged Open Flow to implement a end-site
broker and co-ordination software ECSEL, described
in the next section below. The XSP libraries and API
provide a standard interface for applications to
specify parameters that define network paths. The
realization of these paths is then managed by our
XSP daemon (XSPd) that signals the underlying
provisioning service while providing feedback to the
application. A transparent XSP wrapper, or ``shim'',
library gives existing applications the ability to
signal XSPd without source code modifications.
Since XSP is implemented at the session layer, it has
the flexibility to support multiple transport protocols
– TCP, parallel TCP (as implemented in GridFTP),
or RDMA. These protocols can be chose
dynamically depending on the data transfer purpose,
capability and the capabilities of the underlying
network.
III. PREVIOUS WORK: END-TO-END
SERVICE AT LAYER2
(ECSEL)
Deploying loss-sensitive, high-performance
applications across the WAN poses the challenge of
providing an end-to-end layer-2 circuit with no loss,
guaranteed bandwidth, and stable latency. OSCARS
can be used to provide layer-2 connectivity across the
WAN. However, due to administrative and technical
constraints, OSCARS cannot control the path from
the site border to the endpoints, unless implemented
explicitly within the campus itself as a separate
domain. The data-transfer hosts or DTNs3
have no
knowledge of the LAN topology they are connected
to, and the LAN needs to be configured explicitly to
transport the Ethernet frames from the end host to the
ingress point of the OSCARS circuit. Also, allowing
or denying traffic across the WAN needs to be
controlled by the local campus policy, which based
on authentication and authorization decides what
resources is assigned to users, projects, or class of
applications. Before admitting a request, both sites
must agree to use common WAN resources, the
guaranteed bandwidth virtual circuit created by
OSCARS. Campuses with OpenFlow capability can
run an isolated domain, using the local policy to
allow or deny which wide-area traffic may be
forwarded.
To implement the concept above, we leverage the
application layer, so that an end-to-end network
middleware can broker and manage WAN OSCARS
circuits as well as control the local OpenFlow
domain. The application understands a very simple
topology, itself and the remote host, typically, in the
form of a DNS name. The middleware, manages a
more complex topology, reflecting all the
administrative domains involved in the path between
the endpoints. The network controller, ECSEL,
which manages both the LAN topology and the site-
specific WAN resources, provides this topology.
A. ECSEL, a Site-to-Site IDC
ECSEL (End-to-End Circuit Service at Layer 2), is
our implementation of an Inter-Domain Controller
(IDC) 4
that negotiates local and remote network
resources while keeping intact the administrative
boundaries; each site maintain full control on local
resources and how they are utilized. There are two
categories of local resources: the LAN and WAN
OSCARS circuit connection to the remote site.
OSCARS circuits, registered with ECSEL, are
associated with metadata describing the authorized
usage of each of the circuits. For example, circuits
can be limited to certain users or projects. The
OSCARS circuits are reservations referring to either
already provisioned circuits or advanced
reservations. The LAN resources are managed by an
OpenFlow controller that discovers the local network
topology, computes the proper path between the end
host and the proper OSCARS circuit, and applies the
forwarding rules, thus establishing the layer-2 circuit.
ISBN:978-1534910799
www.iaetsd.in
Proceedings of ICAER-2016
©IAETSD 201632
The ECSEL Open Flow controller leverages the
Open Flow discovery protocol to not only learn the
topology of switches and routers of the LAN, but also
the endpoint itself. The end host listens to Link Layer
Discovery Protocol (LLDP) packets broadcast by the
Open Flow switches to discover how it is contacted
to the network, and, in turn, registers itself to
ECSEL. (LLDP is used by network devices to
advertise their identity, capabilities, and neighbors
on an Ethernet LAN).
B. ECSEL Workflow
When the session layer, via XSPd, requests a
layer-2 path between two end hosts that support
RDMA over Ethernet, it supplies a high-level
topology that is based on the identity of the end hosts
as well as their domains, along with requested
bandwidth, start time, and duration. Using X509-
based authentication and authorization representing
the requesting application or project or end-user, the
local policy will select an available WAN OSCARS
circuit and then, using the IDC protocol, contact its
peer on the remote domain. The remote domain
ECSEL will then verify if the request is compliant
with the local policy, and if so, the OSCARS circuit
is then reserved. Meanwhile, both of the end hosts
are listening for Link-Layer Discovery Protocol
(LLDP)5
packets sent on the wire by the Open Flow
switches they are connected to, and through parsing
them the Open Flow switch identifier and port
number is discovered. The hosts register themselves
to the site's ECSEL, completing the LAN topology
built by the Open Flow controller. At the time the
circuit reservation begins, the Open Flow controller
computes the best path between the end hosts and the
end point of the OSCARS circuit, and begins
forwarding RDMA frames and performing the
appropriate VLAN translation, thus establishing the
RDMA flow between the two hosts. In the absence
of any form of link layer flow control, establishment
of an end-to-end circuit through services like ECSEL
is necessary, in order to differentiate such loss-
sensitive traffic from other best- effort flows,
particularly if the best possible RoCE performance is
desired.
Figure 1: Network architecture for SC11 ECSEL demonstrator
C. SC11 SCinet Research Sandbox demonstration6
The SC11 SCinet SRS demonstration consisted of
establishing a 10G layer 2 path between a data
transfer node (DTN) located at BNL, Long Island,
and another on the LBNL booth on the show floor, in
Seattle, Washington. Each DTN utilized RoCE, a
layer 2 RDMA protocol,, in order to achieve the
necessary performance. Provisioning of the network
was coordinated by ECSEL, using ESnet’s OSCARS
service for the intra-continental path, and Open Flow
switches for the LAN architecture. Full automation
of data transfer was provided by the middleware and
service Globus Online.
The demonstration was very successful. ECSEL was
easy to deploy in an extremely dynamic environment
such as Super Computing, thanks to its core code
borrowed from OSCARS.
The application itself, grid FTP using RoCE
demonstrated that we could use a high performance
layer 2 protocol with well-behaved characteristics. It
provided better than TCP throughput with very low
CPU utilization. This was the motivation for
following up on the ESCEL model.
IV. ARCHITECTURAL MODELS
As described above, ECSEL provides a model for
how a campus implementing a data transfer service
can leverage Open Flow to provide flexible, end-to-
end connectivity. For SC12, we explore new
architectural models to support science that leverage
SDN/Open Flow by exploring more complicated use-
cases, a) supporting multiple- science disciplines as
ISBN:978-1534910799
www.iaetsd.in
Proceedings of ICAER-2016
©IAETSD 201633
typical in a supercomputing data center and b)
flexible creation of virtual networks over the wide-
area for dynamic science collaborations.
A. Multiple Science Centers
1) Description and Challenges
A typical supercomputing center or a large campus,
like the National Labs, typically hosts multiple
science disciplines and collaborations. Most of the
science disciplines either produce data using the
supercomputers by running simulations or move data
for analysis to the supercomputing center from
remote instruments. The data generated from the
simulation, the raw data from the instruments and the
analysis/results is then typically hosted at the
supercomputer center for other scientists from the
collaboration to access or transferred to another
computing location for further analysis or local
visualization. As mentioned before, large
collaborations like the LHC produce vast amounts of
data that are then analyzed and replicated among all
continents and analyzed by thousands of scientists.
In order to facilitate network transfers, there are two
models that are usually employed. The
supercomputer centers, funded to support multiple
projects, end up setting a Science DMZ enclave with
a common infrastructure configured for high-speed
data transfer (also called Data Transfer Nodes or
DTNs). This shared resource is available to all
science disciplines, but typically requires scheduling,
manual management of data transfers from local
storage to this dedicated DTN infrastructure and
manual interaction with the local infrastructure
management teams that own these resources. On the
contrary, in campuses, the hardware is funded
through projects and each science discipline deploys
their own DTNs that they usually do not share with
other science areas. To implement an effective
ScienceDMZ, the local campus IT folks need to work
closely with the scientists to put into place a secure,
high-performance mechanism to transfer the data
securely between the DMZ and the
computational/storage infrastructure behind the
security perimeter. Consequently, in many scenarios
either the data transfer hosts are stuck behind the low-
performance firewall limiting their throughput, or are
a shared resource requiring manual intervention from
multiple teams.
In addition to sharing the DTN resources, there is no
central management system that allocates and
rebalances the WAN bandwidth in response to the
data transfers in progress. Most of these data transfers
then end up using the routed IP network, and are
subject to the performance vagaries of best effort
networking.
To create a more automated and resilient Science
DMZ model for multiple science collaborations on
campus, we propose to explore an architectural
model that leverages the capabilities of Open
Flow/SDN.
2) Open Flow/SDN Science DMZ architectural
model
The design of this architectural model is based on two
important premises:
1. The science data is hosted by the scientist
behind the security perimeter and only the
portion of data that needs to be transferred to
another location is exposed within the hosts
on the Science DMZ
2. Wide Area resources like virtual-circuits are
subject to use policies implemented and
enforced by the local site administration.
The architectural model proposes putting a DTN
redirector within the science DMZ. When the DTN
redirector gets a data transfer request, the flow is
redirected to the appropriate DTN within the security
perimeter using flow rules. The firewall functions are
bypassed by encapsulating the flow in one of the pre-
approved VLANs.
ISBN:978-1534910799
www.iaetsd.in
Proceedings of ICAER-2016
©IAETSD 201634
Figure 2: OpenFlow-based end-site architecture to
support multiple science disciplines
These pre-approved VLANs are locally configured
to bypass the firewall function. The VLAN
translation function of OpenFlow is leveraged to
change the incoming header, and flow is re-directed
without rewriting the IP header. This approach
enables science collaborations to maintain their DTN
alongside the data/storage infrastructure. The site
network administrators have full flexibility to
manage policies, including security, at the
centralized Open Flow controller. All local policy
functions, the data transfer workflow,
authentication/authorization functions and
configuration interfaces can be implemented as an
application on the Open Flow controller, which we
name as the “Open Flow Science DMZ Application”.
This approach is a natural extension of ECSEL,
which primarily supported end-to-end layer 2
protocols between two end-points, and allows it to
scale across multiple science disciplines.
The proposed workflow also reduces the ongoing
support burden to the campus IT administrators
while improving the security characteristics as well.
The firewall is configured statically to bypass certain
VLANs that are local to the site though the VLAN
encapsulation and assignment managed by the Open
Flow controller application.
The sites supporting multiple science disciplines will
benefit a lot from this approach. All the science data
will now be managed at one location and by the
science, while the complexity of staging the data at
the DMZ DTN from the primary data store protected
behind the security perimeter can be eliminated. Each
science discipline can now not only manage their
own data and DTN architecture, but also support
custom data transfer protocols that may be unique to
that collaboration.
B. Dynamic Science Collaborations
1) Description and Challenges
Science collaborations tackling large problems like
Climate or sharing one-of-a-kind instruments like the
LHC develop a more formalized architecture for
hosting and distributing data. Even though these
architectures are highly dependent on a high-
performance network, they are typically managed
completely by the scientists or IT administrators that
are part of the collaboration itself. The networking-
savvy collaborations typically leverage the point-to-
point inter-domain guaranteed bandwidth circuits
provided by the R&E networks to get better
performance, but they are in the minority. There are
many others that just use the general IP routing
service and experience poor performance, or take to
alternate means of transporting their data like
shipping hard-drives.
Existing technologies like IPSec, VPLS or L2TP are
currently used to bridge multiple sites together in a
virtual private network (VPN). The multiple sites
connected by this tunneling protocol or virtual
routers can share IP routing information between the
sites, so they can route traffic across the VPN. Some
of these technologies are overlay technologies that do
not require participation by the service provider other
than providing a routed IP connection. Other
technologies, are VPNs offered by the service
provider, and require complex routing configurations
in order to work.
In most of the science collaborations, an approach
that involves a lot of complex site configuration,
management by on-site IT teams is not feasible due
to the management complexity, and the ephemeral
nature of these collaborations. In addition, it is not
easy to apply policies to verify that only science
ISBN:978-1534910799
www.iaetsd.in
Proceedings of ICAER-2016
©IAETSD 201635
traffic is utilizing these inter-site connections,
especially when each site is managed by a different
administrative entity.
The goal is to create an infrastructure on-demand for
a flexible science collaboration tied together with a
virtual network ensures all existing capabilities of
high-performance. In addition, the requirements
from the science collaborations is 1) flexibility for
them to manage their wide area bandwidth 2) easy
virtual private network setup between collaborators
that does not require huge configuration overhead 3)
flexibility to use either layer 2 or routed IP services
between the collaboration sites, providing higher
performance to standard IP applications.
2) ‘One-virtual-switch’ network virtualization
model
For dynamic science collaborations, it is common
practice to establish connectivity between the sites
through dynamic or static point-to-point circuits.
Thus, for large science collaborations, each site ends
up supporting multiple point-to-point circuits with
customized access, IP addresses, and security
policies, all managed manually.
We tackle this limitation by creating a new
abstraction – “one virtual switch” representing the
WAN [Figure 5]. This abstraction is simple, atomic,
programmable, and network-wide. The abstraction
enables multiple sites belonging to a collaboration to
build logical circuits to the virtual ports of the WAN
virtual switch. The virtual switch, in turn, exposes an
OpenFlow programmatic interface that enables the
sites to easily program and redirect data flows to the
appropriate site and end-point dynamically.
One of the key elements of this architecture is the
implementation of the physical infrastructure that
can be virtualized in software to appear as a single
switch. This is accomplished by deploying OF
enabled devices at the customer facing edge of the
WAN network with a programmable WAN
interconnect fabric implemented by guaranteed
bandwidth OSCARS circuits connecting them. The
circuits can be modified dynamically behind the
scenes, and protected in order to implement a very
adaptable and reliable fabric. Unlike port identifiers
of a real switch that are typically vendor and switch
specific, the ports on the virtual switch can be
abstract and named logically, in order to make it
much more intuitive and usable. This provides the
topological foundation over which the virtual
infrastructure is built.
To provide dynamic control of the infrastructure, we
create a simplified OpenFlow control API that
exposes the virtual switch and its logical topology to
the end-sites. Using OpenFlow, the end-sites or
science collaborations can dynamically program
switching of flows between the various end-sites
using the virtual topology, and shielded from the
complex multi-domain physical connectivity view.
With this element of control, the collaboration is able
to multiplex multiple flows over a single site
connection and virtually switch them to the
appropriate destination as the data flow needs of the
collaboration change.
The previous model of site-to-site negotiation, as
implemented in ECSEL, is still supported to ensure
authorized admission control as well as for resource
management of the shared wide area resources,
namely the bandwidth reserved for the site’s
connectivity into the virtual switch. It is unclear at the
moment if the entire science collaboration can work
with one controller, or if it is more advantageous for
each site to manage their resources, with their own
controller. Tradeoffs of each approach will be part of
active experimentation once the virtualization
architecture is implemented for the demonstration.
The figure below [Figure 3] shows implementation
details of how the virtual view and the physical
implementation relate to each other. The one-virtual-
ISBN:978-1534910799
www.iaetsd.in
Proceedings of ICAER-2016
©IAETSD 201636
switch abstraction, like a physical Open Flow switch,
provides both a management interface and a control
interface. The control interface, using the Open Flow
protocol, enables dynamic configuration and control
of flows, similar to a real switch. The management
interface allows site-administrators to provide the
parameters of the collaboration enabling the virtual
switch abstraction to be setup for the applications.
This approach to network virtualization, through
creation of a simple ‘one-virtual-switch’ abstraction
enables the research collaborators and network
administrators to treat the wide-area network as a
local switch with similar methods of switching and
control:
• The OSCARS wide-area traffic-engineering
service creates a flexible backplane between
the various OpenFlow switches, enabling the
multipoint transport between the edges of the
WAN.
• The OpenFlow switches in the WAN, at the
customer edges, perform flexible flow
switching and VLAN translation, hiding the
multi-point complexity from the end-sites
and the application.
• The end-site Open Flow enabled applications
program flows on the one-virtual-switch in
the same way done locally.
Figure 3: End-to-end virtualization using One-
Virtual-Switch, ECSEL and OSCARS
V. SC12 DEMONSTRATION
Building upon the already demonstrated SDN
concept for end-site, ECSEL at SC11, the SC12
demonstration will focus on the dynamic science
collaboration architectural model as defined above.
An extension of ECSEL to show the multi-science
campus is also a stretch goal. These two
demonstrations will showcase implementations that
will enable scientists to deal with the data-deluge in
a flexible and scalable manner. We will leverage
existing data transfer protocols like GridFTP to
demonstrate the conceptual model described above.
VI. RELATED WORK
The broad concepts and challenges for data-intensive
science described in this paper have been widely
understood and is a topic of active research in the
R&E community. Some of the widely accepted
research solutions that have transitioned into
production networks include Hybrid Networking,
OSCARS[6], IDC among others. New projects have
recently tried to tackle some of the end-site issues for
non-Open Flow technologies like ESCPS [7] funded
by DOE. Open Flow in the wide-area has been
recently gaining a lot of attention – Internet2’s NDDI
[8] project creates point to point links over the wide-
area and Google 7
has recently announced using
Open Flow to be the prime network technology
responsible for moving large data sets between their
data centers over the wide-area. Since the Open Flow
and Software-defined paradigm are fairly new,
exploring how these paradigms will apply to existing
problem sets, and create new value is a worthwhile
enterprise.
ACKNOWLEDGMENT
We would like to thank the reviewers for their
positive comments and their thorough reviews. We
are grateful to our professors who helped us in
improving the presentation of the paper.
.
ISBN:978-1534910799
www.iaetsd.in
Proceedings of ICAER-2016
©IAETSD 201637
REFERENCES
[1] William Johnston, “The Square Kilometer Array
– A next generation scientific instrument and its
implications for networks,” TNC 2012,
https://tnc2012.terena.org/core/presentation
[2] Eli Dart, Brian Tierney, editors, “HEP (High
Energy Physics) Network Requirements
Workshop, August 2009 - Final Report”, ESnet
Network Requirements Workshop, August 27,
2009, LBNL LBNL-3397E.
[3] T. Abe et. al. “BELLE II Technical Design
Report”, KEK Report 2010- 1, 2010 ,
http://arxiv.org/abs/1011.0352v1
[4] Eli Dart, Brian Tierney, editors, “BER
(Biological and Environmental Research)
Network Requirements Workshop, April 2010 -
Final Report”, ESnet Network Requirements
Workshop, April 29, 2010.
[5] E. Kissel and M. Swany. The extensible session
protocol: A protocol for future internet
architectures. Technical Report UDEL-
2012/001, Dept. of CIS, University of Delaware,
2012
[6] C. Guok, D. Robertson, M. Thompson, J. Lee,
B. Tierney, and W.
Johnston. Intra and inter domain circuit
provisioning using the oscars
reservation system. In Third International
Conference on Broadband
Communications Networks and Systems,
IEEE/ICST, October 2006
[7] End Site Control Plane Service,
ISBN:978-1534910799
www.iaetsd.in
Proceedings of ICAER-2016
©IAETSD 201638

Weitere ähnliche Inhalte

Was ist angesagt?

Efficient IOT Based Sensor Data Analysis in Wireless Sensor Networks with Cloud
Efficient IOT Based Sensor Data Analysis in Wireless Sensor Networks with CloudEfficient IOT Based Sensor Data Analysis in Wireless Sensor Networks with Cloud
Efficient IOT Based Sensor Data Analysis in Wireless Sensor Networks with Cloudiosrjce
 
Effects of power conservation, wireless coverage and cooperation on data diss...
Effects of power conservation, wireless coverage and cooperation on data diss...Effects of power conservation, wireless coverage and cooperation on data diss...
Effects of power conservation, wireless coverage and cooperation on data diss...marwaeng
 
Unit i introduction to grid computing
Unit i   introduction to grid computingUnit i   introduction to grid computing
Unit i introduction to grid computingsudha kar
 
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)ijceronline
 
Inroduction to grid computing by gargi shankar verma
Inroduction to grid computing by gargi shankar vermaInroduction to grid computing by gargi shankar verma
Inroduction to grid computing by gargi shankar vermagargishankar1981
 
grid mining
grid mininggrid mining
grid miningARNOLD
 
Lambda Data Grid: An Agile Optical Platform for Grid Computing and Data-inten...
Lambda Data Grid: An Agile Optical Platform for Grid Computing and Data-inten...Lambda Data Grid: An Agile Optical Platform for Grid Computing and Data-inten...
Lambda Data Grid: An Agile Optical Platform for Grid Computing and Data-inten...Tal Lavian Ph.D.
 
TRUST BASED ROUTING METRIC FOR RPL ROUTING PROTOCOL IN THE INTERNET OF THINGS
TRUST BASED ROUTING METRIC FOR RPL ROUTING PROTOCOL IN THE INTERNET OF THINGSTRUST BASED ROUTING METRIC FOR RPL ROUTING PROTOCOL IN THE INTERNET OF THINGS
TRUST BASED ROUTING METRIC FOR RPL ROUTING PROTOCOL IN THE INTERNET OF THINGSpijans
 
An Efficient Approach for Data Gathering and Sharing with Inter Node Communi...
 An Efficient Approach for Data Gathering and Sharing with Inter Node Communi... An Efficient Approach for Data Gathering and Sharing with Inter Node Communi...
An Efficient Approach for Data Gathering and Sharing with Inter Node Communi...cscpconf
 
CYBER INFRASTRUCTURE AS A SERVICE TO EMPOWER MULTIDISCIPLINARY, DATA-DRIVEN S...
CYBER INFRASTRUCTURE AS A SERVICE TO EMPOWER MULTIDISCIPLINARY, DATA-DRIVEN S...CYBER INFRASTRUCTURE AS A SERVICE TO EMPOWER MULTIDISCIPLINARY, DATA-DRIVEN S...
CYBER INFRASTRUCTURE AS A SERVICE TO EMPOWER MULTIDISCIPLINARY, DATA-DRIVEN S...ijcsit
 
Using BIG DATA implementations onto Software Defined Networking
Using BIG DATA implementations onto Software Defined NetworkingUsing BIG DATA implementations onto Software Defined Networking
Using BIG DATA implementations onto Software Defined NetworkingIJCSIS Research Publications
 
A REAL TIME PRIORITY BASED SCHEDULER FOR LOW RATE WIRELESS SENSOR NETWORKS
A REAL TIME PRIORITY BASED SCHEDULER FOR LOW RATE WIRELESS SENSOR NETWORKSA REAL TIME PRIORITY BASED SCHEDULER FOR LOW RATE WIRELESS SENSOR NETWORKS
A REAL TIME PRIORITY BASED SCHEDULER FOR LOW RATE WIRELESS SENSOR NETWORKSIJCNCJournal
 
Grid Computing - Collection of computer resources from multiple locations
Grid Computing - Collection of computer resources from multiple locationsGrid Computing - Collection of computer resources from multiple locations
Grid Computing - Collection of computer resources from multiple locationsDibyadip Das
 
Resume yue yang
Resume yue yangResume yue yang
Resume yue yangYue Yang
 
DWDM-RAM: a data intensive Grid service architecture enabled by dynamic optic...
DWDM-RAM: a data intensive Grid service architecture enabled by dynamic optic...DWDM-RAM: a data intensive Grid service architecture enabled by dynamic optic...
DWDM-RAM: a data intensive Grid service architecture enabled by dynamic optic...Tal Lavian Ph.D.
 
CONTAINERIZED SERVICES ORCHESTRATION FOR EDGE COMPUTING IN SOFTWARE-DEFINED W...
CONTAINERIZED SERVICES ORCHESTRATION FOR EDGE COMPUTING IN SOFTWARE-DEFINED W...CONTAINERIZED SERVICES ORCHESTRATION FOR EDGE COMPUTING IN SOFTWARE-DEFINED W...
CONTAINERIZED SERVICES ORCHESTRATION FOR EDGE COMPUTING IN SOFTWARE-DEFINED W...IJCNCJournal
 

Was ist angesagt? (20)

Efficient IOT Based Sensor Data Analysis in Wireless Sensor Networks with Cloud
Efficient IOT Based Sensor Data Analysis in Wireless Sensor Networks with CloudEfficient IOT Based Sensor Data Analysis in Wireless Sensor Networks with Cloud
Efficient IOT Based Sensor Data Analysis in Wireless Sensor Networks with Cloud
 
Effects of power conservation, wireless coverage and cooperation on data diss...
Effects of power conservation, wireless coverage and cooperation on data diss...Effects of power conservation, wireless coverage and cooperation on data diss...
Effects of power conservation, wireless coverage and cooperation on data diss...
 
3. the grid new infrastructure
3. the grid new infrastructure3. the grid new infrastructure
3. the grid new infrastructure
 
Unit i introduction to grid computing
Unit i   introduction to grid computingUnit i   introduction to grid computing
Unit i introduction to grid computing
 
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)
 
Inroduction to grid computing by gargi shankar verma
Inroduction to grid computing by gargi shankar vermaInroduction to grid computing by gargi shankar verma
Inroduction to grid computing by gargi shankar verma
 
Syllabus cse
Syllabus cseSyllabus cse
Syllabus cse
 
Grid computing & its applications
Grid computing & its applicationsGrid computing & its applications
Grid computing & its applications
 
grid mining
grid mininggrid mining
grid mining
 
Lambda Data Grid: An Agile Optical Platform for Grid Computing and Data-inten...
Lambda Data Grid: An Agile Optical Platform for Grid Computing and Data-inten...Lambda Data Grid: An Agile Optical Platform for Grid Computing and Data-inten...
Lambda Data Grid: An Agile Optical Platform for Grid Computing and Data-inten...
 
TRUST BASED ROUTING METRIC FOR RPL ROUTING PROTOCOL IN THE INTERNET OF THINGS
TRUST BASED ROUTING METRIC FOR RPL ROUTING PROTOCOL IN THE INTERNET OF THINGSTRUST BASED ROUTING METRIC FOR RPL ROUTING PROTOCOL IN THE INTERNET OF THINGS
TRUST BASED ROUTING METRIC FOR RPL ROUTING PROTOCOL IN THE INTERNET OF THINGS
 
An Efficient Approach for Data Gathering and Sharing with Inter Node Communi...
 An Efficient Approach for Data Gathering and Sharing with Inter Node Communi... An Efficient Approach for Data Gathering and Sharing with Inter Node Communi...
An Efficient Approach for Data Gathering and Sharing with Inter Node Communi...
 
CYBER INFRASTRUCTURE AS A SERVICE TO EMPOWER MULTIDISCIPLINARY, DATA-DRIVEN S...
CYBER INFRASTRUCTURE AS A SERVICE TO EMPOWER MULTIDISCIPLINARY, DATA-DRIVEN S...CYBER INFRASTRUCTURE AS A SERVICE TO EMPOWER MULTIDISCIPLINARY, DATA-DRIVEN S...
CYBER INFRASTRUCTURE AS A SERVICE TO EMPOWER MULTIDISCIPLINARY, DATA-DRIVEN S...
 
Grid Computing
Grid ComputingGrid Computing
Grid Computing
 
Using BIG DATA implementations onto Software Defined Networking
Using BIG DATA implementations onto Software Defined NetworkingUsing BIG DATA implementations onto Software Defined Networking
Using BIG DATA implementations onto Software Defined Networking
 
A REAL TIME PRIORITY BASED SCHEDULER FOR LOW RATE WIRELESS SENSOR NETWORKS
A REAL TIME PRIORITY BASED SCHEDULER FOR LOW RATE WIRELESS SENSOR NETWORKSA REAL TIME PRIORITY BASED SCHEDULER FOR LOW RATE WIRELESS SENSOR NETWORKS
A REAL TIME PRIORITY BASED SCHEDULER FOR LOW RATE WIRELESS SENSOR NETWORKS
 
Grid Computing - Collection of computer resources from multiple locations
Grid Computing - Collection of computer resources from multiple locationsGrid Computing - Collection of computer resources from multiple locations
Grid Computing - Collection of computer resources from multiple locations
 
Resume yue yang
Resume yue yangResume yue yang
Resume yue yang
 
DWDM-RAM: a data intensive Grid service architecture enabled by dynamic optic...
DWDM-RAM: a data intensive Grid service architecture enabled by dynamic optic...DWDM-RAM: a data intensive Grid service architecture enabled by dynamic optic...
DWDM-RAM: a data intensive Grid service architecture enabled by dynamic optic...
 
CONTAINERIZED SERVICES ORCHESTRATION FOR EDGE COMPUTING IN SOFTWARE-DEFINED W...
CONTAINERIZED SERVICES ORCHESTRATION FOR EDGE COMPUTING IN SOFTWARE-DEFINED W...CONTAINERIZED SERVICES ORCHESTRATION FOR EDGE COMPUTING IN SOFTWARE-DEFINED W...
CONTAINERIZED SERVICES ORCHESTRATION FOR EDGE COMPUTING IN SOFTWARE-DEFINED W...
 

Andere mochten auch

A sdn based application aware and network provisioning
A sdn based application aware and network provisioningA sdn based application aware and network provisioning
A sdn based application aware and network provisioningStanley Wang
 
Reference Architecture-Validated & Tested Approach to Define Network Design
Reference Architecture-Validated & Tested Approach to Define Network DesignReference Architecture-Validated & Tested Approach to Define Network Design
Reference Architecture-Validated & Tested Approach to Define Network DesignDataWorks Summit
 
Networking Issues For Big Data
Networking Issues For Big DataNetworking Issues For Big Data
Networking Issues For Big Datarjain51
 
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of thingsBig Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of thingsRamakant Gawande
 
Introduction to Software Defined Networking (SDN)
Introduction to Software Defined Networking (SDN)Introduction to Software Defined Networking (SDN)
Introduction to Software Defined Networking (SDN)rjain51
 

Andere mochten auch (6)

A sdn based application aware and network provisioning
A sdn based application aware and network provisioningA sdn based application aware and network provisioning
A sdn based application aware and network provisioning
 
WhenSDNmeetsBigData
WhenSDNmeetsBigDataWhenSDNmeetsBigData
WhenSDNmeetsBigData
 
Reference Architecture-Validated & Tested Approach to Define Network Design
Reference Architecture-Validated & Tested Approach to Define Network DesignReference Architecture-Validated & Tested Approach to Define Network Design
Reference Architecture-Validated & Tested Approach to Define Network Design
 
Networking Issues For Big Data
Networking Issues For Big DataNetworking Issues For Big Data
Networking Issues For Big Data
 
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of thingsBig Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
 
Introduction to Software Defined Networking (SDN)
Introduction to Software Defined Networking (SDN)Introduction to Software Defined Networking (SDN)
Introduction to Software Defined Networking (SDN)
 

Ähnlich wie Iaetsd survey on big data analytics for sdn (software defined networks)

IEEE Networking 2016 Title and Abstract
IEEE Networking 2016 Title and AbstractIEEE Networking 2016 Title and Abstract
IEEE Networking 2016 Title and Abstracttsysglobalsolutions
 
Lambda data grid: communications architecture in support of grid computing
Lambda data grid: communications architecture in support of grid computingLambda data grid: communications architecture in support of grid computing
Lambda data grid: communications architecture in support of grid computingTal Lavian Ph.D.
 
9-2020.pdf
9-2020.pdf9-2020.pdf
9-2020.pdffermanrw
 
First Steps Toward Scientific Cyber-Security Experimentation in Wide-Area Cyb...
First Steps Toward Scientific Cyber-Security Experimentation in Wide-Area Cyb...First Steps Toward Scientific Cyber-Security Experimentation in Wide-Area Cyb...
First Steps Toward Scientific Cyber-Security Experimentation in Wide-Area Cyb...DETER-Project
 
GridComputing-an introduction.ppt
GridComputing-an introduction.pptGridComputing-an introduction.ppt
GridComputing-an introduction.pptNileshkuGiri
 
OpenFlow: Enabling Innovation in Campus Networks
OpenFlow: Enabling Innovation in Campus NetworksOpenFlow: Enabling Innovation in Campus Networks
OpenFlow: Enabling Innovation in Campus NetworksAndy Juan Sarango Veliz
 
IJSRED-V1I1P5
IJSRED-V1I1P5IJSRED-V1I1P5
IJSRED-V1I1P5IJSRED
 
Interference Revelation in Mobile Ad-hoc Networks and Confrontation
Interference Revelation in Mobile Ad-hoc Networks and ConfrontationInterference Revelation in Mobile Ad-hoc Networks and Confrontation
Interference Revelation in Mobile Ad-hoc Networks and Confrontationirjes
 
A Survey of Past, Present and Future of Software Defined Networking.pdf
A Survey of Past, Present and Future of Software Defined Networking.pdfA Survey of Past, Present and Future of Software Defined Networking.pdf
A Survey of Past, Present and Future of Software Defined Networking.pdfWendy Belieu
 
Cyberinfrastructure and Applications Overview: Howard University June22
Cyberinfrastructure and Applications Overview: Howard University June22Cyberinfrastructure and Applications Overview: Howard University June22
Cyberinfrastructure and Applications Overview: Howard University June22marpierc
 
International Refereed Journal of Engineering and Science (IRJES)
International Refereed Journal of Engineering and Science (IRJES)International Refereed Journal of Engineering and Science (IRJES)
International Refereed Journal of Engineering and Science (IRJES)irjes
 
F233842
F233842F233842
F233842irjes
 
IRJET- Cost Effective Workflow Scheduling in Bigdata
IRJET-  	  Cost Effective Workflow Scheduling in BigdataIRJET-  	  Cost Effective Workflow Scheduling in Bigdata
IRJET- Cost Effective Workflow Scheduling in BigdataIRJET Journal
 
A Centralized Network Management Application for Academia and Small Business ...
A Centralized Network Management Application for Academia and Small Business ...A Centralized Network Management Application for Academia and Small Business ...
A Centralized Network Management Application for Academia and Small Business ...ITIIIndustries
 
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...Tal Lavian Ph.D.
 
Call Admission Control (CAC) with Load Balancing Approach for the WLAN Networks
Call Admission Control (CAC) with Load Balancing Approach for the WLAN NetworksCall Admission Control (CAC) with Load Balancing Approach for the WLAN Networks
Call Admission Control (CAC) with Load Balancing Approach for the WLAN NetworksIJARIIT
 
IRJET- Comparative Study on Embedded Feature Selection Techniques for Interne...
IRJET- Comparative Study on Embedded Feature Selection Techniques for Interne...IRJET- Comparative Study on Embedded Feature Selection Techniques for Interne...
IRJET- Comparative Study on Embedded Feature Selection Techniques for Interne...IRJET Journal
 
Active Network Service Composition
Active Network Service CompositionActive Network Service Composition
Active Network Service CompositionIJERD Editor
 

Ähnlich wie Iaetsd survey on big data analytics for sdn (software defined networks) (20)

IEEE Networking 2016 Title and Abstract
IEEE Networking 2016 Title and AbstractIEEE Networking 2016 Title and Abstract
IEEE Networking 2016 Title and Abstract
 
Lambda data grid: communications architecture in support of grid computing
Lambda data grid: communications architecture in support of grid computingLambda data grid: communications architecture in support of grid computing
Lambda data grid: communications architecture in support of grid computing
 
grid computing
grid computinggrid computing
grid computing
 
9-2020.pdf
9-2020.pdf9-2020.pdf
9-2020.pdf
 
First Steps Toward Scientific Cyber-Security Experimentation in Wide-Area Cyb...
First Steps Toward Scientific Cyber-Security Experimentation in Wide-Area Cyb...First Steps Toward Scientific Cyber-Security Experimentation in Wide-Area Cyb...
First Steps Toward Scientific Cyber-Security Experimentation in Wide-Area Cyb...
 
GridComputing-an introduction.ppt
GridComputing-an introduction.pptGridComputing-an introduction.ppt
GridComputing-an introduction.ppt
 
40 41
40 4140 41
40 41
 
OpenFlow: Enabling Innovation in Campus Networks
OpenFlow: Enabling Innovation in Campus NetworksOpenFlow: Enabling Innovation in Campus Networks
OpenFlow: Enabling Innovation in Campus Networks
 
IJSRED-V1I1P5
IJSRED-V1I1P5IJSRED-V1I1P5
IJSRED-V1I1P5
 
Interference Revelation in Mobile Ad-hoc Networks and Confrontation
Interference Revelation in Mobile Ad-hoc Networks and ConfrontationInterference Revelation in Mobile Ad-hoc Networks and Confrontation
Interference Revelation in Mobile Ad-hoc Networks and Confrontation
 
A Survey of Past, Present and Future of Software Defined Networking.pdf
A Survey of Past, Present and Future of Software Defined Networking.pdfA Survey of Past, Present and Future of Software Defined Networking.pdf
A Survey of Past, Present and Future of Software Defined Networking.pdf
 
Cyberinfrastructure and Applications Overview: Howard University June22
Cyberinfrastructure and Applications Overview: Howard University June22Cyberinfrastructure and Applications Overview: Howard University June22
Cyberinfrastructure and Applications Overview: Howard University June22
 
International Refereed Journal of Engineering and Science (IRJES)
International Refereed Journal of Engineering and Science (IRJES)International Refereed Journal of Engineering and Science (IRJES)
International Refereed Journal of Engineering and Science (IRJES)
 
F233842
F233842F233842
F233842
 
IRJET- Cost Effective Workflow Scheduling in Bigdata
IRJET-  	  Cost Effective Workflow Scheduling in BigdataIRJET-  	  Cost Effective Workflow Scheduling in Bigdata
IRJET- Cost Effective Workflow Scheduling in Bigdata
 
A Centralized Network Management Application for Academia and Small Business ...
A Centralized Network Management Application for Academia and Small Business ...A Centralized Network Management Application for Academia and Small Business ...
A Centralized Network Management Application for Academia and Small Business ...
 
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...
 
Call Admission Control (CAC) with Load Balancing Approach for the WLAN Networks
Call Admission Control (CAC) with Load Balancing Approach for the WLAN NetworksCall Admission Control (CAC) with Load Balancing Approach for the WLAN Networks
Call Admission Control (CAC) with Load Balancing Approach for the WLAN Networks
 
IRJET- Comparative Study on Embedded Feature Selection Techniques for Interne...
IRJET- Comparative Study on Embedded Feature Selection Techniques for Interne...IRJET- Comparative Study on Embedded Feature Selection Techniques for Interne...
IRJET- Comparative Study on Embedded Feature Selection Techniques for Interne...
 
Active Network Service Composition
Active Network Service CompositionActive Network Service Composition
Active Network Service Composition
 

Mehr von Iaetsd Iaetsd

iaetsd Survey on cooperative relay based data transmission
iaetsd Survey on cooperative relay based data transmissioniaetsd Survey on cooperative relay based data transmission
iaetsd Survey on cooperative relay based data transmissionIaetsd Iaetsd
 
iaetsd Software defined am transmitter using vhdl
iaetsd Software defined am transmitter using vhdliaetsd Software defined am transmitter using vhdl
iaetsd Software defined am transmitter using vhdlIaetsd Iaetsd
 
iaetsd Health monitoring system with wireless alarm
iaetsd Health monitoring system with wireless alarmiaetsd Health monitoring system with wireless alarm
iaetsd Health monitoring system with wireless alarmIaetsd Iaetsd
 
iaetsd Equalizing channel and power based on cognitive radio system over mult...
iaetsd Equalizing channel and power based on cognitive radio system over mult...iaetsd Equalizing channel and power based on cognitive radio system over mult...
iaetsd Equalizing channel and power based on cognitive radio system over mult...Iaetsd Iaetsd
 
iaetsd Economic analysis and re design of driver’s car seat
iaetsd Economic analysis and re design of driver’s car seatiaetsd Economic analysis and re design of driver’s car seat
iaetsd Economic analysis and re design of driver’s car seatIaetsd Iaetsd
 
iaetsd Design of slotted microstrip patch antenna for wlan application
iaetsd Design of slotted microstrip patch antenna for wlan applicationiaetsd Design of slotted microstrip patch antenna for wlan application
iaetsd Design of slotted microstrip patch antenna for wlan applicationIaetsd Iaetsd
 
REVIEW PAPER- ON ENHANCEMENT OF HEAT TRANSFER USING RIBS
REVIEW PAPER- ON ENHANCEMENT OF HEAT TRANSFER USING RIBSREVIEW PAPER- ON ENHANCEMENT OF HEAT TRANSFER USING RIBS
REVIEW PAPER- ON ENHANCEMENT OF HEAT TRANSFER USING RIBSIaetsd Iaetsd
 
A HYBRID AC/DC SOLAR POWERED STANDALONE SYSTEM WITHOUT INVERTER BASED ON LOAD...
A HYBRID AC/DC SOLAR POWERED STANDALONE SYSTEM WITHOUT INVERTER BASED ON LOAD...A HYBRID AC/DC SOLAR POWERED STANDALONE SYSTEM WITHOUT INVERTER BASED ON LOAD...
A HYBRID AC/DC SOLAR POWERED STANDALONE SYSTEM WITHOUT INVERTER BASED ON LOAD...Iaetsd Iaetsd
 
Fabrication of dual power bike
Fabrication of dual power bikeFabrication of dual power bike
Fabrication of dual power bikeIaetsd Iaetsd
 
Blue brain technology
Blue brain technologyBlue brain technology
Blue brain technologyIaetsd Iaetsd
 
iirdem The Livable Planet – A Revolutionary Concept through Innovative Street...
iirdem The Livable Planet – A Revolutionary Concept through Innovative Street...iirdem The Livable Planet – A Revolutionary Concept through Innovative Street...
iirdem The Livable Planet – A Revolutionary Concept through Innovative Street...Iaetsd Iaetsd
 
iirdem Surveillance aided robotic bird
iirdem Surveillance aided robotic birdiirdem Surveillance aided robotic bird
iirdem Surveillance aided robotic birdIaetsd Iaetsd
 
iirdem Growing India Time Monopoly – The Key to Initiate Long Term Rapid Growth
iirdem Growing India Time Monopoly – The Key to Initiate Long Term Rapid Growthiirdem Growing India Time Monopoly – The Key to Initiate Long Term Rapid Growth
iirdem Growing India Time Monopoly – The Key to Initiate Long Term Rapid GrowthIaetsd Iaetsd
 
iirdem Design of Efficient Solar Energy Collector using MPPT Algorithm
iirdem Design of Efficient Solar Energy Collector using MPPT Algorithmiirdem Design of Efficient Solar Energy Collector using MPPT Algorithm
iirdem Design of Efficient Solar Energy Collector using MPPT AlgorithmIaetsd Iaetsd
 
iirdem CRASH IMPACT ATTENUATOR (CIA) FOR AUTOMOBILES WITH THE ADVOCATION OF M...
iirdem CRASH IMPACT ATTENUATOR (CIA) FOR AUTOMOBILES WITH THE ADVOCATION OF M...iirdem CRASH IMPACT ATTENUATOR (CIA) FOR AUTOMOBILES WITH THE ADVOCATION OF M...
iirdem CRASH IMPACT ATTENUATOR (CIA) FOR AUTOMOBILES WITH THE ADVOCATION OF M...Iaetsd Iaetsd
 
iirdem ADVANCING OF POWER MANAGEMENT IN HOME WITH SMART GRID TECHNOLOGY AND S...
iirdem ADVANCING OF POWER MANAGEMENT IN HOME WITH SMART GRID TECHNOLOGY AND S...iirdem ADVANCING OF POWER MANAGEMENT IN HOME WITH SMART GRID TECHNOLOGY AND S...
iirdem ADVANCING OF POWER MANAGEMENT IN HOME WITH SMART GRID TECHNOLOGY AND S...Iaetsd Iaetsd
 
iaetsd Shared authority based privacy preserving protocol
iaetsd Shared authority based privacy preserving protocoliaetsd Shared authority based privacy preserving protocol
iaetsd Shared authority based privacy preserving protocolIaetsd Iaetsd
 
iaetsd Secured multiple keyword ranked search over encrypted databases
iaetsd Secured multiple keyword ranked search over encrypted databasesiaetsd Secured multiple keyword ranked search over encrypted databases
iaetsd Secured multiple keyword ranked search over encrypted databasesIaetsd Iaetsd
 
iaetsd Robots in oil and gas refineries
iaetsd Robots in oil and gas refineriesiaetsd Robots in oil and gas refineries
iaetsd Robots in oil and gas refineriesIaetsd Iaetsd
 
iaetsd Modeling of solar steam engine system using parabolic
iaetsd Modeling of solar steam engine system using paraboliciaetsd Modeling of solar steam engine system using parabolic
iaetsd Modeling of solar steam engine system using parabolicIaetsd Iaetsd
 

Mehr von Iaetsd Iaetsd (20)

iaetsd Survey on cooperative relay based data transmission
iaetsd Survey on cooperative relay based data transmissioniaetsd Survey on cooperative relay based data transmission
iaetsd Survey on cooperative relay based data transmission
 
iaetsd Software defined am transmitter using vhdl
iaetsd Software defined am transmitter using vhdliaetsd Software defined am transmitter using vhdl
iaetsd Software defined am transmitter using vhdl
 
iaetsd Health monitoring system with wireless alarm
iaetsd Health monitoring system with wireless alarmiaetsd Health monitoring system with wireless alarm
iaetsd Health monitoring system with wireless alarm
 
iaetsd Equalizing channel and power based on cognitive radio system over mult...
iaetsd Equalizing channel and power based on cognitive radio system over mult...iaetsd Equalizing channel and power based on cognitive radio system over mult...
iaetsd Equalizing channel and power based on cognitive radio system over mult...
 
iaetsd Economic analysis and re design of driver’s car seat
iaetsd Economic analysis and re design of driver’s car seatiaetsd Economic analysis and re design of driver’s car seat
iaetsd Economic analysis and re design of driver’s car seat
 
iaetsd Design of slotted microstrip patch antenna for wlan application
iaetsd Design of slotted microstrip patch antenna for wlan applicationiaetsd Design of slotted microstrip patch antenna for wlan application
iaetsd Design of slotted microstrip patch antenna for wlan application
 
REVIEW PAPER- ON ENHANCEMENT OF HEAT TRANSFER USING RIBS
REVIEW PAPER- ON ENHANCEMENT OF HEAT TRANSFER USING RIBSREVIEW PAPER- ON ENHANCEMENT OF HEAT TRANSFER USING RIBS
REVIEW PAPER- ON ENHANCEMENT OF HEAT TRANSFER USING RIBS
 
A HYBRID AC/DC SOLAR POWERED STANDALONE SYSTEM WITHOUT INVERTER BASED ON LOAD...
A HYBRID AC/DC SOLAR POWERED STANDALONE SYSTEM WITHOUT INVERTER BASED ON LOAD...A HYBRID AC/DC SOLAR POWERED STANDALONE SYSTEM WITHOUT INVERTER BASED ON LOAD...
A HYBRID AC/DC SOLAR POWERED STANDALONE SYSTEM WITHOUT INVERTER BASED ON LOAD...
 
Fabrication of dual power bike
Fabrication of dual power bikeFabrication of dual power bike
Fabrication of dual power bike
 
Blue brain technology
Blue brain technologyBlue brain technology
Blue brain technology
 
iirdem The Livable Planet – A Revolutionary Concept through Innovative Street...
iirdem The Livable Planet – A Revolutionary Concept through Innovative Street...iirdem The Livable Planet – A Revolutionary Concept through Innovative Street...
iirdem The Livable Planet – A Revolutionary Concept through Innovative Street...
 
iirdem Surveillance aided robotic bird
iirdem Surveillance aided robotic birdiirdem Surveillance aided robotic bird
iirdem Surveillance aided robotic bird
 
iirdem Growing India Time Monopoly – The Key to Initiate Long Term Rapid Growth
iirdem Growing India Time Monopoly – The Key to Initiate Long Term Rapid Growthiirdem Growing India Time Monopoly – The Key to Initiate Long Term Rapid Growth
iirdem Growing India Time Monopoly – The Key to Initiate Long Term Rapid Growth
 
iirdem Design of Efficient Solar Energy Collector using MPPT Algorithm
iirdem Design of Efficient Solar Energy Collector using MPPT Algorithmiirdem Design of Efficient Solar Energy Collector using MPPT Algorithm
iirdem Design of Efficient Solar Energy Collector using MPPT Algorithm
 
iirdem CRASH IMPACT ATTENUATOR (CIA) FOR AUTOMOBILES WITH THE ADVOCATION OF M...
iirdem CRASH IMPACT ATTENUATOR (CIA) FOR AUTOMOBILES WITH THE ADVOCATION OF M...iirdem CRASH IMPACT ATTENUATOR (CIA) FOR AUTOMOBILES WITH THE ADVOCATION OF M...
iirdem CRASH IMPACT ATTENUATOR (CIA) FOR AUTOMOBILES WITH THE ADVOCATION OF M...
 
iirdem ADVANCING OF POWER MANAGEMENT IN HOME WITH SMART GRID TECHNOLOGY AND S...
iirdem ADVANCING OF POWER MANAGEMENT IN HOME WITH SMART GRID TECHNOLOGY AND S...iirdem ADVANCING OF POWER MANAGEMENT IN HOME WITH SMART GRID TECHNOLOGY AND S...
iirdem ADVANCING OF POWER MANAGEMENT IN HOME WITH SMART GRID TECHNOLOGY AND S...
 
iaetsd Shared authority based privacy preserving protocol
iaetsd Shared authority based privacy preserving protocoliaetsd Shared authority based privacy preserving protocol
iaetsd Shared authority based privacy preserving protocol
 
iaetsd Secured multiple keyword ranked search over encrypted databases
iaetsd Secured multiple keyword ranked search over encrypted databasesiaetsd Secured multiple keyword ranked search over encrypted databases
iaetsd Secured multiple keyword ranked search over encrypted databases
 
iaetsd Robots in oil and gas refineries
iaetsd Robots in oil and gas refineriesiaetsd Robots in oil and gas refineries
iaetsd Robots in oil and gas refineries
 
iaetsd Modeling of solar steam engine system using parabolic
iaetsd Modeling of solar steam engine system using paraboliciaetsd Modeling of solar steam engine system using parabolic
iaetsd Modeling of solar steam engine system using parabolic
 

Kürzlich hochgeladen

Vivazz, Mieres Social Housing Design Spain
Vivazz, Mieres Social Housing Design SpainVivazz, Mieres Social Housing Design Spain
Vivazz, Mieres Social Housing Design Spaintimesproduction05
 
Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Bookingroncy bisnoi
 
result management system report for college project
result management system report for college projectresult management system report for college project
result management system report for college projectTonystark477637
 
UNIT-II FMM-Flow Through Circular Conduits
UNIT-II FMM-Flow Through Circular ConduitsUNIT-II FMM-Flow Through Circular Conduits
UNIT-II FMM-Flow Through Circular Conduitsrknatarajan
 
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...SUHANI PANDEY
 
PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELL
PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELLPVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELL
PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELLManishPatel169454
 
Call for Papers - International Journal of Intelligent Systems and Applicatio...
Call for Papers - International Journal of Intelligent Systems and Applicatio...Call for Papers - International Journal of Intelligent Systems and Applicatio...
Call for Papers - International Journal of Intelligent Systems and Applicatio...Christo Ananth
 
Glass Ceramics: Processing and Properties
Glass Ceramics: Processing and PropertiesGlass Ceramics: Processing and Properties
Glass Ceramics: Processing and PropertiesPrabhanshu Chaturvedi
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations120cr0395
 
Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)simmis5
 
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptxBSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptxfenichawla
 
Generative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTGenerative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTbhaskargani46
 
UNIT-III FMM. DIMENSIONAL ANALYSIS
UNIT-III FMM.        DIMENSIONAL ANALYSISUNIT-III FMM.        DIMENSIONAL ANALYSIS
UNIT-III FMM. DIMENSIONAL ANALYSISrknatarajan
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VDineshKumar4165
 
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordCCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordAsst.prof M.Gokilavani
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...roncy bisnoi
 

Kürzlich hochgeladen (20)

Vivazz, Mieres Social Housing Design Spain
Vivazz, Mieres Social Housing Design SpainVivazz, Mieres Social Housing Design Spain
Vivazz, Mieres Social Housing Design Spain
 
Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking
 
result management system report for college project
result management system report for college projectresult management system report for college project
result management system report for college project
 
UNIT-II FMM-Flow Through Circular Conduits
UNIT-II FMM-Flow Through Circular ConduitsUNIT-II FMM-Flow Through Circular Conduits
UNIT-II FMM-Flow Through Circular Conduits
 
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
 
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
 
PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELL
PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELLPVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELL
PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELL
 
Call for Papers - International Journal of Intelligent Systems and Applicatio...
Call for Papers - International Journal of Intelligent Systems and Applicatio...Call for Papers - International Journal of Intelligent Systems and Applicatio...
Call for Papers - International Journal of Intelligent Systems and Applicatio...
 
Glass Ceramics: Processing and Properties
Glass Ceramics: Processing and PropertiesGlass Ceramics: Processing and Properties
Glass Ceramics: Processing and Properties
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations
 
Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)
 
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
 
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptxBSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
 
Generative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTGenerative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPT
 
UNIT-III FMM. DIMENSIONAL ANALYSIS
UNIT-III FMM.        DIMENSIONAL ANALYSISUNIT-III FMM.        DIMENSIONAL ANALYSIS
UNIT-III FMM. DIMENSIONAL ANALYSIS
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - V
 
NFPA 5000 2024 standard .
NFPA 5000 2024 standard                                  .NFPA 5000 2024 standard                                  .
NFPA 5000 2024 standard .
 
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordCCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 
Roadmap to Membership of RICS - Pathways and Routes
Roadmap to Membership of RICS - Pathways and RoutesRoadmap to Membership of RICS - Pathways and Routes
Roadmap to Membership of RICS - Pathways and Routes
 

Iaetsd survey on big data analytics for sdn (software defined networks)

  • 1. SURVEY ON BIG DATA ANALYTICS FOR SDN (SOFTWARE DEFINED NETWORKS) Pavithra.K, Student, Department of Computer Science and Engineering, Velammal Institute of Technology, Anna University, Chennai, India. cpavithrababu@gmail.com Ravivarma.A.K Student,Department of Computer Science and Engineering Velammal Institute of Technology, Anna University, Chennai, India ravivarma753@gmail.com Abstract— It is challenging to architect, build and support IT infrastructure to deal with the data deluge in university campuses, supercomputer centers and R&E networks. Hybrid network architecture, multi-domain bandwidth reservations, performance monitoring and GLIF Open Light path Exchanges (GOLE) are examples of network architectures that have been proposed, championed and implemented successfully to meet the needs of science. Most recently, Science DMZ, a campus design pattern that bypasses traditional performance hotspots in typical campus network implementation, has been gaining momentum. In this paper and corresponding demonstration, we build upon the SC11 SC inet Research Sandbox demonstrator with Software-Defined networking to explore new architectural approaches. A virtual switch network abstraction is explored, that when combined with software-defined networking concepts provides the science users a simple, adaptable network framework to meet their upcoming application requirements. Keywords-Network Virtualization; Open Flow; Software- Defined Networking; Multi-Domain; OSCARS; Science DMZ I. INTRODUCTION Science research has been increasingly data-driven as well as conducted in large collaborative partnerships involving researchers, instruments and high performance computing centers. Large-scale instruments like Large Hadron Collider or Square Kilometer Array and simulations produce petabytes of data that is likely to be shared and analyzed by tens to thousands of scientists. Due to a variety of reasons, including political and funding constraints, data is typically not processed, analyzed and visualized at the location it is produced, but moved to more convenient regional locations for the geographically distributed researchers. The larger the science collaboration, the higher the dependence on a functioning distributed architecture. Efficient tools and high-performance network architectures that seamlessly move data between locations have quickly become the backbone of state-of-the-art science collaborations. For example, ESnet alone has ISBN:978-1534910799 www.iaetsd.in Proceedings of ICAER-2016 ©IAETSD 201629
  • 2. observed approximately 60%+ annual growth in scientific data traffic for over 20 years. The LHC ATLAS and CMS experiments are examples of large science collaborations that rely heavily on networks to distribute petabytes of data across the globe every year. Similar paradigms are now rapidly emerging across many scientific disciplines from genomics to climate research to material sciences. For many of these disciplines, new experimental facilities are coming online like the Belle 2 High Energy Physics experiment in Japan that is expecting to collect at least 250 Petabytes (PB) in its first five years of operation. In addition, existing facilities like X-ray synchrotrons are being upgraded with new detectors that are collecting data at unprecedented resolution and refresh rates. The current detectors can now produce raw data of petabytes per second or more, and the next generation is expected to produce data volumes many times higher. All told, the data intensity of many disciplines is projected to increase by a factor of ten or more over the next few years. As the amount of traffic increases, there is a greater need for simple, scalable end-to-end network architectures and implementations that enable applications to use the network most efficiently. The Research and Education network community has successfully abstracted current networking technologies, like MPLS and SONET, to develop a multi-domain, automated, guaranteed bandwidth service. This capability has enabled scientists to build guaranteed bandwidth virtual circuits from their campus to a destination end point, which could be another campus or a supercomputing data center across the country or continents. Multi-domain performance testing, championed and developed by the same community, ensures that any end-to- end network glitches like packet-loss are quickly identified and resolved. As this architecture has been widely adopted, new challenges have emerged. First, the bottleneck for scientific productivity has shifted from the WAN to the campus and data center networks. Enterprise network architectures supporting a wide-variety of organizational missions has not been architected to support automated provisioning tools such as dynamic provisioning of guaranteed virtual circuits, end-to-end. In most cases, campus networks optimized for business operations are neither designed for nor capable of supporting the data movement requirements of science Second, even though a lot of manual interaction has been automated, important actions still need to be manually configured for end-to-end connectivity. Network topology (including service end-points) and VLAN translation at the borders between WAN and LAN are extremely important but maintained manually. Third, supporting large science collaborations with point-to -point circuits still requires active management or creation of long-term circuits (equivalent to a statically configured circuit). Fourth, dynamic exchange of policy and authorization between the source campuses an Destination campus is critical for any automated system to work. Before a wide area connection is setup or used, both campuses need to agree to authorize and allocate the local resources for data movement. Software-defined networking, using the Open Flow protocol, provides interesting and novel capabilities that can be leveraged, not only to solve the new challenges described above, but also to potentially simplify the implementation of existing solutions. This paper will examine the various architectural models of leveraging Open Flow based switches and the software-defined networking model within the ISBN:978-1534910799 www.iaetsd.in Proceedings of ICAER-2016 ©IAETSD 201630
  • 3. science-networking context and will describe a couple of demonstration scenarios that will be implemented for SC12 SCinet Research Sandbox. II. BACKGROUND A. Software-defined networking (SDN) and Open Flow (OF) The flow of data packets that constitute communication between any two devices connected over the network has been largely controlled by standard protocols defined for the different abstraction layers. These abstraction layers and their standard interfaces has been the root cause of highly successful scaling of the Internet. With this model, whenever a data packet arrives at a network device, the packets are switched based on standard forwarding rules which neither the network operator nor application have full control over. Even though this standard packet or flow routing model has scaled for the general purpose Internet, some applications and network operators would like better and more granular control over the treatment of packets on a per application flow. This paradigm of providing an API for application or network management programs to programmatically control the hardware forwarding of packet flows is known as "Software- Defined Networking". Open Flow is one of the control protocols specified by the Open Networking Foundation (ONF) 1 that enables the network hardware to provide such an API to the application programs and specifies a framework through which centralized control of flow forwarding rules can be orchestrated. Even though the traffic isolation with dynamic, automated, virtual circuits has been standardized and is being actively deployed by wide- area R&E network providers, the end-to- end path for a high-performance data flow typically traverses portions of the campus and data- center infrastructure that do not have any automated control to isolate the large data flows. With the adoption of Software - defined Networking paradigm and Open Flow, the campus and data-center operators can provide a programmatic interface that can be leveraged to build an end-to-end network service with the same traffic isolation characteristics that is needed to meet the requirements of the big-data movers. Even though Software-Defined Networking and Open Flow are different, they are sometimes used interchangeably. . B. ScienceDMZ2 A laboratory or university campus network typically supports multiple organizational missions. First, it must provide infrastructure for network traffic associated with the organization’s normal business operations including email, procurement systems, and web browsing, among others. The network must also be built with security features that protect the financial and personnel data of the organization. At the same time, these networks are also supposed to be used as the foundation for the scientific research process as scientists depend on this infrastructure to share, store, and analyze research data from many different external sources. In most cases, however, networks optimized for these business and security operations are neither designed for nor capable of supporting the requirements of data intensive science. Multi-gigabit data flows over paths that have 100-200 millisecond RTT, as required by most international science collaborations, cannot be supported by typical LAN equipment and are explicitly impeded by state ful firewalls at domain boundaries. When scientists attempt to run data intensive applications over these so-called “general purpose” networks, the result is often poor performance - in many cases so poor that the science mission is significantly impeded. By defining a separate part of the network that is designed to support data-intensive science flow, the Science DMZ model provides a framework for building a scalable, extensible network infrastructure that aims to eliminate the packet loss that causes poor TCP performance, to implement appropriate use policies so that high-performance applications are ISBN:978-1534910799 www.iaetsd.in Proceedings of ICAER-2016 ©IAETSD 201631
  • 4. not hampered by unnecessary constraints, to create an effective on-ramp for local science resources to access wide area network services and to provide mechanisms for ensuring consistent performance. C. XSP: Extensible Service Protocol: Applications can refer back to that state, make changes, and signal the network to suit their particular requirements. In order to implement XSP as part of a high- performance, end-to-end, data transfer mechanism, we leveraged Open Flow to implement a end-site broker and co-ordination software ECSEL, described in the next section below. The XSP libraries and API provide a standard interface for applications to specify parameters that define network paths. The realization of these paths is then managed by our XSP daemon (XSPd) that signals the underlying provisioning service while providing feedback to the application. A transparent XSP wrapper, or ``shim'', library gives existing applications the ability to signal XSPd without source code modifications. Since XSP is implemented at the session layer, it has the flexibility to support multiple transport protocols – TCP, parallel TCP (as implemented in GridFTP), or RDMA. These protocols can be chose dynamically depending on the data transfer purpose, capability and the capabilities of the underlying network. III. PREVIOUS WORK: END-TO-END SERVICE AT LAYER2 (ECSEL) Deploying loss-sensitive, high-performance applications across the WAN poses the challenge of providing an end-to-end layer-2 circuit with no loss, guaranteed bandwidth, and stable latency. OSCARS can be used to provide layer-2 connectivity across the WAN. However, due to administrative and technical constraints, OSCARS cannot control the path from the site border to the endpoints, unless implemented explicitly within the campus itself as a separate domain. The data-transfer hosts or DTNs3 have no knowledge of the LAN topology they are connected to, and the LAN needs to be configured explicitly to transport the Ethernet frames from the end host to the ingress point of the OSCARS circuit. Also, allowing or denying traffic across the WAN needs to be controlled by the local campus policy, which based on authentication and authorization decides what resources is assigned to users, projects, or class of applications. Before admitting a request, both sites must agree to use common WAN resources, the guaranteed bandwidth virtual circuit created by OSCARS. Campuses with OpenFlow capability can run an isolated domain, using the local policy to allow or deny which wide-area traffic may be forwarded. To implement the concept above, we leverage the application layer, so that an end-to-end network middleware can broker and manage WAN OSCARS circuits as well as control the local OpenFlow domain. The application understands a very simple topology, itself and the remote host, typically, in the form of a DNS name. The middleware, manages a more complex topology, reflecting all the administrative domains involved in the path between the endpoints. The network controller, ECSEL, which manages both the LAN topology and the site- specific WAN resources, provides this topology. A. ECSEL, a Site-to-Site IDC ECSEL (End-to-End Circuit Service at Layer 2), is our implementation of an Inter-Domain Controller (IDC) 4 that negotiates local and remote network resources while keeping intact the administrative boundaries; each site maintain full control on local resources and how they are utilized. There are two categories of local resources: the LAN and WAN OSCARS circuit connection to the remote site. OSCARS circuits, registered with ECSEL, are associated with metadata describing the authorized usage of each of the circuits. For example, circuits can be limited to certain users or projects. The OSCARS circuits are reservations referring to either already provisioned circuits or advanced reservations. The LAN resources are managed by an OpenFlow controller that discovers the local network topology, computes the proper path between the end host and the proper OSCARS circuit, and applies the forwarding rules, thus establishing the layer-2 circuit. ISBN:978-1534910799 www.iaetsd.in Proceedings of ICAER-2016 ©IAETSD 201632
  • 5. The ECSEL Open Flow controller leverages the Open Flow discovery protocol to not only learn the topology of switches and routers of the LAN, but also the endpoint itself. The end host listens to Link Layer Discovery Protocol (LLDP) packets broadcast by the Open Flow switches to discover how it is contacted to the network, and, in turn, registers itself to ECSEL. (LLDP is used by network devices to advertise their identity, capabilities, and neighbors on an Ethernet LAN). B. ECSEL Workflow When the session layer, via XSPd, requests a layer-2 path between two end hosts that support RDMA over Ethernet, it supplies a high-level topology that is based on the identity of the end hosts as well as their domains, along with requested bandwidth, start time, and duration. Using X509- based authentication and authorization representing the requesting application or project or end-user, the local policy will select an available WAN OSCARS circuit and then, using the IDC protocol, contact its peer on the remote domain. The remote domain ECSEL will then verify if the request is compliant with the local policy, and if so, the OSCARS circuit is then reserved. Meanwhile, both of the end hosts are listening for Link-Layer Discovery Protocol (LLDP)5 packets sent on the wire by the Open Flow switches they are connected to, and through parsing them the Open Flow switch identifier and port number is discovered. The hosts register themselves to the site's ECSEL, completing the LAN topology built by the Open Flow controller. At the time the circuit reservation begins, the Open Flow controller computes the best path between the end hosts and the end point of the OSCARS circuit, and begins forwarding RDMA frames and performing the appropriate VLAN translation, thus establishing the RDMA flow between the two hosts. In the absence of any form of link layer flow control, establishment of an end-to-end circuit through services like ECSEL is necessary, in order to differentiate such loss- sensitive traffic from other best- effort flows, particularly if the best possible RoCE performance is desired. Figure 1: Network architecture for SC11 ECSEL demonstrator C. SC11 SCinet Research Sandbox demonstration6 The SC11 SCinet SRS demonstration consisted of establishing a 10G layer 2 path between a data transfer node (DTN) located at BNL, Long Island, and another on the LBNL booth on the show floor, in Seattle, Washington. Each DTN utilized RoCE, a layer 2 RDMA protocol,, in order to achieve the necessary performance. Provisioning of the network was coordinated by ECSEL, using ESnet’s OSCARS service for the intra-continental path, and Open Flow switches for the LAN architecture. Full automation of data transfer was provided by the middleware and service Globus Online. The demonstration was very successful. ECSEL was easy to deploy in an extremely dynamic environment such as Super Computing, thanks to its core code borrowed from OSCARS. The application itself, grid FTP using RoCE demonstrated that we could use a high performance layer 2 protocol with well-behaved characteristics. It provided better than TCP throughput with very low CPU utilization. This was the motivation for following up on the ESCEL model. IV. ARCHITECTURAL MODELS As described above, ECSEL provides a model for how a campus implementing a data transfer service can leverage Open Flow to provide flexible, end-to- end connectivity. For SC12, we explore new architectural models to support science that leverage SDN/Open Flow by exploring more complicated use- cases, a) supporting multiple- science disciplines as ISBN:978-1534910799 www.iaetsd.in Proceedings of ICAER-2016 ©IAETSD 201633
  • 6. typical in a supercomputing data center and b) flexible creation of virtual networks over the wide- area for dynamic science collaborations. A. Multiple Science Centers 1) Description and Challenges A typical supercomputing center or a large campus, like the National Labs, typically hosts multiple science disciplines and collaborations. Most of the science disciplines either produce data using the supercomputers by running simulations or move data for analysis to the supercomputing center from remote instruments. The data generated from the simulation, the raw data from the instruments and the analysis/results is then typically hosted at the supercomputer center for other scientists from the collaboration to access or transferred to another computing location for further analysis or local visualization. As mentioned before, large collaborations like the LHC produce vast amounts of data that are then analyzed and replicated among all continents and analyzed by thousands of scientists. In order to facilitate network transfers, there are two models that are usually employed. The supercomputer centers, funded to support multiple projects, end up setting a Science DMZ enclave with a common infrastructure configured for high-speed data transfer (also called Data Transfer Nodes or DTNs). This shared resource is available to all science disciplines, but typically requires scheduling, manual management of data transfers from local storage to this dedicated DTN infrastructure and manual interaction with the local infrastructure management teams that own these resources. On the contrary, in campuses, the hardware is funded through projects and each science discipline deploys their own DTNs that they usually do not share with other science areas. To implement an effective ScienceDMZ, the local campus IT folks need to work closely with the scientists to put into place a secure, high-performance mechanism to transfer the data securely between the DMZ and the computational/storage infrastructure behind the security perimeter. Consequently, in many scenarios either the data transfer hosts are stuck behind the low- performance firewall limiting their throughput, or are a shared resource requiring manual intervention from multiple teams. In addition to sharing the DTN resources, there is no central management system that allocates and rebalances the WAN bandwidth in response to the data transfers in progress. Most of these data transfers then end up using the routed IP network, and are subject to the performance vagaries of best effort networking. To create a more automated and resilient Science DMZ model for multiple science collaborations on campus, we propose to explore an architectural model that leverages the capabilities of Open Flow/SDN. 2) Open Flow/SDN Science DMZ architectural model The design of this architectural model is based on two important premises: 1. The science data is hosted by the scientist behind the security perimeter and only the portion of data that needs to be transferred to another location is exposed within the hosts on the Science DMZ 2. Wide Area resources like virtual-circuits are subject to use policies implemented and enforced by the local site administration. The architectural model proposes putting a DTN redirector within the science DMZ. When the DTN redirector gets a data transfer request, the flow is redirected to the appropriate DTN within the security perimeter using flow rules. The firewall functions are bypassed by encapsulating the flow in one of the pre- approved VLANs. ISBN:978-1534910799 www.iaetsd.in Proceedings of ICAER-2016 ©IAETSD 201634
  • 7. Figure 2: OpenFlow-based end-site architecture to support multiple science disciplines These pre-approved VLANs are locally configured to bypass the firewall function. The VLAN translation function of OpenFlow is leveraged to change the incoming header, and flow is re-directed without rewriting the IP header. This approach enables science collaborations to maintain their DTN alongside the data/storage infrastructure. The site network administrators have full flexibility to manage policies, including security, at the centralized Open Flow controller. All local policy functions, the data transfer workflow, authentication/authorization functions and configuration interfaces can be implemented as an application on the Open Flow controller, which we name as the “Open Flow Science DMZ Application”. This approach is a natural extension of ECSEL, which primarily supported end-to-end layer 2 protocols between two end-points, and allows it to scale across multiple science disciplines. The proposed workflow also reduces the ongoing support burden to the campus IT administrators while improving the security characteristics as well. The firewall is configured statically to bypass certain VLANs that are local to the site though the VLAN encapsulation and assignment managed by the Open Flow controller application. The sites supporting multiple science disciplines will benefit a lot from this approach. All the science data will now be managed at one location and by the science, while the complexity of staging the data at the DMZ DTN from the primary data store protected behind the security perimeter can be eliminated. Each science discipline can now not only manage their own data and DTN architecture, but also support custom data transfer protocols that may be unique to that collaboration. B. Dynamic Science Collaborations 1) Description and Challenges Science collaborations tackling large problems like Climate or sharing one-of-a-kind instruments like the LHC develop a more formalized architecture for hosting and distributing data. Even though these architectures are highly dependent on a high- performance network, they are typically managed completely by the scientists or IT administrators that are part of the collaboration itself. The networking- savvy collaborations typically leverage the point-to- point inter-domain guaranteed bandwidth circuits provided by the R&E networks to get better performance, but they are in the minority. There are many others that just use the general IP routing service and experience poor performance, or take to alternate means of transporting their data like shipping hard-drives. Existing technologies like IPSec, VPLS or L2TP are currently used to bridge multiple sites together in a virtual private network (VPN). The multiple sites connected by this tunneling protocol or virtual routers can share IP routing information between the sites, so they can route traffic across the VPN. Some of these technologies are overlay technologies that do not require participation by the service provider other than providing a routed IP connection. Other technologies, are VPNs offered by the service provider, and require complex routing configurations in order to work. In most of the science collaborations, an approach that involves a lot of complex site configuration, management by on-site IT teams is not feasible due to the management complexity, and the ephemeral nature of these collaborations. In addition, it is not easy to apply policies to verify that only science ISBN:978-1534910799 www.iaetsd.in Proceedings of ICAER-2016 ©IAETSD 201635
  • 8. traffic is utilizing these inter-site connections, especially when each site is managed by a different administrative entity. The goal is to create an infrastructure on-demand for a flexible science collaboration tied together with a virtual network ensures all existing capabilities of high-performance. In addition, the requirements from the science collaborations is 1) flexibility for them to manage their wide area bandwidth 2) easy virtual private network setup between collaborators that does not require huge configuration overhead 3) flexibility to use either layer 2 or routed IP services between the collaboration sites, providing higher performance to standard IP applications. 2) ‘One-virtual-switch’ network virtualization model For dynamic science collaborations, it is common practice to establish connectivity between the sites through dynamic or static point-to-point circuits. Thus, for large science collaborations, each site ends up supporting multiple point-to-point circuits with customized access, IP addresses, and security policies, all managed manually. We tackle this limitation by creating a new abstraction – “one virtual switch” representing the WAN [Figure 5]. This abstraction is simple, atomic, programmable, and network-wide. The abstraction enables multiple sites belonging to a collaboration to build logical circuits to the virtual ports of the WAN virtual switch. The virtual switch, in turn, exposes an OpenFlow programmatic interface that enables the sites to easily program and redirect data flows to the appropriate site and end-point dynamically. One of the key elements of this architecture is the implementation of the physical infrastructure that can be virtualized in software to appear as a single switch. This is accomplished by deploying OF enabled devices at the customer facing edge of the WAN network with a programmable WAN interconnect fabric implemented by guaranteed bandwidth OSCARS circuits connecting them. The circuits can be modified dynamically behind the scenes, and protected in order to implement a very adaptable and reliable fabric. Unlike port identifiers of a real switch that are typically vendor and switch specific, the ports on the virtual switch can be abstract and named logically, in order to make it much more intuitive and usable. This provides the topological foundation over which the virtual infrastructure is built. To provide dynamic control of the infrastructure, we create a simplified OpenFlow control API that exposes the virtual switch and its logical topology to the end-sites. Using OpenFlow, the end-sites or science collaborations can dynamically program switching of flows between the various end-sites using the virtual topology, and shielded from the complex multi-domain physical connectivity view. With this element of control, the collaboration is able to multiplex multiple flows over a single site connection and virtually switch them to the appropriate destination as the data flow needs of the collaboration change. The previous model of site-to-site negotiation, as implemented in ECSEL, is still supported to ensure authorized admission control as well as for resource management of the shared wide area resources, namely the bandwidth reserved for the site’s connectivity into the virtual switch. It is unclear at the moment if the entire science collaboration can work with one controller, or if it is more advantageous for each site to manage their resources, with their own controller. Tradeoffs of each approach will be part of active experimentation once the virtualization architecture is implemented for the demonstration. The figure below [Figure 3] shows implementation details of how the virtual view and the physical implementation relate to each other. The one-virtual- ISBN:978-1534910799 www.iaetsd.in Proceedings of ICAER-2016 ©IAETSD 201636
  • 9. switch abstraction, like a physical Open Flow switch, provides both a management interface and a control interface. The control interface, using the Open Flow protocol, enables dynamic configuration and control of flows, similar to a real switch. The management interface allows site-administrators to provide the parameters of the collaboration enabling the virtual switch abstraction to be setup for the applications. This approach to network virtualization, through creation of a simple ‘one-virtual-switch’ abstraction enables the research collaborators and network administrators to treat the wide-area network as a local switch with similar methods of switching and control: • The OSCARS wide-area traffic-engineering service creates a flexible backplane between the various OpenFlow switches, enabling the multipoint transport between the edges of the WAN. • The OpenFlow switches in the WAN, at the customer edges, perform flexible flow switching and VLAN translation, hiding the multi-point complexity from the end-sites and the application. • The end-site Open Flow enabled applications program flows on the one-virtual-switch in the same way done locally. Figure 3: End-to-end virtualization using One- Virtual-Switch, ECSEL and OSCARS V. SC12 DEMONSTRATION Building upon the already demonstrated SDN concept for end-site, ECSEL at SC11, the SC12 demonstration will focus on the dynamic science collaboration architectural model as defined above. An extension of ECSEL to show the multi-science campus is also a stretch goal. These two demonstrations will showcase implementations that will enable scientists to deal with the data-deluge in a flexible and scalable manner. We will leverage existing data transfer protocols like GridFTP to demonstrate the conceptual model described above. VI. RELATED WORK The broad concepts and challenges for data-intensive science described in this paper have been widely understood and is a topic of active research in the R&E community. Some of the widely accepted research solutions that have transitioned into production networks include Hybrid Networking, OSCARS[6], IDC among others. New projects have recently tried to tackle some of the end-site issues for non-Open Flow technologies like ESCPS [7] funded by DOE. Open Flow in the wide-area has been recently gaining a lot of attention – Internet2’s NDDI [8] project creates point to point links over the wide- area and Google 7 has recently announced using Open Flow to be the prime network technology responsible for moving large data sets between their data centers over the wide-area. Since the Open Flow and Software-defined paradigm are fairly new, exploring how these paradigms will apply to existing problem sets, and create new value is a worthwhile enterprise. ACKNOWLEDGMENT We would like to thank the reviewers for their positive comments and their thorough reviews. We are grateful to our professors who helped us in improving the presentation of the paper. . ISBN:978-1534910799 www.iaetsd.in Proceedings of ICAER-2016 ©IAETSD 201637
  • 10. REFERENCES [1] William Johnston, “The Square Kilometer Array – A next generation scientific instrument and its implications for networks,” TNC 2012, https://tnc2012.terena.org/core/presentation [2] Eli Dart, Brian Tierney, editors, “HEP (High Energy Physics) Network Requirements Workshop, August 2009 - Final Report”, ESnet Network Requirements Workshop, August 27, 2009, LBNL LBNL-3397E. [3] T. Abe et. al. “BELLE II Technical Design Report”, KEK Report 2010- 1, 2010 , http://arxiv.org/abs/1011.0352v1 [4] Eli Dart, Brian Tierney, editors, “BER (Biological and Environmental Research) Network Requirements Workshop, April 2010 - Final Report”, ESnet Network Requirements Workshop, April 29, 2010. [5] E. Kissel and M. Swany. The extensible session protocol: A protocol for future internet architectures. Technical Report UDEL- 2012/001, Dept. of CIS, University of Delaware, 2012 [6] C. Guok, D. Robertson, M. Thompson, J. Lee, B. Tierney, and W. Johnston. Intra and inter domain circuit provisioning using the oscars reservation system. In Third International Conference on Broadband Communications Networks and Systems, IEEE/ICST, October 2006 [7] End Site Control Plane Service, ISBN:978-1534910799 www.iaetsd.in Proceedings of ICAER-2016 ©IAETSD 201638