Strata London WANdisco

© 2019 WANdisco PLC. All rights reserved.
Overcome Data Gravity with
A LiveData Strategy
Strata Data 2019 — London
Joel S. Horwitz, Senior VP Marketing, WANdisco

Wide
Area
Network
Distributed
Computing
The experts in distributed
computing
A decentralized IT organization
requires a Platform to ensure
information availability and
consistency across multiple data
centers, development sites, data
clusters, and multiple clouds.

A platform for ANY IT Architecture
MultiSite Active
Backup
Disaster
Recovery
MultiCloud Data Lake Migration
FUSION
Security DConE Web UI SDK
LiveCode
Git Gerritt SVN
LiveData
Local/NFS HDFS Object Storage
IBM Alibaba Cloud AWS Azure Google Cloud Oracle
Cloud
Architect
Security
Manager
Data
Architect
Cloud
Engineer
Data
Operator
Data
Engineer
Persona
Solutions
Platform
IT Assets
Cloud

WANdisco FUSION Platform
Protect Your Investment
No downtime, no outages,
and no risk with guaranteed
near- zero RTO and RPO.
Transform Your IT Economics
Create a bedrock for
performance by fully utilizing
hardware previously reserved
for backup and recovery.
Break through constraints
Distribute all of your code and
data for developers to access at
the speed of business.

Hadoop to Hadoop

Customer Example: Hadoop to Hadoop
“One of the things that impressed us most
about the WANdisco Fusion platform was its
ability to resolve the data consistency
challenges of replicating large amounts of
data between active Hadoop clusters.”
Steven Swartzlander, Lead Architect at HM Health Solutions

Hadoop to Cloud

Customer Example: Hadoop to Cloud
Playtika used WANdisco Fusion to transfer data
to Amazon S3 as it changed in their on-premises
Cloudera Hadoop cluster. WANdisco Fusion’s
active data replication guaranteed data
consistency in both locations.

Cloud to Cloud

Customer Example: Cloud to Cloud
With WANdisco products, AMCO
can replicate all incoming
Application data from their
hosted instance in Mexico to
AWS.

The 3 stages of Data Movement to Cloud
BigData Movement to the
Cloud
Hybrid Data to Ensure
Business Continuity LiveData for MultiCloud
PHASE PHASE PHASE
321
• Single pass migration with
guaranteed consistency
• Minimal disruption to operations
• Maximize target ingest rate
• Every path becomes live as soon
as it is migrated
• Eliminate vendor lock-in
• Gain true data availability
• Reduce cost structures
• Easy Management of Multiple
Cloud Storage Providers
• No Vendor Lock-in
• Increased Data Availability

“Computer science still says
what we have done is
impossible… but it’s not.”
Dr. Yeturu Aahlad, Chief Scientist, Inventor & Co-founder

The LiveData Gap

WANdisco eliminates the LiveData gap
inconsistency, unused
capacity, economic
limitations
Multiplies IT’s ability to execute at any scale, with same budget
The
LiveData
Gap

WANdisco eliminates the LiveData gap
WANdisco Fusion
multiplier effect:
IT achieves more
with the same budget
Multiplies IT’s ability to execute at any scale, with same budget
LiveData
Multiplier
Effect

The LiveData Gap
20ZB
global data storage in
2016, growing to
160Zb in 2025
$46B
global storage spend
in 2016
$67B
global spend on public
cloud computing
Massive growth, massive investments: can’t keep up

A platform for ANY IT Architecture

Industries and Professions
Automotive Government Healthcare Financial Services Telecom
Energy Entertainment Retail Developer
Collaboration
Manufacturing

“WANdisco Fusion provides
consistent data across our cloud and
on-premises solutions, offering near-
zero RPO and enabling hybrid cloud
agility to drive the business forward.”
—
Ajay Prasad, Big Data Leader, AMD

“Of all the technologies we
evaluated, WANdisco Fusion
was the only solution that
offered the speed, guaranteed
data consistency, and
continuous replication we
required to analyze our patient
data.”
—
Dr. Susheel Varma, Technology Officer for the Center
for Computational Imaging & Simulation Technologies
in Biomedicine, The University of Sheffield

“WANdisco Fusion
ensures that all of our
sites are up and running
all of the time.”
—
Angela Thomas, Development Tools
Manager, Juniper Networks

“WANdisco enabled us to
upgrade our system
effortlessly with no issues
after we went live. We
are a very happy and
satisfied customer.”
—
Adinarayana Sreenath, Director, Big Data
Architecture, Envestnet | Yodlee

Our Strategic Partners
WANdisco’s industry-leading technology and services partners are ready to help you
deploy WANdisco Fusion and achieve LiveData.

Forward Thinking Executives have a LiveData Strategy
Fortune 50 Motor Vehicle Company
100%
uptime while moving massive
continuously changing sets of
vehicular data for driverless car
initiative
Fortune 50 Retailer
2X
compute capacity fully
deployed by reducing server
hardware requirements by
50%
Global 50 Bank
ZERO
planned outages while
seamlessly upgrading key
financial applications

David Richards, CEO & founder, WANdisco
“Founding a company is a personal
& intimate process that demands
huge amounts of passion,
commitment & energy.”

Demonstration

WANdisco Fusion coordinates
change

Let’s follow a simple scenario of one object PUT performed by one
client, using the LiveData for Multicloud Fusion product
Object x
A B C A B C

User sends a request to create an object in object storage.
This goes through the Fusion Multicloud Proxy
Object x
Proposal to create an object
PUT
A B C A B C

Fusion Server gets this request from the Multicloud Proxy, and co-
ordinates the request with other Fusion Servers in a membership
Object x
Consensus to create the object
PUT
A B C A B C

This membership emits a Global Sequence of operations
Object x
Replica Agreements
PUT
A B C A B C

Execution of the same Globally-Sequenced operation in
each location results in replica object creation
Object x
PUT
A B C A B C

Originating client PUTs via the proxy to its local object storage
Object x
Object write
PUT
A B C A B C

Object creation occurs locally at local speed with only
the consensus performed in addition so far
Object x
A B C A B C

Fusion is aware of the completion of that PUT and initiates
the transfer of content to other replicas
Object x Object x
Content replication
A B C A B C

Writes can occur in any location, while Fusion guarantees the
consistency of the object storage through consensus
Objec
t x Object x
A B C A B C

Multiple clients can operate in any location without
changing that consistency guarantee

Different types of underlying object storage can be used

This can extend beyond what the public cloud vendors offer as
internal, eventually-consistent replication only

Fusion can operate across arbitrary distance

THANK YOU
Connect @wandisco

Backup Slides

Public Cloud A
West Region
FUSION enables LiveData everywhere
Public Cloud A
East Region
Data in Production Dev/Test or Disaster
Recovery
Data Users
Public
Cloud B
HYPERSCALE
ECONOMICS
Fully automated,
utilizes all capacity,
data at any scale
ALWAYS ACCURATE
Query any node,
get the same results
RUNS ANYWHERE
On premises, hybrid cloud,
cloud, multi-cloud
ALWAYS
PROTECTED
No single point
of failure
ALWAYS
AVAILABLE
Shared logical pool
of data

WANdisco Fusion for Disaster
Recovery
WANdisco Fusion guarantees global data consistency and
accessibility for your critical applications, and protects your
data in the event of a disaster.

WANdisco Fusion for Cloud
MigrationWANdisco Fusion gives you the ability to successfully move
to the cloud without risking business continuity.

WANdisco Fusion for Hybrid Cloud
Transition from separate management of data in private and
public clouds to unified, integrated operations, easily and
cost effectively.

WANdisco Fusion for Multi-Cloud Replication
Deploy WANdisco Fusion to enable global data access
across any cloud provider so that you can access your data
when you want it from anywhere.

Approaches to data replication:
DistCp, AzCopy, etc.
• Unidirectional replication with a source and
target
• Target Storage/location is typically read only
• Content will become inconsistent
• Manual and labor intensive process to
manage and reconcile differences
• Inefficient use of the network
• Only works between similar storage
technologies
• Does not cater for consistency of all relevant
metadata (security, etc.)
Step 2
Data from source
is periodically
copied into target
Data Center 2
Target Storage
Data Center 1
Source Storage
ACTIVE
NAMENODE
DATA NODES
ACTIVE
NAMENODE
DATA NODES
INTERNET
Step 1
Data is ingested into
source first
VPN
POINT-IN-TIME or SCHEDULED COPY

• Disruptions in any of the separate
environments will cause the two storage
environments to diverge
• Potential to run out of buffer at point of
ingest when inter-environment network is
down
• Requires constant attention and
administration to keep running
• Data modified on any environment after
ingest is not replicated, leading to further
divergence
INTERNET
Data Center 2
Environment B
Data Center 1
Environment A
INTERNET
Step 2
Load balancer sends one copy
of data to Environment A and
one copy to Environment B
Step 1
Data is sent to load balancer
LOAD BALANCER
ACTIVE
NAMENODE
DATA NODES
ACTIVE
NAMENODE
DATA NODES
PARALLEL (DUAL) INGEST

• Global consistency not possible in a
multi-cloud environment (vendor specific
only, and limited to specific paired
regions)
• Primarily uni-directional, relies on
versioning to avoid demands of true
active/active operation
• In some environments, replication is
eventually consistent, and not
guaranteed to be immediately available
Cloud Provider A
Region 1
Cloud Provider A
Region 2
One-way replication
Eventual consistency
Cloud Provider A
S3 api
Cloud Provider B
Other api
Vendor specific
APIs extract and
load strategy
CLOUD-NATIVE GEO REPLICATION & CDC

WANdisco LiveData for MultiCloud
LiveData for MultiCloud
• Built on the WANdisco Fusion
platform
• Extends capabilities for object store
consistency and replication to multi-
cloud architectures
• Spans S3-compatible, Azure Blob
storage, on-premises and cloud
storage systems
• Same scale, performance, flexibility
that WANdisco brings to big data
platforms

WANdisco LiveData for MultiCloud
Capabilities
• Data consistency in a multi-cloud environment
• Continuous replication of changing petabyte-
scale data without disruption
Benefits
• Enable heterogenous storage
• Access data from anywhere (read and write)
• Simplify management of multiple cloud
providers
• Enable multi-cloud operations
• Avoid vendor lock-in
• Geo data availability
Use Cases
• Global data consistency
• Guarantee global data accuracy: across
clouds, regions, locations, and hybrid
deployments
• Eliminate reliance on cloud vendors
• Data resiliency, downtime, failures,
regulations, compliance, performance,
cost
• Use the right cloud for the right job
• Optimize strategy, business performance
and operations

Paxos is the foundation for
WANdisco’s consensus technology:
DConE
Correctness
Distributed
Coordination
Continuous
Availability
Leaderless
consensus
OptimalityProven
DConE: WANdisco’s unique
implementation of Paxos has
overcome operationalization
difficulties. Superior to other
consensus approaches particularly
in large scale production uses e.g.
ZAB (Zookeeper), Raft, Group
Communication (Galera)
Concurrency and
multiple state machines

Strata London WANdisco

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Strata London WANdisco

Ähnlich wie Strata London WANdisco (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Strata London WANdisco

Hinweis der Redaktion