OrientDB Distributed Architecture v2.0

•

17 gefällt mir•79,977 views

Orient Technologies

OrientDB Distributed Architecture Overview

Technologie

Short history
!
In 2012, we had a Master/Slave replication
!
While it scaled up well on reads, users
complained of a single Master node
bottleneck
It’s quite easy to scale up reads, the hard
part is to scale up both reads and writes
Copyright (c) - Orient Technologies LTD 2

How Master/Slave works
Copyright (c) - Orient Technologies LTD
3
C C C
Master
Node
Slave
Node
Slave
Node
Writes
Master
node is the
bottleneck

Master/Slave
!
PROS:
- Relatively easy to develop
!
CONS:
- The master is the bottleneck for writes
- No matter how many servers you have, the
throughput is limited by the Master node
Copyright (c) - Orient Technologies LTD 4

What happened to OrientDB's M/S architecture?
This is the old
MASTER/SLAVE
replication
Copyright (c) - Orient Technologies LTD 5

2012: new architectural goals
Multi-Master: all the nodes must accept writes
Sharding: split data in multiple partitions
Better Fail-Over
Simplified configuration with Auto-Discovery
Copyright (c) - Orient Technologies LTD 6

Auto-Discovery
C
Master
Node
I’m the
only one!
Copyright (c) - Orient Technologies LTD 7

Auto-Discovery
Connected!
C
Master
Node
Master
Node
Copyright (c) - Orient Technologies LTD 8

Clients see the distributed configuration
C
Master
Node
updated distributed
configuration is broadcasted to
all the connected clients
Master
Node
Copyright (c) - Orient Technologies LTD 9

Auto-reconnect in case of failure
In case of failure, the
clients auto-reconnect to
C C
the available nodes
Master
Node
Master
Node
Copyright (c) - Orient Technologies LTD 10

Auto-deploy of databases
automatically deployed
C
to the new joining
Master
Node
C
Master
Node
DB are
nodes
C
C
DB DB
Copyright (c) - Orient Technologies LTD 11

Classes rely on Cluster to store records
1 class -> 1 cluster Class
Customer
customer
By default
Cluster
Copyright (c) - Orient Technologies LTD 12

Classes can be split into more clusters
Customer
customer_usa
Class
multiple clusters
and assign them to
customer_china
Define
each node
Cluster Cluster
customer_europe
Cluster
Copyright (c) - Orient Technologies LTD 13

Assign 1 cluster per Node
Master
Node
Customer
Master
Node
Master
Node
customer_usa customer_europe customer_china
Copyright (c) - Orient Technologies LTD 14

Copyright (c) - Orient Technologies LTD
What about
sharing + replication?
!
We used a solution similar
to RAID for HardDrives
15

RAID for databases
Replica
factor = 2
Master
Node
Customer
Master
Node
Master
Node
customer_usa customer_europe customer_china
customer_china customer_usa customer_europe
Copyright (c) - Orient Technologies LTD 16

RAID for databases
Replica
factor = 3
Master
Node
Master
Node
Each node
owns all customers
Master
Node
customer_usa customer_europe customer_china
customer_customer_china usa customer_europe
customer_europe customer_china customer_usa
Copyright (c) - Orient Technologies LTD 17

Replication: under the hood
Client sends an INSERT request
HZ
Queue
Requests
Master
Node
HZ
Queue
Master
Node
HZ
Queue
Master
Node
C
INSERT
Copyright (c) - Orient Technologies LTD 18

Replication: under the hood
HZ
Queue
Response handling
Requests
Master
Node
HZ
Queue
Master
Node
HZ
Queue
WriteQuorum
= 2
Sends OK
Master
Node
C
HZ
Queue
HZ
Queue
HZ
Queue
OK
Responses
Copyright (c) - Orient Technologies LTD 19

Replication: under the hood
Fix the unaligned node
HZ
Queue
Requests
Master
Node
HZ
Queue
Master
Node
HZ
Queue
Master
Node
HZ
Queue
HZ
Queue
HZ
Queue
Responses
Fix
Copyright (c) - Orient Technologies LTD 20

Linear and Elastic scalability
C
Master
Node
C
on both read & writes!
Master
Node
C
C
Master
Node
C
C
C
C
Master
Node
C
C
C
C Master
Node
C
C
C
Master
Node
C
C
C
Master
Node
C
C
Copyright (c) - Orient Technologies LTD 21

Hazelcast’s role
Auto-Discovering (Multicast/TCP-IP/Amazon)
Queues for requests and responses
Store metadata in distributed Maps
Distributed Locks
Copyright (c) - Orient Technologies LTD 22

OrientDB’s Future Roadmap
OrientDB 2.0 (Sept 2014) has even better
performance: +300% improvement on all the
distributed operations
Pluggable conflict resolution strategy
Auto-discovery also by Clients
Copyright (c) - Orient Technologies LTD 23

Weitere ähnliche Inhalte

Was ist angesagt?

The days of the relational database being a one-stop-shop for all of your persistence needs are over. Although NoSQL databases address some issues that can’t be addressed by relational databases, the opposite is true as well. The relational database offers an unparalleled feature set and rock solid stability. One cannot underestimate the importance of using the right tool for the job, and for some jobs, one tool is not enough. This talk focuses on the strength and weaknesses of both relational and NoSQL databases, the benefits and challenges of polyglot persistence, and examples of polyglot persistence in the wild. These slides were presented at WindyCityDB 2010.

Polyglot Persistence - Two Great Tastes That Taste Great Together

John Wood

Description Generative adversarial network (GAN) has recently emerged as a promising generative modeling approach. It consists of a generative network and a discriminative network. Through the competition between the two networks, it learns to model the data distribution. In addition to modeling the image/video distribution in computer vision problems, the framework finds use in defining visual concept using examples. To a large extent, it eliminates the need of hand-crafting objective functions for various computer vision problems. In this tutorial, we will present an overview of generative adversarial network research. We will cover several recent theoretical studies as well as training techniques and will also cover several vision applications of generative adversarial networks.

Tutorial on Theory and Application of Generative Adversarial Networks

MLReview

Docker Compose is the last piece of the orchestration puzzle. After provisioning Docker daemons on any host in any location with Docker Machine and clustering them with Docker Swarm, users can employ Docker Compose to assemble multi-container distributed apps that run on top of these clusters. The first step to employing Docker Compose is to use a simple YAML file to declaratively define the desired state of the multi-container app: containers: web: build: . command: python app.py ports: - "5000:5000" volumes: - .:/code links: - redis environment: - PYTHONUNBUFFERED=1 redis: image: redis:latest command: redis-server --appendonly yes This example shows how Docker Compose takes advantage of existing containers. Specifically, in this simple two-container app declaration, the first container is a Python app built each time from the Dockerfile in the current directory. The second container is built from the redis Official Repo on the Docker Hub Registry. The links directive declares that the Python app container is dependent on the redis container. Not that it’s defined, starting your app is as easy as … % docker up With this single command, the Python container is automatically built from its Dockerfile and the redis container is pulled from the Docker Hub Registry. Then, thanks to the links directive expressing the dependency between the Python and redis containers, the redis container is started *first*, followed by the Python container. Docker Compose is still a work-in-progress and we want your help to design it. In particular, we want to know whether or not you think this should be a part of the Docker binary or a separate tool. Head over to the proposal on GitHub to try out an alpha build and have your say. Coda All this is just the briefest introduction to Docker Machine, Docker Swarm, and Docker Compose. We hope you’ll take a moment to try them out and give us feedback – these projects are moving quickly and we welcome your input! We also wish to thank the many community members who have contributed their experience, feedback, and pull requests during the pre-Alpha iterations of these projects. It’s thanks to you that we were able to make so much progress so quickly, and in the right direction. Distributed apps offer many benefits to users – portability, scalability, dynamic development-to-deployment acceleration – and we’re excited by the role the Docker platform, community, and ecosystem are playing in making these apps easier to build, ship, and run. We’ve got a ways to go, but we’re psyched by this start – join us and help us get there faster!

Docker Compose by Aanand Prasad

Docker, Inc.

Introduction to Cypher

Neo4j

Training Week: Create a Knowledge Graph: A Simple ML Approach

Neo4j

Join the Altinity experts as we dig into ClickHouse sharding and replication, showing how they enable clusters that deliver fast queries over petabytes of data. We’ll start with basic definitions of each, then move to practical issues. This includes the setup of shards and replicas, defining schema, choosing sharding keys, loading data, and writing distributed queries. We’ll finish up with tips on performance optimization. #ClickHouse #datasets #ClickHouseTutorial #opensource #ClickHouseCommunity #Altinity ----------------- Join ClickHouse Meetups: https://www.meetup.com/San-Francisco-... Check out more ClickHouse resources: https://altinity.com/resources/ Visit the Altinity Documentation site: https://docs.altinity.com/ Contribute to ClickHouse Knowledge Base: https://kb.altinity.com/ Join the ClickHouse Reddit community: https://www.reddit.com/r/Clickhouse/ ---------------- Learn more about Altinity! Site: https://www.altinity.com LinkedIn: https://www.linkedin.com/company/alti... Twitter: https://twitter.com/AltinityDB

Deep Dive on ClickHouse Sharding and Replication-2202-09-22.pdf

Altinity Ltd

Quand utiliser MongoDB … Et quand vous en passer…

MongoDB

Relationships are highly predictive of behavior. Graph technology abstracts connections in our data so businesses can apply relationships and network structures to make better predictions. Hear about the journey from graph analytics and machine learning to graph-enhanced AI. We’ll also cover how enterprises are using graph data science in areas such as fraud, targeted marketing, healthcare, and recommendations.

Leveraging Graphs for Artificial Intelligence and Machine Learning - Phani Da...

Neo4j

Introduction to MongoDB.pptx

Surya937648

ontop: A tutorial

Mariano Rodriguez-Muro

Introduction to HiveQL

kristinferrier

MapReduce

Amir Payberah

Alexys will explain how Scylla shard-aware drivers are implemented and why Scylla benefits from them. Taking the Python shard-aware driver as an example, Alexys will demonstrate how recent shard-aware drivers can leverage the new shard allocation algorithm that Scylla 4.3 brings to the table, and how to make use of it from a developer or administrator point of view. Alexys will showcase benefits from real production graphs observed at Numberly.

Getting the Scylla Shard-Aware Drivers Faster

ScyllaDB

Introduction to docker and docker compose

Lalatendu Mohanty

Kubernetes presentation

GauranG Bajpai

Getting Started with Knowledge Graphs

Peter Haase

Introduction to MongoDB

NodeXperts

Federated Engine 실무적용사례

I Goo Lee

Graph and RDF databases

Nassim Bahri

In this talk we will discuss how to build and run containers without root privileges. As part of the discussion, we will introduce new programs like fuse-overlayfs and slirp4netns and explain how it is possible to do this using user namespaces. fuse-overlayfs allows to use the same storage model as "root" containers and use layered images. slirp4netns emulates a TCP/IP stack in userland and allows to use a network namespace from a container and let it access the outside world (with some limitations). We will also introduce Usernetes, and how to run Kubernetes in an unprivileged user namespace https://sched.co/Jcgg

Rootless Containers

Akihiro Suda

Was ist angesagt? (20)

Polyglot Persistence - Two Great Tastes That Taste Great Together

Tutorial on Theory and Application of Generative Adversarial Networks

Docker Compose by Aanand Prasad

Introduction to Cypher

Training Week: Create a Knowledge Graph: A Simple ML Approach

Deep Dive on ClickHouse Sharding and Replication-2202-09-22.pdf

Quand utiliser MongoDB … Et quand vous en passer…

Leveraging Graphs for Artificial Intelligence and Machine Learning - Phani Da...

Introduction to MongoDB.pptx

ontop: A tutorial

Introduction to HiveQL

MapReduce

Getting the Scylla Shard-Aware Drivers Faster

Introduction to docker and docker compose

Kubernetes presentation

Getting Started with Knowledge Graphs

Introduction to MongoDB

Federated Engine 실무적용사례

Graph and RDF databases

Rootless Containers

Ähnlich wie OrientDB Distributed Architecture v2.0

OrientDB and Hazelcast

Luca Garulli

OrientDB uses Hazelcast to achieve a distributed configuration with multi-master replication. By using these together you can scale up horizontally by adding new servers without stopping or reconfigure the cluster. In this webinar, you’ll be introduced to OrientDB and how it compares to other NoSQL DBMS. You will also learn how and why Hazelcast is being used with OrientDB to achieve scale, elasticity and performance. Both Hazelcast and Orient Technologies are providing professional open source support to their respective projects under the Apache software license.

OrientDB & Hazelcast: In-Memory Distributed Graph Database

Hazelcast

Scale Out Your Graph Across Servers and Clouds with OrientDB

Luca Garulli

Accelerate Reed-Solomon coding for Fault-Tolerance in RAID-like system

Shuai Yuan

Best Practices for Building Open Source Data Layers

IBMCompose

352-001-Exam-ADVDESIGN

KylieJonathan

ScaleIO : capitalisez sur vos infrastructures existantes avec une solution so...

RSD

Best practices for long-term support and security of the device-tree

Alison Chaiken

OpenSlava Infrastructure Automation Patterns

Antons Kranga

IBM recently announced SMCv2 for SMC-Dv2. SMCv2 defines Shared Memory Communications for TCP/IP connections that span multiple IP subnets. This presentation will introduce how this new capability applies to SMC-Dv2 for z/OS V2R4 and ISMv2 for the IBM z15. The key concepts of the SMC-Dv2 will be introduced along with an overview of how to get started using the new solution with z/OS 2.4. The overview will also cover exploitation and configuration considerations for existing SMC-D users and for new SMC-Dv2 only users. In this presentation, customers will learn about this new capability and how this capability can extend the performance benefits of SMC-D to additional System Z workloads.

Introduction to IBM Shared Memory Communications Version 2 (SMCv2) and SMC-Dv2

zOSCommserver

EMC ScaleIO Overview

walshe1

Deview 2013 rise of the wimpy machines - john mao

NAVER D2

Drbd9 and drbdmanage_june_2016

Philipp Reisner

AWS Meetup Paris - Short URL project by Pernod Ricard

Charles Rapp

Xiv svc best practices - march 2013

Jinesh Shah

200-301-demo.pdf

CiscoExamDumpsarticl1

How is this newsletter going to help you? Apart from providing you with a brief glimpse of the test’s topics and shape, we are able to additionally assist you discover efficient education substances. Cisco’s internet site is a extraordinary starting point, but you shouldn’t restriction your self to it. Despite the fact that you would possibly have by no means heard approximately them, you have to attempt exam dumps as they may grow to be your secret tool to get a passing rating in 2 hundred-301 assessment. But now, let’s start with the exam details.

Cisco 200-301 Exam Dumps

CiscoExamDumpsarticl2

Cisco 200-301 Exam Dumps

CiscoExamDumpsarticl

Massively Parallel RISC-V Processing with Transactional Memory

Netronome

GumGum relies heavily on Cassandra for storing different kinds of metadata. Currently GumGum reaches 1 billion unique visitors per month using 3 Cassandra datacenters in Amazon Web Services spread across the globe. This presentation will detail how we scaled out from one local Cassandra datacenter to a multi-datacenter Cassandra cluster and all the problems we encountered and choices we made while implementing it. How did we architect multi-region Cassandra in AWS? What were our experiences in implementing multi-datacenter Cassandra? How did we achieve low latency with multi-region Cassandra and the Datastax Driver? What are the different Cassandra use cases at GumGum? How did we integrate our Cassandra with Spark?

GumGum: Multi-Region Cassandra in AWS

DataStax Academy

Ähnlich wie OrientDB Distributed Architecture v2.0 (20)

OrientDB and Hazelcast

OrientDB & Hazelcast: In-Memory Distributed Graph Database

Scale Out Your Graph Across Servers and Clouds with OrientDB

Accelerate Reed-Solomon coding for Fault-Tolerance in RAID-like system

Best Practices for Building Open Source Data Layers

352-001-Exam-ADVDESIGN

ScaleIO : capitalisez sur vos infrastructures existantes avec une solution so...

Best practices for long-term support and security of the device-tree

OpenSlava Infrastructure Automation Patterns

Introduction to IBM Shared Memory Communications Version 2 (SMCv2) and SMC-Dv2

EMC ScaleIO Overview

Deview 2013 rise of the wimpy machines - john mao

Drbd9 and drbdmanage_june_2016

AWS Meetup Paris - Short URL project by Pernod Ricard

Xiv svc best practices - march 2013

200-301-demo.pdf

Cisco 200-301 Exam Dumps

Massively Parallel RISC-V Processing with Transactional Memory

GumGum: Multi-Region Cassandra in AWS

Kürzlich hochgeladen

Scaling API-first – The story of a global engineering organization

Radu Cotescu

The Raspberry Pi 5 was announced on October 2023. This new version of the popular embedded device comes with a new iteration of Broadcom’s VideoCore GPU platform, and was released with a fully open source driver stack, developed by Igalia. The presentation will discuss some of the major changes required to support this new Video Core iteration, the challenges we faced in the process and the solutions we provided in order to deliver conformant OpenGL ES and Vulkan drivers. The talk will also cover the next steps for the open source Raspberry Pi 5 graphics stack. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://eoss24.sched.com/event/1aBEx

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Igalia

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

With more memory available, system performance of three Dell devices increased, which can translate to a better user experience Conclusion When your system has plenty of RAM to meet your needs, you can efficiently access the applications and data you need to finish projects and to-do lists without sacrificing time and focus. Our test results show that with more memory available, three Dell PCs delivered better performance and took less time to complete the Procyon Office Productivity benchmark. These advantages translate to users being able to complete workflows more quickly and multitask more easily. Whether you need the mobility of the Latitude 5440, the creative capabilities of the Precision 3470, or the high performance of the OptiPlex Tower Plus 7010, configuring your system with more RAM can help keep processes running smoothly, enabling you to do more without compromising performance.

Boost PC performance: How more available memory can improve productivity

Principled Technologies

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

A Call to Action for Generative AI in 2024

Results

Heather Hedden, Senior Consultant at Enterprise Knowledge, presented “The Role of Taxonomy and Ontology in Semantic Layers” at a webinar hosted by Progress Semaphore on April 16, 2024. Taxonomies at their core enable effective tagging and retrieval of content, and combined with ontologies they extend to the management and understanding of related data. There are even greater benefits of taxonomies and ontologies to enhance your enterprise information architecture when applying them to a semantic layer. A survey by DBP-Institute found that enterprises using a semantic layer see their business outcomes improve by four times, while reducing their data and analytics costs. Extending taxonomies to a semantic layer can be a game-changing solution, allowing you to connect information silos, alleviate knowledge gaps, and derive new insights. Hedden, who specializes in taxonomy design and implementation, presented how the value of taxonomies shouldn’t reside in silos but be integrated with ontologies into a semantic layer. Learn about: - The essence and purpose of taxonomies and ontologies in information and knowledge management; - Advantages of semantic layers leveraging organizational taxonomies; and - Components and approaches to creating a semantic layer, including the integration of taxonomies and ontologies

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Enterprise Knowledge

Histor y of HAM Radio presentation slide

vu2urc

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

Presentation on how to chat with PDF using ChatGPT code interpreter

naman860154

Real Time Object Detection Using Open CV

Khem

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

Tata AIG General Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

🐬 The future of MySQL is Postgres 🐘

RTylerCroy

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

Microsoft's Threat Matrix for Kubernetes helps organizations understand the attack surface a Kubernetes deployment introduces to their environments. This ensures that adequate detections and mitigations are in place. By covering over 40 different attacker techniques, defenders can learn about Kubernetes-specific mitigations and controls to deploy to their environments. In this session, we will explore the MS-TA9013 Host Path Mount technique, which is commonly used by attackers to perform privilege escalation in a Kubernetes cluster. Attendees will learn how attackers and defenders can: * Escape the container's host volume mount to gain persistence on an underlying node * Move laterally from the underlying node into the customer's cloud environment * Analyze Kubernetes audit logs to detect pods deployed with a hostPath mount * Deploy an admission controller that prevents new pods from using a hostPath mount

Breaking the Kubernetes Kill Chain: Host Path Mount

Puma Security, LLC

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Rafal Los

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

GenCyber Cyber Security Day Presentation

Michael W. Hawkins

Kürzlich hochgeladen (20)

Scaling API-first – The story of a global engineering organization

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Boost PC performance: How more available memory can improve productivity

Data Cloud, More than a CDP by Matt Robison

A Call to Action for Generative AI in 2024

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Histor y of HAM Radio presentation slide

How to Troubleshoot Apps for the Modern Connected Worker

Axa Assurance Maroc - Insurer Innovation Award 2024

Presentation on how to chat with PDF using ChatGPT code interpreter

Real Time Object Detection Using Open CV

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Tata AIG General Insurance Company - Insurer Innovation Award 2024

🐬 The future of MySQL is Postgres 🐘

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

Breaking the Kubernetes Kill Chain: Host Path Mount

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Boost Fertility New Invention Ups Success Rates.pdf

GenCyber Cyber Security Day Presentation

OrientDB Distributed Architecture v2.0

1. Distributed DBMS

2. Short history ! In 2012, we had a Master/Slave replication ! While it scaled up well on reads, users complained of a single Master node bottleneck It’s quite easy to scale up reads, the hard part is to scale up both reads and writes Copyright (c) - Orient Technologies LTD 2

3. How Master/Slave works Copyright (c) - Orient Technologies LTD 3 C C C Master Node Slave Node Slave Node Writes Master node is the bottleneck

4. Master/Slave ! PROS: - Relatively easy to develop ! CONS: - The master is the bottleneck for writes - No matter how many servers you have, the throughput is limited by the Master node Copyright (c) - Orient Technologies LTD 4

5. What happened to OrientDB's M/S architecture? This is the old MASTER/SLAVE replication Copyright (c) - Orient Technologies LTD 5

6. 2012: new architectural goals Multi-Master: all the nodes must accept writes Sharding: split data in multiple partitions Better Fail-Over Simplified configuration with Auto-Discovery Copyright (c) - Orient Technologies LTD 6

7. Auto-Discovery C Master Node I’m the only one! Copyright (c) - Orient Technologies LTD 7

8. Auto-Discovery Connected! C Master Node Master Node Copyright (c) - Orient Technologies LTD 8

9. Clients see the distributed configuration C Master Node updated distributed configuration is broadcasted to all the connected clients Master Node Copyright (c) - Orient Technologies LTD 9

10. Auto-reconnect in case of failure In case of failure, the clients auto-reconnect to C C the available nodes Master Node Master Node Copyright (c) - Orient Technologies LTD 10

11. Auto-deploy of databases automatically deployed C to the new joining Master Node C Master Node DB are nodes C C DB DB Copyright (c) - Orient Technologies LTD 11

12. Classes rely on Cluster to store records 1 class -> 1 cluster Class Customer customer By default Cluster Copyright (c) - Orient Technologies LTD 12

13. Classes can be split into more clusters Customer customer_usa Class multiple clusters and assign them to customer_china Define each node Cluster Cluster customer_europe Cluster Copyright (c) - Orient Technologies LTD 13

14. Assign 1 cluster per Node Master Node Customer Master Node Master Node customer_usa customer_europe customer_china Copyright (c) - Orient Technologies LTD 14

15. Copyright (c) - Orient Technologies LTD What about sharing + replication? ! We used a solution similar to RAID for HardDrives 15

16. RAID for databases Replica factor = 2 Master Node Customer Master Node Master Node customer_usa customer_europe customer_china customer_china customer_usa customer_europe Copyright (c) - Orient Technologies LTD 16

17. RAID for databases Replica factor = 3 Master Node Master Node Each node owns all customers Master Node customer_usa customer_europe customer_china customer_customer_china usa customer_europe customer_europe customer_china customer_usa Copyright (c) - Orient Technologies LTD 17

18. Replication: under the hood Client sends an INSERT request HZ Queue Requests Master Node HZ Queue Master Node HZ Queue Master Node C INSERT Copyright (c) - Orient Technologies LTD 18

19. Replication: under the hood HZ Queue Response handling Requests Master Node HZ Queue Master Node HZ Queue WriteQuorum = 2 Sends OK Master Node C HZ Queue HZ Queue HZ Queue OK Responses Copyright (c) - Orient Technologies LTD 19

20. Replication: under the hood Fix the unaligned node HZ Queue Requests Master Node HZ Queue Master Node HZ Queue Master Node HZ Queue HZ Queue HZ Queue Responses Fix Copyright (c) - Orient Technologies LTD 20

21. Linear and Elastic scalability C Master Node C on both read & writes! Master Node C C Master Node C C C C Master Node C C C C Master Node C C C Master Node C C C Master Node C C Copyright (c) - Orient Technologies LTD 21

22. Hazelcast’s role Auto-Discovering (Multicast/TCP-IP/Amazon) Queues for requests and responses Store metadata in distributed Maps Distributed Locks Copyright (c) - Orient Technologies LTD 22

23. OrientDB’s Future Roadmap OrientDB 2.0 (Sept 2014) has even better performance: +300% improvement on all the distributed operations Pluggable conflict resolution strategy Auto-discovery also by Clients Copyright (c) - Orient Technologies LTD 23

OrientDB Distributed Architecture v2.0

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie OrientDB Distributed Architecture v2.0

Ähnlich wie OrientDB Distributed Architecture v2.0 (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

OrientDB Distributed Architecture v2.0