1. Rolling Updates: Database
Version Migrations with
minimum Disruption
Anton Kovalenko,
YDB TPM

2. 2
1 2
Rolling
update
YDB Layered
Architecture
3 4
Rolling update:
YDB way
Availability
and Hardware
Failures
Agenda

3. 3
YDB — Open-Source
Distributed SQL
Database
• Relational
ACID OLTP transactions
• Consistency
Strongly consistent
Serializable transaction isolation level
• Mission critical database
Works for projects with 24x7 requirements
• Highly available
Survives AZ plus rack failure w/o human
intervention, available for read/write

4. 4
Users operate tables
to read and write data
• Tables have a primary key (PK)
• Tables are sorted by PK
• Tables could grow up
to petabytes of data
• Tables are automatically
partitioned
Row 1
Row 2
…
Row N
Column 1 Column 2 … Column N
Primary key
Partition 1
…
Partition N
Split point

5. 7
Every software requires update
Single DB server
App1 App2
DB Cluster
App1 App2 App4
App3
DB Node DB Node 1 DB Node 2 DB Node 3

6. 8
What is rolling update
App1 App2
Compute Node 2 Compute Node 3
App3
Compute Node 1

7. 9
1 2 3
Minimize
error rate
Keep read
and write
availability
Minimize latency
degradation
Rolling update challenges are

8. 10
YDB Architecture
application layer
User Application
Tablet
YDB SDK
Compute Layer
gRPC Proxies
Query Processor
Distributed Transactions
User tablets
Tablet
…
Tablet
System tablets
Tablet
…
Storage Layer
Distributed Storage
Internal cluster network

9. 11
YDB SDK hides the complexity
Compute Node 1
App1 App2
Compute Node 2 Compute Node 3
App3

10. 12
1 2 3
Compute
YDB SDK Distributed Storage
YDB Layers

11. 13
YDB storage availability model
NVME
Storage server 1
NVME NVME NVME
Storage server 2
NVME NVME NVME
Storage server 3
NVME NVME
AZ1 AZ2 AZ3

12. 14
YDB storage availability model
vdisk 1
AZ1
vdisk 2 vdisk 3 vdisk 4
AZ2
vdisk 5 vdisk 6 vdisk 7
AZ3
vdisk 8 vdisk 9
Compute Node 1

13. 15
Compute node can
run on any cluster node
Storage Layer
BlobStorage Component
Internal cluster network
Compute
node 1
Compute
node 2
Compute
node 3
Compute
node 4
Compute
node 5
DbName = DB2
DbName = DB1

14. 16
Compute node restart
causes transient errors
Compute
node 1
Compute
node 2
Compute
node 3
Compute
node 4
Compute
node 5
Compute
node 6
App1 App2 App3
AZ1 AZ2 AZ3

15. 17
1 2 3
Minimize
error rate
Keep read
and write
availability
Minimize latency
degradation
Rolling update
is a challenging task

16. 18
Restart storage nodes one by one
AZ1 AZ2 AZ3
Compute
node 100
Rolling restart tool
Storage server 1
Compute
node 101
Compute
node 102
Storage server 2
Compute
node 103
Compute
node 104
Storage server 3
Compute
node 105

17. 19
YDB helps to restart storage
Rolling
restart
tool
4: list of nodes safe to restart
Storage restart constraints
• Keep read and right availability
• Restart as fast as possible
Large cluster restart is long
• 1 node restarts about 10s
• 1k node cluster restart 3h
YDB
Cluster
Management
System
3: request for restart
2: token + list of all nodes
1: restart storage nodes

18. 20
CMS controls compute restarts
Rolling
restart
tool
Compute restart constraints
• Keep enough resources
• Restart as fast as possible
Restart multiple databases
• Databases are independent
• Different databases could be restarted
simultaneously
YDB
Cluster
Management
System
4: list of nodes safe to restart
3: request for restart
2: token + list of all nodes
1: restart compute nodes for some databases

19. 21
CMS allows
to keep availability
Cluster Management System
• YDB Component
• Protects cluster
from unavailability
• Enables restart orchestration

20. 22
Minimize user
operations disruption
Compute node 102
Tablet
Tablet
Tablet
App1
UNAVAILABLE
select name from product where id = 'ydb';
Compute node 101
Tablet
Tablet
Tablet

21. 23
Minimize user operations
disruption
Compute
node 1
Compute
node 2
Compute
node 3
Compute
node 4
Compute
node 5
Compute
node 6
App1 App2 App3
AZ1 AZ2 AZ3

22. 24
Compute node restart
causes errors
Unavailable
Bad session

23. 25
Graceful tablets evacuation
Tablet
AZ1 AZ2 AZ3
Compute
Node 100
Tablet
Tablet
Tablet
Tablet
Compute
Node 101
Tablet
Tablet
Tablet
Rolling restart tool
Tablet
Compute
Node 102
Tablet
Tablet
Tablet
Tablet
Compute
Node 103
Tablet
Tablet
Tablet
Tablet
Compute
Node 104
Tablet
Tablet
Tablet
Tablet
Compute
Node 105
Tablet
Tablet
Tablet
SIGSTOP

24. 26
Graceful session evacuation
Tablet
Tablet
Tablet
Tablet
Tablet
Compute
Node 101
Tablet
Tablet
Tablet
Tablet
Compute
Node 102
Tablet
Tablet
Tablet
Tablet
Compute
Node 103
Tablet
Tablet
Tablet
Tablet
Compute
Node 104
Tablet
Tablet
Tablet
Tablet
Compute
Node 105
Tablet
Tablet
Tablet
SIGSTOP
YDB App
x-ydb-server-hints: session-close
Rolling restart tool
AZ1 AZ2 AZ3
Compute
Node 100

25. 27
• Cluster Management System
Tracks availability
Speeds-up restart
• Session and tablets evacuation
Reduces errors
YDB solves
challenges

26. 28
• PostgreSQL wire and syntax
compatibility (C++)
To simplify migration of our users
we make PostgreSQL compatibility
• OLAP engine (C++)
We build OLAP engine
to improve analytical experience
• Column-organized tables (C++)
We make column-organized tables
to improve performance of analytical queries
• K8S deployment (Go)
We make our own k8s operator to make
it easyto deploy our database
in a cloud environment
Current
challenges

27. 29
It’s easy
to try YDB
ydb.tech
• Managed service in Nebius Cloud
• On premise deployment options

28. Thank you!
Anton Kovalenko
kovalad@ydb.tech
Join our telegram chat t.me/ydb_en