Project Voldemort, Distributed database management system developed by LinkedIn and inspired by Amazon's DynamoDb. the presentation is more inclined towards aesthetics and depends on the presenters for information and might not create a lot of text.

1. Aaron Cullen
Benjamin Kelly
Eoin O Neill
Gioacchino Castorio
Shivam Sachdeva

2.  Linkedin’s Problem
 Voldemort
 Read only system
 Applications
 Problems
 Testing
 Other Systems
Structure

3. LINKEDINS
PROBLEM

4. INTRO TO
LORD
VOLDEMORT

5. READ ONLY SYSTEM FOR VOLDEMORT
Data partitioning
Indexing
Bulk loading process
Roll back capability
R.

6. DATA PARTITIONING
P 11
N 2
P 0
N 0
P 1
N 1
P 2
N 2
P 3
N 0
P 4
N 1
P 5
N 2
P 6
N 0
P 7
N 1
P 8
N 2
P 9
N 0
P 10
N 1
P = Partition
N = Node
MD5 Key

7. INDEXING
Key Size Key Value8 Bytes Offset Collided
Tuples
Data fileIndex file
8 4 2 4 4

8. BULK-LOADING
Driver
Program
Hadoop
HDFS
cluster
Parallel Fetch
Trigger Fetch
Trigger Swap
Trigger Build
Swap
Build

9. Update Corrupted
data
Roll-Back
ROLL-BACK

10. APPLICATIONS OF THE SYSTEM
LinkedIn
Gilt.com Voldemort for its cart and checkout
Nokia, E Harmony etc.
A

11. FEATURES USED BY LINKEDIN
People you may know
Skills
Company Follow
LinkedIn Share
A

12. PROBLEMS WITH THE SYSTEM
Java-only
eHarmony Issue
Node faults rebalancing
Roll-back problem

13. NODE FAULT REBALANCING
P 11
N 2
P 0
N 0
P 1
N 1
P 2
N 2
P 3
N 0
P 4
N 1
P 5
N 2
P 6
N 0
P 7
N 1
P 8
N 2
P 9
N 0
P 10
N 1
P = Partition
N = Node
MD5 Key
Node 0 Fails
X
X
X
X

14. Update Corrupted
data
Roll-Back
ROLL-BACK PROBLEM

15. TESTING
AGAINST
MYSQL
Upload Time Latency

16. OTHER SYSTEMS

17. TESTING WITH OTHER SYSTEMS
Tilmann Rabl; Mohammad Sadoghi ; Hans-Arno Jacobsen. “Solving Big Data Challenges for Enterprise Application
Performance Management”

18. Why the name
“ ”?

19. References
• Rabl, Tilmann; Sadoghi, Mohammad; Jacobsen, Hans-
Arno; Gómez-Villamor, Sergio; Muntés-Mulero, Victor;
Mankovskii, Serge (August 2012). "Solving Big Data
Challenges for Enterprise Application Performance
Management“
• Hua Feng, (August 22, 2012). “Benchmarking the
suitability of key-value stores for distributed scientific
data ”
• Medallia, Diego Erdody. “Choosing a key-value storage
system (Cassandra vs. Voldemort)”
• LinkedIn, Roshan Sumbaly; Jay Kreps; Lei Gao; Alex
Feinberg ;Chinmay Soman; Sam Shah, “Serving Large-
scale Batch Computed Data with Project Voldemort”
• Tilmann Rabl; Mohammad Sadoghi ; Hans-Arno
Jacobsen. “Solving Big Data Challenges for Enterprise
Application Performance Management”

20. Questions?