Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2n1fqWa. Vinay Chella and Ioannis Papapanagiotou designed a benchmarking system for Netflix's Cloud platform that can mimic the performance of production use cases. They showcase how the deployment, management, and monitoring of multiple instances can be done from a single entry-point (UI). They also show how they integrated a benchmarking tool into their release lifecycle. Filmed at qconsf.com. Vinay Chella is a Cloud Data Architect at Netflix and Apache Cassandra MVP. Ioannis Papapanagiotou is a senior software engineer at Netflix’s Cloud Database Engineering team.

2. InfoQ.com: News & Community Site
• Over 1,000,000 software developers, architects and CTOs read the site world-
wide every month
• 250,000 senior developers subscribe to our weekly newsletter
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• 2 dedicated podcast channels: The InfoQ Podcast, with a focus on
Architecture and The Engineering Culture Podcast, with a focus on building
• 96 deep dives on innovative topics packed as downloadable emags and
minibooks
• Over 40 new content items per week
Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
ndbench-neflix-cloud-performance

3. Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide
Presented at QCon San Francisco
www.qconsf.com

4. Netflix Data Benchmark
(NDBench)

5. Circa end of 2015 AD

9. Netflix Data Benchmark
(NDBench)

10. Vinay Chella
Ioannis Papapanagiotou
Architects
Cloud Database Engineering @ Netflix

12. Databases and Caches

13. ● Tens of petabytes of data
● Trillions of ops / day
● Tens of Millions of replications / sec
● Tens of Thousands of servers
● Hundreds of microservice clients
Netflix Data Scale

14. Agenda
●
●
●
●
●

16. Our Needs
● Single benchmark framework for all data
stores/services
● Dynamic configuration while the test is running.
● Test a platform along with production microservices
● Integrate with other platform cloud services
● Pluggable patterns and loads
● Auto tunable framework
● Run infinite horizon tests

17. What is NDBench?

18. ●
●
●
●
NDBench allows

19. NDBench Features

20. Side-by-Side comparison

21. Varying Data Models

22. Different instance types

23. Heterogeneous service
comparison

24. Workload Patterns and Loads

25. Different Client APIs

26. Cloud Ecosystem integration
Cloud Discovery Properties Metrics

27. Agenda
●
●
●
●
●

28. Architecture
● Plugin: Adding Client
drivers
● Core: Workload generator
● Web: UI and the servlets

29. What is Pluggable?
•
•

30. Load Patterns
•
○
•
○

31. Configuring a cluster

32. Continuous Delivery Integration

38. NDBench exemplar
uses

39. C*

40. C* 7 to 8 (reads)

41. i2 vs i3 instance type

42. SSD Tuning

43. CMS vs G1GC for Cassandra

44. AMI Certification Process

45. Throughput Scalability

46. Latency

47. • Benchmarking Tool
• Integration Tests
• Deployment Validation
NDBench @ Netflix as ...

48. Auto-tuning
● Find the appropriate capacity that
the cluster can sustain
○ RPS/WPS
○ Number of documents
indexed/sec
● After X% of SLA violations,
NDBench stops stepping up the
load
○ Exponential backoff

49. Github: https://github.com/netflix/ndbench
Talk to us: https://gitter.im/Netflix/ndbench

50. Take away

51. Q & A
Vinay Chella - @vinaykchella
Ioannis Papapanagiotou - @ipapapa

53. Architecture
● Core: Workload
generator
● API: Adding plugins
● Web: UI and the
servlets

54. Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
ndbench-neflix-cloud-performance