Presenters: Don Marti, Glauber Costa, and Dor Laor of Cloudius Systems The need for performance tuning of the JVM and OS is making administrators the bottleneck for Cassandra deployments--especially in virtual environments. Over the past two years, the OSv project has profiled tuning-sensitive applications with a special focus on Cassandra. Today, many of the important bottlenecks for NoSQL applications are tunable on a conventional OS, but do not require tuning in the OSv environment. OSv gives Cassandra a simpler environment, set up to run one application in a single address space. This talk will cover how to use OSv to improve performance in key areas such as JVM memory allocation and network throughput--without loading up your to-do list with difficult tuning tasks.

1. Cassandra on OSv
Dor Laor, Don Marti and Glauber Costa
Cloudius Systems

2. Become the best OS
powering virtual machines
in the cloud
Your App
OSv
Hypervisor
Hardware
Your App
OSv + JVM
Hypervisor
Hardware
OSv + JVM
Hypervisor
Hardware
OSv
Hypervisor
Hardware
Your App
OSv + JVM
Hypervisor
Hardware

4. [ 0.000] Status() {return PreBeta;}
[ 0.103] HR.count() { return pp(18);}
[ 0.217] countries.size() {return 9;}
[ 0.423] getOpenSourceExperience() {
ret list.add(KVM).add(Xen).add(containers);}
[ 0.735] Mission(){ret “write code that doesn’t suck”;}

5. Cassandra boot time on OSv

6. What is OSv?
Traditional Stack Thin OS
Java App
App Server
Hypervisor
Hardware
JVM
guest OS
C++ App
guest OS
App Server
OSv + JVM
Hypervisor
Hardware
Your App
Your App
OSv

9. Pimp my Memcached
Requests/s (higher is better)

10. Redis on Vitamins

11. Cassandra

12. Performance: Leave no stone unturned
Memory Huge pages, Heap vs Sys
I/O Zero copy, full aio, batching
Scheduling Lock free, low latency
Tuning Out of the box, auto
CPU Low cost ctx, Direct signals...

13. New TCP/IP Stack
Common kernel
network stack
Net Channel design:

14. Value Proposition II: Manageability

16. OSv management interface

21. Stateless root-fs
NO Tuning
NO State
NO Patching
4 VMs per sys
admin ratio

22. www.osv.io/Capstan:
VM build and deploy
● Docker-like config file
● Takes about 3 seconds to build
● Runs on any OS (written in Go)
cat Capstanfile
base: cloudius/osv-openjdk
cmdline: > /java.so -XX:+UseThreadPriorities -XX:+UseParNewGC -
XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -
XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 ...
org.apache.cassandra.service.CassandraDaemon
build: make

23. Deploying OSv at scale
OSV Cloud Init:
- Stateless
- Watch ma, no puppet/chef
- Single (external) file to rule them all
files:
/etc/config: |
my config
goes here
httpserver:
ssl: yes
port: 443
topology:
- dc_name: DC1
racks:
- rack_name: c1
nodes:
- broadcast_address: 1.2.3.4
dc_local_address: 5.6.7.8

24. Some more OSv Goodies
rest-api
Jolokia JVM
PaaS
approach for
runtimes
ZFS
snapshots
Ruby,
Node,
Scala,
more
Cloud Init
NewRelic
integ
JVM
Ballooning

25. ~20MB image size
Ideal for multi
tenants
70% better tcp latency
Stateless,
streamable config
Runs on virtualBox, kvm,
vmw, xen, ec2, gce
Public image repository

26. Thank you!
Try it! http://osv.io/
Run on public cloud
Follow @CloudiusSystems