Short intro on Graphite and StatsD for Arch-Meetup

1. Graphite
A quick look at Graphite and StatsD
Adrian Moisey
Yola
Operations Engineer

2. All these things!
What are they?
Sta o n
t sD rb
Ca
ra p hene
Gr G
er
ap is p
hi t h Gdash
e W

3. A quick diagram:
StatsD Carbon Whisper
Graphite
http://dashboard/

4. A quick diagram:
StatsD

5. StatsD
network daemon
listens for statistics: counters or timers
over UDP
aggregates them and sends them to carbon

6. StatsD
Python:
import socket
sock = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)
sock.sendto("myapp.signups:1|c", ("graphite.example.com", 8125))

7. StatsD
Bash:
echo "myapp.signups:1|c" | nc -w 1 -u graphite.example.com 8125

8. StatsD
Or use something else:
Ruby - https://github.com/dawanda/statsd-client
Django - https://github.com/andymckay/django-statsd
Java - https://github.com/youdevise/java-statsd-client
PHP - https://github.com/seejohnrun/php-statsd
.net - https://github.com/ragnard/Graphite.NET
(I just googled for these)

9. A quick diagram:
StatsD Carbon

10. Carbon
network daemon
listens for statistics
over TCP
Stores them on disk using Whisper

11. A quick diagram:
StatsD Carbon Whisper

12. Whisper
fixed size database
RRD-like
fast and reliable store of numeric data

13. A quick diagram:
StatsD Carbon Whisper
Graphite

14. Graphite
http://graphite.yola.net/render/?
width=586&height=308&&target=diamond.net.yol
a.inet.prod.infra1.loadavg.01&target=diamond.ne
t.yola.inet.prod.infra1.loadavg.05&target=diamon
d.net.yola.inet.prod.infra1.loadavg.15
Hard to read?

15. Graphite
http://graphite.yola.net/render/
width=586
height=308
target=diamond.net.yola.inet.prod.infra1.loadavg.01
target=diamond.net.yola.inet.prod.infra1.loadavg.05
target=diamond.net.yola.inet.prod.infra1.loadavg.15

16. Graphite

17. Graphite
Lets make it prettier!

18. Graphite
http://graphite.yola.net/render/
Width=586
Height=308
title=infra1 – load average
vtitle=load
from=-30hours
target=alias(diamond.net.yola.inet.prod.infra1.loadavg.01,”1min”)
target=alias(diamond.net.yola.inet.prod.infra1.loadavg.05,”5min”)
target=alias(diamond.net.yola.inet.prod.infra1.loadavg.15,”15min”)

19. Graphite

20. Graphite

21. Graphite

22. Graphite
movingAverage(seriesList, windowSize)

23. Graphite

24. Graphite
integral(seriesList)

25. Graphite
http://graphite.yola.net/render/
width=586
Height=308
target=color(drawAsInfinite(stats.deploys.qa.qa.*),”red”)
target=alpha(color(stacked(diamond.net.yola.inet.qa.memor
y.Active),”orange”)%,0.7)

26. Graphite

27. A quick diagram:
StatsD Carbon Whisper
Graphite
http://dashboard/

28. Dashboards!

29. Dashboards!