Got logs? With so much technology powering your business, you need tools to help you identify problems and analyze past behavior. Apache 2.0-licensed Elasticsearch ELK stack is here to help you process, store, and visualize any kind of logging data, in real time, from any source imaginable! Log management seems so boring. Log rotation, retention policy, grep, yuck! What are your servers are doing? Did last night's upgrade break anything? How your users are interacting with your products? Why did the site go down last weekend? Get ready to turn your log pains into awesome visual insights and more! BAM! Elasticsearch ELK! ELK stands for Elasticsearch, Logstash, and Kibana. Each of these three are lovely, open source projects that, together, give you and your business log management superpowers. This talk will primarily be done in three parts: open source and community, technology, and use cases. * The first part will introduce each project and its success as open source software, most notably through supportive and open communities. * The second part will discuss the each project and the problems solved. * The third (and most exciting!) part will highlight a variety of use cases and problem that real humans are using Elasticsearch ELK to solve. Live demos of some use cases will be provided. Attendees will leave the presentation totally full of excitement about this toolset and bursting with fresh ideas about how to tackle their sour logging problems.

1. Logstash
find happiness in your logs
with Elasticsearch ELK

2. Open Source

3. Apache 2.0 License
Open Source

4. Open and Friendly
Community
Open Source

5. If a new user has a bad time,
it’s a bug.
Open Source

6. Technology

7. Logstash

8. Processing &
Transport
Logstash

9. Logstash
FiltersInputs Outputs
42 51 54
Processing & Transport

10. Logstash Processing & Transport
LAMP Example
Apache
Mysql
PHP
Syslog
Nagios
Elasticsearch
Graphite
IRC
Parse: Latency,
Bandwidth,
and Errors
Load Balancer

11. Logstash Example Inputs
Files
Graphite
SNMPEmail
Syslog
TwitterTCP
RabbitMQ

12. Logstash Example Filters
Grok
Date
FingerprintGeoIP
Multiline
User Agent
Key-Value

13. Logstash Example Outputs
Elasticsearch
Graphite
XMPP
Nagios
Email Pagerduty
S3

14. Elasticsearch

15. Near Real-Time
Search & Analysis
Elasticsearch

16. Scalable
Elasticsearch

17. REST + JSON API
Elasticsearch

18. Kibana

19. Visualization &
Exploration
Kibana

21. Use Cases

22. Share Logs with Your
Tech Support Team
Use Cases

23. Graph all things!
Use Cases

24. Exploration by Non-
Technical Users
Use Cases

25. Troubleshooting Latency
?
Latency
Time
X

26. Movie Releases Demo
Use Cases

27. Apache Logs Demo
Use Cases