Slides from a talk during the Elastic Manchester Meetup on 2016-07-28

1. SERVERLESS LOGGING WITH
ELK
Edoardo Paolo Scalafiotti - Software Engineer @ Sainsbury’s

3. About me
Go, NodeJS
SPAs, WebComponents
Material Design
Serverless Architecture
Microservices
Machine Learning
FabLab, Meetups

4. Agenda
OVERVIEW
WHY SERVERLESS?
CHALLENGES
USE CASES
DEMO
Q & A

5. WHAT IS SERVERLESS?

6. TL;DR
FaaS is about running back end code without
managing your own server systems or your own
server applications

7. applications that run in stateless compute
containers that are event-triggered,
ephemeral and fully managed by a 3rd party

8. ● 2 overlapping areas: BaaS and PaaS
● run code without provisioning or managing
servers
● horizontal scaling is completely automatic,
elastic, and managed by the provider
● responds to triggers

10. WHY SHOULD WE CARE?

11. serverless is
HOT!

12. Typical servers in business and enterprise data
centers deliver between 5 and 15 percent of
their maximum computing output on average
over the course of the year

13. ● Reduced operational cost
● Good with irregular, high spike traffic that
cannot be handled by auto-scaling
● Promotes best coding practises

14. WHAT ARE THE CHALLENGES?

15. TL;DR
not for the faint-hearted... at the moment

16. ● Ugly hacks for keeping the function alive
● Vendor lock-in
● Unit testing is ok, integration... another story
● Repetition of logic
● Concurrent limit
● Logging, Monitoring and Debugging

17. USE CASES

18. USE WISELY
FaaS, containers and VMs are not enemies

19. FAAS is seen as a better choice for
event-driven apps with few event types per
application component,
while CONTAINERS are seen as a better choice
for synchronous-request driven components
with many entry points

20. VM Containers Serverless
Configure
machines,
storage,
networking and
OS
Run servers,
configure
applications and
control scaling
Run my code
when it’s
needed

21. Use cases:
● Real-time file processing (ingestion)
● Real-time stream processing (mkt. data)
● Extract, Transform, Load
● IoT Backends
● Mobile Backends
● RESTful APIs

22. ● Open Source alternative: IBM’s OpenWhisk
● API Orchestration: serverless.com and
claudia.js
● Multiple PL support: Apex
● Logging and monitoring: ELK

23. LET’S GET TO THE CODE...

24. THE MISSION
...is to monitor a set of Lambda-based
functions that generates
Game Of Thrones plot points

26. DEMO

27. github.com/edoardo849/lot