Serverless architectures are attracting more and more interest from the IT professionals and companies hoping to lower the costs of creating and operating distributed systems without constant worrying about availability, scalability and capacity management. Despite all the attractive properties that serverless architectures offer, such systems still need to be comprehensively monitored to be effectively operated and maintain the expected quality of service and SLAs. In this talk, I will provide the overview of monitoring capabilities required by system built on the Serverless stack, discuss various AWS services that can be used to deliver such capabilities. I will cover everything from metering and logging to tracing, auditing and alerting. Additionally, I will share some top tips on how to monitor and optimise the spend on the cloud infrastructure as well as control and adjust provisioned capacity for the resources that use provisioned capacity model, like DynamoDB and Kinesis. Lastly, I will also offer some suggestions on how to supplement provider’s own solutions with bespoke extensions, built using the Serverless stack, to provide even more comprehensive monitoring.

1. MONITORING
SERVERLESS
ARCHITECTURES

2. @RafalGancarz
Your Manager
CAN YOU HELP WITH SOME PRODUCTION PROBLEMS?

3. (CC) Rachel Gardner

4. Rafal Gancarz
Lead Consultant @ OpenCredo
@RafalGancarz

5. @RafalGancarz
WHAT IS
SERVERLESS?

6. (CC) theaucitron

7. @RafalGancarz
Cloud-native

8. @RafalGancarz
PaaS?

9. @RafalGancarz
Serverless ≠ FaaS
FaasServerless

10. @RafalGancarz
Managed runtime

11. @RafalGancarz
WHY
SERVERLESS?

12. (CC) snapp3r

13. @RafalGancarz
Availability

14. @RafalGancarz
Scalability

15. @RafalGancarz
Economy

16. @RafalGancarz
Time to market

17. @RafalGancarz
Security

18. @RafalGancarz
Operability

19. @RafalGancarz
SERVERLESS
BUILDING BLOCKS

20. @RafalGancarz
AWS Lambda
Java, C#, NodeJS, Python
sync & async invocation
1 million invocations and 400k GB-s
free per month
$0.20 per 1 million requests and ~
$6.65 for 400k GB-s thereafter

21. @RafalGancarz
AWS API Gateway
security, caching, throttling
functions as API implementations
1 million requests free per month
$3.50 per 1 million requests and
$0.09/GB (for the first 10 TB, then
cheaper)

22. @RafalGancarz
AWS DynamoDB
document and key-value
function as triggered procedures
25 GB of storage and 25 units of read
capacity each month for free (~200k
requests per month)
$0.25 per GB/month and $0.0065 per
hour for 10 units of write capacity (36k
writes/hour) or 50 units of read capacity
(180k reads/hour)

23. @RafalGancarz
AWS S3
durable, available and scalable
functions as content processors
5 GB of storage and 15 GB of data
transfer out to Internet each month
for free
$0.03 per TB/month and $0.09 per
GB data transfer out to Internet

24. @RafalGancarz
AWS SNS
pub-sub, push notifications
functions as destinations
1m publishes, 1m mobile push
notifications, 1k emails, 100k HTTP
notifications and 1 GB of data transfer out
each month for free
$0.50 per 1m publishes, $0.60 per 1m
HTTP notifications and $0.09 per GB data
transfer out to the Internet

25. @RafalGancarz
AWS Kinesis Streams
pub-sub, persistent
functions as consumers
no free tier
$0.015 per shard/hour, $0.014 per
1m PUT payload units (25KB) +
extended retention charges
data transfer is free

26. @RafalGancarz
Other AWS services
SQS
Redshift
IoT
ElastiCache
CognitoSES
RDS
ElasticSearch
EMR
Batch
Route53CloudFront
Greengrass Button
Step Functions

27. (CC) Grégoire Lannoy
MONITORING

28. @RafalGancarz
AWS CloudWatch
scalable, managed
real-time monitoring
metrics, logs, alarms, events

29. (CC) Jérôme S
METRICS

30. @RafalGancarz
CloudWatch Metrics
retention: 1m (15 days), 5m (63 days),
1h (15 months)
basic monitoring (1m/5m) is free
10 metrics and 1 million API requests for
free each month
$0.30 per metric/month for the first 10k
metrics ($0.02 for metrics over 1M)
$0.01 for 1000 API requests

31. @RafalGancarz
AWS Lambda
Invocations
Errors
Dead Letter Errors
Duration
Throttles

32. @RafalGancarz
AWS API Gateway
4XX Error
5XX Error
Cache Hit Count
Cache Miss Count
Count
Integration Latency
Latency

33. @RafalGancarz
AWS DynamoDB
Provisioned Capacity Units Read/Write
Consumed Capacity Units Read/Write
Online Index Consumed Capacity/Progress/Throttling
Returned Bytes
Returned Item Count
Returned Records Count (Streams)
Successful Request Latency
Errors System/User
Conditional Check Failed Requests
Throttled Events Read/Write/Requests

34. @RafalGancarz
AWS S3
Bucket Size Bytes (daily)
Number Of Objects (daily)
All Requests
Get/Put/Delete/Head/Post/List Requests
Bytes Downloaded/Uploaded
Errors 4XX/5XX
First Byte Latency
Total Request Latency

35. @RafalGancarz
AWS SNS
Number Of Messages Published
Publish Size
Number Of Notifications Delivered
Number Of Notifications Failed
SMS Success Rate

36. @RafalGancarz
Custom Metrics
function
Lambda
CloudWatch
SDK

37. @RafalGancarz
Estimated Billing
Total Estimated Charges
Estimated Charges (per service)

38. (CC) Kevin Dooley
DASHBOARDS

39. @RafalGancarz
CloudWatch Dashboards
metrics, alarms, static text
3 dashboards (up to 50 metrics) per
month for free
$3 per dashboard per month

40. ALERTING
(CC) Martin Abegglen

41. @RafalGancarz
CloudWatch Alarms
watches metrics over time
can trigger a function via SNS
10 alarms per month for free
$0.10 per alarm per month

42. @RafalGancarz
Serverless Alerting
function
alarm topic
email
SMS
channel
metric
condition

43. LOGGING
(CC) Mari Smith

44. @RafalGancarz
CloudWatch Logs
ingests and stores application logs
configurable retention period
5 GB data ingestion and 5 GB
archived storage per month for free
$0.5985 per GB ingested per month
$0.0315 per GB archived per month

45. @RafalGancarz
Log Collection
log groupLambda
stdout
function
stderr

46. @RafalGancarz
Log Filtering
log group metric alarm
filter condition

47. @RafalGancarz
Log Streaming
log group
function Elastic
Search
stream function

48. @RafalGancarz
Log Browsing
log group
Elastic
Search
function
JSON
Kibana
+
Bunyan CLI
Bunyan

49. EVENTS
(CC) JD Hancock

50. @RafalGancarz
CloudWatch Events
stores & streams application events
$1 per 1 million custom events

51. @RafalGancarz
Custom Events
function
SDK
event rule function

52. @RafalGancarz
DynamoDB dynamic capacity
function
SDK
event
metrics
table

53. HEALTH CHECKS
(CC) Rosmarie Voegtli

54. @RafalGancarz
Route53 Health Checks
monitors HTTP(S) endpoints
50 AWS endpoint checks per month
for free
$0.50 per health check per month
$1 per feature (HTTPS, string
matching, fast interval, latency) per
month

55. @RafalGancarz
Health Checks
health
check
metric alarm
api function table

56. TRACING
(CC) Ozzy Delaney

57. @RafalGancarz
AWS X-Ray
collects transaction traces
support for Lambda coming soon
100k traces recorded and 1 million
traces retrieved/scanned free per
month
$5 per 1 million traces recorded and
$0.50 per 1 million traces retrieved/
scanned per month

58. AUDITING
(CC) The Steve

59. @RafalGancarz
AWS CloudTrail
audits all console, API, SDK activity
first copy of management event free
additional copies $2 per 100k
events
$0.10 per 100k data events

60. THE FUTURE
(CC) matt northam

61. @RafalGancarz
Total Visibility

62. @RafalGancarz
Monitoring as a Service

63. @RafalGancarz
Monitoring not only
for Operations

64. @RafalGancarz
Application <-> Monitoring
metrics
events
logs
feedback
Application
Services
Monitoring
Services

65. @RafalGancarz
Monitoring as the enabler
for the new functionality

66. (CC) Alan Turkus
QUESTIONS?
@RafalGancarz