Serverless computing is steadily gaining momentum in the IT industry and more companies are looking to leverage this new way of building and running cloud native systems. Yet, since this area is still relatively young, many are confused about best ways to go about building serverless architectures, particularly more complex ones.

1. Serverless for the Enterprise
Rafal Gancarz
CODEMOTION MILAN - SPECIAL EDITION
10 – 11 NOVEMBER 2017

2. @RafalGancarz
AIR ASIA
HANDLES UP TO 40 MILLION REQUESTS PER DAY

3. @RafalGancarz
THOMSON REUTERS
PROCESSES UP TO 10,000 EVENTS PER SECOND
(25 BILLION EVENTS PER MONTH)

4. @RafalGancarz
FINRA
EXECUTES 500 BILLION DATA VALIDATIONS
ON 37 BILLION MARKET EVENTS EVERY DAY

5. @RafalGancarz
Rafal Gancarz
IT Consultant @ Starbucks
@RafalGancarz

6. @RafalGancarz
WHAT IS
SERVERLESS?

7. (CC) theaucitron

8. @RafalGancarz
Cloud-native

9. @RafalGancarz
Platform as a Service
(PaaS)

10. @RafalGancarz
Event-driven

11. @RafalGancarz
Managed

12. @RafalGancarz
Serverless ≠ FaaS
Faas
Serverless
FaaS = Function as a Service

13. @RafalGancarz
WHY
SERVERLESS?

14. (CC) snapp3r

15. @RafalGancarz
Availability
at $0

16. @RafalGancarz
Scalability
0 … 1000 …

17. @RafalGancarz
Economy
pay per use

18. @RafalGancarz
Time to market
months -> days

19. @RafalGancarz
Security
in depth

20. @RafalGancarz
Operability
from the start

21. @RafalGancarz
Culture
Agile/DevOps

22. (CC) Neil Tackaberry
ENTERPRISE REQUIREMENTS

23. PERFORMANCE
RESPONSIVENESS

24. SCALABILITY
AVAILABILITY, ELASTICITY

25. SECURITY
AUDITABILITY, COMPLIANCE

26. OPERABILITY
OBSERVABILITY, SUPPORTABILITY

27. FLEXIBILITY
EVOLVABILITY, MAINTAINABILITY

28. VIABILITY
SUITABILITY, DELIVERABILITY, ECONOMICS

29. (CC) Ray Sadler
BUILDING BLOCKS

30. @RafalGancarz
AWS Lambda
Java, C#, NodeJS, Python
sync & async invocation
max 5 minutes execution time
1 million invocations and 400k GB-s free per
month
$0.20 per 1 million requests and ~$6.65 for
400k GB-s thereafter
Cloud Functions Functions

31. @RafalGancarz
Execution model
event + context
callback (err, data)
(NodeJS)
return value
(Java, Python, C#)

32. @RafalGancarz
Hello World (NodeJS)
console.log(‘Loading function’)
exports.handler = (event, context, callback) => {
// console.log(JSON.stringify(event));
// your logic goes here
callback(null, 'Hello from Lambda’);
// callback(new Error(‘something went wrong’));
};

33. @RafalGancarz
Hello World (Python)
from __future__ import print_function
import json
print('Loading function')
def lambda_handler(event, context):
print("Received event: " + json.dumps(event, indent=2))
// your logic goes here
return “Hello from Lambda”
#raise Exception('Something went wrong')

34. @RafalGancarz
AWS S3
durable, available and scalable
functions as content processors
5 GB of storage and 15 GB of data
transfer out to Internet each month for
free
$0.03 per TB/month and $0.09 per GB
data transfer out to Internet
Cloud Storage Blob Storage

35. @RafalGancarz
Image resizer
S3 object
S3 bucket
Lambda
function
upload
notification
put

36. @RafalGancarz
AWS API Gateway
security, caching, throttling
functions as API implementations
1 million requests free per month
$3.50 per 1 million requests and
$0.09/GB (for the first 10 TB, then
cheaper)
Cloud Endpoints <integrated>

37. @RafalGancarz
NPM Registry
API
handler
API
Gateway
publisher
upload
NPM package
tarball

38. @RafalGancarz
AWS DynamoDB
document and key-value
function as triggered procedures
25 GB of storage and 25 units of read
capacity each month for free (~200k requests
per month)
$0.25 per GB/month and $0.0065 per hour
for 10 units of write capacity (36k writes/hour)
or 50 units of read capacity (180k reads/hour)
Firebase, Bigtable
DataStore
Table Storage

39. @RafalGancarz
CRUD API
API
handler
API
Gateway
DynamoDB
table
record
processor
DynamoDB
table
trigger

40. @RafalGancarz
AWS SNS
pub-sub, push notifications
functions as destinations
1m publishes, 1m mobile push notifications,
1k emails, 100k HTTP notifications and 1
GB of data transfer out each month for free
$0.50 per 1m publishes, $0.60 per 1m
HTTP notifications and $0.09 per GB data
transfer out to the Internet
Cloud Pub/Sub Queue Storage, Event Grid

41. @RafalGancarz
Async tasks
API
handler
API
Gateway
DynamoDB
table
SNS
topic
task
executor

42. @RafalGancarz
AWS Kinesis Streams
pub-sub, persistent
functions as consumers
no free tier
$0.015 per shard/hour, $0.014 per 1m PUT
payload units (25KB) + extended retention
charges
data transfer is free
Cloud Pub/Sub Queue Storage

43. @RafalGancarz
AWS SQS
point to point messaging, persistent
poll based API, functions need to
consume messages explicitly
1m requests (API actions or messages)
each month for free
$0.40 per 1m requests (standard) or
$0.50 per 1m requests (FIFO)
Cloud Pub/Sub Queue Storage

44. @RafalGancarz
Persistent consumers
API
handler
API
Gateway
SNS
topic
SQS
queue

45. (CC) Tim Lumley
ECOSYSTEM

46. @RafalGancarz
Serverless Ecosystem (AWS)
SES
LEX
Cloud
Front
Route53
KMS
Cognito
Step
Functions
Security
Delivery
Messaging
Glacier
RDS
Redshift
Elasti
Cache
Athena
EMRES
Storage&Analytics
Artificial
Intelligence
Polly
Rekognition
Operations
IoT
Alexa
Skills
Internet of Things
Compute
Cloud
Trail
Batch
ECS
EC2
Legend:
no servers in sight
servers visible
servers visible (VPC)

47. @RafalGancarz
Serverless Ecosystem (GCP)
Machine Learning
Cloud Natural Language API
Cloud Speech API
Cloud Translation API
Cloud Vision API
Cloud Video Intelligence API
Cloud Pub/Sub
Cloud Spanner

48. @RafalGancarz
Serverless Ecosystem (Azure)
Cosmos DB
Machine Learning
Text Analytics API
Face API
Compute Vision API
Analytics Services

49. @RafalGancarz
single cloud vs multi-cloud

50. (CC) perceptions
ARCHITECTURE
PATTERNS

51. @RafalGancarz
Serverless Monolith

52. @RafalGancarz
Serverless Microservices
A B C
D

53. @RafalGancarz
Sync integration
A B
HTTPS (IAM/?)
HTTPS (IAM)

54. @RafalGancarz
Async integration
A B

55. @RafalGancarz
Async notifications
A B

56. (CC) etherlore
CONTINUOUS
DELIVERY
DEPLOYMENT

57. @RafalGancarz
Infrastructure provisioning
A
AWS
CloudFormation
(SAM)
Hashicorp
Terraform
(S3 remote state)

58. @RafalGancarz
Build/deployment pipeline
1 checkout
build (compile/transpile + execute unit tests)
deploy to DEVELOPMENT environment + execute
component/API tests
deploy to TESTING environment + execute end to end tests
deploy to STAGING environment + execute smoke tests
deploy to PRODUCTION environment + execute smoke
tests
2
3
4
5
6

59. @RafalGancarz
Infrastructure provisioning
CI/CD orchestrator
A
B
C
DEVELOPMENT
A
B
C
TESTING
A
B
C
STAGING
A
B
C
PRODUCTION

60. @RafalGancarz
Code deployments
ES 2015
+rollupjs.org babeljs.io
apex.run

61. @RafalGancarz
Testing
Unit testing
(local/CI)
Acceptance testing
(test environment)
Smoke testing
(post deployment)
testing pyramid
Component testing
(dev environment)

62. @RafalGancarz
Testing
+ +
Unit testing (local + CI)
+
Acceptance/functional testing (AWS)
+
Smoke testing (AWS)
+
(mochajs.org) (chaijs.com) (sinonjs.org) (proxyquire)

63. (CC) haru__q
SECURITY

64. @RafalGancarz
Security in depth
A B
team
CI/CD
IAM
IAM
STS
IAM
IAM / API KEY / STS / CUSTOM

65. @RafalGancarz
AWS Parameter Store
scalable, managed, secured
configuration values and secrets

66. @RafalGancarz
Secret storage
API
handler
API
Gateway
secret
KMS
ciphertext
plaintext
key
generate key

67. (CC) Grégoire Lannoy
MONITORING

68. @RafalGancarz
AWS CloudWatch
scalable, managed
real-time monitoring
metrics, logs, alarms, events
Stackdriver n/a

69. (CC) Jérôme S
METRICS

70. @RafalGancarz
CloudWatch Metrics
retention: 1m (15 days), 5m (63 days), 1h
(15 months)
basic monitoring (1m/5m) is free
10 metrics and 1 million API requests for
free each month
$0.30 per metric/month for the first 10k
metrics ($0.02 for metrics over 1M)
$0.01 for 1000 API requests
Stackdriver Monitoring n/a

71. ALERTING
(CC) Martin Abegglen

72. @RafalGancarz
CloudWatch Alarms
watches metrics over time
can trigger a function via SNS
10 alarms per month for free
$0.10 per alarm per month
Stackdriver Monitoring n/a

73. @RafalGancarz
Serverless Alerting
function
CW
alarm
SNS
topic
email
SMS
channel
CW
metric
condition

74. LOGGING
(CC) Mari Smith

75. @RafalGancarz
CloudWatch Logs
ingests and stores application logs
configurable retention period
5 GB data ingestion and 5 GB
archived storage per month for free
$0.5985 per GB ingested per month
$0.0315 per GB archived per month
Stackdriver Logging n/a

76. @RafalGancarz
Log Collection
CloudWatch
log group
Lambda
service
stdout
Lambda
function
stderr

77. @RafalGancarz
Log Filtering
CloudWatch
log group
CloudWatch
metric
CloudWatch
alarm
filter condition

78. @RafalGancarz
Log Browsing
log group Elastic
Search
function
JSON
Kibana
Bunyan

79. EVENTS
(CC) JD Hancock

80. @RafalGancarz
CloudWatch Events
stores & streams application events
$1 per 1 million custom events

81. @RafalGancarz
Scheduled tasks
function
SDK
event
metrics
table

82. HEALTH CHECKS
(CC) Rosmarie Voegtli

83. @RafalGancarz
Route53 Health Checks
monitors HTTP(S) endpoints
50 AWS endpoint checks per month
for free
$0.50 per health check per month
$1 per feature (HTTPS, string
matching, fast interval, latency) per
month

84. @RafalGancarz
Health Checks
health
check
metric alarm
api function table

85. TRACING
(CC) Ozzy Delaney

86. @RafalGancarz
AWS X-Ray
collects transaction traces
100k traces recorded and 1 million
traces retrieved/scanned free per
month
$5 per 1 million traces recorded and
$0.50 per 1 million traces retrieved/
scanned per month
Stackdriver Trace n/a

87. AUDITING
(CC) The Steve

88. @RafalGancarz
AWS CloudTrail
audits all console, API, SDK activity
first copy of management event free
additional copies $2 per 100k events
$0.10 per 100k data events

89. CHALLENGES(CC) mangpages

90. @RafalGancarz
Infancy

91. @RafalGancarz
Rapid Evolution

92. @RafalGancarz
Provider Lock-in

93. @RafalGancarz
Capacity management
(Lambda, DynamoDB, Kinesis Streams)

94. @RafalGancarz
Frameworks

95. @RafalGancarz
Tooling

96. THE FUTURE
(CC) matt northam

97. @RafalGancarz
Maturity

98. @RafalGancarz
Services & Tools

99. @RafalGancarz
Patterns

100. @RafalGancarz
Business Agility

101. (CC) Alan Turkus
THANK YOU!
QUESTIONS?
@RafalGancarz