RISE Conference 2018 - Hong Kong Developer Workshop: Microservices for Startups - Donnie Prakoso

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
R I S E – D eve lo p e r Wo r ks h o p
Microservices for Startup
Hong Kong, July 2018
@donnieprakoso
donnieprakoso
Donnie Prakoso
AWS Technology Evangelist, ASEAN

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What Is Microservices?

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
What Is Microservices?
An approach to developing a single application as a suite of
small services, each running in its own process and
communicating with lightweight mechanisms, often an HTTP
resource API
- Martin Fowler & James Lewis
https://martinfowler.com

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Monolithic vs. Microservices
webserver
.package
Order UI
Order service
Inventory
service
Shipping
service
Order
UI
Inventory
service
Order
service
Shipping
service

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Tenets of Microservices Architectures
Do one
thing wellIndependent
Decentralized
Black box
Polyglot
You build it, you run it

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Benefits of Microservices Architecture
Agility
Flexible
scaling
Easy
deployment
Technology
freedom
Reusable code
Resilience

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building Microservices with AWS

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Focus on building business logic.
!

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Twelve-Factor App
1. Codebase
2. Dependencies
3. Config
4. Backing Services
5. Build, Release Run
6. Processes
7. Port Binding
8. Concurrency
9. Disposability
10. Dev/Prod parity
11. Logs
12. Admin Processes
https://12factor.net/

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Computing power for microservices.
1

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon EC2 Amazon ECS AWS Lambda
INSTANCES CONTAINERS SERVERLESS

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
PRODUCTION WORKLOADS ON AWS
AWS VPC
networking mode
Advanced task
placement
Deep integration
with AWS platform
ECS CLI…{ }
Global footprint
Powerful scheduling
engines
Auto scaling
CloudWatch metrics
Load balancers
Linux & Windows

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
E L A S T I C C O N TA I N E R S E RV I C E F O R K U B E R N E T E S
(EKS)

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Lambda
Bring your own code
• Node.js, Java, Python,
C#, Go
• Bring your own libraries
(even native ones)
Simple resource model
• Select power rating from
128 MB to 3 GB
• CPU and network
allocated proportionately
Flexible use
• Synchronous or
asynchronous
• Integrated with other
AWS services
Flexible authorization
• Securely grant access to
resources and VPCs
• Fine-grained control for
invoking your functions

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Using AWS Lambda
Authoring functions
• WYSIWYG editor or
upload packaged .zip
• AWS Cloud9 IDE
• Third-party plugins
(Eclipse, Visual Studio)
Monitoring and logging
• Metrics for requests,
errors, and throttles
• Built-in logs to Amazon
CloudWatch Logs
• Distributed tracing with
AWS X-Ray
Programming model
• Use processes, threads,
/tmp, sockets normally
• AWS SDK built in
(Python and Node.js)
Stateless
• Persist data using
external storage
• No affinity or access to
underlying infrastructure

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon API Gateway
Create a unified
API frontend for
multiple
microservices
Authenticate and
authorize
requests to a
backend
DDoS protection
and throttling
for your backend
Throttle, meter,
and monetize
API usage by
third-party
developers

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Manage the code lifecycle from
commit to run.
2

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS
CodeCommit
AWS
CodeDeploy
AWS
CodeBuild
AWS
CodePipeline
AWS
CodeStar
Amazon ECR

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Continuous Deployment
AWS
CodeCommit AWS
CodePipeline
AWS
CodeBuild
Amazon
ECR
Amazon
ECS
instance
Spot
Instance
AWS
CloudFormation
1. Commit
Code
2. Trigger
Pipeline
3.Build
Artifact
5.Update
Stack
6. Update Service
4. Push Image

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CI/CD

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
App Config – EC2 System Manager
•prod.app1.db-pass
•general.license-code
•prod.app2.user-name
ECS Cluster
EC2 Instance EC2 Instance
TASK A
TASK B
TASK B
EC2 System Manager –
Parameter Store

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Secrets Manager
Rotate secrets safely Secure and audit
secrets centrally
Manage access with
fine-grained policies
Easily rotate, manage, and retrieve database credentials, API keys, and
other secrets through their lifecycle

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Stateless Processes
3

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon
DynamoDB
Amazon
ElastiCache
Amazon RDS

26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Trace across complex architectures
for troubleshooting and
optimization.
4

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS
CloudTrail
Amazon
CloudWatch
AWS
X-Ray

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Publish and coordinate inter-
process communications.
5

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Step Functions
Easily coordinate multiple Lambda functions using
visual workflows
Visualize in
the console
Define in JSON Monitor
executions

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Benefits of Step Functions Orchestration
Change and add steps
without writing code
to evolve applications
and innovate faster
Coordinate and visualize
Lambda functions as a
series of steps to quickly
create serverless apps
Automatically trigger and
track each step at scale
and handle errors with
built-in retry and fallback
Productivity AgilityResilience

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Managed Service Discovery
6

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Find endpoints,
then connect
Functional calls
Application communication is evolving
Known endpoints, APIs

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why is it non trivial?
Dynamic by design:
Number of containers & instances
Auto assigned IP addresses & ports
Placement, scheduling, scaling
Deployments and upgrades
Health and connectivity

34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Where is Service X?”
Friendly name -> IP + port
E.g., app: {10.0.4.5:8080, 10.0.4.6:8080 }
What is Service Discovery?
Service registry is a database populated
with information on how to dispatch
requests to microservice instances.

35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SERVICE
A
INSTANCE 1
SERVICE
B
INSTANCE 1
CLIENT
How to contact you?
What’s your IP+Port?
How to contact you?
What’s your IP+Port?

36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SERVIC
E A
INSTANCE 1
SERVICE
B
INSTANCE 1
CLIENT
Which one is available?
SERVICE
A
INSTANCE 2
SERVIC
E B
INSTANCE 1
Which one is available?

37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SERVIC
E A
INSTANCE 1
CLIENT
SERVIC
E A
INSTANCE 2
SERVIC
E B
INSTANCE 1
SERVIC
E B
INSTANCE 2
Service removed!

38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SERVIC
E A
INSTANCE 1
SERVICE
B
INSTANCE 1
CLIENT
SERVICE
A
INSTANCE 2
SERVICE
B
INSTANCE 2
NEW DEPLOYMENT!
SERVICE
C
INSTANCE 1
SERVICE
C
INSTANCE 2

39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Introducing
Service Discovery for
Amazon ECS

40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why?
Predictable
Names
for services
Auto updated
with latest,
healthy IP, port
Managed: No
overhead of
installation or
monitoring
High availability,
high scale
Extensible:
Flexible
boundaries for
auto discovery

41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
You build apps where
services are invoked by
name & name resolves
to IP/port dynamically
You turn on service
discovery during
deployment —
service creation
DEV OPS

42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Service Discovery Components
Service
CNAME: A / SRV record
Namespace

43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enables these use cases
1
Blue green deployments
• myapp.staging.local
• myapp.prod.local
• Private IP
• abstract cluster details
2
Internal micro services
• web.myapp.local
• Expose Private IP
3
External micro services
• web.myapp.mycompany.com
• Expose public IP or ELB EIP
• network + container health
check
4
Across ECS & EKS
• Service1.myapp.ecs
• Service2.myapp.eks
5
Across ECS &
AWS & onPrem
• Service1.myapp.ecs
• Service2.myapp.ec2
• Service3.myapp.onprem
6
Expose to service mesh
• Service1.myapp.local
• Service2.myapp.local

44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Cool Stuffs to Get You Started
• What are microservices?
• AWS services to help you build
microservices
• Whitepapers, workshops, blogs
https://aws.amazon.com/microservices/

45. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
COMING UP NEXT
Serverless for Mobile Developers
Gabe Hollombe | 1:00PM
Thursday, July 12
10:00AM – Microservices for Startups
11:00AM – Serverless for Mobile Developers
12:00PM – How to: Simplify Container Deployment &
Operations with Amazon ECS & Fargate
1:00PM – How to: Build Data Driven Apps with GraphQL
& AWS AppSync
2:00PM – Serverless Architectural Patterns
3:00PM – Coordinating Microservices with AWS Step
Functions
4:00PM – Theatre Review & Ask the Experts

46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Go Build!
Donnie Prakoso
AWS Technology Evangelist, ASEAN
@donnieprakoso
donnie@amazon.com