SlideShare ist ein Scribd-Unternehmen logo
1 von 122
Downloaden Sie, um offline zu lesen
Scaling  the  Platform  for  
Your  Startup
Andreas  Chatzakis
AWS  Solutions  Architecture
Why  are  you  here?
• Building  the  technology  platform  for  your  startup
• You  want  to  prepare  for  success
• Learn  about  design  patterns  &  scalability
• A  pragmatic  approach  for  startups
Priorities  for  startups
• Racing  within  a  window  of  opportunity
• Small  team  with  no  legacy
• Focus  on  solving  a  problem
• Avoid  over-­engineering  &  re-­engineering
• Reduce  risk  of  failure  when  you  go  viral
A  scalable  architecture
• Can  support  growth  in  users,  traffic,  data  size  
• Without  practical  limits
• Without  a  drop  in  performance
• Seamlessly  -­ just  by  adding  more  resources
• Efficiently  -­ in  terms  of  cost  per  user
First  some  basics
AWS  Regions
US-WEST (Oregon)
EU-WEST (Ireland)
ASIA PAC (Tokyo)
US-WEST (N. California)
SOUTH AMERICA (Sao Paulo)
US-EAST (Virginia)
AWS GovCloud (US)
ASIA PAC
(Sydney)
ASIA PAC
(Singapore)
CHINA (Beijing)
Availability  Zones  (AZs)
US-WEST (Oregon)
EU-WEST (Ireland)
ASIA PAC (Tokyo)
US-WEST (N. California)
SOUTH AMERICA (Sao Paulo)
US-EAST (Virginia)
AWS GovCloud (US)
ASIA PAC
(Sydney)
ASIA PAC
(Singapore)
CHINA (Beijing)
EU-CENTRAL (Frankfurt)
ASIA PAC (Singapore)
CHINA (Beijing)
Edge  Locations
Enterprise
Applications
Virtual  Desktop Sharing  &  Collaboration
Platform
Services
Analytics
Hadoop
Real-­time
Streaming  Data
Data
Warehouse
Data
Pipelines
App  Services
Queuing  &  
Notifications
Workflow
App  streaming
Transcoding
Email
Search
Deployment  &  Management
One-­click  web  
app  deployment
Dev/ops  resource  
management
Resource  
Templates
Mobile  Services
Identity
Sync
Mobile  
Analytics
Push  
Notifications
Administration
&  Security
Identity  
Management
Access  
Control
Usage  
Auditing
Key  
Storage
Monitoring
And  Logs
Core
Services
Compute
(VMs,  Auto-­scaling  
and   Load   Balancing)
Storage
(Object,  Block  
and   Archival)
CDN
Databases
(Relational,   NoSQL,  
Caching)
Networking
(VPC,  DX,  DNS)
Infrastructure Regions Availability  Zones Points  of  Presence
Day  1  – Dev  &  private  beta
Single  host
THE server
(e.g. Apache,
MySQL)
Elastic IP
www.example.com
Amazon Route 53
DNS service
Server Image (AMI)
Day  2  -­ Public  beta
We  need  a  bigger  server
• Add  larger  &  faster  storage  (EBS)
• Use  the  right  instance  type
• Easy  to  change  instance  sizes
• Not  our  long  term  strategy
• Will  hit  an  endpoint  eventually
• No  fault  tolerance
Separating  web  and  DB
• More  capacity
• Scale  each  tier  individually
• Tailor  instance  for  each  tier
– Instance  type
– Storage
• Security
– Security  groups
– DB  in  a  private  VPC  subnet
But  how  do  I  choose  what  
DB  technology  I  need?  
SQL?  NoSQL?
Why  start  with  a  Relational  DB?
• SQL  is  versatile  &  feature-­rich
• Lots  of  existing  code,  tools,  knowledge
• Clear  patterns  to  scalability  (for  read-­heavy  apps)
• Reality:  eventually  you  will  have  a  polyglot  data  layer
– There  will  be  workloads  where  NoSQL  is  a  better  fit
– Combination  of  both  Relational  and  NoSQL
– Use  the  right  tool  for  each  workload
Key  Insight:  Relational  Databases  are  Complex
• Our  experience  running  Amazon.com taught  us  that  
relational  databases  can  be  a  pain  to  manage  and  
operate  with  high  availability
• Poorly  managed  relational  databases  are  a  leading  
cause  of  lost  sleep  and  downtime  in  the  IT  world!
• Especially  for  startups  with  small  teams
Relational  Databases
Fully managed; zero admin
Amazon
RDS
Deploy
Amazon  Aurora
Improving  efficiency
Offload  static  content
• Amazon  S3:  highly  available  hosting  that  scales
– Static  files  (JavaScript,  CSS,  images)
– User  uploads
• S3  URLs  – serve  directly  from  S3
• Let  the  web  server  focus  on  dynamic  content
Masterclass  Live:  Amazon  S3
Upcoming  Session  at  the  AWS  Pop  Up  Loft
Wednesday  16th September,  10.00
Amazon  CloudFront
• Worldwide  network  of  edge  locations
• Cache  on  the  edge  
– Reduce  latency
– Reduce  load  on  origin  servers  
– Static  and dynamic  content
– Even  few  seconds  caching  of  popular  content  can  have  huge  impact
• Connection  optimizations
– Optimize  transfer  route
– Reuse  connections
– Benefits  even  non  cachable content
CloudFront
CloudFront for  static  &  dynamic  content
Amazon
Route 53
EC2 instance(s)
S3 bucket
Static content
Dynamic content
css/*
js/*
Images/*
Default(*)
CloudFron
t
distributio
n
Database  caching
• Faster  response  from  RAM
• Reduce  load  on  database
Application server
1.  If  data  in  cache,  
return  result
2. If  not  in  cache,  
read  from  DB
RDS database
Amazon ElastiCache
3.  And  store  
in  cache
Amazon  ElastiCache:  in-­memory  cache
• Simple  to  Deploy  
• Managed
– Automatically  replaces  failed  nodes
– Patch  management
• Elastic
• Compatible ElastiCache
Day  3  – Paying  customers
High  Availability
Availability Zone a
RDS DB
instance
Web
server
S3 bucket for
static assets
www.example.com
Amazon Route 53
DNS service
Amazon CloudFront
ElastiCache
node 1
High  Availability
Availability Zone a
RDS DB
instance
Availability Zone b
Web
server
Web
server
S3 bucket for
static assets
www.example.com
Amazon Route 53
DNS service
Amazon CloudFront
ElastiCache
node 1
High  Availability
Availability Zone a
RDS DB
instance
Availability Zone b
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
Web
server
Web
server
S3 bucket for
static assets
Amazon CloudFront
ElastiCache
node 1
Elastic  Load  Balancing
• Managed  Load  Balancing  Service
• Fault  tolerant
• Health  Checks
• Distributes  traffic  across  AZs
• Elastic  – automatically  scales  its  capacity
Data  Layer  HA
Availability Zone a
RDS DB
instance
Availability Zone b
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
Web
server
Web
server
S3 bucket for
static assets
ElastiCache
node 1
Amazon CloudFront
Availability Zone a
RDS DB
instance
Availability Zone b
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
Web
server
Web
server
RDS DB
standby
S3 bucket for
static assets
ElastiCache
node 1
Amazon CloudFront
Data  Layer  HA
Data  Layer  HA
Availability Zone a
RDS DB
instance
ElastiCache
node 1
Availability Zone b
S3 bucket for
static assets
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
Web
server
Web
server
RDS DB
standby
Data  Layer  HA
Availability Zone a
RDS DB
instance
ElastiCache
node 1
Availability Zone b
S3 bucket for
static assets
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
Web
server
Web
server
RDS DB
standby
ElastiCache
node 2
User  sessions
• Problem:  Often  stored  on  local  disk  
(not  shared)    
• Quickfix:  ELB  Session  stickiness
• Solution:  DynamoDB
Elastic Load
Balancing
Web
server
Web
server
Logged  in Logged  out
Amazon  DynamoDB
• Managed  document  and  key-­value  NoSQL  DB
• Simple  to  launch  and  scale
• To  millions  of  IOPS
• Both  reads  and  writes
• Consistent,  fast  performance
• Durable:  perfect  for  storage  of  session  data
https://github.com/aws/aws-­dynamodb-­session-­tomcat
http://docs.aws.amazon.com/aws-­sdk-­php/guide/latest/feature-­dynamodb-­session-­handler.html
AWS  bootcamp:  Architecting  Highly  
Available  Applications  on  AWS
Free  Training at  the  AWS  Pop  Up  Loft
9th October  10.00
Day  4  – Let’s  go  viral!
Replace  guesswork  with  elastic  IT
Startups  pre-­AWS
Demand
Unhappy
Customers
Waste $$$
Traditional
Capacity
Capacity
Demand
AWS Cloud
Scaling  the  web  tier
Availability Zone a
RDS DB
instance
ElastiCache
node 1
Availability Zone b
S3 bucket for
static assets
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
Web
server
Web
server
RDS DB
standby
ElastiCache
node 2
Scaling  the  web  tier
Availability Zone a
RDS DB
instance
ElastiCache
node 1
Availability Zone b
S3 bucket for
static assets
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
Web
server
Web
server
RDS DB
standby
ElastiCache
node 2
Web
server
Web
server
Scaling  the  web  tier
Availability Zone a
RDS DB
instance
ElastiCache
node 1
Availability Zone b
S3 bucket for
static assets
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
Web
server
Web
server
RDS DB
standby
ElastiCache
node 2
Web
server
Web
server
Automatic  resizing  of  compute  
clusters  based  on  demand  
Feature Details
Control Define	
  minimum	
  and	
  maximum	
  instance pool	
  
sizes	
  and	
  when	
  scaling	
  and	
  cool	
  down	
  occurs.
Integrated	
  to	
  Amazon	
  
CloudWatch
Use	
  metrics gathered	
  by	
  CloudWatch to	
  drive	
  
scaling.
Instance	
  types Run	
  Auto	
  Scaling	
  for	
  on-­‐demand	
  and	
  Spot	
  
Instances. Compatible	
  with	
  VPC.
aws autoscaling create-­auto-­scaling-­group
-­-­auto-­scaling-­group-­name  MyGroup
-­-­launch-­configuration-­name  MyConfig
-­-­min-­size  4
-­-­max-­size  200
-­-­availability-­zones  us-­west-­2c,  us-­west-­2b
Auto  Scaling Trigger  auto-­scaling  policy
Amazon  
CloudWatch
Decompose  into  small,  
loosely  coupled,  stateless  
building  blocks
Prerequisite
What  does  this  mean  in  practice?
• Only  store  transient  data  on  local  disk
• Needs  to  persist  beyond  a  single  http  request?
– Then  store  it  elsewhere
User  uploads
User  Sessions
Amazon  S3
AWS  DynamoDB
Application  Data
Amazon  RDS
Having  decomposed  into  
small,  loosely  coupled,  
stateless  building  blocks
You  can  now  Scale  out  with  ease
Having	
  done	
  that…
Having  decomposed  into  
small,  loosely  coupled,  
stateless  building  blocks
We  can  also  Scale  back  with  ease
Having	
  done	
  that…
Take  the  shortcut
• While  this  architecture  is  simple  you  still  need  
to  deal  with:  
– Configuration  details
– Deploying  code  to  multiple  instances
– Maintaining  multiple  environments  (Dev,  Test,  Prod)
– Maintain  different  versions  of  the  application
• Solution:  Use  AWS  Elastic  Beanstalk
AWS  Elastic  Beanstalk  (EB)
• Easily  deploy,  monitor,  and  scale  three-­tier  web  
applications  and  services.
• Infrastructure  provisioned  and  managed  by  EB  
• You  maintain  control.
• Preconfigured  application  containers  
• Easily  customizable.
• Support  for  these  platforms:
Deploy  your  Apps  with  AWS  Elastic  
Beanstalk
Upcoming  Session  at  the  AWS  Pop  Up  Loft
Tuesday  15th September,  16.00
Day  5  – Add  more  features
Mobile
Push
Notifications
Mobile
Analytics
Cognito
Cognito
Sync
Analytics
Kinesis
Data
Pipeline
RedShift EMR
Your  Applications
AWS  Global  Infrastructure
Network
VPC
Direct
Connect
Route   53
Storage
EBS S3 Glacier CloudFront
Database
DynamoDBRDS ElastiCache
Deployment   &  Management
Elastic
Beanstalk
OpsWorks
Cloud
Formation
Code
Deploy
Code
Pipeline
Code
Commit
Security  &  Administration
CloudWatch Config
Cloud
Trail
IAM Directory KMS
Application
SQS SWF
App
Stream
Elastic
Transcoder
SES
Cloud
Search
SNS
Enterprise  Applications
WorkSpaces WorkMail WorkDocs
Compute
EC2 ELB
Auto
Scaling
LambdaECS
AWS  building  blocks
Inherently  Scalable  &  Highly  Available Scalable  &  Highly  Available
a Elastic  Load  Balancing
a Amazon  CloudFront
a Amazon  Route53
a Amazon  S3
a Amazon  SNS  /  SQS
a Amazon  SES
a Amazon  CloudSearch
a AWS  Lambda
a …
a Amazon  DynamoDB
a Amazon  Redshift
a Amazon  RDS
a Amazon  Elasticache
a …
4 Amazon  EC2
4 Amazon  VPC
Automated Configurable With  the  right  architecture
Stay  focused  as  you  scale  your  team
AWS
Cloud-­‐Based
Infrastructure
Your
Business
More	
  Time	
  to	
  Focus	
  on
Your	
  Business
Configuring	
  Your	
  
Cloud	
  Assets
70%
30%70%
On-­‐Premise
Infrastructure
30%
Managing	
  All	
  of	
  the	
  
“Undifferentiated	
  Heavy	
  Lifting”
Don’t  reinvent  the  wheel
• Notification  system
• E-­Mail  component
• Search  engine
• Workflow  engine
• Queue
• Transcoding  system
• Monitoring  system
Amazon  
CloudSearch
Amazon  SQSAmazon  SNS
Amazon  Elastic  
Transcoder
Amazon  SWFAmazon  SES
If  you  find  yourself  writing  your  own…
Search  features
• Freetext AND  Structured
• Synonyms
• Stemming
• Relevance
• Complex  scoring
• Faceting
• Geospatial
Amazon  CloudSearch  is  a  fully  managed  search  
service  in  the  cloud  for  your  website  or  application  
Rich  search  feature  set
Source:	
  IDC,	
  Nielsen,	
  Twitter	
  blog
Faceting Highlighting Autocomplete
suggestions
Geospatial  
search
34  languages  covering  major  geographies
Ease  of  operation
Auto-­
scaling
High
availability
Self-­healing
clusters
Data
durability
Day  6  – Growing  fast
Prepare  for  the  challenges
• Increase  in  concurrent  users
• Data  size  growth
• More  features  =>  more  DB  tables
• Technical  debt  (e.g.  inefficient  queries)
– Reduce  it
– Manage  it
Scaling  Relational  DBs  – option  1
Increase  Database  instance  specs
– Larger  instance  type  (RAM,  CPU,  Network)
– More  storage  
– Faster  storage  (IOPS)
– Amazon  Aurora
My  SQL  compatible
Available,  durable,  and  fault  tolerant
5X  better  performance  of  
high-­end  MySQL  database
Highly  scalable  and  secure
Up  to  64TB  of  storage
Amazon  Aurora
1/10th  the  cost  of  the  leading  
commercial  database  solutions
Amazon  Aurora  -­ Write  performance
• MySQL  Sysbench
• R3.8XL  with  32  cores  
and  244  GB  RAM
• 4  client  machines  with  
1,000  threads  each
Amazon  Aurora  -­ Read  performance
• MySQL  Sysbench
• R3.8XL  with  32  cores  
and  244  GB  RAM
• Single  client  with  
1,000  threads
Scaling  Relational  DBs  – option  2
Read  Replicas  (Master  – Slave)
– Scale  out  beyond  capacity  of  single  DB  instance
– Available  in  Amazon  RDS  for  MySQL,  PostgreSQL  and  Amazon  Aurora
– Replication  lag
– Writes  =>  master
– Reads  with  tolerance  to  stale  data  =>  read  replica  (slave)
– Reads  with  need  for  most  recent  data  =>  master
Scaling  the  DB
Web
server
Web
server
Web
server
Web
server
Availability Zone a
RDS DB
instance
ElastiCache
node 1
Availability Zone b
S3 bucket for
static assets
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
RDS DB
standby
ElastiCache
node 2
Scaling  the  DB
Web
server
Web
server
Web
server
Web
server
Availability Zone a
RDS DB
instance
ElastiCache
node 1
Availability Zone b
S3 bucket for
static assets
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
RDS DB
standby
ElastiCache
node 2
RDS read
replica
Scaling  the  DB
Web
server
Web
server
Web
server
Web
server
Availability Zone a
RDS DB
instance
ElastiCache
node 1
Availability Zone b
S3 bucket for
static assets
www.example.com
Amazon Route 53
DNS service
Elastic Load
Balancing
RDS DB
standby
ElastiCache
node 2
RDS read
replica
RDS read
replica
Amazon  Aurora  Replicas  have  less  replication  lag
2.6 3.4 3.9 5.4
1,000 2,000 5,000 10,000
0
50,000
100,000
150,000
200,000
250,000
300,000
350,000
Updates  per  second
Read  replica  lag  in  milliseconds
Read  replica  lag
Aurora
RDS   MySQL;;30,000  IOPS  (Single  AZ)
Updates per
second
Amazon  
Aurora
RDS  MySQL
30K IOPS
(single  AZ)
1,000 2.62  ms 0  s
2,000 3.42  ms 1  s
5,000 3.94  ms 60  s
10,000 5.38  ms 300  s
Write  workload
250  tables
Query  cache  on  for  Amazon  Aurora,  off  for  MySQL  (best  
settings)
What  if  your  app  is  write-­heavy?
Challenge:  You  will  eventually  hit  the  write  throughput  or  
storage  limit  of  the  master  node  
Solutions:
• Federation  (splitting  into  multiple  DBs  based  on  function)
• Sharding (splitting  one  data  set  up  across  multiple  hosts)
Database  federation
• Split  up  databases  by  
function/purpose
• Harder  to  do  cross-­function  
queries
• Essentially  delaying  the  need  for  
something  like  sharding/NoSQL  
until  much  further  down  the  line
• Won’t  help  with  single  huge  
functions/tables
Forums  DB
Users  DB
Products  
DB
Sharded horizontal  scaling
• More  complex  at  the  
application  layer
• ORM  support  can  help
• No  practical  limit  on  
scalability
• Operation  
complexity/sophistication  
• Shard  by  function  or  key  
space
• RDBMS  or  NoSQL
User ShardID
002345 A
002346 B
002347 C
002348 B
002349 A
Shard  C
Shard  B
Shard  A
NoSQL data  stores
• Trade  query  &  integrity  features  of  Relational  DBs  for
– More  flexible  data  model  
– Horizontal  scalability  &  predictable  performance
DynamoDB
Provisioned  read/write  performance  per  table
Massive  and  Seamless  Scale
• Distributed  system  that  can  scale  both  reads  and writes
– Sharding +  Replicas
• Automatic  partitioning:
– Data  set  size  growth
– Provisioned  capacity  increases table
Low	
  provisioned	
  throughput
Table
Partition
SSD
Region
Illustrative   diagram   only
Availability  ZoneAvailability  Zone Availability  Zone
Replica
Partition
SSD
Replica
Partition
SSD
Increased	
  provisioned	
  throughput
Illustrative   diagram   only
Region
Table
Partition
SS
D
Table
Partition
SS
D
Table
Partition
SS
D
Table
Partition
SS
D
Table
Partition
SS
D
Table
Partition
SS
D
Table
Partition
SS
D
Table
Partition
SS
D
Table
Partition
SS
D
Table
Partition
SS
D
High	
  provisioned	
  throughput
Region
Illustrative   diagram   only
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Tabl
e
Partitio
n
Monitoring
Cloudwatch
Operationally  you  will  need:
• Metrics
– Default
– Custom
• Alarms
• Centralized  logs
AWS  Marketplace  &  Partners  Can  Help
• Find,  research,  buy  software
• Aligns  with  EC2  usage  model  
• Launch  in  minutes
• Marketplace  billing  integrated  
into  your  AWS  account
• 20+  categories
Learn  more  at:  aws.amazon.com/marketplace
Loose  Coupling
Amazon  Simple  Queuing  Service  (SQS)
Tight	
  coupling
• Place	
  asynchronous	
  tasks	
  into	
  Amazon	
  SQS
• Respond	
  quickly	
  to	
  end	
  users
• Protects	
  backend	
  systems	
  from	
  spikes
• Process	
  at	
  own	
  pace
• Protect	
  end	
  users	
  from	
  backend	
  problems
• Item	
  will	
  be	
  processed	
  eventually
SQS
Get
Message
Back
End EC2
Instance
Put
Message
Front
End EC2
Instance
Decoupling  in  action
Loose	
  coupling
Upload	
  photo
Resize	
  
photo
EC2  Instances
Decoupling  in  action
Loose	
  coupling
Q
Upload	
  photo
Resize	
  
photo
Upload	
  photo
Resize	
  
photo
EC2  Instances
Amazon  SQS
EC2  Instances
Decoupling  in  action
Loose	
  coupling
Q
Upload	
  photo
Resize	
  
photoUpload	
  photo
Resize	
  
photoUpload	
  photo
Resize	
  
photo
Upload	
  photo
Resize	
  
photoResize	
  
photoResize	
  
photo
EC2  Instances
Amazon  SQS
EC2  Instances
Introducing  AWS  Lambda
Amazon  S3  Bucket  Events AWS  Lambda
Original  image Thumbnailed image
1
2
3
Event-­Driven  Compute  in  the  Cloud
Lambda  functions:  Stateless,  request-­driven  code  execution
• Triggered  by  events  in  other  services:
• PUT  to  an  Amazon  S3  bucket
• Write  to  an  Amazon  DynamoDB  table
• Record  in  an  Amazon  Kinesis  stream
• Amazon  SNS  Message  received
• Changes  in  Amazon  Cognito data
• Makes  it  easy  to…
• Transform  data  as  it  reaches  the  cloud
• Perform  data-­driven  auditing,  analysis,  and  notification
• Kick  off  workflows
Data  Triggers  – Amazon  Simple  Notification  Service
Lambda  FunctionSNSCloudWatch
Metric
Data  Triggers  – Amazon  Cognito
Lambda  FunctionCognito
Data  Triggers:  Amazon  DynamoDB
AWS  LambdaAmazon  DynamoDB
Table  and  Stream
Send  SNS  Push  
notifications
Update  another  table
Data  Triggers  – Amazon  Kinesis
IoT
Device
Kinesis Lambda DynamoDB
Dynamic  content  generation  
based  on  incoming  news  text  
and  images
Real  time  log  
processing  for  
prediction  analytics
Thumbnailing
installation  site  photos  
for  mobile  use
Real  time  processing  and  
recording  of  inbound  traffic  from  
a  range  of  social  media  
platforms
Large  scale  distributed  
search  across  blog  
content
Operational  
analytics  and  real  
time  troubleshooting
Introducing  the  AWS  API  Gateway
Internet
Mobile  Apps
Websites
Services
API  
Gateway
AWS  Lambda  
functions
AWS
API  Gateway  
Cache
Endpoints  on  
Amazon  EC2  /  
Amazon  
Elastic  
Beanstalk
Any  other  publicly  
accessible  endpoint
Amazon  
CloudWatch  
Monitoring
No  server  is  easier  to  manage  than  
"no  server”.
Werner  Vogels
Startups  without  Servers
Upcoming  Session  at  the  AWS  Pop  Up  Loft
Thursday  17th September,  11.00
Thursday  1st October,  10.00
Build  a  data-­driven  company
Experiment  and  collect  data
• Build  an  MVP
• Run  A/B  testing
• Analyze  user  behavior
• Iterate
• Get  insights  about  your  customers
Data  Produced
Available  for  Analysis
Gartner:  User  Survey  Analysis:  Key  Trends  Shaping  the  Future  of  Data  Center  Infrastructure  Through  2011  
IDC:  Worldwide  Business  Analytics  Software  2012–2016  Forecast  and  2011  Vendor  Shares  
Three  Types  of  Data  Analytics
Retrospective
analysis  and  
reporting
Here-­and-­now
real-­time  processing  
and  dashboards
Predictions
to  enable  smart  
apps
Amazon  Kinesis  
Amazon  EC2
Amazon  DynamoDB
AWS  Lambda
Amazon  Redshift  
Amazon  RDS  
Amazon  S3
Amazon  EMR
AWS  Marketplace
Amazon  Machine  Learning
Amazon  EMR
AWS  Lambda
Fast,  simple,  petabyte-­scale  data  warehousing  for  less  than  $1,000/TB/Year
Amazon  Redshift
Amazon  Redshift  Architecture
• Leader  Node
– SQL  endpoint
– Stores  metadata
– Coordinates  query  execution
• Compute  Nodes
– Local,  columnar  storage
– Execute  queries  in  parallel
– Load,  backup,  restore  via  
Amazon  S3;;  load  from  
Amazon  DynamoDB  or  SSH
• Two  hardware  platforms
– Optimized  for  data  processing
– DW1:  HDD;;  scale  from  2TB  to  1.6PB
– DW2:  SSD;;  scale  from  160GB  to  256TB
10  GigE
(HPC)
Ingestion
Backup
Restore
SQL  Clients/BI  Tools
128GB   RAM
16TB   disk
16   cores
Amazon  S3  /  DynamoDB  /  SSH
JDBC/ODBC
128GB   RAM
16TB   disk
16   coresCompute  
Node
128GB   RAM
16TB   disk
16   coresCompute  
Node
128GB   RAM
16TB   disk
16   coresCompute  
Node
Leader
Node
Amazon  Redshift  Node  Types
Dense  
Storage
DW1.XL
15  GB  RAM
2  TB  disk
2  vcpus
Single  Node  (2  TB)
Cluster  2-­32  Nodes  (4  TB  – 64  TB)
XL XL XL XL XL XL XL XL
XL XL XL XL XL XL XL XL
XL XL XL XL XL XL XL XL
XL XL XL XL XL XL XL XL
XL
Amazon  Redshift  Node  Types
Dense  
Storage
DW1.8XL
120  GB  RAM
16  vcpus
16  TB  disk
Cluster  2-­100  Nodes  (32  TB  – 1.6  PB)
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
Amazon  Redshift  Node  Types
Dense  
Compute
DW2.L
15  GB  RAM
160  GB  
SSD
2  vpus
Single  Node  (160  GB)
Cluster  2-­32  Nodes  (320  GB  – 5  TB)
L
L L L L L L L L
L L L L L L L L
L L L L L L L L
L L L L L L L L
Amazon  Redshift  Node  Types
Dense  
Compute
DW2.8XL
244  GB  RAM
32  vcpus
2.5  TB  SSD
Cluster  2-­100  Nodes  (5  TB  – 256  TB)
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
AWS  bootcamp:  Building  a  Big  Data  
Platform  on  AWS
Free  Training at  the  AWS  Pop  Up  Loft
2nd October  10.00
Stay  Lean
It  is  cheap  to  get  started  on  AWS
How  do  successful  startups  save  more  as  they  
grow  and  extend  their  runway?
Stay  Lean!
http://aws.amazon.com/solutions/case-­studies/flipboard
Amazon   EBS  
standard   volume  
prices  are  lowered  
up   to  50%  for  both  
storage  and   I/O  
requests.
January  21,  2014
50%
Amazon   is  
reducing   prices  for  
Amazon  
ElasticCache cache  
nodes   by  an  
average  of  34%.
March  26,  2014
34%
Amazon   S3:  We  are  
reducing   prices  for  
Standard   and  Reduced  
Redundancy   Storage,  
by  an  average  of  51%.
March  26,  2014
51%
We’ve  announced  price  reductions  42*  times  since  
our  inception  in  2006.  Recent  price  drops  included…
*as   of   April   1,   2014
Main  cost-­saving  principles
1. Turn  off the  lights
2. Use  Auto  Scaling
3. Use  the  newer  instance  types
4. Use  the  right  instances for  your  workload
5. Use  Reserved  Instances  for  predictable  workloads
6. Use  Spot  Instances  for  async workloads
7. Leverage  Amazon  S3  storage  classes
8. Use  Glacier for  archival
9. Serve  content  through  Cloudfront
10. Offload  your  architecture
Tools:  Cost  Explorer,  Detailed  Billing,  Alerts,  Usage  Reports
Summary
Amazon Route 53
DNS serviceNo  limit
Availability Zone a
RDS DB
instance
ElastiCache
node 2
Availability Zone b
S3 bucket for
static assets
www.example.com
Elastic Load
Balancing
RDS DB
standby
ElastiCache
node 3
RDS read
replica
RDS read
replica
DynamoDB
RDS read
replica
ElastiCache
node 4
RDS read
replica
ElastiCache
node 1
CloudSearchLambdaSES SQS
A  quick  review
• Keep  it  simple  and  stateless
• Make  use  of  managed  self-­scaling  services
• Multi-­AZ  and  AutoScale your  EC2  infrastructure
• Use  the  right  DB  for  each  workload  
• Cache  data  at  multiple  levels
• Simplify  operations  with  deployment  tools
Next  steps?
READ!    
• aws.amazon.com/documentation
• aws.amazon.com/architecture
• aws.amazon.com/start-­ups
• aws.amazon.com/training
ASK  FOR  HELP!
• forums.aws.amazon.com
• aws.amazon.com/support
AWS  for  Startups
Upcoming  Sessions  at  the  AWS  Pop  Up  Loft
11th September,  13.00
16th September,  17.00
29th September,  17.00
14th October,            18.00

Weitere ähnliche Inhalte

Was ist angesagt?

Lighting your Big Data Fire with Apache Spark
Lighting your Big Data Fire with Apache SparkLighting your Big Data Fire with Apache Spark
Lighting your Big Data Fire with Apache SparkAmazon Web Services
 
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...Amazon Web Services
 
AWS APAC Webinar Week - Training & Certification Masterclass
AWS APAC Webinar Week - Training & Certification MasterclassAWS APAC Webinar Week - Training & Certification Masterclass
AWS APAC Webinar Week - Training & Certification MasterclassAmazon Web Services
 
AWS IoT Workshop Keynote
AWS IoT Workshop KeynoteAWS IoT Workshop Keynote
AWS IoT Workshop KeynoteIan Massingham
 
AWS Sydney Summit 2013 - Building Web Scale Applications with AWS
AWS Sydney Summit 2013 - Building Web Scale Applications with AWSAWS Sydney Summit 2013 - Building Web Scale Applications with AWS
AWS Sydney Summit 2013 - Building Web Scale Applications with AWSAmazon Web Services
 
How Western Union Implemented Security Measures at Scale on AWS with Dome9
 How Western Union Implemented Security Measures at Scale on AWS with Dome9  How Western Union Implemented Security Measures at Scale on AWS with Dome9
How Western Union Implemented Security Measures at Scale on AWS with Dome9 Amazon Web Services
 
Maximizing Business Value as You Migrate to AWS
Maximizing Business Value as You Migrate to AWSMaximizing Business Value as You Migrate to AWS
Maximizing Business Value as You Migrate to AWSAmazon Web Services
 
Track 5 Session 5_STG03 AWS 檔案儲存服務概觀
Track 5 Session 5_STG03 AWS 檔案儲存服務概觀Track 5 Session 5_STG03 AWS 檔案儲存服務概觀
Track 5 Session 5_STG03 AWS 檔案儲存服務概觀Amazon Web Services
 
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAX
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAXThe Lean Cloud for Startups with AWS - Customer Success Story - wireWAX
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAXAmazon Web Services
 
Modernize and Move your Microsoft Applications on AWS
Modernize and Move your Microsoft Applications on AWSModernize and Move your Microsoft Applications on AWS
Modernize and Move your Microsoft Applications on AWSAmazon Web Services
 
Getting Started with Amazon Redshift
Getting Started with Amazon RedshiftGetting Started with Amazon Redshift
Getting Started with Amazon RedshiftAmazon Web Services
 
Introducing Database Offerings on AWS - Technical 101
Introducing Database Offerings on AWS - Technical 101Introducing Database Offerings on AWS - Technical 101
Introducing Database Offerings on AWS - Technical 101Amazon Web Services
 
AWS Sydney Summit 2013 - Keynote
AWS Sydney Summit 2013 - KeynoteAWS Sydney Summit 2013 - Keynote
AWS Sydney Summit 2013 - KeynoteAmazon Web Services
 
Amazon EC2 Instances, Featuring Performance Optimisation Best Practices
Amazon EC2 Instances, Featuring Performance Optimisation Best PracticesAmazon EC2 Instances, Featuring Performance Optimisation Best Practices
Amazon EC2 Instances, Featuring Performance Optimisation Best PracticesAmazon Web Services
 
Webinar aws 101 a walk through the aws cloud- introduction to cloud computi...
Webinar aws 101   a walk through the aws cloud- introduction to cloud computi...Webinar aws 101   a walk through the aws cloud- introduction to cloud computi...
Webinar aws 101 a walk through the aws cloud- introduction to cloud computi...Amazon Web Services
 
Introduction to Cloud Computing with Amazon Web Services
Introduction to Cloud Computing with Amazon Web ServicesIntroduction to Cloud Computing with Amazon Web Services
Introduction to Cloud Computing with Amazon Web ServicesAmazon Web Services
 

Was ist angesagt? (20)

AWS for Startups
AWS for StartupsAWS for Startups
AWS for Startups
 
Lighting your Big Data Fire with Apache Spark
Lighting your Big Data Fire with Apache SparkLighting your Big Data Fire with Apache Spark
Lighting your Big Data Fire with Apache Spark
 
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
 
AWS APAC Webinar Week - Training & Certification Masterclass
AWS APAC Webinar Week - Training & Certification MasterclassAWS APAC Webinar Week - Training & Certification Masterclass
AWS APAC Webinar Week - Training & Certification Masterclass
 
AWS IoT Workshop Keynote
AWS IoT Workshop KeynoteAWS IoT Workshop Keynote
AWS IoT Workshop Keynote
 
AWS Sydney Summit 2013 - Building Web Scale Applications with AWS
AWS Sydney Summit 2013 - Building Web Scale Applications with AWSAWS Sydney Summit 2013 - Building Web Scale Applications with AWS
AWS Sydney Summit 2013 - Building Web Scale Applications with AWS
 
The Tightrope for K12 IT
The Tightrope for K12 ITThe Tightrope for K12 IT
The Tightrope for K12 IT
 
How Western Union Implemented Security Measures at Scale on AWS with Dome9
 How Western Union Implemented Security Measures at Scale on AWS with Dome9  How Western Union Implemented Security Measures at Scale on AWS with Dome9
How Western Union Implemented Security Measures at Scale on AWS with Dome9
 
Maximizing Business Value as You Migrate to AWS
Maximizing Business Value as You Migrate to AWSMaximizing Business Value as You Migrate to AWS
Maximizing Business Value as You Migrate to AWS
 
Track 5 Session 5_STG03 AWS 檔案儲存服務概觀
Track 5 Session 5_STG03 AWS 檔案儲存服務概觀Track 5 Session 5_STG03 AWS 檔案儲存服務概觀
Track 5 Session 5_STG03 AWS 檔案儲存服務概觀
 
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAX
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAXThe Lean Cloud for Startups with AWS - Customer Success Story - wireWAX
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAX
 
Modernize and Move your Microsoft Applications on AWS
Modernize and Move your Microsoft Applications on AWSModernize and Move your Microsoft Applications on AWS
Modernize and Move your Microsoft Applications on AWS
 
Cost Optimisation on AWS
Cost Optimisation on AWSCost Optimisation on AWS
Cost Optimisation on AWS
 
Getting Started with Amazon Redshift
Getting Started with Amazon RedshiftGetting Started with Amazon Redshift
Getting Started with Amazon Redshift
 
Introducing Database Offerings on AWS - Technical 101
Introducing Database Offerings on AWS - Technical 101Introducing Database Offerings on AWS - Technical 101
Introducing Database Offerings on AWS - Technical 101
 
AWS Sydney Summit 2013 - Keynote
AWS Sydney Summit 2013 - KeynoteAWS Sydney Summit 2013 - Keynote
AWS Sydney Summit 2013 - Keynote
 
State of the Union: Storage
State of the Union: StorageState of the Union: Storage
State of the Union: Storage
 
Amazon EC2 Instances, Featuring Performance Optimisation Best Practices
Amazon EC2 Instances, Featuring Performance Optimisation Best PracticesAmazon EC2 Instances, Featuring Performance Optimisation Best Practices
Amazon EC2 Instances, Featuring Performance Optimisation Best Practices
 
Webinar aws 101 a walk through the aws cloud- introduction to cloud computi...
Webinar aws 101   a walk through the aws cloud- introduction to cloud computi...Webinar aws 101   a walk through the aws cloud- introduction to cloud computi...
Webinar aws 101 a walk through the aws cloud- introduction to cloud computi...
 
Introduction to Cloud Computing with Amazon Web Services
Introduction to Cloud Computing with Amazon Web ServicesIntroduction to Cloud Computing with Amazon Web Services
Introduction to Cloud Computing with Amazon Web Services
 

Andere mochten auch

7 Stages of Scaling Web Applications
7 Stages of Scaling Web Applications7 Stages of Scaling Web Applications
7 Stages of Scaling Web ApplicationsDavid Mitzenmacher
 
CFS: Cassandra Backed Storage for Hadoop
CFS: Cassandra Backed Storage for HadoopCFS: Cassandra Backed Storage for Hadoop
CFS: Cassandra Backed Storage for HadoopDataStax Academy
 
Vertical vs Horizontal Scaling
Vertical vs Horizontal Scaling Vertical vs Horizontal Scaling
Vertical vs Horizontal Scaling Mark Myers
 
Advanced data modeling with apache cassandra
Advanced data modeling with apache cassandraAdvanced data modeling with apache cassandra
Advanced data modeling with apache cassandraPatrick McFadin
 
I Truth #2 -ILove
I Truth #2 -ILoveI Truth #2 -ILove
I Truth #2 -ILovebdpayne
 
Keep Cloud Transformation on Track: Nine Best Practices to Avoid or Break Thr...
Keep Cloud Transformation on Track: Nine Best Practices to Avoid or Break Thr...Keep Cloud Transformation on Track: Nine Best Practices to Avoid or Break Thr...
Keep Cloud Transformation on Track: Nine Best Practices to Avoid or Break Thr...Amazon Web Services
 
The Trotternish Landslides
The Trotternish LandslidesThe Trotternish Landslides
The Trotternish LandslidesAlan Doherty
 
Online Makeover: As Technology Changes, So Should Your Web Site
Online Makeover: As Technology Changes, So Should Your Web SiteOnline Makeover: As Technology Changes, So Should Your Web Site
Online Makeover: As Technology Changes, So Should Your Web SiteChris Gee
 
ケーズデンキの販管費比率が低い本当の理由
ケーズデンキの販管費比率が低い本当の理由ケーズデンキの販管費比率が低い本当の理由
ケーズデンキの販管費比率が低い本当の理由Hikaru GOTO
 
Workstyles e Netstyles Sostenibili e Competitivi
Workstyles e Netstyles Sostenibili e CompetitiviWorkstyles e Netstyles Sostenibili e Competitivi
Workstyles e Netstyles Sostenibili e Competitivijexxon
 
Tsunami - Sendai Earthquake
Tsunami - Sendai EarthquakeTsunami - Sendai Earthquake
Tsunami - Sendai EarthquakeAlan Doherty
 
Knooppuntcafé Roparun Team 296 Beeld en Geluid
Knooppuntcafé Roparun Team 296 Beeld en GeluidKnooppuntcafé Roparun Team 296 Beeld en Geluid
Knooppuntcafé Roparun Team 296 Beeld en GeluidGeert Wissink
 
Luigi vannutelli, La dinamica dei Contratti ICT in Azienda
Luigi vannutelli, La dinamica dei Contratti ICT in AziendaLuigi vannutelli, La dinamica dei Contratti ICT in Azienda
Luigi vannutelli, La dinamica dei Contratti ICT in AziendaAndrea Rossetti
 
Rss Presentation
Rss PresentationRss Presentation
Rss PresentationEmily24
 

Andere mochten auch (20)

7 Stages of Scaling Web Applications
7 Stages of Scaling Web Applications7 Stages of Scaling Web Applications
7 Stages of Scaling Web Applications
 
CFS: Cassandra Backed Storage for Hadoop
CFS: Cassandra Backed Storage for HadoopCFS: Cassandra Backed Storage for Hadoop
CFS: Cassandra Backed Storage for Hadoop
 
Vertical vs Horizontal Scaling
Vertical vs Horizontal Scaling Vertical vs Horizontal Scaling
Vertical vs Horizontal Scaling
 
Advanced data modeling with apache cassandra
Advanced data modeling with apache cassandraAdvanced data modeling with apache cassandra
Advanced data modeling with apache cassandra
 
I Truth #2 -ILove
I Truth #2 -ILoveI Truth #2 -ILove
I Truth #2 -ILove
 
Keep Cloud Transformation on Track: Nine Best Practices to Avoid or Break Thr...
Keep Cloud Transformation on Track: Nine Best Practices to Avoid or Break Thr...Keep Cloud Transformation on Track: Nine Best Practices to Avoid or Break Thr...
Keep Cloud Transformation on Track: Nine Best Practices to Avoid or Break Thr...
 
Milieu
MilieuMilieu
Milieu
 
Van gogh
Van goghVan gogh
Van gogh
 
The Trotternish Landslides
The Trotternish LandslidesThe Trotternish Landslides
The Trotternish Landslides
 
Online Makeover: As Technology Changes, So Should Your Web Site
Online Makeover: As Technology Changes, So Should Your Web SiteOnline Makeover: As Technology Changes, So Should Your Web Site
Online Makeover: As Technology Changes, So Should Your Web Site
 
ケーズデンキの販管費比率が低い本当の理由
ケーズデンキの販管費比率が低い本当の理由ケーズデンキの販管費比率が低い本当の理由
ケーズデンキの販管費比率が低い本当の理由
 
Leicestshire
LeicestshireLeicestshire
Leicestshire
 
Workstyles e Netstyles Sostenibili e Competitivi
Workstyles e Netstyles Sostenibili e CompetitiviWorkstyles e Netstyles Sostenibili e Competitivi
Workstyles e Netstyles Sostenibili e Competitivi
 
Tsunami - Sendai Earthquake
Tsunami - Sendai EarthquakeTsunami - Sendai Earthquake
Tsunami - Sendai Earthquake
 
Raves
RavesRaves
Raves
 
ccPublisher
ccPublisherccPublisher
ccPublisher
 
Knooppuntcafé Roparun Team 296 Beeld en Geluid
Knooppuntcafé Roparun Team 296 Beeld en GeluidKnooppuntcafé Roparun Team 296 Beeld en Geluid
Knooppuntcafé Roparun Team 296 Beeld en Geluid
 
she de franco
she de francoshe de franco
she de franco
 
Luigi vannutelli, La dinamica dei Contratti ICT in Azienda
Luigi vannutelli, La dinamica dei Contratti ICT in AziendaLuigi vannutelli, La dinamica dei Contratti ICT in Azienda
Luigi vannutelli, La dinamica dei Contratti ICT in Azienda
 
Rss Presentation
Rss PresentationRss Presentation
Rss Presentation
 

Ähnlich wie Scaling the Platform for Your Startup

Scaling the Platform for Your Startup - Startup Talks June 2015
Scaling the Platform for Your Startup - Startup Talks June 2015Scaling the Platform for Your Startup - Startup Talks June 2015
Scaling the Platform for Your Startup - Startup Talks June 2015Amazon Web Services
 
Scaling the Platform for Your Startup
Scaling the Platform for Your StartupScaling the Platform for Your Startup
Scaling the Platform for Your StartupAmazon Web Services
 
Dean Bryen: Scaling The Platform For Your Startup
Dean Bryen: Scaling The Platform For Your StartupDean Bryen: Scaling The Platform For Your Startup
Dean Bryen: Scaling The Platform For Your Startuphuguk
 
Ceate a Scalable Cloud Architecture
Ceate a Scalable Cloud ArchitectureCeate a Scalable Cloud Architecture
Ceate a Scalable Cloud ArchitectureAmazon Web Services
 
How to Scale to Millions of Users with AWS
How to Scale to Millions of Users with AWSHow to Scale to Millions of Users with AWS
How to Scale to Millions of Users with AWSAmazon Web Services
 
Scaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million UsersScaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million UsersAmazon Web Services
 
NWCloud Cloud Track - Best Practices for Architecting in the Cloud
NWCloud Cloud Track - Best Practices for Architecting in the CloudNWCloud Cloud Track - Best Practices for Architecting in the Cloud
NWCloud Cloud Track - Best Practices for Architecting in the Cloudnwcloud
 
Your First 10 Million Users with Amazon Web Services
Your First 10 Million Users with Amazon Web ServicesYour First 10 Million Users with Amazon Web Services
Your First 10 Million Users with Amazon Web ServicesAmazon Web Services
 
AWS Cloud Kata 2014 | Jakarta - 2-1 AWS Intro and Scale 2014
AWS Cloud Kata 2014 | Jakarta - 2-1 AWS Intro and Scale 2014AWS Cloud Kata 2014 | Jakarta - 2-1 AWS Intro and Scale 2014
AWS Cloud Kata 2014 | Jakarta - 2-1 AWS Intro and Scale 2014Amazon Web Services
 
Aws webcast - Scaling on AWS 13 08-20
Aws webcast - Scaling on AWS 13 08-20Aws webcast - Scaling on AWS 13 08-20
Aws webcast - Scaling on AWS 13 08-20Amazon Web Services
 
AWS Summit Stockholm 2014 – T1 – Architecting highly available applications o...
AWS Summit Stockholm 2014 – T1 – Architecting highly available applications o...AWS Summit Stockholm 2014 – T1 – Architecting highly available applications o...
AWS Summit Stockholm 2014 – T1 – Architecting highly available applications o...Amazon Web Services
 
(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014
(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014
(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014Amazon Web Services
 
Your First 10 million Users on the AWS Cloud
Your First 10 million Users on the AWS CloudYour First 10 million Users on the AWS Cloud
Your First 10 million Users on the AWS CloudAmazon Web Services
 
Scaling on AWS for the First 10 Million Users at Websummit Dublin
Scaling on AWS for the First 10 Million Users at Websummit DublinScaling on AWS for the First 10 Million Users at Websummit Dublin
Scaling on AWS for the First 10 Million Users at Websummit DublinAmazon Web Services
 
Scaling on AWS for the First 10 Million Users at Websummit Dublin
Scaling on AWS for the First 10 Million Users at Websummit DublinScaling on AWS for the First 10 Million Users at Websummit Dublin
Scaling on AWS for the First 10 Million Users at Websummit DublinIan Massingham
 
Journey Towards Scaling Your Application to Million Users
Journey Towards Scaling Your Application to Million UsersJourney Towards Scaling Your Application to Million Users
Journey Towards Scaling Your Application to Million UsersAdrian Hornsby
 
Migrating enterprise workloads to AWS
Migrating enterprise workloads to AWSMigrating enterprise workloads to AWS
Migrating enterprise workloads to AWSTom Laszewski
 
Scaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million Users Scaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million Users Amazon Web Services
 

Ähnlich wie Scaling the Platform for Your Startup (20)

Scaling the Platform for Your Startup - Startup Talks June 2015
Scaling the Platform for Your Startup - Startup Talks June 2015Scaling the Platform for Your Startup - Startup Talks June 2015
Scaling the Platform for Your Startup - Startup Talks June 2015
 
Create cloud service on AWS
Create cloud service on AWSCreate cloud service on AWS
Create cloud service on AWS
 
Scaling the Platform for Your Startup
Scaling the Platform for Your StartupScaling the Platform for Your Startup
Scaling the Platform for Your Startup
 
Dean Bryen: Scaling The Platform For Your Startup
Dean Bryen: Scaling The Platform For Your StartupDean Bryen: Scaling The Platform For Your Startup
Dean Bryen: Scaling The Platform For Your Startup
 
Ceate a Scalable Cloud Architecture
Ceate a Scalable Cloud ArchitectureCeate a Scalable Cloud Architecture
Ceate a Scalable Cloud Architecture
 
How to Scale to Millions of Users with AWS
How to Scale to Millions of Users with AWSHow to Scale to Millions of Users with AWS
How to Scale to Millions of Users with AWS
 
Scaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million UsersScaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million Users
 
NWCloud Cloud Track - Best Practices for Architecting in the Cloud
NWCloud Cloud Track - Best Practices for Architecting in the CloudNWCloud Cloud Track - Best Practices for Architecting in the Cloud
NWCloud Cloud Track - Best Practices for Architecting in the Cloud
 
Your First 10 Million Users with Amazon Web Services
Your First 10 Million Users with Amazon Web ServicesYour First 10 Million Users with Amazon Web Services
Your First 10 Million Users with Amazon Web Services
 
AWS Cloud Kata 2014 | Jakarta - 2-1 AWS Intro and Scale 2014
AWS Cloud Kata 2014 | Jakarta - 2-1 AWS Intro and Scale 2014AWS Cloud Kata 2014 | Jakarta - 2-1 AWS Intro and Scale 2014
AWS Cloud Kata 2014 | Jakarta - 2-1 AWS Intro and Scale 2014
 
Aws webcast - Scaling on AWS 13 08-20
Aws webcast - Scaling on AWS 13 08-20Aws webcast - Scaling on AWS 13 08-20
Aws webcast - Scaling on AWS 13 08-20
 
AWS Summit Stockholm 2014 – T1 – Architecting highly available applications o...
AWS Summit Stockholm 2014 – T1 – Architecting highly available applications o...AWS Summit Stockholm 2014 – T1 – Architecting highly available applications o...
AWS Summit Stockholm 2014 – T1 – Architecting highly available applications o...
 
(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014
(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014
(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014
 
Your First 10 million Users on the AWS Cloud
Your First 10 million Users on the AWS CloudYour First 10 million Users on the AWS Cloud
Your First 10 million Users on the AWS Cloud
 
Scaling on AWS for the First 10 Million Users at Websummit Dublin
Scaling on AWS for the First 10 Million Users at Websummit DublinScaling on AWS for the First 10 Million Users at Websummit Dublin
Scaling on AWS for the First 10 Million Users at Websummit Dublin
 
Scaling on AWS for the First 10 Million Users at Websummit Dublin
Scaling on AWS for the First 10 Million Users at Websummit DublinScaling on AWS for the First 10 Million Users at Websummit Dublin
Scaling on AWS for the First 10 Million Users at Websummit Dublin
 
Journey Towards Scaling Your Application to Million Users
Journey Towards Scaling Your Application to Million UsersJourney Towards Scaling Your Application to Million Users
Journey Towards Scaling Your Application to Million Users
 
Migrating enterprise workloads to AWS
Migrating enterprise workloads to AWSMigrating enterprise workloads to AWS
Migrating enterprise workloads to AWS
 
[Jun AWS 201] Technical Workshop
[Jun AWS 201] Technical Workshop[Jun AWS 201] Technical Workshop
[Jun AWS 201] Technical Workshop
 
Scaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million Users Scaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million Users
 

Mehr von Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

Mehr von Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Kürzlich hochgeladen

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 

Kürzlich hochgeladen (20)

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 

Scaling the Platform for Your Startup

  • 1. Scaling  the  Platform  for   Your  Startup Andreas  Chatzakis AWS  Solutions  Architecture
  • 2. Why  are  you  here? • Building  the  technology  platform  for  your  startup • You  want  to  prepare  for  success • Learn  about  design  patterns  &  scalability • A  pragmatic  approach  for  startups
  • 3. Priorities  for  startups • Racing  within  a  window  of  opportunity • Small  team  with  no  legacy • Focus  on  solving  a  problem • Avoid  over-­engineering  &  re-­engineering • Reduce  risk  of  failure  when  you  go  viral
  • 4. A  scalable  architecture • Can  support  growth  in  users,  traffic,  data  size   • Without  practical  limits • Without  a  drop  in  performance • Seamlessly  -­ just  by  adding  more  resources • Efficiently  -­ in  terms  of  cost  per  user
  • 6. AWS  Regions US-WEST (Oregon) EU-WEST (Ireland) ASIA PAC (Tokyo) US-WEST (N. California) SOUTH AMERICA (Sao Paulo) US-EAST (Virginia) AWS GovCloud (US) ASIA PAC (Sydney) ASIA PAC (Singapore) CHINA (Beijing)
  • 7. Availability  Zones  (AZs) US-WEST (Oregon) EU-WEST (Ireland) ASIA PAC (Tokyo) US-WEST (N. California) SOUTH AMERICA (Sao Paulo) US-EAST (Virginia) AWS GovCloud (US) ASIA PAC (Sydney) ASIA PAC (Singapore) CHINA (Beijing) EU-CENTRAL (Frankfurt) ASIA PAC (Singapore) CHINA (Beijing)
  • 9. Enterprise Applications Virtual  Desktop Sharing  &  Collaboration Platform Services Analytics Hadoop Real-­time Streaming  Data Data Warehouse Data Pipelines App  Services Queuing  &   Notifications Workflow App  streaming Transcoding Email Search Deployment  &  Management One-­click  web   app  deployment Dev/ops  resource   management Resource   Templates Mobile  Services Identity Sync Mobile   Analytics Push   Notifications Administration &  Security Identity   Management Access   Control Usage   Auditing Key   Storage Monitoring And  Logs Core Services Compute (VMs,  Auto-­scaling   and   Load   Balancing) Storage (Object,  Block   and   Archival) CDN Databases (Relational,   NoSQL,   Caching) Networking (VPC,  DX,  DNS) Infrastructure Regions Availability  Zones Points  of  Presence
  • 10. Day  1  – Dev  &  private  beta
  • 11. Single  host THE server (e.g. Apache, MySQL) Elastic IP www.example.com Amazon Route 53 DNS service Server Image (AMI)
  • 12. Day  2  -­ Public  beta
  • 13. We  need  a  bigger  server • Add  larger  &  faster  storage  (EBS) • Use  the  right  instance  type • Easy  to  change  instance  sizes • Not  our  long  term  strategy • Will  hit  an  endpoint  eventually • No  fault  tolerance
  • 14. Separating  web  and  DB • More  capacity • Scale  each  tier  individually • Tailor  instance  for  each  tier – Instance  type – Storage • Security – Security  groups – DB  in  a  private  VPC  subnet
  • 15. But  how  do  I  choose  what   DB  technology  I  need?   SQL?  NoSQL?
  • 16. Why  start  with  a  Relational  DB? • SQL  is  versatile  &  feature-­rich • Lots  of  existing  code,  tools,  knowledge • Clear  patterns  to  scalability  (for  read-­heavy  apps) • Reality:  eventually  you  will  have  a  polyglot  data  layer – There  will  be  workloads  where  NoSQL  is  a  better  fit – Combination  of  both  Relational  and  NoSQL – Use  the  right  tool  for  each  workload
  • 17. Key  Insight:  Relational  Databases  are  Complex • Our  experience  running  Amazon.com taught  us  that   relational  databases  can  be  a  pain  to  manage  and   operate  with  high  availability • Poorly  managed  relational  databases  are  a  leading   cause  of  lost  sleep  and  downtime  in  the  IT  world! • Especially  for  startups  with  small  teams
  • 18. Relational  Databases Fully managed; zero admin Amazon RDS Deploy Amazon  Aurora
  • 20. Offload  static  content • Amazon  S3:  highly  available  hosting  that  scales – Static  files  (JavaScript,  CSS,  images) – User  uploads • S3  URLs  – serve  directly  from  S3 • Let  the  web  server  focus  on  dynamic  content
  • 21. Masterclass  Live:  Amazon  S3 Upcoming  Session  at  the  AWS  Pop  Up  Loft Wednesday  16th September,  10.00
  • 22. Amazon  CloudFront • Worldwide  network  of  edge  locations • Cache  on  the  edge   – Reduce  latency – Reduce  load  on  origin  servers   – Static  and dynamic  content – Even  few  seconds  caching  of  popular  content  can  have  huge  impact • Connection  optimizations – Optimize  transfer  route – Reuse  connections – Benefits  even  non  cachable content CloudFront
  • 23. CloudFront for  static  &  dynamic  content Amazon Route 53 EC2 instance(s) S3 bucket Static content Dynamic content css/* js/* Images/* Default(*) CloudFron t distributio n
  • 24. Database  caching • Faster  response  from  RAM • Reduce  load  on  database Application server 1.  If  data  in  cache,   return  result 2. If  not  in  cache,   read  from  DB RDS database Amazon ElastiCache 3.  And  store   in  cache
  • 25. Amazon  ElastiCache:  in-­memory  cache • Simple  to  Deploy   • Managed – Automatically  replaces  failed  nodes – Patch  management • Elastic • Compatible ElastiCache
  • 26. Day  3  – Paying  customers
  • 27. High  Availability Availability Zone a RDS DB instance Web server S3 bucket for static assets www.example.com Amazon Route 53 DNS service Amazon CloudFront ElastiCache node 1
  • 28. High  Availability Availability Zone a RDS DB instance Availability Zone b Web server Web server S3 bucket for static assets www.example.com Amazon Route 53 DNS service Amazon CloudFront ElastiCache node 1
  • 29. High  Availability Availability Zone a RDS DB instance Availability Zone b www.example.com Amazon Route 53 DNS service Elastic Load Balancing Web server Web server S3 bucket for static assets Amazon CloudFront ElastiCache node 1
  • 30. Elastic  Load  Balancing • Managed  Load  Balancing  Service • Fault  tolerant • Health  Checks • Distributes  traffic  across  AZs • Elastic  – automatically  scales  its  capacity
  • 31. Data  Layer  HA Availability Zone a RDS DB instance Availability Zone b www.example.com Amazon Route 53 DNS service Elastic Load Balancing Web server Web server S3 bucket for static assets ElastiCache node 1 Amazon CloudFront
  • 32. Availability Zone a RDS DB instance Availability Zone b www.example.com Amazon Route 53 DNS service Elastic Load Balancing Web server Web server RDS DB standby S3 bucket for static assets ElastiCache node 1 Amazon CloudFront Data  Layer  HA
  • 33. Data  Layer  HA Availability Zone a RDS DB instance ElastiCache node 1 Availability Zone b S3 bucket for static assets www.example.com Amazon Route 53 DNS service Elastic Load Balancing Web server Web server RDS DB standby
  • 34. Data  Layer  HA Availability Zone a RDS DB instance ElastiCache node 1 Availability Zone b S3 bucket for static assets www.example.com Amazon Route 53 DNS service Elastic Load Balancing Web server Web server RDS DB standby ElastiCache node 2
  • 35. User  sessions • Problem:  Often  stored  on  local  disk   (not  shared)     • Quickfix:  ELB  Session  stickiness • Solution:  DynamoDB Elastic Load Balancing Web server Web server Logged  in Logged  out
  • 36. Amazon  DynamoDB • Managed  document  and  key-­value  NoSQL  DB • Simple  to  launch  and  scale • To  millions  of  IOPS • Both  reads  and  writes • Consistent,  fast  performance • Durable:  perfect  for  storage  of  session  data https://github.com/aws/aws-­dynamodb-­session-­tomcat http://docs.aws.amazon.com/aws-­sdk-­php/guide/latest/feature-­dynamodb-­session-­handler.html
  • 37. AWS  bootcamp:  Architecting  Highly   Available  Applications  on  AWS Free  Training at  the  AWS  Pop  Up  Loft 9th October  10.00
  • 38. Day  4  – Let’s  go  viral!
  • 39. Replace  guesswork  with  elastic  IT Startups  pre-­AWS Demand Unhappy Customers Waste $$$ Traditional Capacity Capacity Demand AWS Cloud
  • 40. Scaling  the  web  tier Availability Zone a RDS DB instance ElastiCache node 1 Availability Zone b S3 bucket for static assets www.example.com Amazon Route 53 DNS service Elastic Load Balancing Web server Web server RDS DB standby ElastiCache node 2
  • 41. Scaling  the  web  tier Availability Zone a RDS DB instance ElastiCache node 1 Availability Zone b S3 bucket for static assets www.example.com Amazon Route 53 DNS service Elastic Load Balancing Web server Web server RDS DB standby ElastiCache node 2 Web server Web server
  • 42. Scaling  the  web  tier Availability Zone a RDS DB instance ElastiCache node 1 Availability Zone b S3 bucket for static assets www.example.com Amazon Route 53 DNS service Elastic Load Balancing Web server Web server RDS DB standby ElastiCache node 2 Web server Web server
  • 43. Automatic  resizing  of  compute   clusters  based  on  demand   Feature Details Control Define  minimum  and  maximum  instance pool   sizes  and  when  scaling  and  cool  down  occurs. Integrated  to  Amazon   CloudWatch Use  metrics gathered  by  CloudWatch to  drive   scaling. Instance  types Run  Auto  Scaling  for  on-­‐demand  and  Spot   Instances. Compatible  with  VPC. aws autoscaling create-­auto-­scaling-­group -­-­auto-­scaling-­group-­name  MyGroup -­-­launch-­configuration-­name  MyConfig -­-­min-­size  4 -­-­max-­size  200 -­-­availability-­zones  us-­west-­2c,  us-­west-­2b Auto  Scaling Trigger  auto-­scaling  policy Amazon   CloudWatch
  • 44.
  • 45.
  • 46. Decompose  into  small,   loosely  coupled,  stateless   building  blocks Prerequisite
  • 47. What  does  this  mean  in  practice? • Only  store  transient  data  on  local  disk • Needs  to  persist  beyond  a  single  http  request? – Then  store  it  elsewhere User  uploads User  Sessions Amazon  S3 AWS  DynamoDB Application  Data Amazon  RDS
  • 48. Having  decomposed  into   small,  loosely  coupled,   stateless  building  blocks You  can  now  Scale  out  with  ease Having  done  that…
  • 49. Having  decomposed  into   small,  loosely  coupled,   stateless  building  blocks We  can  also  Scale  back  with  ease Having  done  that…
  • 50. Take  the  shortcut • While  this  architecture  is  simple  you  still  need   to  deal  with:   – Configuration  details – Deploying  code  to  multiple  instances – Maintaining  multiple  environments  (Dev,  Test,  Prod) – Maintain  different  versions  of  the  application • Solution:  Use  AWS  Elastic  Beanstalk
  • 51. AWS  Elastic  Beanstalk  (EB) • Easily  deploy,  monitor,  and  scale  three-­tier  web   applications  and  services. • Infrastructure  provisioned  and  managed  by  EB   • You  maintain  control. • Preconfigured  application  containers   • Easily  customizable. • Support  for  these  platforms:
  • 52. Deploy  your  Apps  with  AWS  Elastic   Beanstalk Upcoming  Session  at  the  AWS  Pop  Up  Loft Tuesday  15th September,  16.00
  • 53. Day  5  – Add  more  features
  • 54. Mobile Push Notifications Mobile Analytics Cognito Cognito Sync Analytics Kinesis Data Pipeline RedShift EMR Your  Applications AWS  Global  Infrastructure Network VPC Direct Connect Route   53 Storage EBS S3 Glacier CloudFront Database DynamoDBRDS ElastiCache Deployment   &  Management Elastic Beanstalk OpsWorks Cloud Formation Code Deploy Code Pipeline Code Commit Security  &  Administration CloudWatch Config Cloud Trail IAM Directory KMS Application SQS SWF App Stream Elastic Transcoder SES Cloud Search SNS Enterprise  Applications WorkSpaces WorkMail WorkDocs Compute EC2 ELB Auto Scaling LambdaECS
  • 55. AWS  building  blocks Inherently  Scalable  &  Highly  Available Scalable  &  Highly  Available a Elastic  Load  Balancing a Amazon  CloudFront a Amazon  Route53 a Amazon  S3 a Amazon  SNS  /  SQS a Amazon  SES a Amazon  CloudSearch a AWS  Lambda a … a Amazon  DynamoDB a Amazon  Redshift a Amazon  RDS a Amazon  Elasticache a … 4 Amazon  EC2 4 Amazon  VPC Automated Configurable With  the  right  architecture
  • 56. Stay  focused  as  you  scale  your  team AWS Cloud-­‐Based Infrastructure Your Business More  Time  to  Focus  on Your  Business Configuring  Your   Cloud  Assets 70% 30%70% On-­‐Premise Infrastructure 30% Managing  All  of  the   “Undifferentiated  Heavy  Lifting”
  • 57. Don’t  reinvent  the  wheel • Notification  system • E-­Mail  component • Search  engine • Workflow  engine • Queue • Transcoding  system • Monitoring  system Amazon   CloudSearch Amazon  SQSAmazon  SNS Amazon  Elastic   Transcoder Amazon  SWFAmazon  SES If  you  find  yourself  writing  your  own…
  • 58. Search  features • Freetext AND  Structured • Synonyms • Stemming • Relevance • Complex  scoring • Faceting • Geospatial
  • 59. Amazon  CloudSearch  is  a  fully  managed  search   service  in  the  cloud  for  your  website  or  application  
  • 60. Rich  search  feature  set Source:  IDC,  Nielsen,  Twitter  blog Faceting Highlighting Autocomplete suggestions Geospatial   search
  • 61. 34  languages  covering  major  geographies
  • 63. Day  6  – Growing  fast
  • 64. Prepare  for  the  challenges • Increase  in  concurrent  users • Data  size  growth • More  features  =>  more  DB  tables • Technical  debt  (e.g.  inefficient  queries) – Reduce  it – Manage  it
  • 65. Scaling  Relational  DBs  – option  1 Increase  Database  instance  specs – Larger  instance  type  (RAM,  CPU,  Network) – More  storage   – Faster  storage  (IOPS) – Amazon  Aurora
  • 66. My  SQL  compatible Available,  durable,  and  fault  tolerant 5X  better  performance  of   high-­end  MySQL  database Highly  scalable  and  secure Up  to  64TB  of  storage Amazon  Aurora 1/10th  the  cost  of  the  leading   commercial  database  solutions
  • 67. Amazon  Aurora  -­ Write  performance • MySQL  Sysbench • R3.8XL  with  32  cores   and  244  GB  RAM • 4  client  machines  with   1,000  threads  each
  • 68. Amazon  Aurora  -­ Read  performance • MySQL  Sysbench • R3.8XL  with  32  cores   and  244  GB  RAM • Single  client  with   1,000  threads
  • 69. Scaling  Relational  DBs  – option  2 Read  Replicas  (Master  – Slave) – Scale  out  beyond  capacity  of  single  DB  instance – Available  in  Amazon  RDS  for  MySQL,  PostgreSQL  and  Amazon  Aurora – Replication  lag – Writes  =>  master – Reads  with  tolerance  to  stale  data  =>  read  replica  (slave) – Reads  with  need  for  most  recent  data  =>  master
  • 70. Scaling  the  DB Web server Web server Web server Web server Availability Zone a RDS DB instance ElastiCache node 1 Availability Zone b S3 bucket for static assets www.example.com Amazon Route 53 DNS service Elastic Load Balancing RDS DB standby ElastiCache node 2
  • 71. Scaling  the  DB Web server Web server Web server Web server Availability Zone a RDS DB instance ElastiCache node 1 Availability Zone b S3 bucket for static assets www.example.com Amazon Route 53 DNS service Elastic Load Balancing RDS DB standby ElastiCache node 2 RDS read replica
  • 72. Scaling  the  DB Web server Web server Web server Web server Availability Zone a RDS DB instance ElastiCache node 1 Availability Zone b S3 bucket for static assets www.example.com Amazon Route 53 DNS service Elastic Load Balancing RDS DB standby ElastiCache node 2 RDS read replica RDS read replica
  • 73. Amazon  Aurora  Replicas  have  less  replication  lag 2.6 3.4 3.9 5.4 1,000 2,000 5,000 10,000 0 50,000 100,000 150,000 200,000 250,000 300,000 350,000 Updates  per  second Read  replica  lag  in  milliseconds Read  replica  lag Aurora RDS   MySQL;;30,000  IOPS  (Single  AZ) Updates per second Amazon   Aurora RDS  MySQL 30K IOPS (single  AZ) 1,000 2.62  ms 0  s 2,000 3.42  ms 1  s 5,000 3.94  ms 60  s 10,000 5.38  ms 300  s Write  workload 250  tables Query  cache  on  for  Amazon  Aurora,  off  for  MySQL  (best   settings)
  • 74. What  if  your  app  is  write-­heavy? Challenge:  You  will  eventually  hit  the  write  throughput  or   storage  limit  of  the  master  node   Solutions: • Federation  (splitting  into  multiple  DBs  based  on  function) • Sharding (splitting  one  data  set  up  across  multiple  hosts)
  • 75. Database  federation • Split  up  databases  by   function/purpose • Harder  to  do  cross-­function   queries • Essentially  delaying  the  need  for   something  like  sharding/NoSQL   until  much  further  down  the  line • Won’t  help  with  single  huge   functions/tables Forums  DB Users  DB Products   DB
  • 76. Sharded horizontal  scaling • More  complex  at  the   application  layer • ORM  support  can  help • No  practical  limit  on   scalability • Operation   complexity/sophistication   • Shard  by  function  or  key   space • RDBMS  or  NoSQL User ShardID 002345 A 002346 B 002347 C 002348 B 002349 A Shard  C Shard  B Shard  A
  • 77. NoSQL data  stores • Trade  query  &  integrity  features  of  Relational  DBs  for – More  flexible  data  model   – Horizontal  scalability  &  predictable  performance DynamoDB Provisioned  read/write  performance  per  table
  • 78. Massive  and  Seamless  Scale • Distributed  system  that  can  scale  both  reads  and writes – Sharding +  Replicas • Automatic  partitioning: – Data  set  size  growth – Provisioned  capacity  increases table
  • 79. Low  provisioned  throughput Table Partition SSD Region Illustrative   diagram   only Availability  ZoneAvailability  Zone Availability  Zone Replica Partition SSD Replica Partition SSD
  • 80. Increased  provisioned  throughput Illustrative   diagram   only Region Table Partition SS D Table Partition SS D Table Partition SS D Table Partition SS D Table Partition SS D Table Partition SS D Table Partition SS D Table Partition SS D Table Partition SS D Table Partition SS D
  • 81. High  provisioned  throughput Region Illustrative   diagram   only Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n Tabl e Partitio n
  • 83. Cloudwatch Operationally  you  will  need: • Metrics – Default – Custom • Alarms • Centralized  logs
  • 84. AWS  Marketplace  &  Partners  Can  Help • Find,  research,  buy  software • Aligns  with  EC2  usage  model   • Launch  in  minutes • Marketplace  billing  integrated   into  your  AWS  account • 20+  categories Learn  more  at:  aws.amazon.com/marketplace
  • 86. Amazon  Simple  Queuing  Service  (SQS) Tight  coupling • Place  asynchronous  tasks  into  Amazon  SQS • Respond  quickly  to  end  users • Protects  backend  systems  from  spikes • Process  at  own  pace • Protect  end  users  from  backend  problems • Item  will  be  processed  eventually SQS Get Message Back End EC2 Instance Put Message Front End EC2 Instance
  • 87. Decoupling  in  action Loose  coupling Upload  photo Resize   photo EC2  Instances
  • 88. Decoupling  in  action Loose  coupling Q Upload  photo Resize   photo Upload  photo Resize   photo EC2  Instances Amazon  SQS EC2  Instances
  • 89. Decoupling  in  action Loose  coupling Q Upload  photo Resize   photoUpload  photo Resize   photoUpload  photo Resize   photo Upload  photo Resize   photoResize   photoResize   photo EC2  Instances Amazon  SQS EC2  Instances
  • 90. Introducing  AWS  Lambda Amazon  S3  Bucket  Events AWS  Lambda Original  image Thumbnailed image 1 2 3
  • 91. Event-­Driven  Compute  in  the  Cloud Lambda  functions:  Stateless,  request-­driven  code  execution • Triggered  by  events  in  other  services: • PUT  to  an  Amazon  S3  bucket • Write  to  an  Amazon  DynamoDB  table • Record  in  an  Amazon  Kinesis  stream • Amazon  SNS  Message  received • Changes  in  Amazon  Cognito data • Makes  it  easy  to… • Transform  data  as  it  reaches  the  cloud • Perform  data-­driven  auditing,  analysis,  and  notification • Kick  off  workflows
  • 92. Data  Triggers  – Amazon  Simple  Notification  Service Lambda  FunctionSNSCloudWatch Metric
  • 93. Data  Triggers  – Amazon  Cognito Lambda  FunctionCognito
  • 94. Data  Triggers:  Amazon  DynamoDB AWS  LambdaAmazon  DynamoDB Table  and  Stream Send  SNS  Push   notifications Update  another  table
  • 95. Data  Triggers  – Amazon  Kinesis IoT Device Kinesis Lambda DynamoDB
  • 96. Dynamic  content  generation   based  on  incoming  news  text   and  images Real  time  log   processing  for   prediction  analytics Thumbnailing installation  site  photos   for  mobile  use Real  time  processing  and   recording  of  inbound  traffic  from   a  range  of  social  media   platforms Large  scale  distributed   search  across  blog   content Operational   analytics  and  real   time  troubleshooting
  • 97. Introducing  the  AWS  API  Gateway Internet Mobile  Apps Websites Services API   Gateway AWS  Lambda   functions AWS API  Gateway   Cache Endpoints  on   Amazon  EC2  /   Amazon   Elastic   Beanstalk Any  other  publicly   accessible  endpoint Amazon   CloudWatch   Monitoring
  • 98. No  server  is  easier  to  manage  than   "no  server”. Werner  Vogels
  • 99. Startups  without  Servers Upcoming  Session  at  the  AWS  Pop  Up  Loft Thursday  17th September,  11.00 Thursday  1st October,  10.00
  • 101. Experiment  and  collect  data • Build  an  MVP • Run  A/B  testing • Analyze  user  behavior • Iterate • Get  insights  about  your  customers
  • 102. Data  Produced Available  for  Analysis Gartner:  User  Survey  Analysis:  Key  Trends  Shaping  the  Future  of  Data  Center  Infrastructure  Through  2011   IDC:  Worldwide  Business  Analytics  Software  2012–2016  Forecast  and  2011  Vendor  Shares  
  • 103. Three  Types  of  Data  Analytics Retrospective analysis  and   reporting Here-­and-­now real-­time  processing   and  dashboards Predictions to  enable  smart   apps Amazon  Kinesis   Amazon  EC2 Amazon  DynamoDB AWS  Lambda Amazon  Redshift   Amazon  RDS   Amazon  S3 Amazon  EMR AWS  Marketplace Amazon  Machine  Learning Amazon  EMR AWS  Lambda
  • 104. Fast,  simple,  petabyte-­scale  data  warehousing  for  less  than  $1,000/TB/Year Amazon  Redshift
  • 105. Amazon  Redshift  Architecture • Leader  Node – SQL  endpoint – Stores  metadata – Coordinates  query  execution • Compute  Nodes – Local,  columnar  storage – Execute  queries  in  parallel – Load,  backup,  restore  via   Amazon  S3;;  load  from   Amazon  DynamoDB  or  SSH • Two  hardware  platforms – Optimized  for  data  processing – DW1:  HDD;;  scale  from  2TB  to  1.6PB – DW2:  SSD;;  scale  from  160GB  to  256TB 10  GigE (HPC) Ingestion Backup Restore SQL  Clients/BI  Tools 128GB   RAM 16TB   disk 16   cores Amazon  S3  /  DynamoDB  /  SSH JDBC/ODBC 128GB   RAM 16TB   disk 16   coresCompute   Node 128GB   RAM 16TB   disk 16   coresCompute   Node 128GB   RAM 16TB   disk 16   coresCompute   Node Leader Node
  • 106. Amazon  Redshift  Node  Types Dense   Storage DW1.XL 15  GB  RAM 2  TB  disk 2  vcpus Single  Node  (2  TB) Cluster  2-­32  Nodes  (4  TB  – 64  TB) XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL XL
  • 107. Amazon  Redshift  Node  Types Dense   Storage DW1.8XL 120  GB  RAM 16  vcpus 16  TB  disk Cluster  2-­100  Nodes  (32  TB  – 1.6  PB) 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
  • 108. Amazon  Redshift  Node  Types Dense   Compute DW2.L 15  GB  RAM 160  GB   SSD 2  vpus Single  Node  (160  GB) Cluster  2-­32  Nodes  (320  GB  – 5  TB) L L L L L L L L L L L L L L L L L L L L L L L L L L L L L L L L L
  • 109. Amazon  Redshift  Node  Types Dense   Compute DW2.8XL 244  GB  RAM 32  vcpus 2.5  TB  SSD Cluster  2-­100  Nodes  (5  TB  – 256  TB) 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL 8XL
  • 110. AWS  bootcamp:  Building  a  Big  Data   Platform  on  AWS Free  Training at  the  AWS  Pop  Up  Loft 2nd October  10.00
  • 112. It  is  cheap  to  get  started  on  AWS How  do  successful  startups  save  more  as  they   grow  and  extend  their  runway? Stay  Lean!
  • 114. Amazon   EBS   standard   volume   prices  are  lowered   up   to  50%  for  both   storage  and   I/O   requests. January  21,  2014 50% Amazon   is   reducing   prices  for   Amazon   ElasticCache cache   nodes   by  an   average  of  34%. March  26,  2014 34% Amazon   S3:  We  are   reducing   prices  for   Standard   and  Reduced   Redundancy   Storage,   by  an  average  of  51%. March  26,  2014 51% We’ve  announced  price  reductions  42*  times  since   our  inception  in  2006.  Recent  price  drops  included… *as   of   April   1,   2014
  • 115. Main  cost-­saving  principles 1. Turn  off the  lights 2. Use  Auto  Scaling 3. Use  the  newer  instance  types 4. Use  the  right  instances for  your  workload 5. Use  Reserved  Instances  for  predictable  workloads 6. Use  Spot  Instances  for  async workloads 7. Leverage  Amazon  S3  storage  classes 8. Use  Glacier for  archival 9. Serve  content  through  Cloudfront 10. Offload  your  architecture
  • 116. Tools:  Cost  Explorer,  Detailed  Billing,  Alerts,  Usage  Reports
  • 118. Amazon Route 53 DNS serviceNo  limit Availability Zone a RDS DB instance ElastiCache node 2 Availability Zone b S3 bucket for static assets www.example.com Elastic Load Balancing RDS DB standby ElastiCache node 3 RDS read replica RDS read replica DynamoDB RDS read replica ElastiCache node 4 RDS read replica ElastiCache node 1 CloudSearchLambdaSES SQS
  • 119. A  quick  review • Keep  it  simple  and  stateless • Make  use  of  managed  self-­scaling  services • Multi-­AZ  and  AutoScale your  EC2  infrastructure • Use  the  right  DB  for  each  workload   • Cache  data  at  multiple  levels • Simplify  operations  with  deployment  tools
  • 120. Next  steps? READ!     • aws.amazon.com/documentation • aws.amazon.com/architecture • aws.amazon.com/start-­ups • aws.amazon.com/training ASK  FOR  HELP! • forums.aws.amazon.com • aws.amazon.com/support
  • 121.
  • 122. AWS  for  Startups Upcoming  Sessions  at  the  AWS  Pop  Up  Loft 11th September,  13.00 16th September,  17.00 29th September,  17.00 14th October,            18.00