The Angry Birds global web shop (at times the highest traffic Magento platform in the world) runs on Magento Enterprise, scales 100% automatically in the AWS infrastructure and is designed to easily handle 20x traffic peaks during marketing and new release peaks. Learn how to implement a Magento store for optimal performance, how to run it in a cloud environment, about the infrastructure and the applied strategies for continuous delivery, auto-scaling and zero-downtime rollouts.

1. Magento
High Performance
…in the cloud
php[world] 2014 – Washington D.C.

2. Fabrizio Branca

3. fbrnc
fbrnc

5. E-Commerce:
Magento
CMS:
TYPO3
Portals:
ZF, FLOW,…
Mobile Searchperience:
SOLR
>120 people
world-wide
High
Performance
/Scale
Global
Enterprise
Projects

6. San Francisco, CA
Janine
Fiona
that’s me
Leo

8. Who’s runs a shop with
10 orders/hour?
Who’s runs a shop with
10 orders/min?
Who’s runs a shop with
10 orders/sec?
YOU...?

10. PC games (download)
Plush toys, shirts, ...

11. > 24.000.000 likes > 500.000 followers
Social Media
Impact

12. your application
one process of…
execution time
memory

14. that’s your server
…running your
application

15. 𝑡𝑜𝑡𝑎𝑙 𝑚𝑒𝑚𝑜𝑟𝑦 = 𝑐𝑜𝑛𝑐𝑢𝑟𝑟𝑒𝑛𝑡 𝑢𝑠𝑒𝑟𝑠 ∗ 𝑚𝑒𝑚𝑜𝑟𝑦/𝑝𝑟𝑜𝑐𝑒𝑠𝑠
256 MB
/process
100 users
25 GB RAM
1000 users250 GB RAM

16. Option 1
Make your app “smaller”
make it
faster!make it
consume less
memory!

17. Option 2
Make your box “bigger”
a.k.a.
“vertical scaling”

18. Option 3
Add more boxes
a.k.a.
“horizontal scaling”

19. Vertical
Scaling
Optimization
Horizontal
Scaling
bigger
box
more
boxes
smaller “app”
Scaling

20. Single Server
Multi-Server
vs.
Single server
vs. Multi server
What’s the big deal?

21. Shared nothing?
Session
Storage
Cache
Code
JS/CSS
bundles
DatabaseAssets

22. Multi Server
Deployment

23. “Hello World!
Free Shipping
for everyone!”

25. “Hello World!
Free Shipping
for everyone!”
“Check out
our new
product!”
“Holiday
Season!”

26. Slow response
times, server
crashes,…

27. Waste of
money

28. Waste of
money
Slow response
times, server
crashes,…

29. Auto Scaling!
Pay per hour

30. Actually, it
looks more
like this

31. Cloud
(in case you haven’t
noticed…:)

33. Amazon EC2 Amazon S3 Amazon RDS
CloudFront
Route 53ElastiCache Elastic Load
Balancing
Cloud Services
AWS Management
ConsoleRightScale Amazon SWFOpsWorks
AWS
CloudFormation

34. EC2 instance

35. EC2 instance
Server Array
(or “auto-scaling group”)
Based on
various metrics

36. Server Array
(or “auto-scaling group”)
EC2 instance

37. Server Array
(or “auto-scaling group”)
EC2 instance

38. Elastic
Architecture
Booting new
instances
fully automatic
Auto-healing
Infrastructure
as Code

39. Loose
Coupling
No hardcoding!
“RightScale API, give
me all frontend
servers”
“ELB, here I am”

40. S3
Deployment X
Backend
Array
Frontend
Array
Worker
Array
Varnish
Array
S3 RDSElastiCache
CloudFront CloudFrontRoute 53
shop.angrybirds.com
Braintree
MailDRM
Giftcards
ELB

41. ELB
Backend
Array
Frontend
Array
Worker
Array
Varnish
Array
Deployment X
Route 53

42. Deployment X+1
Worker
Array
nt X
Route 53
ELB
Backend
Array
Frontend
Array
W
Varnish
Array

43. Worker
Array
nt X
Route 53
Backend
Array
Frontend
Array
W
Varnish
Array
Deployment X+1
ELB

44. Route 53
Backend
Array
Deployment X+1
Frontend
Array
Worker
Array
Varnish
Array
Deployment X
ELB ELB

45. Downtime
Number of
lost carts
Number of
lost sessions
and logins

46. 1.000.000unique visitors. per day.

47. concurrent users.

48. Orders.
10
5 6
7
8
9
per second.
Yes, per second!

49. AWS
OpsWorks
“DevOps Application Management Service”

50. Stacks, Layers
Instances and Apps
e.g. “production”
Varnish
PHP
DB Instances

51. Lifecycle
Events

52. Build InstallationDeploymentProvisioning
Chef
deploy
cookbook
before_
migrate.rb
Jenkins
Setup Conf Deploy

55. Route 53
ELB
CloudFront:
Theme (JS/CSS,…)
CloudFront:
media files
Internet
S3:
media
files
S3: build
packages
Continuous
Integration
Pipeline (Jenkins)
OpsWorks
Availability Zone
AWS
CloudFormation
CloudWatch
✓
✓inherently fault tolerant
✓
✓ ✓ ✓
✓
Redis:
Sessions
Redis:
Cache Backend
RDS DB
instance
RDS DB
instance standby
(Multi-AZ)
✓ ✓
Auto Scaling Group
Frontend Layer Backend Layer
Worker Layer
Varnish Layer
Data Layer
RDS DB Read
replica (for
reports)
Redis:
Full page cache
backend
✓
Production
Stack
External Services
(Fulfillment, DRM,
Giftcards,…)
SES:
Transactional
emails
✓
SQS:
Queue
✓
OpsWorks
Setup
“Stack”
(= Environment)
“Layers”
App Instances

56. VarnishCustom Layer
Redis Cache
Redis Sessions
Custom Layer
Magento Production,
Magento Staging,
Wordpress,…
PHP App Layer
MySQL
DB Layer
Minimal
Setup
Route 53
ELB
CloudFront:
Theme
(JS/CSS,…)
✓
✓ ✓
S3: build
packages
Continuous
Integration
Pipeline
(Jenkins)
✓
reuse instance for
multiple layers
Not recommended!
Just a thought
experiment…
< $120/month
for a c3.2xlarge

57. AppVarnish
Reverse Proxy
Protecting
the application
Only a few
requests hit your app!

58. 90%
Varnish
Tweaking
Cache Hitrate

59. 80%
Varnish
Tweaking
Cache Hitrate

60. 98.6%
Varnish
Tweaking
Cache Hitrate

61. Reduce
Number of Requests
… hitting your application

62. Use a
CDN

63. Offload
dynamic
parts
Do
Ajax

66. Request a page (HTTP Request)
deliver static page
Request
Delivering static content
Placeholders for dynamic parts.
Cache-Control headers
Ajax call request dynamic parts
and transfers the id of the currently visited product
JSON response with dynamic content
Replace placeholder
Write session id to cookie
Render the page
Browser Varnish Application

67. use cookies or
localStorage
Don’t
Ajax

68. Request a page (HTTP Request)
deliver static page
Request
Delivering static content
Placeholders for dynamic parts.
Cache-Control headers
Ajax call request dynamic parts
and transfers the id of the currently visited product
JSON response with dynamic content
Replace placeholder
Write session id to cookie
Render the page
Browser Varnish Application

69. 3xx
4xx
5xx
Redirects
Client errors
Cache other
status codes
Server errors

70. http://example.com/
?utm_source=phpworld14
&utm_medium=slides
…and many more.
Normalize
URLs
Filter these!

71. Reduce
Number of Requests
… hitting your application
Don’t AjaxDo Ajax
3xx
4xx
5xx
Cache other
status codes
http://example.com/
?utm_source=pw14
&utm_medium=slides
Normalize URLsUse a CDN

72. Bottleneck
Candidates
Dynamic requests
are still too slow?

73. How do you know?

74. StackDriver New Relic Aoe_Profiler Xdebug
Server
App
Profile!
minimal
overhead
Knows about
Magento… Very
detailed!

75. RAM
& CPU
That’s easy…

76. DatabaseThat’s not so easy…
offload the
database
less queries
(caching!)
more efficient
queries
(indexes,…)
scaling
sharding
master/slave
Percona Toolkit
(slow) query log

77. Growing
Data
Trimming
the fat!
Orders
Promotions
cms / banners
Aoe_CacheCleaner
Aoe_QuoteCleaner

78. File I/O
especially on
virtual machines!

79. lib
community
core
local
Number of *.php files by location
Less file
operations

80. Aoe_ClassPathCache
Magento
Compiler
Solution
File I/O
…also check
Magento 2!

81. External
Components Frontend?
Cache
Backend?
Web Services?
Webserver?

82. Bottleneck
Candidates
Memory CPU File I/ODatabase
External
Components

83. Launch!
Deployment
Space game
launch!
USA wakes up

84. http://joind.in/talk/view/11889

85. Thank you!
Any questions?
{firstname}.{lastname}@aoe.com
http://www.aoe.com
http://www.fabrizio-branca.de
@fbrnc
Follow me on twitter!
My blog