1. Telling your
Cumulonimbus from
your stratus and why it
matters (Clouds)
Alex McFadyen, CTO
drupal.org : a_c_m || drupal.org/user/195063
email : alex@demotix.com
twitter : @a_c_m
2. Introduction
Alex McFadyen
CTO of Demotix
Drupaler for 5 years 20 weeks
Demotix.com
A two minute (or less) introduction
http://prezi.com/_ugoyxm4qprv/demotixcom-2-minutes/
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
3. Buzzword alert – CLOUD!!
To the world
“Cloud computing refers to the delivery of computing and
storage capacity as a service to a heterogeneous community of
end-recipients”
- http://en.wikipedia.org/wiki/Cloud_computing
To me (a Drupal dev)
“The cloud is just marketing gloss on quick to set up VPSs when
you need them, perhaps have 'unlimited' storage space and even
a CDN if your lucky”
- Me, just now.
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
4. Public health announcement
Why not just pay for it to be someone else’s problem
and not care about the “cloud”?
●
If you can. Do.
●
But perhaps you tried that and it didn't work :(
●
Complexity (doesn't fit generic solutions)
●
Policy / Control freak
“With great power comes great responsibility”
- Uncle Ben
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
5. Things to think about
@ Slice ratio (How big is your share?)
●
Most (not all) cloud providers slice servers up into equal
cpu/ram/disk space chunks and sell them off.
●
Some let you add on resources you need, others don't.
●
Problem for file servers.
@ Poor disk IO
●
Are your disks local or over the network?
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
6. Things to think about
@ More servers, more problems?
●
Once your past dedicated use servers (web, db etc) you
have to do work on the app to support more servers.
@ Support
●
Do you have any?
●
How about at 3am?
●
On Christmas day
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
7. Things to think about
@ Bad neighbours & overselling
●
Starts out great, then reddit moves in next door.
@ Cloud A != Cloud B
●
Disks, Slice ratio, network speed, location, management
systems etc
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
8. How to pick your cloud
@ Benchmarks?
●
http://cloudharmony.com cpu/ram/disk/web/db
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
9. Try, try, try again!
@ Try before you buy
●
Some companies will give you a free day/week.
●
Put as close as you can 1:1 copy of your current site on it
and...
@ Test, test and test some more
●
AB / Siege test your caching system not your app.
●
Instead replay your log files with HTTPERF or Jmeter.
●
Monitor the results with Munin/Cacti/Newrelic.
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
10. “The Clouds”
but not services
●
Amazon
●
Rackspace
●
Azure (Microsoft)
●
DediServe
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
11. My Kickstarter Benchmark
●
Demotix is not a good example.
●
So, using a popular distro instead.
●
Build duplicate machines with puppet
●
Benchmark with Blaze Meter
● Run jmeter in the cloud
●
Drupal module!
●
Very cool people (gave me a free account to help this talk)
●
Monitor with NewRelic (also free from BlazeMeter!)
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
12. How the servers were built
●
~4GB ram + what ever you get with
that
●
Puppet install :
https://github.com/a-c-m/puppet-drupal-lamp
●
20 line bash script (to install bits)
●
Thats it! (I promise)
●
Like the sound of that?
●
Go to “Vagrant: A crash course” @ 4:30pm
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
13. How the servers were tested
●
20 Urls from the store
●
7 unauthenticated users
●
7 authenticated users
●
10 min test, 160 second ram up
●
Run using our friends Blaze Meter
●
Graphed with NewRelic
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
14. Amazon EC2
● No free trial :( but pay by the hour.
● M1.Medium linux VPS = £62.65/mo
● 1 x Intel Xeon
● 3.7 GB ram
● 410 GB disk
● M1.Large (EBS-Optimized) linux VPS = £137.35/mo
● 2 x Intel Xeon
● 7.5 GB ram
● 850 GB disk
● Bandwidth, support etc is extra
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
15. Amazon EC2 M - BlazeMeter
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
16. Amazon EC2 M – app
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
17. Amazon EC2 M – server
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
18. Amazon EC2 L - BlazeMeter
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
19. Amazon EC2 L – app
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
20. Amazon EC2 L – server
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
21. Rackspace Cloud
●
No free trial :( but pay by the hour.
●
4GB linux VPS = £116.80/mo
●
AMD Quad-Core
●
4 GB ram
●
160 GB disk
●
Bandwidth, support etc is extra
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
22. Rackspace - BlazeMeter
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
23. Rackspace – app
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
24. Rackspace – server
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
25. Microsoft Azure
● 90 Days for free?!?
● 1 Medium linux VPS = £73.32/mo
● 2x AMD Opteron
● 3.5 GB ram
● 30 GB disk
● 1 Large linux VPS = £146.63/mo
● 4x AMD Opteron
● 7 GB ram
● 30 GB disk
● Smart interface
● Bandwidth, support etc is extra
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
26. Microsoft Azure M - BlazeMeter
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
27. Microsoft Azure M - app
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
28. Microsoft Azure m - server
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
29. Microsoft Azure L - BlazeMeter
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
30. Microsoft Azure L - app
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
31. Microsoft Azure L - server
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
32. DediServe
● Friendly / talk to them.
Gave me a free server to do this test.
● 2GB linux VPS = £66.41/mo
● 4x Intel Xeon
● 2 GB ram
● 50 GB disk
● 1.5 TB transfer
● 4GB linux VPS = £107.99/mo
● 8x Intel Xeon
● 4 GB ram
● 100 GB disk
● 3 TB transfer
● Managed Support is extra
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
33. DediServe 2GB - BlazeMeter
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
34. DediServe 2GB – app
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
35. DediServe 2GB – server
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
36. DediServe 4GB - BlazeMeter
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
37. DediServe 4GB – app
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
38. DediServe 4GB – server
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
39. Price VS average pageload
9000
8000
7000
6000
MS per page (average)
Amazon Medium
5000 Amazon Large
Rackspace 4GB
Azure Medium
4000 Azure Large
DediServe 2GB
DediServe 4GB
3000
2000
1000
0
£40.00 £60.00 £80.00 £100.00 £120.00 £140.00 £160.00
£ per month
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
40. Shameless affiliate link
Drupal Camp London Saturday March 2nd, 2013
ALEX McFADYEN | alex@demotix.com | @a_c_m
41. Thank you
Questions?
Alex McFadyen, CTO
drupal.org : a_c_m || drupal.org/user/195063
email : alex@demotix.com
twitter : @a_c_m