SkillPages Engineering Presentation presented at Amazon Lean

1. Iain MacDonald
SkillPages Engineering Team

2. One Place to Find Skilled People

3. Registered Users
7 million
6 million
5 million
4 million
3 million
2 million
1 million
2011 2012

4. Examples of what they can do

5. 18 MONTHS 230 COUNTIRES
100,000 PEOPLE PRESENTED WITH
NEW WORK OPPORTUNITIES EVERY DAY
1,000,000 NEW MEMBERS/MONTH
4,500,000 UNIQUE VISITORS/MONTH

6. A New Global Internet Utility
Retail & Cloud! Find Skilled People Online Storage

8. Connect people with skills
to people who need them
On a large scale within a trusted environment.

9. Challenges
Performance Flexibility Time To
Scalability
Market

11. Focus on developing a product users want
Amazon provide the Infrastructure!

13. Key AWS Components
EC2 ELB S3 SQS EMR
On Demand Computing Auto scaling Load Elastic Storage for Platform Message Big Data Processing
High I/O SSD Balancer User & Sys resources Queues
Cloudwatch EBS Dynamo Cloudfront SWF
Monitoring & Alarms Instance Storage Scalable noSQL db Global Content Coordinates
Push App Metrics Std & Provisioned IOS Atomic Counters Delivery Network Application Workflows

14. Scale Out vs. Scale Up
Support Rolling Upgrades
Instrument via CloudWatch

15. Measure Everything
Split Testing is invaluable
Drive decisions based on Data

16. Add 40GB+ Telemetry data daily
Compute via Elastic Map Reduce
Surfaced via SSAS & Tableau

18. Boyd’s Law of Iteration
“Speed of iteration always beats
quality of iteration.”
Where you are today doesn’t matter so much,
compared to where you’re going tomorrow.

19. 2 Major releases per week
Multiple smaller pushes per day
Everybody Tests

20. Repeat the process to get more feedback
Pay down technical debt along the way!

21. Where Are We Now?

22. 62 Instances 3 Availability Zones 3.1M Contacts per Day
Core Fleet US East (Northern VA) Over 3.1 Million contacts &
Add capacity as required Planned for Multi Region connections uploaded
Working towards autoscale each day
>2.5 Billion Relationships Tech Team of 19 10M+ Growth Increments
Our social graph models Total company size 37 Ready for additional 10 million
over 2.5 Billion social users at any point in time
relationships

23. and

24. • Started with On Demand Instances
• Grew into Reserved Instances (Save 48%)
• Leverage Spot Pricing (Save 76%)
• Use Cost Allocation Functionality
Significant Savings when managed

25. Excellent support & guidance from
AWS Team from the outset.
Currently on Business Level
1hr Response 24/7 email, phone and chat
Checkout Trusted Advisor

26. Why cloud works for SkillPages
• Allows us to focus on innovation
• Deliver better product to our users
• Ability to scale & adopt
• Economic Sense

27. Where you find skilled people