A talk about the lessons learnt in data management on AWS

1. Greg Arnette
Founder & CTO
@gregarnette
Lessons Learned:
Big Data Management in the
Cloud Finalist: Storage Product of the
Year

2. Sonian, Inc.
• Founded 2007, Boston, MA USA HQ
• 7,000 Customers
• 100% Delivered from “the Cloud”
• Solves enterprise retention needs for
email, IM, files, & Sharepoint
• New emerging market:
• Information Archiving and Analytics
Copyright 2007-2009 Sonian, Inc. Company Confidential

3. Fast Search in Big Data

4. Hot Statistics
• Over a billion objects
• 250 K CPU hours/month
• 180 terabytes on S3 and
EBS
Copyright 2007-2009 Sonian, Inc. Company Confidential

5. Copyright 2007-2009 Sonian, Inc. Company Confidential

6. Cloud Building Blocks

7. Design for the Cloud
• Think about architectures differently
than you are used to… this is a good
thing
Copyright 2007-2009 Sonian, Inc. Company Confidential

8. Old World
Copyright 2007-2009 Sonian, Inc. Company Confidential

9. New World
Copyright 2007-2009 Sonian, Inc. Company Confidential

10. New World
Copyright 2007-2009 Sonian, Inc. Company Confidential

11. Cloud Building Blocks

12. Cloud Scaling

13. Cloud Scaling

14. But What About
Security?
• Data in the cloud can be more secure
than on-premises
• Security = Privacy and Resiliency
• Encrypt everything, cloud customers
own the keys
Copyright 2007-2009 Sonian, Inc. Company Confidential

15. Cost Control is Critical
• Implement cost management system
from Day 1
• Different “psychology” than buying
hardware
Copyright 2007-2009 Sonian, Inc. Company Confidential

16. Great Tools
• Chef from OpsCode
• Nagios… simple and flexible
Copyright 2007-2009 Sonian, Inc. Company Confidential

17. Why AWS?
• All the right ingredients
• Flexible options: Compute, Storage, DB
• Spot Pricing! & Reserved Instances!
• Strongest SLA for storage
Copyright 2007-2009 Sonian, Inc. Company Confidential

18. “Silver” Cloud
• Price advantage using cloud for
infrastructure
• Amazon Web Services is the CTO’s
“CTO”
• Whole new way of building SaaS apps
• Focus on your domain expertise
Copyright 2007-2009 Sonian, Inc. Company Confidential

19. “Dark” Cloud
• Don’t treat cloud like regular co-lo
space
• Get your cloud “sea legs”
• Architect for failure
(If you do all this then there is no “dark”)
Copyright 2007-2009 Sonian, Inc. Company Confidential

20. Q&A
Contact Greg Arnette
greg@sonian.com
@gregarnette
Copyright 2007-2009 Sonian, Inc. Company Confidential