Trusted Opinion CTO shares the experience in re-engineering of a social network. Major parts of the presentation: - lessons learned during the re-engirding process - open source frameworks used to implement a highly scalable web applications - system architecture solutions used 5 years ago and today

1. Propel to the Cloud with Open Source or “How we re-engineered a social network” by Gene Leybzon, CTO, Trusted Opinion, Inc

2. Trusted Opinion Social Recommendation Network 2 Propel to the cloud by Gene Leybzon

3. Trusted Opinion in Numbers Over Million users Over 100 Countries Over 1.5 Million Bars and Restaurants with reviews Over 100,000 emails sent daily 3 Propel to the cloud by Gene Leybzon

4. “Legacy” architecture 4 Propel to the cloud by Gene Leybzon

5. How J2EE architecture became a liability instead of an asset Business needs: Almost “on-the fly” code changes with immediate deployments (daily releases) Extreme scalability Constant tuning based on A/B testing Can not afford expensive DB licensing fee Parallelism in code development with no bottlenecks in the develop-test-release cycles 5 Propel to the cloud by Gene Leybzon

6. “Legacy” hosting 6 Propel to the cloud by Gene Leybzon

7. Scalability and Performance Problems Too much work performed in Database (store procedures did a lot of math on the data) Way too expensive to go to database cluster while a single server (even 16 core) has it’s limits too Overhead of J2EE+templates (slow performance) 7 Propel to the cloud by Gene Leybzon

8. Other Pain Points Managing offshore development team Significantof effort in system/database administration Too slow to implementchanges Hard to implement detail user behavior analytics Time to be multilingual and integrate with CDN to support international customers 8 Propel to the cloud by Gene Leybzon

9. Solution Complete re-architecture from the top-to-bottom and from the bottom-up Update to current Snapshot of the best technologies 9 Propel to the cloud by Gene Leybzon

10. Wish list that became the Plan Use latest and greatest technologies Open source, and open source only! Scalability on demand Local team for core software development Best analytics with customized A/B testing framework Good performance and with even better performance perception 10 Propel to the cloud by Gene Leybzon

11. Why Cloud? Scalability on demand Dynamic load Ease deployment/keeping configuration Simplify IT Cool factor 11 Propel to the cloud by Gene Leybzon

12. Why Amazon? EC2 Cloud Front MapReduce Load balancer Performance monitoring 12 Propel to the cloud by Gene Leybzon

13. Job Ahead #lines of Java code Migrating to the new database and with completely different database schema Add language support (20 core languages) Add on-demand image uploading to CDN and serving all static content from the CDN 13 Propel to the cloud by Gene Leybzon

14. Challenges Where to find right and motivated developers? Where to rent the office How to create a quality code development culture How to have fun along the way 14 Propel to the cloud by Gene Leybzon

15. Lessons People first Happy developers write good code In-house recruiting Focus on the core, borrow the rest 15 Propel to the cloud by Gene Leybzon

16. New Architecture 16 Propel to the cloud presentation by Gene Leybzon

17. New Database Architecture 17 Propel to the cloud by Gene Leybzon

18. Analyzing log data 18 Propel to the cloud by Gene Leybzon

19. Semantic Web and RDF Used at Trusted Opinion to store information about Movies and Restaurants Data stored across all items as “triplets” Allows structured and semi-structured data to be mixed, exposed, and shared across different applications Took a lot of load from relational DB Easy to add new item categories 19 Propel to the cloud by Gene Leybzon

20. You can do it too! “Just do itRight” “Right” developers (treat them with respect!) “Right” technology (keep an eye on technology trends, use it fresh but ready) “Right” design (NO new frameworks, focus on the product, not a framework) “Right” management team 20 Propel to the cloud by Gene Leybzon