The document summarizes best practices for building scalable and reliable websites. It discusses techniques for caching, load balancing, storage, databases, monitoring, and application architecture. Specific recommendations include caching everything possible, reducing DNS lookups and requests, using content delivery networks, sharding databases, and scaling services horizontally.

1. Building scalable and reliable websites Studencki Festiwal Informatyczny Kraków, 12-14.03.2009 Tomasz Napierała

2. Tomasz Napierała Systems Architecture Engineer JID/email: tomasz.mapierala@allegro.pl

3. feed chain Naspers/MIH Tradus GaduGadu mail.ru Tencent QQ QXL Ricardo Allegro.pl QXL Poland

4. we are the borg 800 employees 650 in poland 125 in IT 13 services 10 on platform

5. . cz . ro . ua . bg . sk auctions ads payments shops inventory

6. meat the team

7. technical dept Application Unit 1 Application Unit 2 R&D BI & DWH PMO P&L Infrastructure Infrastructure: Systems Networks DBA Help Desk NOC

8. history Źródło: aukcjostat.pl Oracle DC2

9. ranks Site in Alexa: - 134th/206th worldwide - 4th in Poland Auctions: - 7th worldwide (counting eBay divisions) - biggest in central/eastern Europe

10. childhood

14. service lifecycle Internet www DB www DB Internet Internet ? Internet Internet www DB www DB cache

16. recipes do you have any? we've got some...

17. cache everything browser client proxy reverse proxy memcached eaccelerator/xcache db cache fs cache

18. frontend reduce DNS response optimize images use ETags flush buffer get rid of cookies minimize requests control cache gzip JS at the bottom CSS at the top

19. frontend – the award let's see, how much we can really earn

20. frontend – the award empty cache vs primed cache 93% gain empty cache primed cache size filetype size filetype 6.5K 1 html/text 6.5K 1 html/text 7.3K 4 javascript 0.0K 1 css 8.3K 12 css images 71.4K 19 images 93.6K 37 6.5K 1

21. frontend – the award sweets get without cookie: 360B get with cookie: 1003B 75% gain

22. frontend – numbers

23. load balancing … or buy LACP/bonding LVS/IPVS HAProxy perlbal varnish/nginx ...

24. distribute load Internet cache LB originals LB Internet cache LB originals

27. database tune replicate, replicate more sharding

28. sharding + denormalization scale out availability small dataset - growing can be pain expensive joins plannig nightmare still replicate SPOF lookup table

29. eee, managebility easy to manage easy to deploy extensible easy to troubleshoot

30. mines sometimes better is worse

31. when time is an issue

37. application architecture Internet static www images LB cache originals Storage DB cache/pool cache originals upload

39. thank you

40. questions?