Presentation I made in the Mar del Plata Developers Conference in 2011 about social apps, and social scalability.

1. We’re hiring!
Social Apps
And Social Scalability
Matias Paterlini
Altodot
Tuesday, December 6, 11

2. <?php
echo “Hola Mundo!!!”;
?>
Tuesday, December 6, 11

3. about me...
Tuesday, December 6, 11

4. • CTO & Co-founder at Altodot
(creators of The Fan Machine)
• Former CTO & Co-founder at
Virtualinmobiliario.com
• Former CTO & Co-founder at Xristianos
Producciones
• Jóven Empresario Bonaerense 2008
• Head at Emprendedores Cristianos
Tuesday, December 6, 11

5. Tuesday, December 6, 11

6. Tuesday, December 6, 11

7. Tuesday, December 6, 11

8. Tuesday, December 6, 11

9. Tuesday, December 6, 11

10. What we do
Tuesday, December 6, 11

11. Social Apps!!!
Tuesday, December 6, 11

12. What???
Tuesday, December 6, 11

13. Web or desktop
applications connected
to Social Networks
Tuesday, December 6, 11

14. Which social
Networks?
Tuesday, December 6, 11

15. Facebook Twitter
Orkut Google +
Sonico Foursquare
Google
Linkedin Hi5
Tuesday, December 6, 11

16. Most Annoying API
award?
Tuesday, December 6, 11

17. Tuesday, December 6, 11

18. Some Facts...
Tuesday, December 6, 11

19. Twitter
Tuesday, December 6, 11

20. • 500K users in Argentina
• 0,56 % of users produce 50% of the
content.
• The majority uses SmartPhones
• Users with more than 10 friends: 60%
• Users with more than 130 friends (media at
Facebook), 20%.
Tuesday, December 6, 11

21. Open Social
Tuesday, December 6, 11

22. • 1,6 Billion Users world wide (several times
duplicated people)
• 100x “Social networks” implemented
• Orkut still leading at Brazil
• Just launched Open Social 2
Tuesday, December 6, 11

23. Facebook
Tuesday, December 6, 11

24. • 750+ MM Users
• +18 Million in Argentina (85% penetration)
• +1 M Active Users in Argentina in May
• 50% of active users login every day
• average user has 130 friends
• Billion dollars business
Tuesday, December 6, 11

25. • devs from 190 countries
• 20 million installs every day
• 250 million uses FB Connect every day
• 10K websites integrated every day
• 900 million open graph objects
• 70 translations
Tuesday, December 6, 11

26. What can we do?
Tuesday, December 6, 11

27. Twitter
Tuesday, December 6, 11

28. REST API
Real Stream API
Search API
Tuesday, December 6, 11

29. Any limits?
Tuesday, December 6, 11

30. 350 Authorized
Requests per hour
Tuesday, December 6, 11

31. Deal with it...
Tuesday, December 6, 11

32. Some Samples
Tuesday, December 6, 11

33. Tuesday, December 6, 11

34. Tuesday, December 6, 11

35. Tuesday, December 6, 11

36. Tuesday, December 6, 11

37. Tuesday, December 6, 11

38. THE Social Network
Tuesday, December 6, 11

39. Facebook
Tuesday, December 6, 11

40. Social Graph
Tuesday, December 6, 11

41. Tuesday, December 6, 11

42. THE Platform
Tuesday, December 6, 11

43. Graph API REST API
ADS API Facebook Credits
Graph API explorer XFBML
Javascript SDK (FB Connect)
Social Plugins Places API
Tuesday, December 6, 11

44. THE Protocol
Tuesday, December 6, 11

45. Open Graph
Tuesday, December 6, 11

46. Tuesday, December 6, 11

47. Graph API
Tuesday, December 6, 11

48. Objects Reference
Tuesday, December 6, 11

49. Objects Handling:
POST, GET, DELETE
Tuesday, December 6, 11

50. Public info, private info
Tuesday, December 6, 11

51. Objects Connections
Tuesday, December 6, 11

52. Tuesday, December 6, 11

53. Tuesday, December 6, 11

54. Tuesday, December 6, 11

55. Tuesday, December 6, 11

56. REST Api
Tuesday, December 6, 11

57. Javascript SDK
Tuesday, December 6, 11

58. Ads API
Tuesday, December 6, 11

59. Social Channels
Tuesday, December 6, 11

60. Canvas Page
Tuesday, December 6, 11

61. Tuesday, December 6, 11

62. Tuesday, December 6, 11

63. Tuesday, December 6, 11

64. Tuesday, December 6, 11

65. FanPage Tabs (apps)
Tuesday, December 6, 11

66. Tuesday, December 6, 11

67. Tuesday, December 6, 11

68. Tuesday, December 6, 11

69. Tuesday, December 6, 11

70. Feed Stories on Walls
Tuesday, December 6, 11

71. Tuesday, December 6, 11

72. Tuesday, December 6, 11

73. Tuesday, December 6, 11

74. Facebook Connect
Tuesday, December 6, 11

75. Tuesday, December 6, 11

76. Otras ideas...
Tuesday, December 6, 11

77. Tuesday, December 6, 11

78. Tuesday, December 6, 11

79. Tuesday, December 6, 11

80. Tuesday, December 6, 11

81. Tuesday, December 6, 11

82. Social Plugins
Tuesday, December 6, 11

83. Tuesday, December 6, 11

84. Tuesday, December 6, 11

85. Like Box
Tuesday, December 6, 11

86. Tuesday, December 6, 11

87. Like and Send Button
Tuesday, December 6, 11

88. Tuesday, December 6, 11

89. Tuesday, December 6, 11

90. Live Stream
Tuesday, December 6, 11

91. Tuesday, December 6, 11

92. Comments Box
Tuesday, December 6, 11

93. Tuesday, December 6, 11

94. Tuesday, December 6, 11

95. Social
Scalability
Tuesday, December 6, 11

96. The Fan Machine
Scalability
Tuesday, December 6, 11

97. The Friendfeed
approach
Tuesday, December 6, 11

98. Horizontal Scalability
Tuesday, December 6, 11

99. Static File Caching
Web Server 1 Web Server 2 Web Server 3
Data Caching
Database 1 Database 1
(replicated DB)
Tuesday, December 6, 11

100. What about the DB?
Tuesday, December 6, 11

101. Static File Caching
Web Server Web Server Web Server
1 2 3
(Transaccional,
read-write) Data Caching
Master Slave Slave
Database Database Database
(read) (read)
Tuesday, December 6, 11

102. DB scalling issues...
Tuesday, December 6, 11

103. Tuesday, December 6, 11

104. • MAAAAANY Records
Tuesday, December 6, 11

105. • MAAAAANY Records
• Caching not enough
Tuesday, December 6, 11

106. • MAAAAANY Records
• Caching not enough
• Alters lock tables for hours!
Tuesday, December 6, 11

107. • MAAAAANY Records
• Caching not enough
• Alters lock tables for hours!
• Maintenance Issues
Tuesday, December 6, 11

108. • MAAAAANY Records
• Caching not enough
• Alters lock tables for hours!
• Maintenance Issues
• Que haces si se corrompe la base porque
alguien se engancha el cable de la luz con el
pié???
Tuesday, December 6, 11

109. Possible solutions...
Tuesday, December 6, 11

110. Hbase
MongoDB Cassandra
Membase SimpleDB
NoSQL
BigData CouchDB
Hipertable RaptorDB
Tuesday, December 6, 11

111. NoSQL = No Trust!
Tuesday, December 6, 11

112. THE approach
Tuesday, December 6, 11

113. MySQL
Tuesday, December 6, 11

114. Sharded MySQL
databases
Tuesday, December 6, 11

115. MySQL emulating
NoSQL over Sharded
Databases
Tuesday, December 6, 11

116. If( MySQL == NoSQL) {
die(‘WTF???’);
}
Tuesday, December 6, 11

117. Documents = Entities
Tuesday, December 6, 11

118. One Table for entities,
many tables for
indexes.
Tuesday, December 6, 11

119. How does it look like?
Tuesday, December 6, 11

120. File Caching
Web Server Web Server Web Server
1 2 3
Data Caching
Databases Server 1
Shard 1 Shard 4 Shard 10 Shard 7
Shard 2 Shard 5 Shard 11 Shard 8
Shard 3 Shard 6 Shard 12 Shard 9
} Databases
Database Backups
Tuesday, December 6, 11

121. Static File Caching
Web Server Web Server Web Server Web Server
1 2 3 3
DB 1 DB 1 DB 1 DB 1
Shard 1 Shard 3 Shard 6 Shard 9
Shard 2 Shard 4 Shard 7 Shard 10
Shard 3 Shard 5 Shard 8 Shard 11
Database Backups per Shard
Tuesday, December 6, 11

122. THE Benefits...
Tuesday, December 6, 11

123. • Server maintenance per shard
• Data Maintenance Per shard
• NO table alters
• Easy recovery
• Easy scalability
• Easy migration to other No-SQL data
engines
Tuesday, December 6, 11

124. Questions?
Matias Paterlini
matias@altodot.com
@paterlinimatias
We’re hiring!!!
Tuesday, December 6, 11