1. , ,
构
—— FreeWheel MRM
Diane Yu
Co-Founder, CTO
FreeWheel
2009-04
FreeWheel Confidential

2. , 构
Design with failure in mind
• There is no bug free software
• There is no failure proof hardware
Partition your data
• Load balance: Even partition
• Easiness to repartition
• Reduce dependency
Redundancy
• Reduce single point of failure
• System auto recoverability
Monitor, monitor, monitor
• Monitor from customer perspective
• Monitor from capacity perspective
FreeWheel Confidential

3. , 构
KISS
• Keep: Upkeep
• Requirement is meant to change all the time
• Software is meant to evolve all the time
• Simple Stupid
• More code, more maintenance
• Something is wrong when it is complicated
Just in time
• Just in time design
• Perfect design doesn’t exist
• Design just enough to get started
• Just in time refine/refactor
• Know when to refactor
• Refactor in pieces is always better than complete rewrite
FreeWheel Confidential

4. • Up time 99.99%—— down<=4
•
• Web
• failover
•
• Watch Dog/SNMP
• Counter + +
• <150ms
• Web Server + FastCGI
• DB cache
• Gomez
FreeWheel Confidential

5. •
•
• /
•
•
•
• ,
• :
•
• Map-Reduce
FreeWheel Confidential

6. Hadoop
Hadoop Map-Reduce
•
•
•
• Mapper Reducer
• NFS I/O
•
• Debug
•
FreeWheel Confidential

7. Hadoop ( )
• (2k)
G~T
• /
• t A->B->C
• A S1
• , A A0S1, A1S1
• A0S1 S1
S1L1 A1S1 S1L2
•
• t t
FreeWheel Confidential

8. Hadoop ( )
• :
• :
• :
• :
• :
• Map-Reduce Hadoop
• Local Matcher
Map-Reduce
FreeWheel Confidential

9. Hadoop ( )
• Local Reducer
O(n) O(n/m),m
• “ ”
• Overhead
•
• Map-Reduce ETL
FreeWheel Confidential

10. •
•
•
•
•
•
•
•
• , Master-Slave,Delta Push.
• IP Sticky
•
FreeWheel Confidential

11. FreeWheel Confidential

12. dwang@freewheel.tv
+86-13901312946
FreeWheel Confidential