3. Does it Work?
• Improves avg. prec. by 0.14 on average!
– Minimal crowd involvement
– Embarrassingly parallel problem
Top US
Worker
0
0.5
1
0 250 500
WorkerPrecision
Number of Tasks
US Workers
IN Workers
0.6
0.62
0.64
0.66
0.68
0.7
0.72
0.74
0.76
0.78
0.8
1 2 3 4 5 6 7 8 9
Precision
Top K workers
4. Transactive Search
Adapting the concept of transactive memories
(group memories) from psychology
➡Transactive search methods to elicit
information
■ Social network analysis (to direct the search)
■ Crowdsourcing (to get the information)
■ 46% improvement (F1) over best alternative