Crowdsourcing is an ever evolving organism, and crowds themselves have grown to possess different personalities. Some are task driven, simple and quick versus more methodical and guided. Others are focused on results such as high in quality and low in fraud. They all serve a purpose, but the right crowd utilized in the right situation... By Appen. Presented at Crowdsourcing Week Global 2016. Learn more and join the next event: www.crowdsourcingweek.com

1. Managed Crowd Services
Choose your Crowd Wisely

2. Kevin C. Vondemkamp
VP Business Development
Carolyn Harvey
VP Service Delivery
Topics of Discussion
Introductions
Appen Crowd Management
General Crowd Discussion
Choose Your Crowd Wisely
Conclusion

3. Appen’s clients for crowd management resources now include nine of the world’s ten largest information
technology companies and six of the world’s ten largest internet companies by revenue.
• Established 1993 (23 Years)
• Managed Home Office Crowd Services
• Technology, Consulting & Services
• 150 languages in 100 countries
• 500,000 Resource Repository
• APX Appen Limited (Jan 2015)

4. Crowdsourcing is an ever evolving organism, and crowds themselves have grown to possess different personalities. Some are
task driven, simple and quick versus more methodical and guided. Others are focused on results such as high in quality and low
in fraud. They all serve a purpose, but the right crowd utilized in the right situation will outshine the rest.
Mapping expected outcomes to the correct crowd is key, and not always addressed properly. Each year new ideas and
innovations are introduced into the crowdsourcing world, changing the landscape in subtle but powerful ways. Yet how often do
we stop and assess our own crowdsourcing practices and expectations? Is your current crowd the right one for the job?
Choose Your Crowd Wisely!

5. Ancient Babylonia: Crowd Healthcare Services
“They have no physicians, but when a man is ill, they lay him in
the public square, and the passers-by come up to him, and if
they have ever had his disease themselves or have known any
one who has suffered from it, they give him advice,
recommending him to do whatever they found good in their
own case, or in the case known to them”
- Herodotus
The History of the Persian Wars
Choose Your Crowd Wisely!

7. Choose
Your
Crowd
Wisely!
TRUE CROWD
Inexpensive
Simple Binary Task
Self Serve Relationship
Nomadic Resources
No Training
Get What You Get
MANAGED CROWD
Value Add Project Management
Complex Task
Distributed Work
Dedicated Resources
Training / Qualification
Managed to SLA’s

8. Poor (Overlap)
Acceptable
High (SLA’s)
$ $$ $$$
Managed Crowd Services: Complex
True Crowd: Simple Task
Quality
Control
Project Cost
Choose Your Crowd Wisely!

9. 1. Does the project task align with the right crowd?
2. Humans make mistakes, do you have the correct quality expectation?
3. Does ongoing experience contribute to the quality output of the task?
4. How complicated is your task or project?
5. Does your price attract the right crowd?
6. You get what you pay for…
Choose Your Crowd Wisely!

10. 10
Thank You
What Crowd Do You Want To Be Seen With?
Business Offices:
Sydney, Australia
Seattle , WA, USA
San Rafael, CA, USA
Ridgefield, CT, USA
Davao, Philippines
Field Offices:
Hong Kong, China
London, England
Bangalore, India
Peshawar, Pakistan