March 17, 2010 The presentation I gave at the Swiss Testing Day 2010 in Zürich, Switzerlnd.

1. Ewald Roodenrijs
Worldwide Testing: Join the Crowd

2. Program
— What is crowdtesting?
— What are the benefits of crowdtesting?
— What can crowdtesting do?
— Options for service providers
— How to implement for crowdtesting?

3. Remarkable things
Technology changed the world
— Borders have disappeared
— Everyone is connected to one other
— Interaction takes place in different ways
The world has changed with internet, but
software testing hasn’t changed that much...
Now problems with the testing of
— Multiple devices
— Third party updates
— Getting specialists
— Languages

4. Crowdsourcing + testing = Crowdtesting

5. What is crowdtesting?
— Use of crowdsourcing on testing
— New phenomenon
— Substitute to traditional testing
— Focus on acceptance
The use of an (un)known crowd of
people and knowledge when testing
software applications or systems
‘
’

6. Key benefits

7. Build a crowd
Knowledge/Performance
— Specialty (security, usability, ...)
— Beginner vs. Expert
— Novice vs. User
Background
Language
Independent blood
Mirror real world

8. The crowd can help us
— Crowdtesting can
complement in-house
resources at a practical,
tactical level
— Crowdtesting enables to
tap into the creativity and
diversity of a global
community of skilled
professionals

9. Reasons for crowdtesting

10. Applications
Lots of feedback
No sensitive data or functionality
Multi-platform software
Large end-to-end systems
Games
Beta software
Load & performance testing
Mobile software

11. Control the crowd

12. Costs control
No long term contracts
— Add or reduce resources when needed
— No initial investment

13. What makes test service providers special
— Companies have their own test methodologies
— Companies know their clients and the requirements they have for
testing
— Companies have test experts that know everything about the
right test strategy and test coverage
— Companies have years of experience

14. Opportunities service provider

15. Shopping list
A crowd
Crowd build-up
— Experts
— Novice
— Specialists
— (Potential) users
Portion software
Questionairre
Testing environment

16. Examples

17. Conclusion