What is crowdtesting? How does it work? Can the crowd deliver the results? What are the benefits of crowdtesting? Read this infographic to find out.

1. C AN THE CR OW D DELIV E R BE T TE R , FAS TE R , C HE AP E R T E ST I N G FO R SO FT WA R E A P P L I C AT I O N S ?
CROWDTESTING
I N A S S O C I AT I O N W I T H
B R OUG H T TO YO U BY
“
The ability to effectively test
the quality of software applications
has never been more critical to an
organization’s reputation and operations.
- Computerweekly.com
CHANGING WORLD
O F B U S IN E SS , T E C H N OLOGY, A N D A P P L I C AT I O N S
1
APPLICATIONS
,000,000
SMARTPHONE
The number of
Dec 2012
$50B
MOBILE DEVICES
HAS SURPASSED THE NUMBER OF
DESKTOPS & LAPTOPS COMBINED
invested globally
each year during
APPLICATIONS TESTING
CONSUMER-DRIVEN
D
CLOU
THE
SOFTWARE APPLICATIONS
now release more frequently,
than ever to a multitude of
platforms, networks, devices,
configurations, languages,
speeds, and versions.
How can we test effectively in this environment?
CROWDTESTING
delivers
BETTER, FASTER, CHEAPER
testing in a software-driven world
CROWDTESTING
VS
TR AD IT IO N A L IN - H OU S E M E T H OD S
Instead
of hiring
5
TESTERS IN-HOUSE,
50
you can
HIRE
part time
CROWD SOURCED TESTERS
&
who can produce
IN THE SAME
MORE
WORK
300%
TIME
10 X
This will
GIVE
who will have
70%
LESS
FATIGUE
GREATER TEST COVERAGE
OF DEVICES AND SOFTWARE
HOW IT WORKS
EXAM P LE S O F C R OW D S OU R C E D T E ST IN G
1
PHASE
PREPARATION
Assess client’s business needs and goals
Design the Test Plan incl. required skills and capacities
Fix price and deliverables
2
INITIATION PHASE
Define test cases and configurations
Recruit crowdtesters from a global pool of professionals
Establish secure test environment
3
PHASE
EXECUTION
Initiate testing across required devices and software
Manage and supervise test team
Monitor and ensure performance
EVALUATION
4
PHASE
Validate results and conduct quality assurance
Prepare client deliverables
Process testers’ compensation
5
COMPLETION
PHASE
Present in-depth results to client
Refine crowdtesters' classification ratings
Close test cycle
ENTERPRISE
CROWDTESTING
ORGANIZED
Led by certified program managers
Single point contact
Offers ‘crowd management’
PROFESSIONALIZED
C LIE N T LE A D
Testers are screened and proven
Rating system enables skill matching
Many are full-time IT employees
S E N I O R QA S U P E R VIS OR S
STANDARDIZED
Same processes + quality per project
Reports are actionable
Can re-use favorite testers
10-150 C R O W DT E S T E R S
THE BENEFITS
F EATU R E S O F C R OW DT E ST IN G
REAL-WORLD TESTING
SPEED TO MARKET
1000s of use cases across different devices
Crowd is always available to start testing ‘now ’
Crowd can find more defects
Quicker turnaround time
‘GLOCALIZATION’
COST SAVINGS
Can localize testing around ultimate end user
Flexible ‘pay-as-you-go’ models lower costs
Target specific markets, demographics, etc
Save on costs from damaged brand or reputation
CROWDTESTING ROI
FOR MARKET FACING APPS
In-House
Outsourcing
Crowdtesting
COST
‘X’ baseline
Savings of 20%
Savings of 50% +
SCOPE
Focus on all apps with
limited resources
Focus on enterprise
applications with
'flexible' resources
Focus on market-facing
apps with unlimited
resources
SPEED
Months
Weeks
Days
QUALIT Y
Pro: fewer IP issues
Con: fewer brains
Pro: services focus
Con: flexibility a myth
Pro: unlimited innovation
Con: potential IP concerns
VALUE
For market-facing applications aimed at enterprises or consumers,
crowdtesting can identify more bugs, faster, and at a lower cost.
BR OUGH T TO YO U BY
For over 20 yrs, the Swiss headquartered PASS Group has helped companies
from high-growth start-ups to Global 1000 companies deliver high quality software
products. PASS’s crowdsourced testing service passbrains was launched in 2010.
For more information please visit www.passbrains.com and www.pass.ch.
IN ASSO CIATION WITH
Massolution is a unique research and advisory firm specializing in the large enterprise
sector designing, implementing, and managing crowdsourcing and crowdfunding
initiatives. Massolution also operates the industry website Crowdsourcing.org.
More information at www.massolution.com or www.crowdsourcing.org or via
contact@crowdsourcing.org.