Developer-owned QA testing is becoming more common as many organizations shift to leaner development processes and eschew traditional QA strategies.
This presentation discusses how crowdsourced testing can help teams offload repetitive testing work and streamline Agile testing processes. It also demonstrates how Rainforest Developer Experience (DevX) allows developers to increase productivity and minimize testing time with workflow-native crowdsourced testing.
Interested in seeing how Rainforest has helped companies save dev time and QA spend? Check out these success stories!
Guru: http://hubs.ly/H06lwC60
America's Test Kitchen: http://hubs.ly/H06lCX50
2. What does traditional QA look like?
▸ Write test cases
▹ Feature tests, regression tests, etc
▸ Execute tests
▹ Manual or Automated
▸ Reporting bugs
▸ Feedback Loop
▸ Bug remediation
3. Traditional QA DOESN’T FIT IN THE DEV PROCESS
▸ Tests exist outside of development environment
▹ Most developers’ workflow takes place in their local
environment
▸ Testing requires a comprehensive review of functionality
▹ It goes beyond the scope of just one change
▸ Tests updated separately from what is being tested
▹ Versions of test and code must match
4. QA that FITS IN THE DEV PROCESS
“Shifting Left”
Building quality in from the start
5. Dev-Owned QA
The Upside
- Bugs are caught faster
- There’s less room for
communication errors
- Keeps development agile
6. Dev-Owned QA
The Downside
- Time is spent on testing, not
building
- Delays in release schedule
- Because of this “double
duty,” things fall through the
cracks
9. Write Tests
Write & run functional tests through
UI, API or CLI
How Rainforest Works
Run Tests
Each test is sent to 3 trained testers from
our on-demand crowd of 50K testers
Result Verification
Rainforest algorithms verify the accuracy
and quality of the tester results
Results Returned
Results are returned via Rainforest platform
or directly into CI or bug trackers
10. Expertise
The average tester has been working with
Rainforest for 16 months
The Rainforest Crowd Difference
Consistency
68% of testers execute more than 50
Rainforest tests each week
Continued Learning
Our tester pool completes over 15,000 QA
training sessions each week
Machine Learning
Ensures that each test run meets our
standard for quality
14. Benefits of Rainforest DevX
Run all tests synchronously for quick results
Save developer time and resources by allowing the crowd to execute test cases
Testing Flexibility
Test at any point within your release process
Reduce test management overhead
Eliminate versioning problems by coupling test expectations with the code being tested
Bring Regression Testing into
Your Development Workflow
15. “Our devs realized that they wouldn’t
have to leave their code editor to
write a test for something they had
just developed... Rainforest DevX
makes it a lot easier to maintain
and refactor our tests
Mitch Stewart, CTO, Guru
16. “We love that we can drive
Rainforest from the command line
and control the scope of the tests
and cherry pick the browsers we
want to run tests on
Welling LaGrone, Director of Software Engineering,
America’s Test Kitchen
17. $3.3 MMSaved annually over in-house QA
557 HRSSaved on testing per month
30 XSpeed of an in-house team
Customer Stats
18. LEARN MORE
To find out more about streamlining testing…
Contact: info@rainforestqa.com
Github: @rainforestapp
Follow: @rainforest_eng