SlideShare ist ein Scribd-Unternehmen logo
1 von 18
Downloaden Sie, um offline zu lesen
Using Crowdsourced
Testing to Turbocharge
your Development Team
What does traditional QA look like?
▸ Write test cases
▹ Feature tests, regression tests, etc
▸ Execute tests
▹ Manual or Automated
▸ Reporting bugs
▸ Feedback Loop
▸ Bug remediation
Traditional QA DOESN’T FIT IN THE DEV PROCESS
▸ Tests exist outside of development environment
▹ Most developers’ workflow takes place in their local
environment
▸ Testing requires a comprehensive review of functionality
▹ It goes beyond the scope of just one change
▸ Tests updated separately from what is being tested
▹ Versions of test and code must match
QA that FITS IN THE DEV PROCESS
“Shifting Left”
Building quality in from the start
Dev-Owned QA
The Upside
- Bugs are caught faster
- There’s less room for
communication errors
- Keeps development agile
Dev-Owned QA
The Downside
- Time is spent on testing, not
building
- Delays in release schedule
- Because of this “double
duty,” things fall through the
cracks
Solution?
Testing that keeps up with agile development
Crowdsourced Testing
How does it turbocharge your team?
Write Tests
Write & run functional tests through
UI, API or CLI
How Rainforest Works
Run Tests
Each test is sent to 3 trained testers from
our on-demand crowd of 50K testers
Result Verification
Rainforest algorithms verify the accuracy
and quality of the tester results
Results Returned
Results are returned via Rainforest platform
or directly into CI or bug trackers
Expertise
The average tester has been working with
Rainforest for 16 months
The Rainforest Crowd Difference
Consistency
68% of testers execute more than 50
Rainforest tests each week
Continued Learning
Our tester pool completes over 15,000 QA
training sessions each week
Machine Learning
Ensures that each test run meets our
standard for quality
Rainforest DevX
Using crowdsourced testers to run tests and provide
deterministic results within existing workflows
How Rainforest DevX Works
Rainforest CLI
Benefits of Rainforest DevX
Run all tests synchronously for quick results
Save developer time and resources by allowing the crowd to execute test cases
Testing Flexibility
Test at any point within your release process
Reduce test management overhead
Eliminate versioning problems by coupling test expectations with the code being tested
Bring Regression Testing into
Your Development Workflow
“Our devs realized that they wouldn’t
have to leave their code editor to
write a test for something they had
just developed... Rainforest DevX
makes it a lot easier to maintain
and refactor our tests
Mitch Stewart, CTO, Guru
“We love that we can drive
Rainforest from the command line
and control the scope of the tests
and cherry pick the browsers we
want to run tests on
Welling LaGrone, Director of Software Engineering,
America’s Test Kitchen
$3.3 MMSaved annually over in-house QA
557 HRSSaved on testing per month
30 XSpeed of an in-house team
Customer Stats
LEARN MORE
To find out more about streamlining testing…
Contact: info@rainforestqa.com
Github: @rainforestapp
Follow: @rainforest_eng

Weitere ähnliche Inhalte

Was ist angesagt?

Continuous Integration
Continuous IntegrationContinuous Integration
Continuous Integrationdrluckyspin
 
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...CodeScience
 
Continuous delivery in practice (public)
Continuous delivery in practice (public)Continuous delivery in practice (public)
Continuous delivery in practice (public)Tzach Zohar
 
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...Steve Lange
 
Agile testing for large projects
Agile testing for large projectsAgile testing for large projects
Agile testing for large projectsgaoliang641
 
Team wide testing
Team wide testingTeam wide testing
Team wide testingEthan Huang
 
Quality not-speed-for-distrobution
Quality not-speed-for-distrobutionQuality not-speed-for-distrobution
Quality not-speed-for-distrobutionbownyboy
 
Development and test infrastructure
Development and test infrastructureDevelopment and test infrastructure
Development and test infrastructureJun Li
 
How We Build Confidence with Continuous Integration and Automated Testing
How We Build Confidence with Continuous Integration and Automated TestingHow We Build Confidence with Continuous Integration and Automated Testing
How We Build Confidence with Continuous Integration and Automated TestingGareth Marland
 
People factor as failure reason of Agile adoption
People factor as failure reason of Agile adoptionPeople factor as failure reason of Agile adoption
People factor as failure reason of Agile adoptionMikalai Alimenkou
 
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimPerformance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimJAXLondon2014
 
Why your company loves to welcome change but sucks at accommodating it
Why your company loves to welcome change but sucks at accommodating itWhy your company loves to welcome change but sucks at accommodating it
Why your company loves to welcome change but sucks at accommodating itFarooq Ali
 
Continuous Integration and Builds
Continuous Integration and BuildsContinuous Integration and Builds
Continuous Integration and BuildsBhavin Javia
 
Quality Loopback
Quality LoopbackQuality Loopback
Quality LoopbackOmar Bashir
 
Introduction to Automated Testing
Introduction to Automated TestingIntroduction to Automated Testing
Introduction to Automated TestingLars Thorup
 

Was ist angesagt? (19)

Continuous Integration
Continuous IntegrationContinuous Integration
Continuous Integration
 
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
 
Continuous delivery in practice (public)
Continuous delivery in practice (public)Continuous delivery in practice (public)
Continuous delivery in practice (public)
 
DevOps
DevOpsDevOps
DevOps
 
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
 
Agile testing for large projects
Agile testing for large projectsAgile testing for large projects
Agile testing for large projects
 
Team wide testing
Team wide testingTeam wide testing
Team wide testing
 
How to Introduce Continuous Delivery
How to Introduce Continuous DeliveryHow to Introduce Continuous Delivery
How to Introduce Continuous Delivery
 
Test Driven Development
Test Driven DevelopmentTest Driven Development
Test Driven Development
 
Quality not-speed-for-distrobution
Quality not-speed-for-distrobutionQuality not-speed-for-distrobution
Quality not-speed-for-distrobution
 
Unit testing for project managers
Unit testing for project managersUnit testing for project managers
Unit testing for project managers
 
Development and test infrastructure
Development and test infrastructureDevelopment and test infrastructure
Development and test infrastructure
 
How We Build Confidence with Continuous Integration and Automated Testing
How We Build Confidence with Continuous Integration and Automated TestingHow We Build Confidence with Continuous Integration and Automated Testing
How We Build Confidence with Continuous Integration and Automated Testing
 
People factor as failure reason of Agile adoption
People factor as failure reason of Agile adoptionPeople factor as failure reason of Agile adoption
People factor as failure reason of Agile adoption
 
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimPerformance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
 
Why your company loves to welcome change but sucks at accommodating it
Why your company loves to welcome change but sucks at accommodating itWhy your company loves to welcome change but sucks at accommodating it
Why your company loves to welcome change but sucks at accommodating it
 
Continuous Integration and Builds
Continuous Integration and BuildsContinuous Integration and Builds
Continuous Integration and Builds
 
Quality Loopback
Quality LoopbackQuality Loopback
Quality Loopback
 
Introduction to Automated Testing
Introduction to Automated TestingIntroduction to Automated Testing
Introduction to Automated Testing
 

Andere mochten auch

The four layers of the amazon rainforest emmas project2
The four layers of the amazon rainforest emmas project2The four layers of the amazon rainforest emmas project2
The four layers of the amazon rainforest emmas project2babypeanut2424
 
The rain forest
The rain forestThe rain forest
The rain forestdolo12962
 
Rainforest Interactive Powerpoint
Rainforest Interactive PowerpointRainforest Interactive Powerpoint
Rainforest Interactive Powerpointverburam
 
Rainforest Presentation
Rainforest PresentationRainforest Presentation
Rainforest Presentationthomp2al
 
Visual Design with Data
Visual Design with DataVisual Design with Data
Visual Design with DataSeth Familian
 

Andere mochten auch (7)

The four layers of the amazon rainforest emmas project2
The four layers of the amazon rainforest emmas project2The four layers of the amazon rainforest emmas project2
The four layers of the amazon rainforest emmas project2
 
The rain forest
The rain forestThe rain forest
The rain forest
 
Rainforest Interactive Powerpoint
Rainforest Interactive PowerpointRainforest Interactive Powerpoint
Rainforest Interactive Powerpoint
 
Rainforest Presentation
Rainforest PresentationRainforest Presentation
Rainforest Presentation
 
Rainforests Powerpoint
Rainforests PowerpointRainforests Powerpoint
Rainforests Powerpoint
 
Visual Design with Data
Visual Design with DataVisual Design with Data
Visual Design with Data
 
Build Features, Not Apps
Build Features, Not AppsBuild Features, Not Apps
Build Features, Not Apps
 

Ähnlich wie Using Crowdsourced Testing to Turbocharge your Development Team

What_is_Rainforest_QA_-_InfoSheet
What_is_Rainforest_QA_-_InfoSheetWhat_is_Rainforest_QA_-_InfoSheet
What_is_Rainforest_QA_-_InfoSheetDaniel Acee
 
Rainforest QA InfoSheet
Rainforest QA InfoSheetRainforest QA InfoSheet
Rainforest QA InfoSheetEmily Nansen
 
What-is-RainforestQA-InfoSheet
What-is-RainforestQA-InfoSheetWhat-is-RainforestQA-InfoSheet
What-is-RainforestQA-InfoSheetKevin Woods
 
Continuous delivery its not about the technology, its about the people. @sats...
Continuous delivery its not about the technology, its about the people. @sats...Continuous delivery its not about the technology, its about the people. @sats...
Continuous delivery its not about the technology, its about the people. @sats...Tomas Riha
 
Continuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsContinuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsTechWell
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentNeotys
 
1 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 20091 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 2009Pepe
 
Best Practices to Optimize Continuous Testing in DevOps.pdf
Best Practices to Optimize Continuous Testing in DevOps.pdfBest Practices to Optimize Continuous Testing in DevOps.pdf
Best Practices to Optimize Continuous Testing in DevOps.pdfpCloudy
 
product Qa workflow
product Qa workflowproduct Qa workflow
product Qa workflowtanvir afzal
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAdam Stephensen
 
Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Tomas Riha
 
Fllow con 2014
Fllow con 2014 Fllow con 2014
Fllow con 2014 gbgruver
 
Dev ops != Dev+Ops
Dev ops != Dev+OpsDev ops != Dev+Ops
Dev ops != Dev+OpsShalu Ahuja
 
Continuous delivery its not about the technology, its about the people. @pipe...
Continuous delivery its not about the technology, its about the people. @pipe...Continuous delivery its not about the technology, its about the people. @pipe...
Continuous delivery its not about the technology, its about the people. @pipe...Tomas Riha
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughAngela Dugan
 
The Evolution of Test Automation for DevOps
The Evolution of Test Automation for DevOpsThe Evolution of Test Automation for DevOps
The Evolution of Test Automation for DevOpsTEST Huddle
 
Building Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps WorldBuilding Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps WorldQASymphony
 
5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test AutomationSauce Labs
 

Ähnlich wie Using Crowdsourced Testing to Turbocharge your Development Team (20)

Devops Mindset Essentials
Devops Mindset EssentialsDevops Mindset Essentials
Devops Mindset Essentials
 
What_is_Rainforest_QA_-_InfoSheet
What_is_Rainforest_QA_-_InfoSheetWhat_is_Rainforest_QA_-_InfoSheet
What_is_Rainforest_QA_-_InfoSheet
 
Rainforest QA InfoSheet
Rainforest QA InfoSheetRainforest QA InfoSheet
Rainforest QA InfoSheet
 
What-is-RainforestQA-InfoSheet
What-is-RainforestQA-InfoSheetWhat-is-RainforestQA-InfoSheet
What-is-RainforestQA-InfoSheet
 
Continuous delivery its not about the technology, its about the people. @sats...
Continuous delivery its not about the technology, its about the people. @sats...Continuous delivery its not about the technology, its about the people. @sats...
Continuous delivery its not about the technology, its about the people. @sats...
 
Continuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsContinuous Testing of Cloud Applications
Continuous Testing of Cloud Applications
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps Environment
 
1 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 20091 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 2009
 
Best Practices to Optimize Continuous Testing in DevOps.pdf
Best Practices to Optimize Continuous Testing in DevOps.pdfBest Practices to Optimize Continuous Testing in DevOps.pdf
Best Practices to Optimize Continuous Testing in DevOps.pdf
 
product Qa workflow
product Qa workflowproduct Qa workflow
product Qa workflow
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
 
Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.
 
Fllow con 2014
Fllow con 2014 Fllow con 2014
Fllow con 2014
 
Dev ops != Dev+Ops
Dev ops != Dev+OpsDev ops != Dev+Ops
Dev ops != Dev+Ops
 
Continuous delivery its not about the technology, its about the people. @pipe...
Continuous delivery its not about the technology, its about the people. @pipe...Continuous delivery its not about the technology, its about the people. @pipe...
Continuous delivery its not about the technology, its about the people. @pipe...
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools Walkthrough
 
The Evolution of Test Automation for DevOps
The Evolution of Test Automation for DevOpsThe Evolution of Test Automation for DevOps
The Evolution of Test Automation for DevOps
 
Building Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps WorldBuilding Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps World
 
Agile testing
Agile testingAgile testing
Agile testing
 
5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation
 

Kürzlich hochgeladen

TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...AliaaTarek5
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 

Kürzlich hochgeladen (20)

TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 

Using Crowdsourced Testing to Turbocharge your Development Team

  • 1. Using Crowdsourced Testing to Turbocharge your Development Team
  • 2. What does traditional QA look like? ▸ Write test cases ▹ Feature tests, regression tests, etc ▸ Execute tests ▹ Manual or Automated ▸ Reporting bugs ▸ Feedback Loop ▸ Bug remediation
  • 3. Traditional QA DOESN’T FIT IN THE DEV PROCESS ▸ Tests exist outside of development environment ▹ Most developers’ workflow takes place in their local environment ▸ Testing requires a comprehensive review of functionality ▹ It goes beyond the scope of just one change ▸ Tests updated separately from what is being tested ▹ Versions of test and code must match
  • 4. QA that FITS IN THE DEV PROCESS “Shifting Left” Building quality in from the start
  • 5. Dev-Owned QA The Upside - Bugs are caught faster - There’s less room for communication errors - Keeps development agile
  • 6. Dev-Owned QA The Downside - Time is spent on testing, not building - Delays in release schedule - Because of this “double duty,” things fall through the cracks
  • 7. Solution? Testing that keeps up with agile development
  • 8. Crowdsourced Testing How does it turbocharge your team?
  • 9. Write Tests Write & run functional tests through UI, API or CLI How Rainforest Works Run Tests Each test is sent to 3 trained testers from our on-demand crowd of 50K testers Result Verification Rainforest algorithms verify the accuracy and quality of the tester results Results Returned Results are returned via Rainforest platform or directly into CI or bug trackers
  • 10. Expertise The average tester has been working with Rainforest for 16 months The Rainforest Crowd Difference Consistency 68% of testers execute more than 50 Rainforest tests each week Continued Learning Our tester pool completes over 15,000 QA training sessions each week Machine Learning Ensures that each test run meets our standard for quality
  • 11. Rainforest DevX Using crowdsourced testers to run tests and provide deterministic results within existing workflows
  • 14. Benefits of Rainforest DevX Run all tests synchronously for quick results Save developer time and resources by allowing the crowd to execute test cases Testing Flexibility Test at any point within your release process Reduce test management overhead Eliminate versioning problems by coupling test expectations with the code being tested Bring Regression Testing into Your Development Workflow
  • 15. “Our devs realized that they wouldn’t have to leave their code editor to write a test for something they had just developed... Rainforest DevX makes it a lot easier to maintain and refactor our tests Mitch Stewart, CTO, Guru
  • 16. “We love that we can drive Rainforest from the command line and control the scope of the tests and cherry pick the browsers we want to run tests on Welling LaGrone, Director of Software Engineering, America’s Test Kitchen
  • 17. $3.3 MMSaved annually over in-house QA 557 HRSSaved on testing per month 30 XSpeed of an in-house team Customer Stats
  • 18. LEARN MORE To find out more about streamlining testing… Contact: info@rainforestqa.com Github: @rainforestapp Follow: @rainforest_eng