The Reachout Methodology

The Beta-Testing Campaign Platform for Research Projects
The REACHOUT project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 825307.
Beta-Testing Campaign Methodology
For Research Projects
October 2019

Nov 8, 2019 22019
A Beta-Testing Campaign
Methodology
Methodology
Body of methods, rules, and postulates
employed by a discipline.
Beta-testing methodology
The process used to collect feedback for the
purpose of developing a better software
Beta-testing campaign methodology
The body of tools, methods, process and best
practices that can be employed to develop and
run a beta testing campaign

Nov 8, 2019 32019
1. What Is a Beta-Testing Campaign?
2. Running a Beta-Testing Campaign
3. The ReachOut Campaign Platform

Nov 8, 2019 42019
And why you should care
What is a
Beta-Testing
Campaign?

Nov 8, 2019 52019
Where a Beta-Testing
Campaign Fits
A form of external user acceptance testing
Released to a limited audience external to the
programming team
Time-bound into a campaign

Nov 8, 2019 62019
What Are the Benefits of a Beta-
Testing Campaign?
Leverages code development into an initiative that
reaches out to potential users
Generates quality because a beta version
usually undergoes a full cycle of internal system and
usability testing
Enforces product attributes, such as
packaging, tutorials, documentation, installation, on-
line user support, promotion, etc.
Helps identify exploitation opportunities
reported by beta testers
Benefits by Nick Youngson CC BY-SA 3.0 Alpha Stock Images

Nov 8, 2019 72019
Why a Beta-Testing Campaign in a
Research Project?
If a project can launch a beta testing campaign of its results it has
what it takes to bring value to the market, engage with users,
partners and complementors and develop its ecosystem.
Dissemination
Exploitation
Community
Contributors
Early adopters
Impact
Market value
Recognition

Nov 8, 2019 82019
Keep it Simple and to the Point:
Scenario-Based Campaigns
Scenario-based: A tutorial guides beta testers
step-by-step to a “Hello World!” result.
Adapted to the constraints of research projects
Focused: test part of the software before the
whole system becomes available
Simple: a scenario is an efficient way to
explain complex, new generation software
Convenient: easier for beta testers to
understand and participate in
Timely: it can be completed within the scope of
the project duration
https://blog.wedogood.co/inside-we-do-good/phase-davant-premiere-ca-tourne/

Nov 8, 2019 92019
Outcomes to Look for
in a Beta-Testing Campaign
Technical feedback
Deployment report
UX evaluation
Process continuity
Component integration, etc.
Exploitation results
Business needs identified
Relevant business models declared
Potential external contributors/users
Emerging project ecosystem
Beta testers
# of external users who download and test the
software
# of external users who provide a feedback
# of support requests and interactions
https://stats.libretexts.org/Bookshelves/Introductory_Statistics/Book%3A_Introductory_Statistics_(Lane)/2%3A
_Graphing_Distributions/2.01%3A_Graphing_Qualitative_Variables
https://bloom-at.blogspot.com/2017/12/a-report-on-reports.html

Nov 8, 2019 102019
What you have to do by yourself
Running
a Beta-Testing
Campaign

Nov 8, 2019 112019
Stepping Stones to a Successful
beta-testing Campaign
Strategy
Define Goals and Scope of the Campaign
Identify and Assign Key Roles
Technology
Prepare the Software
Draft the Testing Plan
Writing
Develop the Beta Documentation
Develop Communication Material
People
Build contact list
Engage with Beta Testers
Closing
Complete and evaluate results
Complete and circulate reports
http://annamae22.deviantart.com/art/Stepping-Stone-Path-Stock-Photo-PNG-
476002047
ClosingPeopleWritingTechnologyStrategy

Nov 8, 2019 122019
Define Goals and Scope
of the Campaign
Goals
Non-functional or functional testing
Check deployability, demonstrate integration of
the different components
Positioning: clarity of the purpose of the
software, etc.
Test the whole or part of the software?
Scope
Specific functionalities of the software to be
made available to beta testers
Basic modules instead of the whole platform.
Can “Hello world” can be achieved
Adapt objectives to the remaining time of the
project

Nov 8, 2019 132019
Identify and Appoint Key Roles Campaign Manager
Combines technical and dissemination
resources
Internal beta testers
Test the beta test plan
Beta testers
Define ideal profile prior to test
Support Contact
Will be the key contact for beta testers
Participants
All project partners

Nov 8, 2019 142019
Develop Software Package
to be Tested
A proper package, not just the code on Git
Must be easily consumable by third-party IT
professionals.
Beta version packaged and tested
Beta version download link operational
Evaluate the testability of your software.
https://ar.wikipedia.org/wiki/%D9%85%D9%84%D9%81:Group_people_icon.jpg
ClosingPeopleWritingTechnology7Strategy

Nov 8, 2019 152019
Develop Testing Plan Testing scenario defined
What functionality do you want to test?
Relevant “Hello world” defined and tested
What result should the scenario lead to?
Dataset developed and integrated
Should/Can beta testers use own datasets?
Questionnaire
What feedback do you want?

Nov 8, 2019 162019
Write Beta Documentation Introduction,
Beta test goals and timeline
Assumptions and requirements
Software overview
Beta version limitations
Beta-testing scenarios
Step-by-step tutorial
Links to software documentation
Support contact details
Mailing list details
Feedback collection process
Incentive
Link to the GDPR Notice
https://stackoverflow.com/users/1987598/mathias-m%C3%BCller

Nov 8, 2019 172019
Write the Communication Material Necessary writing tasks
Beta-testing campaign announcement mail
Beta-testing campaign announcement tweets
Campaign web page
Beta-testing campaign welcome mail
Beta-testing campaign wrap-up mail
Beta-testing campaign flyer
Beta-testing campaign thank you mail
http://aaasigns.co.nz/print/flyers/

Nov 8, 2019 182019
Build Contact List Beta testers defined
Ideal profile, prerequisites
Developers, Business users
Leverage project ecosystem
Partners, advisory board
Social network followers
Students from participating universities
https://ar.wikipedia.org/wiki/%D9%85%D9%84%D9%81:Group_people_icon.jpg

Nov 8, 2019 192019
Engage with Beta Testers Announce and promote campaign
Leverage social networks
Publish on website
Exhibitions and conferences
Approach potential participants
Send mailings to lists, send out reminders
Face-to-face requests are valuable
Follow-up registrations, downloads, questions
Offer beta testers incentives or rewards
Must recognize contribution
https://pixabay.com/illustrations/hello-hand-shake-handshake-greeting-1546041/

Nov 8, 2019 202019
Complete and Evaluate Results Priority on quality and consistency of feedback
collected
Target at least 10 beta testers recruited
Should receive at least 6 feedback
questionnaires
Follow-up with beta testers
Insist on feedback questionnaires
Request and discuss details
Balance results
Technical feedback
Exploitation opportunities
https://stats.libretexts.org/Bookshelves/Introductory_Statistics/Book%3A_Introductory_Statistics_(Lane)/
2%3A_Graphing_Distributions/2.01%3A_Graphing_Qualitative_Variables

Nov 8, 2019 212019
Complete and Circulate Reports No Beta-Testing Campaign fully completed
without report of results
Internal reporting
For partners and European Commission
External reporting
By web page, mail or press release
As a dissemination action.
ReachOut debriefing
Feedback to improve ReachOut platform
https://bloom-at.blogspot.com/2017/12/a-report-on-reports.html

Nov 8, 2019 222019
What ReachOut do for you
The ReachOut
Campaign Platform

Nov 8, 2019 232019
Questionnaire
Methodology Summary
Campaign
Manager
Packaged
Software
Test scenario
Documentation
Tutorials
Promotion
Actions
Leaflet
Incentives
Partners
Involved
Support Contact
Campaign
Dashboard
Beta testers
ReportingCampaign Page

Nov 8, 2019 242019
ReachOut Provides Templates for
Key Building Blocks
Campaign Manager Home Page
The entry point to the BetaCenter
Campaign Page
Form-based and customizable
Beta documentation template
Checklist and examples
Feedback collection
Draft Questionnaire
Reporting package
Reporting format
Communication Package
Pre-written mails and communication material
Fine print
Agreement, Consent, Disclaimer, GDPR notice
Photo credit: CC BY Holger Zscheyge
We have it all prepared
We have it all prepared
for you!for you!

Nov 8, 2019 252019
My Home Page The Campaign Manager page
The entry point to the BetaCenter
Becomes active upon registration and login
Provides Campaign Manager access to
resources
Edit project description
Create and edit beta-testing campaigns,
Access questionnaire
Access campaign dashboard

Nov 8, 2019 262019
The Campaign Web Page
Template
The Campaign Page is the landing page for the
beta testing campaign
A form guides the Campaign Manager and
automatically creates the Campaign Page
Project description
Logo and website
Beta campaign description
Beta tester registration link
Requirements for participating
Download and documentation links
Key dates

Nov 8, 2019 272019
The Monitoring Dashboard 24 Checkpoints
Self-Evaluation
Visual Synthesis
Helps reporting
To partners
To reviewers
Management
Strategic decisions
Project level
Preparation
Tactical decisions
Back-office tasks
Execution
Live campaign
Results & reporting

Nov 8, 2019 282019
The Questionnaire Template The Questionnaire is the way feedback is
collected on the ReachOut platform
Two-thirds generic and one-third specific
questions
Questions to focus on:
Deployment
UX and tutorial
Documentation
Integration
Exploitation opportunities
Etc.

Nov 8, 2019 292019
The Communication Package Communication between the project and the
beta testers
Leverage ReachOut templates in your
communication
Beta-testing campaign announcement mail
Beta-testing campaign announcement tweets
Campaign web page
Beta-testing campaign welcome mail
Beta-testing campaign wrap-up mail
Beta-testing campaign flyer
Beta-testing campaign thank you mail

Nov 8, 2019 302019
The Beta-Testing Agreement Definitions
Eligibility and Enrollment
Informed consent page
Copyright, Ownership and Acceptable Use
Disclaimer of Liability and Warranty
Data Protection and Privacy
Data Protection page
Modification Rights
Applicable Law

Nov 8, 2019 312019
First Things First:
Register your project
What happens once you register?
We will arrange an online presentation and
discuss your timeline
We will discuss the possibility of making a
presentation at your next plenary meeting
Then we get started:
You are granted access to the templates
We help you set up the campaign page
Together we define the promotion plan

Nov 8, 2019 322019
Define Goals and Scope of the Campaign
Identify and Assign Key Roles
On-going recruitment of beta testers and
follow-ups.
Organization of support actions:
workshops, webinars, etc.
2-3 months 1-2 months
Timeline of Your Campaign
2-3 months
Closing
People
Writing
Technology
Strategy
Prepare Software
Draft Testing Plan
Develop Beta Documentation
Develop Communication Material
Build contact list
Engage with Beta Testers
Complete results and
reports

Nov 8, 2019 332019
Summary Beta-testing is a recognized best practice in
software product development.
Launching a beta testing campaign helps bring
your project closer to the market.
Follow the ReachOut methodology to develop a
beta-testing campaign.
Take advantage of the ReachOut platform and
its ready-made templates.
Develop your beta-testingDevelop your beta-testing
campaign on ReachOut. Now!campaign on ReachOut. Now!

Nov 8, 2019 342019
Thank You!
Funding acknowledgement: The REACHOUT project has received funding from the European Union’s Horizon 2020 research and
innovation programme under grant agreement number 825307.
DISCLAIMER: The information in this document is provided “as is”, and no guarantee or warranty is given that the information is fit for
any particular purpose. The content of this document reflects only the author`s view – the European Commission is not responsible for
any use that may be made of the information it contains. The users use the information at their sole risk and liability.

The Reachout Methodology

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie The Reachout Methodology

Ähnlich wie The Reachout Methodology (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

The Reachout Methodology