ReachOut Methodology

The Beta-Testing Campaign Platform for Research Projects
The REACHOUT project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 825307.
Beta-Testing Campaign Methodology
For Research Projects
March 2020

Mar 24, 2020 22019
A Beta-Testing Campaign
Methodology
Methodology
Body of methods, rules, and postulates
employed by a discipline.
Beta-testing methodology
The process used to collect feedback for the
purpose of developing a better software
Beta-testing campaign methodology
The body of tools, methods, process and best
practices that can be employed to develop and
run a beta testing campaign

Mar 24, 2020 32019
1. What Is a Beta-Testing Campaign?
2. Running a Beta-Testing Campaign
3. The ReachOut Campaign Platform

Mar 24, 2020 42019
And why you should care
What is a
Beta-Testing
Campaign?

Mar 24, 2020 52019
Creating Value
for Research Projects
Users do not want just code
Product attributes create value

Mar 24, 2020 62019
Where a Beta-Testing
Campaign Fits
A form of external user acceptance testing
Released to a limited audience external to the
programming team
Time-bound into a campaign

Mar 24, 2020 72019
What Are the Benefits of a Beta-
Testing Campaign?
Leverages code development into an initiative that
reaches out to potential users
Generates quality because a beta version
usually undergoes a full cycle of internal system and
usability testing
Enforces product attributes, such as
packaging, tutorials, documentation, installation, on-
line user support, promotion, etc.
Helps identify exploitation opportunities
reported by beta testers
Benefits by Nick Youngson CC BY-SA 3.0 Alpha Stock Images

Mar 24, 2020 82019
Why a Beta-Testing Campaign in a
Research Project?
If a project can launch a beta testing campaign of its results it has
what it takes to bring value to the market, engage with users,
partners and complementors and develop its ecosystem.
Dissemination
Exploitation
Community
Contributors
Early adopters
Impact
Market value
Recognition

Mar 24, 2020 92019
Keep it Simple and to the Point:
Scenario-Based Campaigns
Scenario-based: A tutorial guides beta testers
step-by-step to a “Hello World!” result.
Adapted to the constraints of research projects
Focused: test part of the software before the
whole system becomes available
Simple: a scenario is an efficient way to
explain complex, new generation software
Convenient: easier for beta testers to
understand and participate in
Timely: it can be completed within the scope of
the project duration
https://blog.wedogood.co/inside-we-do-good/phase-davant-premiere-ca-tourne/

Mar 24, 2020 102019
Outcomes to Look for
in a Beta-Testing Campaign
Technical feedback
Deployment report
UX evaluation
Process continuity
Component integration, etc.
Exploitation results
Business needs identified
Relevant business models declared
Potential external contributors/users
Emerging project ecosystem
Beta testers
# of external users who download and test the
software
# of external users who provide a feedback
# of support requests and interactions
https://stats.libretexts.org/Bookshelves/Introductory_Statistics/Book%3A_Introductory_Statistics_(Lane)/2%3A
_Graphing_Distributions/2.01%3A_Graphing_Qualitative_Variables
https://bloom-at.blogspot.com/2017/12/a-report-on-reports.html

Mar 24, 2020 112019
What you have to do by yourself
Running
a Beta-Testing
Campaign

Mar 24, 2020 122019
Stepping Stones to a Successful
beta-testing Campaign
Strategy
Define Goals and Scope of the Campaign
Identify and Assign Key Roles
Technology
Prepare the Software
Draft the Testing Plan
Writing
Develop the Beta Documentation
Develop Communication Material
People
Build contact list
Engage with Beta Testers
Closing
Complete and evaluate results
Complete and circulate reports
http://annamae22.deviantart.com/art/Stepping-Stone-Path-Stock-Photo-PNG-
476002047
ClosingPeopleWritingTechnologyStrategy

Mar 24, 2020 132019
Define Goals and Scope
of the Campaign
Goals
Non-functional or functional testing
Check deployability, demonstrate integration of
the different components
Positioning: clarity of the purpose of the
software, etc.
Test the whole or part of the software?
Scope
Specific functionalities of the software to be
made available to beta testers
Basic modules instead of the whole platform.
Can “Hello world” can be achieved
Adapt objectives to the remaining time of the
project

Mar 24, 2020 142019
Identify and Appoint Key Roles Campaign Manager
Combines technical and dissemination
resources
Internal beta testers
Test the beta test plan
Beta testers
Define ideal profile prior to test
Support Contact
Will be the key contact for beta testers
Participants
All project partners

Mar 24, 2020 152019
Incentives for Beta Testers Budget must planned for beta testers rewards
No professional beta testers, limited budget
Must appeal to developers
T-shirts or tech goodies are OK.
A digital reward is easy to deliver
A buying voucher at an online shop for
example.
Recognition of beta testers as contributors on
the website is well appreciated.
Polling all the reward budget into one super
lottery prize is a possibility.

Mar 24, 2020 162019
Develop Software Package
to be Tested
A proper package, not just the code on Git
Must be easily consumable by third-party IT
professionals.
Beta version packaged and tested
Beta version download link operational
Evaluate the testability of your software.
https://ar.wikipedia.org/wiki/%D9%85%D9%84%D9%81:Group_people_icon.jpg
ClosingPeopleWritingTechnology7Strategy

Mar 24, 2020 172019
Develop Testing Plan Testing scenario defined
What functionality do you want to test?
Relevant “Hello world” defined and tested
What result should the scenario lead to?
Dataset developed and integrated
Should/Can beta testers use own datasets?
Questionnaire
What feedback do you want?

Mar 24, 2020 182019
Write Beta Documentation Introduction,
Beta test goals and timeline
Assumptions and requirements
Software overview
Beta version limitations
Beta-testing scenarios
Step-by-step tutorial
Links to software documentation
Support contact details
Mailing list details
Feedback collection process
Incentive
Link to the GDPR Notice
https://stackoverflow.com/users/1987598/mathias-m%C3%BCller

Mar 24, 2020 192019
Write the Communication Material Necessary writing tasks
Beta-testing campaign announcement mail
Beta-testing campaign announcement tweets
Campaign web page
Beta-testing campaign welcome mail
Beta-testing campaign wrap-up mail
Beta-testing campaign flyer
Beta-testing campaign thank you mail
http://aaasigns.co.nz/print/flyers/

Mar 24, 2020 202019
Basic Guidelines Beta testers defined
Ideal profile, prerequisites
Developers, Business users
Metrics
One in five return valuable feedback
Significant results at 10 valuable feedback
Engage openly
Follow-up on registration
Reply swiftly
Communication channel
https://ar.wikipedia.org/wiki/%D9%85%D9%84%D9%81:Group_people_icon.jpg

Mar 24, 2020 212019
How to Recruit Beta Testers From your own project partners
Fellow researchers
Students,
From other projects,
Trade beta-testing participations
Friends and family
Use social networks again and again
Tweeter, LinkedIn, Reddit, etc.
Advertise at events
Scientific and academic events
Industry and open source events
https://pixabay.com/illustrations/hello-hand-shake-handshake-greeting-1546041/

Mar 24, 2020 222019
Complete and Evaluate Results Priority on quality and consistency of feedback
collected
Target at least 10 beta testers recruited
Should receive at least 6 feedback
questionnaires
Follow-up with beta testers
Insist on feedback questionnaires
Request and discuss details
Balance results
Technical feedback
Exploitation opportunities
https://stats.libretexts.org/Bookshelves/Introductory_Statistics/Book%3A_Introductory_Statistics_(Lane)/
2%3A_Graphing_Distributions/2.01%3A_Graphing_Qualitative_Variables

Mar 24, 2020 232019
Complete and Circulate Reports No Beta-Testing Campaign fully completed
without report of results
Internal reporting
For partners and European Commission
External reporting
By web page, mail or press release
As a dissemination action.
ReachOut debriefing
Feedback to improve ReachOut platform
https://bloom-at.blogspot.com/2017/12/a-report-on-reports.html

Mar 24, 2020 242019
What ReachOut do for you
The ReachOut
Campaign Platform

Mar 24, 2020 252019
Methodology Summary
Questionnaire
Campaign
Manager
Packaged
Software
Test scenario
Documentation
Tutorials
Promotion
Actions
Leaflet
Incentives
Partners
Involved
Support Contact
Campaign
Dashboard
Beta testers
ReportingCampaign Page

Mar 24, 2020 262019
ReachOut Provides Templates for
Key Building Blocks
Campaign Manager Home Page
The entry point to the BetaCenter
Campaign Page
Form-based and customizable
Beta documentation template
Checklist and examples
Feedback collection
Draft Questionnaire
Reporting package
Monitoring dashboard
Communication Package
Pre-written mails and communication material
Fine print
Agreement, Consent, Disclaimer, GDPR notice
Photo credit: CC BY Holger Zscheyge
We have it all prepared
We have it all prepared
for you!for you!

Mar 24, 2020 272019
My Home Page The Campaign Manager page
The entry point to the BetaCenter
Becomes active upon registration and login
Provides Campaign Manager access to
resources
Edit project description
Create and edit beta-testing campaigns,
Access questionnaire
Access campaign dashboard

Mar 24, 2020 282019
The Campaign Web Page
Template
The Campaign Page is the landing page for the
beta-testing campaign
A form guides the Campaign Manager and
automatically creates the Campaign Page
Project description
Logo and website
Beta campaign description
Beta tester registration link
Requirements for participating
Download and documentation links
Key dates

Mar 24, 2020 292019
The Monitoring Dashboard 24 Checkpoints
Self-Evaluation
Visual Synthesis
Helps reporting
To partners
To reviewers
Management
Strategic decisions
Project level
Preparation
Tactical decisions
Back-office tasks
Execution
Live campaign
Results & reporting

Mar 24, 2020 302019
The Questionnaire Template The Questionnaire is the way feedback is
collected on the ReachOut platform
Two-thirds generic and one-third specific
questions
Questions to focus on:
Deployment
UX and tutorial
Documentation
Integration
Exploitation opportunities
Etc.

Mar 24, 2020 312019
The Communication Package Communication between the project and the
beta testers
Leverage ReachOut templates in your
communication
Beta-testing campaign announcement mail
Beta-testing campaign announcement tweets
Campaign web page
Beta-testing campaign welcome mail
Beta-testing campaign wrap-up mail
Beta-testing campaign flyer
Beta-testing campaign thank you mail

Mar 24, 2020 322019
The Mailing Lists Campaign list
Communication between Campaign Managers
and Beta Testers
Campaign Managers list
Sharing platform feedbacks, experience,
questions, best practices
Mutual help in finding beta-testers

Mar 24, 2020 332019
The Beta-Testing Agreement Definitions
Eligibility and Enrollment
Informed consent page
Copyright, Ownership and Acceptable Use
Disclaimer of Liability and Warranty
Data Protection and Privacy
Data Protection page
Modification Rights
Applicable Law

Mar 24, 2020 342019
First Things First:
Register your project
What happens once you register?
We will arrange an online presentation and
discuss your timeline
We will discuss the possibility of making a
presentation at your next plenary meeting
Then we get started:
You are granted access to the templates
We help you set up the campaign page
Together we define the promotion plan

Mar 24, 2020 352019
Timeline of Your Campaign
Define Goals and Scope of the Campaign
Identify and Assign Key Roles
On-going recruitment of beta testers and
follow-ups.
Organization of support actions:
workshops, webinars, etc.
1-2 months 1 month1-2 months
Closing
People
Writing
Technology
Strategy
Prepare Software
Draft Testing Plan
Develop Beta Documentation
Develop Communication Material
Build contact list
Engage with Beta Testers
Complete results and
reports

Mar 24, 2020 362019
Summary Beta-testing is a recognized best practice in
software product development.
Launching a beta testing campaign helps bring
your project closer to the market.
Follow the ReachOut methodology to develop a
beta-testing campaign.
Take advantage of the ReachOut platform and
its ready-made templates.
Develop your beta-testingDevelop your beta-testing
campaign on ReachOut. Now!campaign on ReachOut. Now!

Mar 24, 2020 372019
Thank You!
Funding acknowledgement: The REACHOUT project has received funding from the European Union’s Horizon 2020 research and
innovation programme under grant agreement number 825307.
DISCLAIMER: The information in this document is provided “as is”, and no guarantee or warranty is given that the information is fit for
any particular purpose. The content of this document reflects only the author`s view – the European Commission is not responsible for
any use that may be made of the information it contains. The users use the information at their sole risk and liability.

ReachOut Methodology

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie ReachOut Methodology

Ähnlich wie ReachOut Methodology (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

ReachOut Methodology