SlideShare ist ein Scribd-Unternehmen logo
1 von 22
Downloaden Sie, um offline zu lesen
The Wikipedia
Adventure
Experiment in gamified onboarding
7-mission interactive journey
Editing, social, and policy skills
Automatic edit API
Guided tours with event logging
Userspace template tracking
1 year script writing
5 months design and usability dev
1 month alpha bugfixing
1 month beta test
Qualitative survey
players invited to Qualtrics, 600
responses, 42
age median, 25
women, 11 %
US and UK, 2/3
Overall satisfaction
Satisfaction breakdown
●

89%, TWA made me more confident as an editor

●

89%, TWA helped me understand Wikipedia better

●

77%, TWA made me want to edit more

●

79% TWA made me feel welcomed and supported

●

71% , TWA helped me know what to do next

●

80% , TWA prepared me to be a successful contributor to Wikipedia

●

75% , I enjoyed playing it

●

89% , The game is a good way to introduce new editors to Wikipedia

●

89% , Lots of users should be invited to play TWA
"I enjoyed the idea of editing a fake article for practice - in fact, when I first saw the game, I
immediately hoped it would incorporate some sort of actual editing rather than just theory or
questions or something."
"TWA was very informative and helped pull back the curtain on some of the fundamentals of
editing."
"I didn't know there was talk and discussion among users until I played the game...I just thought you
could make comments and report on individual pages."
"I've seen and heard companies, including my own, talk about learning through 'gamification'. I
found TWA to be the best example of gamification I have witnessed to date."
"I think TWA at the moment is a great stepping stone for new users such as myself. I would love to
see it expand to include more 'advanced' topics that can be optionally covered by the user."
“I wish it gave the impression that editors were expected to be mature and intelligent, rather than
idiots who could be entertained and educated with this kind of drivel."
Gamification elements
Design preference
Target demographic
Quantitative data
10,000 invited using hostbot
600 started the game
45% finished the game
2 control groups: not invited, invited no-play
TWA players made more edits
● 20% more edits than a control group of similar but
non-invited new editors

● 90% more edits than those who were invited but did
not play the game
Player group had more 20+ editors
● TWA players were 1.2 - 1.7x more likely to make 20+
edits than either control group

● TWA players were also more likely to make 0 edits
than the control groups, however.
TWA finishers made the most edits
● Players who completed the game made 3.2x more
edits than those who only started the first level of
the game

● Players who completed the game were 2.9x more
likely to make 20+ edits.
Explanation: off and on ramp
1) make test edits within game, leave
2) grow confidence, get highly active
Phase 2
More invitees, more players, more time
Statistical significance, confounds, stage model
Edit persistence and editor retention
Mesh w/ GettingStarted, Teahouse, Mentorship
Questions?
by Jake Orlowitz, Heather Walls, and Siko Bouterse
With help from Jonathan Morgan, Matt Flaschen, and Nischay Nahata
through a WMF Individual Engagement Grant
User:Ocaasi
jorlowitz@gmail.com
@JakeOrlowitz
@WikiAdventure
http://en.wikipedia.org/wiki/WP:TWA
All text and images CC-BY-SA 3.0

Weitere ähnliche Inhalte

Andere mochten auch

Wikipedia and Medicine: Keys to Success
Wikipedia and Medicine: Keys to SuccessWikipedia and Medicine: Keys to Success
Wikipedia and Medicine: Keys to SuccessJake Orlowitz
 
الاجتماع الشهري مايو 2015 لمبادرة قرين presentation
الاجتماع الشهري مايو 2015 لمبادرة قرين presentationالاجتماع الشهري مايو 2015 لمبادرة قرين presentation
الاجتماع الشهري مايو 2015 لمبادرة قرين presentationMohamed Hassan
 
Tussen Vrijheid en Geluk
Tussen Vrijheid en GelukTussen Vrijheid en Geluk
Tussen Vrijheid en GelukLienSantermans
 
FirstWorkshopOnWikipediaResearch
FirstWorkshopOnWikipediaResearchFirstWorkshopOnWikipediaResearch
FirstWorkshopOnWikipediaResearchwebuploader
 
The Future of Wikipedia in Education
The Future of Wikipedia in EducationThe Future of Wikipedia in Education
The Future of Wikipedia in EducationJake Orlowitz
 
Hype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerHype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerLuminary Labs
 

Andere mochten auch (8)

Wikipedia and Medicine: Keys to Success
Wikipedia and Medicine: Keys to SuccessWikipedia and Medicine: Keys to Success
Wikipedia and Medicine: Keys to Success
 
الاجتماع الشهري مايو 2015 لمبادرة قرين presentation
الاجتماع الشهري مايو 2015 لمبادرة قرين presentationالاجتماع الشهري مايو 2015 لمبادرة قرين presentation
الاجتماع الشهري مايو 2015 لمبادرة قرين presentation
 
Tussen Vrijheid en Geluk
Tussen Vrijheid en GelukTussen Vrijheid en Geluk
Tussen Vrijheid en Geluk
 
FirstWorkshopOnWikipediaResearch
FirstWorkshopOnWikipediaResearchFirstWorkshopOnWikipediaResearch
FirstWorkshopOnWikipediaResearch
 
The Future of Wikipedia in Education
The Future of Wikipedia in EducationThe Future of Wikipedia in Education
The Future of Wikipedia in Education
 
Snigdha
Snigdha Snigdha
Snigdha
 
Build Features, Not Apps
Build Features, Not AppsBuild Features, Not Apps
Build Features, Not Apps
 
Hype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerHype vs. Reality: The AI Explainer
Hype vs. Reality: The AI Explainer
 

Mehr von Jake Orlowitz

Wikipedia and Libraries: Increasing your Library’s Visibilityi
Wikipedia and Libraries: Increasing your Library’s VisibilityiWikipedia and Libraries: Increasing your Library’s Visibilityi
Wikipedia and Libraries: Increasing your Library’s VisibilityiJake Orlowitz
 
Future libraries london
Future libraries londonFuture libraries london
Future libraries londonJake Orlowitz
 
WikiOpen: Encyclopedia, health, research, education, & community
WikiOpen: Encyclopedia, health, research, education, & communityWikiOpen: Encyclopedia, health, research, education, & community
WikiOpen: Encyclopedia, health, research, education, & communityJake Orlowitz
 
The Future of Wikipedia in Education
The Future of Wikipedia in Education The Future of Wikipedia in Education
The Future of Wikipedia in Education Jake Orlowitz
 
The Future of Libraries and Wikipedia
The Future of Libraries and WikipediaThe Future of Libraries and Wikipedia
The Future of Libraries and WikipediaJake Orlowitz
 
Can help be fun wikipedia experiments with social help
Can help be fun   wikipedia experiments with social helpCan help be fun   wikipedia experiments with social help
Can help be fun wikipedia experiments with social helpJake Orlowitz
 
Wikipedia and Medicine
Wikipedia and MedicineWikipedia and Medicine
Wikipedia and MedicineJake Orlowitz
 
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...Jake Orlowitz
 

Mehr von Jake Orlowitz (10)

Wikipedia and Libraries: Increasing your Library’s Visibilityi
Wikipedia and Libraries: Increasing your Library’s VisibilityiWikipedia and Libraries: Increasing your Library’s Visibilityi
Wikipedia and Libraries: Increasing your Library’s Visibilityi
 
Future libraries london
Future libraries londonFuture libraries london
Future libraries london
 
WikiOpen: Encyclopedia, health, research, education, & community
WikiOpen: Encyclopedia, health, research, education, & communityWikiOpen: Encyclopedia, health, research, education, & community
WikiOpen: Encyclopedia, health, research, education, & community
 
The Future of Wikipedia in Education
The Future of Wikipedia in Education The Future of Wikipedia in Education
The Future of Wikipedia in Education
 
Inviting diversity
Inviting diversityInviting diversity
Inviting diversity
 
The Future of Libraries and Wikipedia
The Future of Libraries and WikipediaThe Future of Libraries and Wikipedia
The Future of Libraries and Wikipedia
 
Fun is srs bznss
Fun is srs bznssFun is srs bznss
Fun is srs bznss
 
Can help be fun wikipedia experiments with social help
Can help be fun   wikipedia experiments with social helpCan help be fun   wikipedia experiments with social help
Can help be fun wikipedia experiments with social help
 
Wikipedia and Medicine
Wikipedia and MedicineWikipedia and Medicine
Wikipedia and Medicine
 
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...
 

Kürzlich hochgeladen

Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)cama23
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxlancelewisportillo
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4MiaBumagat1
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxHumphrey A Beña
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYKayeClaireEstoconing
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptshraddhaparab530
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Celine George
 
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxBarangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxCarlos105
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfPatidar M
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management systemChristalin Nelson
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
 
Food processing presentation for bsc agriculture hons
Food processing presentation for bsc agriculture honsFood processing presentation for bsc agriculture hons
Food processing presentation for bsc agriculture honsManeerUddin
 
Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4JOYLYNSAMANIEGO
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfTechSoup
 

Kürzlich hochgeladen (20)

Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
 
Raw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptxRaw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptx
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.ppt
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
 
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxBarangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxYOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdf
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management system
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
 
Food processing presentation for bsc agriculture hons
Food processing presentation for bsc agriculture honsFood processing presentation for bsc agriculture hons
Food processing presentation for bsc agriculture hons
 
Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4Daily Lesson Plan in Mathematics Quarter 4
Daily Lesson Plan in Mathematics Quarter 4
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
 

The Wikipedia Adventure: Designing for Impact

  • 2. Experiment in gamified onboarding 7-mission interactive journey Editing, social, and policy skills
  • 3.
  • 4.
  • 5.
  • 6. Automatic edit API Guided tours with event logging Userspace template tracking
  • 7. 1 year script writing 5 months design and usability dev 1 month alpha bugfixing 1 month beta test
  • 8.
  • 9. Qualitative survey players invited to Qualtrics, 600 responses, 42 age median, 25 women, 11 % US and UK, 2/3
  • 11. Satisfaction breakdown ● 89%, TWA made me more confident as an editor ● 89%, TWA helped me understand Wikipedia better ● 77%, TWA made me want to edit more ● 79% TWA made me feel welcomed and supported ● 71% , TWA helped me know what to do next ● 80% , TWA prepared me to be a successful contributor to Wikipedia ● 75% , I enjoyed playing it ● 89% , The game is a good way to introduce new editors to Wikipedia ● 89% , Lots of users should be invited to play TWA
  • 12. "I enjoyed the idea of editing a fake article for practice - in fact, when I first saw the game, I immediately hoped it would incorporate some sort of actual editing rather than just theory or questions or something." "TWA was very informative and helped pull back the curtain on some of the fundamentals of editing." "I didn't know there was talk and discussion among users until I played the game...I just thought you could make comments and report on individual pages." "I've seen and heard companies, including my own, talk about learning through 'gamification'. I found TWA to be the best example of gamification I have witnessed to date." "I think TWA at the moment is a great stepping stone for new users such as myself. I would love to see it expand to include more 'advanced' topics that can be optionally covered by the user." “I wish it gave the impression that editors were expected to be mature and intelligent, rather than idiots who could be entertained and educated with this kind of drivel."
  • 16. Quantitative data 10,000 invited using hostbot 600 started the game 45% finished the game 2 control groups: not invited, invited no-play
  • 17. TWA players made more edits ● 20% more edits than a control group of similar but non-invited new editors ● 90% more edits than those who were invited but did not play the game
  • 18. Player group had more 20+ editors ● TWA players were 1.2 - 1.7x more likely to make 20+ edits than either control group ● TWA players were also more likely to make 0 edits than the control groups, however.
  • 19. TWA finishers made the most edits ● Players who completed the game made 3.2x more edits than those who only started the first level of the game ● Players who completed the game were 2.9x more likely to make 20+ edits.
  • 20. Explanation: off and on ramp 1) make test edits within game, leave 2) grow confidence, get highly active
  • 21. Phase 2 More invitees, more players, more time Statistical significance, confounds, stage model Edit persistence and editor retention Mesh w/ GettingStarted, Teahouse, Mentorship
  • 22. Questions? by Jake Orlowitz, Heather Walls, and Siko Bouterse With help from Jonathan Morgan, Matt Flaschen, and Nischay Nahata through a WMF Individual Engagement Grant User:Ocaasi jorlowitz@gmail.com @JakeOrlowitz @WikiAdventure http://en.wikipedia.org/wiki/WP:TWA All text and images CC-BY-SA 3.0