The opium of the masses: Evaluating ‘High Tea’

•

1 gefällt mir•4,977 views

Through evaluation of a risky but highly successful casual web game, the Wellcome Trust discovered more than they expected about new audiences and how people play games, as well as reaching towards best practice in evaluation itself. Session: Evaluation and measuring engagement case studies

Bildung Unterhaltung & Humor Design

Summative Games Evaluation

Testing:
•Did we achieve our aims?

•To reach a new audience
•To engage them meaningfully with the subject
matter
•To do so with a game which was high quality and
satisfying to play

Summative Games Evaluation

Method
• Analytics
• Survey
• Interviews and Focus Groups
• Community commentary

Summative Games Evaluation

Analytics – Google Analytics

Summative Games Evaluation

Analytics – other tools: Google Trends

Summative Games Evaluation

Analytics – other tools: stats.grok.se

$Summative Games Evaluation Analytics – key findings •Number of plays has passed 3.2 million, far exceeding target of 100k in month one and 50k thereafter •Average dwell time just under 15 min •Most popular countries 26% USA, 6%UK, 5.5% Brazil… •Only about 3% visits to our hosted version, rest syndicated •Around 30k referrals from game to WC site •Social media drove tiny fraction of traffic to the game$

Summative Games Evaluation

Survey – key findings
•Gameplay highly rated (over 91% very or fairly good)
• Around 2/3rds already aware of Opium Wars or trade
• But over 50% either quite or very likely to look for
more information after playing
• Nearly 60% retained the same opinion about the
British empire, but nearly 28% felt more negatively, and
nearly 10% felt more positively
• Comments mostly positive, pleased to be learning and
having fun, small number thought it was tasteless.

Summative Games Evaluation

Interviews – key findings
•Players intrigued by subject matter but also high rating
and front page positioning on game portals
• Positive feedback on game, could have included even
more information about history etc
• All but one who was very familiar with the history felt
they had learnt something.
• Several went on to check Wikipedia page or other
sources, including reading a book about China
• Several had thought about the ethics whilst playing
• Were pleasantly surprised to see us doing this, wanted
to see us do more games

Summative Games Evaluation

Community commentary

Summative Games Evaluation

Community commentary – key findings
• Game portal comments, numerous and often thoughtful
•“How come I only understood what I’d seen in a museum after
playing this game?”
• 18 blog reviews, many discussing history, some economics, not all
English language. Also generated comments and debate on those
blogs
•Threads on Reddit and Metafilter, on history, ethics and economics
• Video reviews and walkthroughs on YouTube, also hack video
• Discussed in depth on Popmatter’s Moving Pixels podcast
• Response from conferences and other similar institutions has been
positive and interested

Summative Games Evaluation

How does all this help us?
• Informs future game design and distribution
• External dissemination and discussion
• Internal awareness and buy-in
• Validation of the project
• Surprising, rewarding and fascinating

Summative Games Evaluation

Share
• http://museumgames.pbworks.com
• @marthasadie
• marthasadie.wordpress.com
•www.wellcomecollection.org/explore/play.aspx

Weitere ähnliche Inhalte

Ähnlich wie The opium of the masses: Evaluating ‘High Tea’

Summative Games Evaluation

Martha Henson

SCC 2012 Evaluating games: learning through play?; Summative evaluation (Mart...

British Science Association

Delivered at Casual Connect USA 2016. How can you validate if your game is worth playing before you write a single line of code? How can you get people to sign up to play your game before a demo is even ready? How many units do you need to ship in order to pay for the initial development of your next game? How many signups do you need this month? The purpose of this talk is to take a step back and view the “Business” as being your product, not the game.

Your Game is None of Your Business | Randall Robbins

Jessica Tams

2. research done

DominikBalint

Gaming wikis & learning

matthewbarr

Gamification in Digital Marketing

2. research done

2. research done

2. research done

Games prese

Twitch - Project Presentation

Daise Rocha

F2P Design Crash Course (Casual Connect Kyiv 2013)

Kongregate

Kiyat games game evaluation process

Sun Cho

Game shows aqa

krober4

Jonathan Barone-University of Washington

SeriousGamesAssoc

Marketing Games in 2016

International Digital Entertainment Agency (IDEA)

How to Apply Game-Based Marketing Dynamics to Twitter | Instructor: James Clark, Co-Founder, Room 214 | @jamesoclark | @Room_214 | Delivered Nov 18, 2010 at TWTRCON SF Why Game-Based Marketing? We are passing over the threshold into a realm of programs built on game-based marketing dynamics. This is important as many organizations are seeking ways to build a following, distribute relevant content and most importantly be entertaining in social media. Understanding the basis of game-based marketing dynamics (leader boards, unlocking levels) leveraged through Twitter is one of only a few strategic approaches that works to simultaneously achieve all goals. What You’ll Learn: We’ll cover the basics of game-based marketing dynamics because (1) you should be aware of them and (2) often times its the smallest spark that ignites the biggest fires. From there we’ll provide the steps to set up and run game-based marketing campaigns in Twitter, in addition to exposing limitations so you won’t be sweating the details in the heat of the battle.

TWTRCON SF 10 Workshop: Game-Based Marketing Dynamics

Edelman

World Council for Curriculum & Instruction Presentation

Jason Rosenblum, PhD

Marketing Games in 2018

International Digital Entertainment Agency (IDEA)

Mochi Media VGSU

Virtual Goods Summit

Ähnlich wie The opium of the masses: Evaluating ‘High Tea’ (20)

Summative Games Evaluation

SCC 2012 Evaluating games: learning through play?; Summative evaluation (Mart...

Your Game is None of Your Business | Randall Robbins

2. research done

Gaming wikis & learning

Gamification in Digital Marketing

2. research done

Games prese

Twitch - Project Presentation

F2P Design Crash Course (Casual Connect Kyiv 2013)

Kiyat games game evaluation process

Game shows aqa

Jonathan Barone-University of Washington

Marketing Games in 2016

TWTRCON SF 10 Workshop: Game-Based Marketing Dynamics

World Council for Curriculum & Instruction Presentation

Marketing Games in 2018

Mochi Media VGSU

Mehr von Museums Computer Group

12,000 sheets of paper per week

Museums Computer Group

how online collections could potentially impact the actual art system

Museums Computer Group

Artificial intelligence and machine learning for the analysis and enrichment ...

Museums Computer Group

Balancing enhancement, innovation and invention

Museums Computer Group

The new phygital normal: case studies from India Shalini Bansal (Museums22)

Museums Computer Group

Towards inclusive digital museum innovation: theoretical and practical issues...

Museums Computer Group

Digital is our everyday reality, digital preservation should be too

Museums Computer Group

Cyberattacks: the reality, the trauma, and how to survive. A case study from ...

Museums Computer Group

A shot in the arm for QR Codes in museums

Museums Computer Group

Museums+Tech 2022 Closing panel

Museums Computer Group

Museums+Tech 2022 Keynote

Museums Computer Group

Museums+Tech 2020: Museums in a crisis Entertaining audiences in a time of crisis Alix Geddes, One Further This is an ongoing study looking at types of content posted by museums online during the various crises of 2020, specifically humour, and how audiences interacted with it. The study consists of surveying digital communications staff at large and small museums across the UK and takes data directly from their website analytics and social media platforms. With the sudden pandemic and subsequent lockdown, museums were forced to close their doors to the public and focused on using their digital channels to share the objects, themes, and stories within their collections, albeit with different perspectives. Digital content was transformed, with accessing collections from home and children’s activities at the forefront. We also saw attempts to reach online audiences with content that would amuse, entertain, and engage. Early on during the crisis, people participated in the Getty Museum Challenge (recreating artwork with objects from home), and hashtags such as #MuseumFromHome and #CuratorBattles gained traction. What was the impact of this? What types of content did audiences flock to, and in what numbers? What trends and insights can be pulled from the data available?

Entertaining audiences in a time of crisis Alix Geddes, One Further

Museums Computer Group

Museums+Tech 2020: Museums in a crisis COVID, content strategy & organisational change Georgina Brooke, National Museums Scotland In January 2020 I moved out of my home in Oxford, north of the border to Scotland, to start a new role as Digital Media Content Manager at National Museums Scotland. I’d done Hogmanay and Burns Night, I’d written a new content strategy, which was about to be rolled out across the organisation. I was beginning to feel like I’d got my foot under the door. By 19 March my mood had changed. The museum was closed, all exhibitions indefinitely postponed, my team was going to reduce by 50%, and all my lovely online audiences were very online, very stressed and very vocal. This paper will look at how the Digital Team at National Museums Scotland developed and adapted an effective content strategy through the lockdown period, including: The content formats and storytelling themes that most successfully connected online audiences with our collections and staff Black Lives Matter – convincing Senior Management to react quickly and commit to a step change in our policies on race and representation within the museums What we learnt and how these lessons are now changing our approach to audience engagement as the museum reopen

COVID, content strategy & organisational change Georgina Brooke, National Mus...

Museums Computer Group

Virtual tours and monetisation Paul Fabel, Guided & Nathan Wilson, YourTour

Museums Computer Group

Museums+Tech 2020: Museums in a crisis Videogames and museums: fields in convergence Amy Hondsmerk, Nottingham Trent University As museums and heritage sites consider the ways in which they can engage visitors in the digital age, a trend expedited by the COVID-19 pandemic, the sector has progressively looked to the videogame industry. Tapping into the ‘experience economy’ (Park and Gilmore 1999), this intersection has allowed museums to explore the role of play in understanding the past. This has taken various forms including collaborations with game companies, utilising existing games to reach gaming communities and broaden audiences, and developing new museum-based games. Yet, while many of these game-related initiatives have been successful, thus far the museum sector has mainly employed video games in a manner that has been limited, with museum games remaining primarily focused on educational or entertainment goals. In the context of changing understanding about interpretation in museums and, specifically, of the recognition of the role of visitors as participants in the interpretative process (Hooper-Greenhill 2000, Staiff 2014), the convergence of museums and videogames is rich area to explore and consider how the sector could realise the full potential of museum video games.

Videogames and museums: fields in convergence Amy Hondsmerk, Nottingham Trent...

Museums Computer Group

Museums+Tech 2020: Museums in a crisis Inclusive digital practice in post-lockdown society Becki Morris & Sarah Simcoe, Disability Collaborative Network and EMBED As we navigate out of crisis during unprecedented times, the pandemic has highlighted that the time is right to reflect on the key role that digital is playing in reaching diverse communities as we create the ‘new normal’. While the heritage sector has traditionally taken a piecemeal approach to delivering digital services, these challenging times have necessitated the sector need for embracing digital inclusive practice. This ensures the continued delivery of services, attracts new audiences, including those who may have previously faced barriers to the physical environment and includes those who are vulnerable to COVID-19 complications. The pandemic has provided the sector with a unique opportunity to build positive intersectional inclusion through digital practices. At the same time, the Black Lives Matter movement has highlighted the issue of colonisation and the importance of greater access to related collections. During this presentation, DCN and EMBED, a cross-sector partnership, will share experiences and key learnings from the lockdown period, what we have done to support the sector and how digital inclusion is core to the sector in creating better, more resilient service, support and participation for audiences and the workforce.

Inclusive digital practice in post-lockdown society Becki Morris & Sarah Simc...

Museums Computer Group

Museums+Tech 2020: Museums in a crisis With a houseboat and an iPhone (how IWM supported home learning during lock down) John Glancy, Imperial War Museum When the UK’s schools closed in March 2020 the needs of the nation’s learners changed. Education was moved to a different type of classroom one that often involved a kitchen table for a desk and a digital device instead of an exercise book. Learning outputs in the heritage sector had to change too. School audiences couldn’t visit our galleries and objects, so the galleries and objects had to visit them… With a Houseboat and an iPhone will explore how Imperial War Museums conceived and developed its 16-part web series Adventures in History and brought a national collection into people’s homes. It will also explore how the work done on this project is inspiring Imperial War Museums to evolve its ongoing digital learning offer by tackling some of the most difficult stories in its collections such as Empire history. We will also explore the ways we are proposing to use eyewitness testimony to support a recovery curriculum by aiding health and well being outcomes.

With a houseboat and an iPhone (how IWM supported home learning during lock d...

Museums Computer Group

Brave new world – thinking about the future of museums Sharon Heal, Director ...

Museums Computer Group

Museums+Tech 2020: Museums in a crisis Museums in an Earth crisis – and how digital can help Bridget McKenzie, Climate Museum The multiple crises facing museums and society are all part of the Earth crisis, caused by an extractive and exploitative system. COVID-19 is an outcome of the ecological emergency, and climate breakdown threatens further blows to the relative stability of past decades in which museums have flourished. The Activist Museum Award has allowed us in Climate Museum UK to enquire into the possibilities of non-extractive digital collecting. As part of this, we are exploring extractivism, taking an environmental approach to the challenge of decolonising museums. A new mobile museum, we are reimagining museums for an age of crisis. This lightning talk will summarise our findings of how digital collections might power activism to tackle the big challenges of social and environmental justice. What are the possibilities for museums to collaborate to create an accessible UK-wide digital collection that gives a climate and ecology lens to cultural artefacts? What is the appetite for a commons-based resource that opens up to democratic interpretation, and that enables its users to learn about the Earth crisis, to express views, to design solutions and to take action?

Museums in an Earth crisis – and how digital can help Bridget McKenzie, Clima...

Museums Computer Group

Museums+Tech 2020: Museums in a crisis SDDC virtual visits pre and post COVID-19: what’s changed? Emilie Carruthers, British Museum The Samsung Digital Discovery Centre offers free live workshops to schools delivered through video conferencing technology, and has done for many years. This puts us in a unique position to compare how the programme and its audience has evolved since COVID-19: how have student and teacher’s expectations changed, are teachers now more comfortable booking virtual experiences for their classes and how has the programme evolved to align with audience expectations? We’ll use the most recent data from the schools Autumn term 2020 to explore these questions and think about how the demand for online live experiences in classrooms might evolve in future.

SDDC virtual visits pre and post COVID-19: what’s changed? Emilie Carruthers,...

Museums Computer Group

Mehr von Museums Computer Group (20)