SlideShare ist ein Scribd-Unternehmen logo
1 von 29
‘Alexa, are vaccines safe?’
Evaluating voice assistant responses to
consumer health questions
Emily Alagha, MSIS, AHIP - Clinical Information Specialist & Data
Management Librarian - Georgetown University Medical Center
Rachel Helbing, MLIS, MS, AHIP - Director of Library Services for
Health Sciences - University of Houston
Objectives
1. Background
2. Purpose
3. Data collection
4. Results
5. Clinical implications
Voice
Assistants
Siri
Google Assistant
Alexa
Online Misinformation
Vaccination rates
Outbreaks
Online Misinformation
Vaccination rates
Outbreaks
Quality & accuracy
Siri
Google Assistant
Alexa
vaccine safety & use
Smart speaker brand owned
©2019MintelGroupLtd.AllRightsReserved.
ConfidentialtoMintel.
Read on mintel.com
Source:
Base:
Fieldwork:
554 internet users aged 18+ who own a smart speaker
March 2019 Lightspeed/Mintel
What brands of smart speakers do you own? Please select all
that apply.
72%
30%
14%
6%
5%
1%
1%
0% 25% 50% 75% 100%
Amazon
Google
Apple
JBL
Sonos
I don't know
Other, please specify
14
Selecting Test Questions
The Centers for Disease
Control (CDC) immunization
FAQ page and the CDC infant
immunization FAQ page
AnswerThePublic.com
search for ‘vaccines’
Test Questions
54 total
Data Collection
1. Set up iPads
2. Asked & recorded answers
3. Scored with rubric
4. Calculated results
Siri
5.16 5.10
0.98
Google Assistant Alexa
Mean
Scores
Voice Assistant Alexa Google Assistant Siri
VA provided same
response to both
researchers
62.96% 70.37% 68.52%
VA understood question
and provided answer
25% 94% 94%
Average spoken words
per answer
29 21 13
Most cited source Wikipedia.org CDC.gov CDC.gov
Limitations
• Data collected in 2018; may not reflect recent algorithm
updates
• Scoring rubric has not been assessed for reliability and
may need future refinements
• May not reflect real use cases that incorporate tailored
search results
• Overall scores for all assistants may have been lower if
prioritizing audio only output
Implications: Web Search
Implications: Third Party Apps
Implications: Third Party Apps
Conclusions
• Siri and Google provided evidence-based links; little
audio output
• Alexa was worst at natural language comprehension;
high audio output
• Many information providers are entering voice
information provision via traditional websites and
third-party apps
• Information professionals should push for better
usability and increased transparency about health
information partnerships
References
1. https://about.ads.microsoft.com/en-us/insights/2019-voice-report
2. https://pixabay.com/photos/voice-control-voice-commands-2598422/
3. Brand icons from https://www.flaticon.com
• https://www.flaticon.com/authors/simpleicon (Google)
• https://www.freepik.com (Apple & Amazon)
4. https://www.pewresearch.org/fact-tank/2013/02/01/majority-of-adults-look-online-for-health-
information/
5. https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0194811
6. https://www.ncbi.nlm.nih.gov/pubmed/26974260
7. https://www.nature.com/articles/d41586-018-07034-4
8. https://www.washingtonpost.com/national/health-science/percentage-of-young-us-children-
who-dont-receive-any-vaccines-has-quadrupled-since-2001/2018/10/11/4a9cca98-cd0d-11e8-
920f-dd52e1ae4570_story.html?utm_term=.f3d142106107
References
9. https://www.cdc.gov/measles/cases-outbreaks.html
10. https://9to5google.com/2019/04/29/google-assistant-siri-market-share/
11. https://www.healthcareitnews.com/news/uchealth-launches-alexa-based-virtual-assistant-
voice-enabled-patient-engagement
12. https://www.theguardian.com/media/2019/aug/27/bbc-to-launch-alexa-rival-that-will-grasp-
regional-accents
13. https://www.theguardian.com/society/2019/jul/10/nhs-teams-up-with-amazon-to-bring-alexa-
to-patients
14. https://www.wired.com/story/amazon-alexa-search-for-the-one-perfect-answer/
15. https://earthtoplanet.com/the-future-of-medicine/

Weitere ähnliche Inhalte

Was ist angesagt?

42396_HP Risk Report App Highlights infographic_042715_D1
42396_HP Risk Report App Highlights infographic_042715_D142396_HP Risk Report App Highlights infographic_042715_D1
42396_HP Risk Report App Highlights infographic_042715_D1
D Larson
 
Using Mobile Technology for Patient Recruitment Webinar
Using Mobile Technology for Patient Recruitment WebinarUsing Mobile Technology for Patient Recruitment Webinar
Using Mobile Technology for Patient Recruitment Webinar
PatientWise
 

Was ist angesagt? (20)

RNs are Social Too! Research Survey by Tact Medical Staffing
RNs are Social Too! Research Survey by Tact Medical Staffing RNs are Social Too! Research Survey by Tact Medical Staffing
RNs are Social Too! Research Survey by Tact Medical Staffing
 
InsightsEd - Global EdTech Snapshot - September 2015
InsightsEd - Global EdTech Snapshot - September 2015InsightsEd - Global EdTech Snapshot - September 2015
InsightsEd - Global EdTech Snapshot - September 2015
 
Future of wearbles 2016
Future of wearbles 2016Future of wearbles 2016
Future of wearbles 2016
 
Mobile Security Trends in the Workplace
Mobile Security Trends in the WorkplaceMobile Security Trends in the Workplace
Mobile Security Trends in the Workplace
 
How to Determine if Your Mobile App is a Medical Device?
How to Determine if Your Mobile App is a Medical Device?How to Determine if Your Mobile App is a Medical Device?
How to Determine if Your Mobile App is a Medical Device?
 
Life From The Frontlines: Independa
Life From The Frontlines: IndependaLife From The Frontlines: Independa
Life From The Frontlines: Independa
 
Retail Industry Application Security Survey Insights
Retail Industry Application Security Survey InsightsRetail Industry Application Security Survey Insights
Retail Industry Application Security Survey Insights
 
42396_HP Risk Report App Highlights infographic_042715_D1
42396_HP Risk Report App Highlights infographic_042715_D142396_HP Risk Report App Highlights infographic_042715_D1
42396_HP Risk Report App Highlights infographic_042715_D1
 
eHealth & IOE(The Internet Of Engagement)
eHealth & IOE(The Internet Of Engagement)eHealth & IOE(The Internet Of Engagement)
eHealth & IOE(The Internet Of Engagement)
 
Technology Prescription for Smarter Healthcare
Technology Prescription for Smarter Healthcare Technology Prescription for Smarter Healthcare
Technology Prescription for Smarter Healthcare
 
mHealth App Developer Economics 2015 by research2guidance
mHealth App Developer Economics 2015 by research2guidancemHealth App Developer Economics 2015 by research2guidance
mHealth App Developer Economics 2015 by research2guidance
 
Using Big Data Systems to Understand Health Care Professional Conversations i...
Using Big Data Systems to Understand Health Care Professional Conversations i...Using Big Data Systems to Understand Health Care Professional Conversations i...
Using Big Data Systems to Understand Health Care Professional Conversations i...
 
Big data hype (and reality)
Big data hype (and reality)Big data hype (and reality)
Big data hype (and reality)
 
Using Mobile Technology for Patient Recruitment Webinar
Using Mobile Technology for Patient Recruitment WebinarUsing Mobile Technology for Patient Recruitment Webinar
Using Mobile Technology for Patient Recruitment Webinar
 
Taking the Physician's Pulse on Cybersecurity
Taking the Physician's Pulse on CybersecurityTaking the Physician's Pulse on Cybersecurity
Taking the Physician's Pulse on Cybersecurity
 
SALVANI MS 102 FINALS
SALVANI MS 102 FINALSSALVANI MS 102 FINALS
SALVANI MS 102 FINALS
 
The Rise and Rise of HCPs' Social Networks - Focus on GCC Region
The Rise and Rise of HCPs' Social Networks - Focus on GCC RegionThe Rise and Rise of HCPs' Social Networks - Focus on GCC Region
The Rise and Rise of HCPs' Social Networks - Focus on GCC Region
 
How Big Data is Transforming Medical Information Insights - DIA 2014
How Big Data is Transforming Medical Information Insights - DIA 2014How Big Data is Transforming Medical Information Insights - DIA 2014
How Big Data is Transforming Medical Information Insights - DIA 2014
 
The Mobility Challenge - Fran Rosch, SVP Mobility
The Mobility Challenge - Fran Rosch, SVP MobilityThe Mobility Challenge - Fran Rosch, SVP Mobility
The Mobility Challenge - Fran Rosch, SVP Mobility
 
High severity vulnerabilities of web apps
High severity vulnerabilities of web appsHigh severity vulnerabilities of web apps
High severity vulnerabilities of web apps
 

Ähnlich wie How well do Voice Assistants answer Consumer Health Questions?

54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
blondellchancy
 
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
BHANU281672
 
Product traceability and food safety (15 oct08)
Product traceability and food safety (15 oct08)Product traceability and food safety (15 oct08)
Product traceability and food safety (15 oct08)
ECR Community
 
Five trends in digital healthcare in 2010
Five trends in digital healthcare in 2010Five trends in digital healthcare in 2010
Five trends in digital healthcare in 2010
Juan Pittau
 

Ähnlich wie How well do Voice Assistants answer Consumer Health Questions? (20)

The Evolving Digital Patient
The Evolving Digital PatientThe Evolving Digital Patient
The Evolving Digital Patient
 
HealthApp-JanFeb16-2
HealthApp-JanFeb16-2HealthApp-JanFeb16-2
HealthApp-JanFeb16-2
 
Learning from the People: Responsibly Encouraging Adoption of Contact Tracing...
Learning from the People: Responsibly Encouraging Adoption of Contact Tracing...Learning from the People: Responsibly Encouraging Adoption of Contact Tracing...
Learning from the People: Responsibly Encouraging Adoption of Contact Tracing...
 
2009 Market Research Dynamics
2009 Market Research Dynamics2009 Market Research Dynamics
2009 Market Research Dynamics
 
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
 
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
54 Parents Worried About Cyber Bullying ofKids Norton Re.docx
 
Search Engine Use 2012
Search Engine Use 2012Search Engine Use 2012
Search Engine Use 2012
 
Webinar: Medical Device Security: An Industry Under Attack and Unprepared to ...
Webinar: Medical Device Security: An Industry Under Attack and Unprepared to ...Webinar: Medical Device Security: An Industry Under Attack and Unprepared to ...
Webinar: Medical Device Security: An Industry Under Attack and Unprepared to ...
 
Role of Conversational AI and Virtual Voice Assistants in Cardiology: What is...
Role of Conversational AI and Virtual Voice Assistants in Cardiology: What is...Role of Conversational AI and Virtual Voice Assistants in Cardiology: What is...
Role of Conversational AI and Virtual Voice Assistants in Cardiology: What is...
 
The Use of Artificial Intelligence (AI) in Food Safety, and What to Expect Next
The Use of Artificial Intelligence (AI) in Food Safety, and What to Expect NextThe Use of Artificial Intelligence (AI) in Food Safety, and What to Expect Next
The Use of Artificial Intelligence (AI) in Food Safety, and What to Expect Next
 
Big data e social media nel Pharma - IMS Health Italia @Aboutpharma Digital S...
Big data e social media nel Pharma - IMS Health Italia @Aboutpharma Digital S...Big data e social media nel Pharma - IMS Health Italia @Aboutpharma Digital S...
Big data e social media nel Pharma - IMS Health Italia @Aboutpharma Digital S...
 
Implications for risk management of digital health technologies
Implications for risk management of digital health technologiesImplications for risk management of digital health technologies
Implications for risk management of digital health technologies
 
Product traceability and food safety (15 oct08)
Product traceability and food safety (15 oct08)Product traceability and food safety (15 oct08)
Product traceability and food safety (15 oct08)
 
Five trends in digital healthcare in 2010
Five trends in digital healthcare in 2010Five trends in digital healthcare in 2010
Five trends in digital healthcare in 2010
 
Mighty Mobile
Mighty MobileMighty Mobile
Mighty Mobile
 
Security Survey 2013 UK
Security Survey 2013 UKSecurity Survey 2013 UK
Security Survey 2013 UK
 
Security survey2013 en
Security survey2013 enSecurity survey2013 en
Security survey2013 en
 
Answer lab best practices in research and design for voice user interfaces
Answer lab best practices in research and design for voice user interfacesAnswer lab best practices in research and design for voice user interfaces
Answer lab best practices in research and design for voice user interfaces
 
Pervasive Analytics Gets Real
Pervasive Analytics Gets RealPervasive Analytics Gets Real
Pervasive Analytics Gets Real
 
Americans Both Optimistic and Concerned about Automation
Americans Both Optimistic and Concerned about AutomationAmericans Both Optimistic and Concerned about Automation
Americans Both Optimistic and Concerned about Automation
 

Kürzlich hochgeladen

Call Girls in Gagan Vihar (delhi) call me [🔝 9953056974 🔝] escort service 24X7
Call Girls in Gagan Vihar (delhi) call me [🔝  9953056974 🔝] escort service 24X7Call Girls in Gagan Vihar (delhi) call me [🔝  9953056974 🔝] escort service 24X7
Call Girls in Gagan Vihar (delhi) call me [🔝 9953056974 🔝] escort service 24X7
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
🌹Attapur⬅️ Vip Call Girls Hyderabad 📱9352852248 Book Well Trand Call Girls In...
🌹Attapur⬅️ Vip Call Girls Hyderabad 📱9352852248 Book Well Trand Call Girls In...🌹Attapur⬅️ Vip Call Girls Hyderabad 📱9352852248 Book Well Trand Call Girls In...
🌹Attapur⬅️ Vip Call Girls Hyderabad 📱9352852248 Book Well Trand Call Girls In...
Call Girls In Delhi Whatsup 9873940964 Enjoy Unlimited Pleasure
 

Kürzlich hochgeladen (20)

Top Rated Bangalore Call Girls Mg Road ⟟ 9332606886 ⟟ Call Me For Genuine S...
Top Rated Bangalore Call Girls Mg Road ⟟   9332606886 ⟟ Call Me For Genuine S...Top Rated Bangalore Call Girls Mg Road ⟟   9332606886 ⟟ Call Me For Genuine S...
Top Rated Bangalore Call Girls Mg Road ⟟ 9332606886 ⟟ Call Me For Genuine S...
 
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
 
Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...
Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...
Mumbai ] (Call Girls) in Mumbai 10k @ I'm VIP Independent Escorts Girls 98333...
 
Top Rated Bangalore Call Girls Majestic ⟟ 9332606886 ⟟ Call Me For Genuine S...
Top Rated Bangalore Call Girls Majestic ⟟  9332606886 ⟟ Call Me For Genuine S...Top Rated Bangalore Call Girls Majestic ⟟  9332606886 ⟟ Call Me For Genuine S...
Top Rated Bangalore Call Girls Majestic ⟟ 9332606886 ⟟ Call Me For Genuine S...
 
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
 
Call Girls in Gagan Vihar (delhi) call me [🔝 9953056974 🔝] escort service 24X7
Call Girls in Gagan Vihar (delhi) call me [🔝  9953056974 🔝] escort service 24X7Call Girls in Gagan Vihar (delhi) call me [🔝  9953056974 🔝] escort service 24X7
Call Girls in Gagan Vihar (delhi) call me [🔝 9953056974 🔝] escort service 24X7
 
Russian Call Girls Service Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
Russian Call Girls Service  Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...Russian Call Girls Service  Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
Russian Call Girls Service Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
 
🌹Attapur⬅️ Vip Call Girls Hyderabad 📱9352852248 Book Well Trand Call Girls In...
🌹Attapur⬅️ Vip Call Girls Hyderabad 📱9352852248 Book Well Trand Call Girls In...🌹Attapur⬅️ Vip Call Girls Hyderabad 📱9352852248 Book Well Trand Call Girls In...
🌹Attapur⬅️ Vip Call Girls Hyderabad 📱9352852248 Book Well Trand Call Girls In...
 
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
 
Top Rated Hyderabad Call Girls Chintal ⟟ 9332606886 ⟟ Call Me For Genuine Se...
Top Rated  Hyderabad Call Girls Chintal ⟟ 9332606886 ⟟ Call Me For Genuine Se...Top Rated  Hyderabad Call Girls Chintal ⟟ 9332606886 ⟟ Call Me For Genuine Se...
Top Rated Hyderabad Call Girls Chintal ⟟ 9332606886 ⟟ Call Me For Genuine Se...
 
Call Girls Guntur Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Guntur  Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Guntur  Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Guntur Just Call 8250077686 Top Class Call Girl Service Available
 
Call Girls Gwalior Just Call 8617370543 Top Class Call Girl Service Available
Call Girls Gwalior Just Call 8617370543 Top Class Call Girl Service AvailableCall Girls Gwalior Just Call 8617370543 Top Class Call Girl Service Available
Call Girls Gwalior Just Call 8617370543 Top Class Call Girl Service Available
 
Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service AvailableCall Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
 
Call Girls Service Jaipur {8445551418} ❤️VVIP BHAWNA Call Girl in Jaipur Raja...
Call Girls Service Jaipur {8445551418} ❤️VVIP BHAWNA Call Girl in Jaipur Raja...Call Girls Service Jaipur {8445551418} ❤️VVIP BHAWNA Call Girl in Jaipur Raja...
Call Girls Service Jaipur {8445551418} ❤️VVIP BHAWNA Call Girl in Jaipur Raja...
 
Call Girls Vasai Virar Just Call 9630942363 Top Class Call Girl Service Avail...
Call Girls Vasai Virar Just Call 9630942363 Top Class Call Girl Service Avail...Call Girls Vasai Virar Just Call 9630942363 Top Class Call Girl Service Avail...
Call Girls Vasai Virar Just Call 9630942363 Top Class Call Girl Service Avail...
 
Premium Call Girls In Jaipur {8445551418} ❤️VVIP SEEMA Call Girl in Jaipur Ra...
Premium Call Girls In Jaipur {8445551418} ❤️VVIP SEEMA Call Girl in Jaipur Ra...Premium Call Girls In Jaipur {8445551418} ❤️VVIP SEEMA Call Girl in Jaipur Ra...
Premium Call Girls In Jaipur {8445551418} ❤️VVIP SEEMA Call Girl in Jaipur Ra...
 
Manyata Tech Park ( Call Girls ) Bangalore ✔ 6297143586 ✔ Hot Model With Sexy...
Manyata Tech Park ( Call Girls ) Bangalore ✔ 6297143586 ✔ Hot Model With Sexy...Manyata Tech Park ( Call Girls ) Bangalore ✔ 6297143586 ✔ Hot Model With Sexy...
Manyata Tech Park ( Call Girls ) Bangalore ✔ 6297143586 ✔ Hot Model With Sexy...
 
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
 
Call Girls Rishikesh Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Rishikesh Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Rishikesh Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Rishikesh Just Call 8250077686 Top Class Call Girl Service Available
 
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
 

How well do Voice Assistants answer Consumer Health Questions?

Hinweis der Redaktion

  1. Smart Homes - US - May 2019