SlideShare ist ein Scribd-Unternehmen logo
1 von 65
Usability Evaluation Considered Harmful Some of the time Saul Greenberg  University of Calgary Bill Buxton Microsoft Research
Warning: Opinions Ahead
Warning: Opinions Ahead Source: stadtherr.com/Rock_Throwing.jpg /
Warning: Opinions Ahead
An anti usability rant? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Usability evaluation  if wrongfully applied ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Solution - Methodology 101 ,[object Object]
Changing how you think ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Part 1. Usability Evaluation
Usability Evaluation ,[object Object],[object Object]
Usability Evaluation Methods ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
Part 2. CHI Trends
CHI Trends  (Barkhuus/Rode, Alt.CHI 2007) 2007
CHI Trends  (Barkhuus/Rode, Alt.CHI 2007) 2007
CHI Trends ,[object Object],2007
CHI Trends  (Call for papers 2008) ,[object Object],[object Object],[object Object],[object Object]
HCI Education
HCI Practice Source: http://www.xperienceconsulting.com/eng/servicios.asp?ap=25
 
Dogma Usability evaluation = validation = CHI = HCI
Part 3. Some Theory
Discovery  vs  Invention  (Scott Hudson UIST ‘07) ,[object Object],[object Object],[object Object],[object Object]
Discovery  vs  Invention  (Scott Hudson UIST ‘07) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
Time Learning Brian Gaines Breakthrough Replication Empiricism Theory Automation Maturity
Time Learning Breakthrough Replication Empiricism Theory Automation Maturity early design & invention science cultural appropriation
Time Learning Breakthrough Replication Empiricism Theory Automation Maturity early design & invention science cultural appropriation
Part 4. Early Design Breakthrough Replication
Memex  Bush
Unimplemented and untested design. Microfilm is impractical. The work is premature and untested.  Resubmit after you build and evaluate this design.
We usually get it wrong
Early design as working sketches ,[object Object]
Early design ,[object Object],[object Object],idea idea idea idea
Early designs ,[object Object],idea1 idea1 idea1 idea1 idea1
Early design ,[object Object],Usability evaluation the better ideas idea5 idea4 idea3 idea2 idea5 idea6 idea7 idea8 idea9 idea5 idea1
Early designs as working sketches ,[object Object],[object Object],idea1 idea1 idea1 idea1 idea1 idea5 idea4 idea3 idea2 idea5 idea6 idea7 idea8 idea9 idea5 idea1
Early designs as working sketches ,[object Object],[object Object],idea5 idea4 idea3 idea2 idea5 idea6 idea7 idea8 idea9 idea5 idea1
Part 6. Science Empiricism Theory
I need to  do an  evaluation
What’s the problem?
It won’t get accepted if I don’t. Duh!
Source: whatitslikeontheinside.com/2005/10/pop-quiz-whats-wrong-with-this-picture.html
Research process ,[object Object],[object Object],[object Object],[object Object],[object Object]
Research process ,[object Object],[object Object],[object Object]
Research process ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Part 6. Cultural Appropriation Automation Maturity
Memex  Bush
1979 Ted Nelson 1945 Bush 1987 Notecards 1992 Sepia 1993 Mosaic 1989 ACM 1990 HTTP
 
 
 
 
 
Part 7. What to do
Evaluation
More Appropriate Evaluation
[object Object],[object Object],[object Object]
We decide what is good research and practice
There is no them
Only us http://eduspaces.net/csessums/weblog/261227.html
Time Learning Brian Gaines Breakthrough major creative advances Replication ideas mimicked and altered; increasing experience Empiricism lessons formulated as empirical design rules Theory underlying causal systems Automation accepted Maturity used routinely
Changing how you think ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Augment  Engelbart
 

Weitere ähnliche Inhalte

Was ist angesagt?

A Framework for Automatic Question Answering in Indian Languages
A Framework for Automatic Question Answering in Indian LanguagesA Framework for Automatic Question Answering in Indian Languages
A Framework for Automatic Question Answering in Indian Languages
IIIT Hyderabad
 

Was ist angesagt? (20)

Building Generative AI-infused apps: what's possible and how to start
Building Generative AI-infused apps: what's possible and how to startBuilding Generative AI-infused apps: what's possible and how to start
Building Generative AI-infused apps: what's possible and how to start
 
Copilot to Cover: Why AI can't replace developers with robots, but can make l...
Copilot to Cover: Why AI can't replace developers with robots, but can make l...Copilot to Cover: Why AI can't replace developers with robots, but can make l...
Copilot to Cover: Why AI can't replace developers with robots, but can make l...
 
How do we train AI to be Ethical and Unbiased?
How do we train AI to be Ethical and Unbiased?How do we train AI to be Ethical and Unbiased?
How do we train AI to be Ethical and Unbiased?
 
عرض بوربوينت للدرس الثالث (أتمتة أدوات المكاتب) لمبحث التكنولوجيا للصف الحادي...
عرض بوربوينت للدرس الثالث (أتمتة أدوات المكاتب) لمبحث التكنولوجيا للصف الحادي...عرض بوربوينت للدرس الثالث (أتمتة أدوات المكاتب) لمبحث التكنولوجيا للصف الحادي...
عرض بوربوينت للدرس الثالث (أتمتة أدوات المكاتب) لمبحث التكنولوجيا للصف الحادي...
 
Navigation and Control LabVIEW Robotics.ppt
Navigation and Control LabVIEW Robotics.pptNavigation and Control LabVIEW Robotics.ppt
Navigation and Control LabVIEW Robotics.ppt
 
Issues on Artificial Intelligence and Future (Standards Perspective)
Issues on Artificial Intelligence  and Future (Standards Perspective)Issues on Artificial Intelligence  and Future (Standards Perspective)
Issues on Artificial Intelligence and Future (Standards Perspective)
 
OpenAI.pptx
OpenAI.pptxOpenAI.pptx
OpenAI.pptx
 
Introduction to LLMs
Introduction to LLMsIntroduction to LLMs
Introduction to LLMs
 
Jobs-To-Be-Done by C6 Bank Lead Product Designer
Jobs-To-Be-Done by C6 Bank Lead Product DesignerJobs-To-Be-Done by C6 Bank Lead Product Designer
Jobs-To-Be-Done by C6 Bank Lead Product Designer
 
AI 2023.pdf
AI 2023.pdfAI 2023.pdf
AI 2023.pdf
 
Behind the Scenes of ChatGPT.pptx
Behind the Scenes of ChatGPT.pptxBehind the Scenes of ChatGPT.pptx
Behind the Scenes of ChatGPT.pptx
 
The rise of AI in design - Are we losing creative control? IXDS Pre-Work Talk...
The rise of AI in design - Are we losing creative control? IXDS Pre-Work Talk...The rise of AI in design - Are we losing creative control? IXDS Pre-Work Talk...
The rise of AI in design - Are we losing creative control? IXDS Pre-Work Talk...
 
Intro to Deep Learning for Question Answering
Intro to Deep Learning for Question AnsweringIntro to Deep Learning for Question Answering
Intro to Deep Learning for Question Answering
 
A Framework for Automatic Question Answering in Indian Languages
A Framework for Automatic Question Answering in Indian LanguagesA Framework for Automatic Question Answering in Indian Languages
A Framework for Automatic Question Answering in Indian Languages
 
A Comprehensive Review of Large Language Models for.pptx
A Comprehensive Review of Large Language Models for.pptxA Comprehensive Review of Large Language Models for.pptx
A Comprehensive Review of Large Language Models for.pptx
 
[Machine Learning 15minutes! #61] Azure OpenAI Service
[Machine Learning 15minutes! #61] Azure OpenAI Service[Machine Learning 15minutes! #61] Azure OpenAI Service
[Machine Learning 15minutes! #61] Azure OpenAI Service
 
الذكاء الاصطناعي
الذكاء الاصطناعيالذكاء الاصطناعي
الذكاء الاصطناعي
 
Semi supervised approach for word sense disambiguation
Semi supervised approach for word sense disambiguationSemi supervised approach for word sense disambiguation
Semi supervised approach for word sense disambiguation
 
introduction Azure OpenAI by Usama wahab khan
introduction  Azure OpenAI by Usama wahab khanintroduction  Azure OpenAI by Usama wahab khan
introduction Azure OpenAI by Usama wahab khan
 
ChatGPT, Generative AI and Microsoft Copilot: Step Into the Future - Geoff Ab...
ChatGPT, Generative AI and Microsoft Copilot: Step Into the Future - Geoff Ab...ChatGPT, Generative AI and Microsoft Copilot: Step Into the Future - Geoff Ab...
ChatGPT, Generative AI and Microsoft Copilot: Step Into the Future - Geoff Ab...
 

Andere mochten auch

Andere mochten auch (8)

Usability and Form Design - University of Calgary
Usability and Form Design - University of CalgaryUsability and Form Design - University of Calgary
Usability and Form Design - University of Calgary
 
Critique, don't Complain - Talk by Andrew Harder
Critique, don't Complain - Talk by Andrew HarderCritique, don't Complain - Talk by Andrew Harder
Critique, don't Complain - Talk by Andrew Harder
 
Twg's guide to onboarding
Twg's guide to onboardingTwg's guide to onboarding
Twg's guide to onboarding
 
Form Design: Best Practices to Improve Conversions
Form Design: Best Practices to Improve ConversionsForm Design: Best Practices to Improve Conversions
Form Design: Best Practices to Improve Conversions
 
Forms usability design best practices experience dynamics web seminar
Forms usability design best practices  experience dynamics web seminarForms usability design best practices  experience dynamics web seminar
Forms usability design best practices experience dynamics web seminar
 
Usability vs Design – When Does One Trump the Other? AI (Alexander Interactiv...
Usability vs Design – When Does One Trump the Other? AI (Alexander Interactiv...Usability vs Design – When Does One Trump the Other? AI (Alexander Interactiv...
Usability vs Design – When Does One Trump the Other? AI (Alexander Interactiv...
 
Web Form Design Best Practices
Web Form Design Best Practices Web Form Design Best Practices
Web Form Design Best Practices
 
16 Design Rules To Break In 2016
16 Design Rules To Break In 201616 Design Rules To Break In 2016
16 Design Rules To Break In 2016
 

Ähnlich wie Usability Evaluation Considered Harmful (Some of the Time)

Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails:Latest Trends in Bioscience Literature SearchText, Tags and Thumbnails:Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Search
marti_hearst
 
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
City University London
 
Uid formative evaluation
Uid formative evaluationUid formative evaluation
Uid formative evaluation
Pen Lister
 
PhD proposal: Specialized heuristics for crowdsourcing website design
PhD proposal: Specialized heuristics for crowdsourcing website designPhD proposal: Specialized heuristics for crowdsourcing website design
PhD proposal: Specialized heuristics for crowdsourcing website design
donellemckinley
 
ECE695DVisualAnalyticsprojectproposal (2)
ECE695DVisualAnalyticsprojectproposal (2)ECE695DVisualAnalyticsprojectproposal (2)
ECE695DVisualAnalyticsprojectproposal (2)
Shweta Gupte
 
Visual thinking colin_ware_lectures_2013_10_research methods
Visual thinking colin_ware_lectures_2013_10_research methodsVisual thinking colin_ware_lectures_2013_10_research methods
Visual thinking colin_ware_lectures_2013_10_research methods
Elsa von Licy
 
Design & Evaluation of the Goal-Oriented Design Knowledge Library
Design & Evaluation of the Goal-Oriented Design Knowledge LibraryDesign & Evaluation of the Goal-Oriented Design Knowledge Library
Design & Evaluation of the Goal-Oriented Design Knowledge Library
andrewhilts
 

Ähnlich wie Usability Evaluation Considered Harmful (Some of the Time) (20)

Summ11 useinterx
Summ11 useinterxSumm11 useinterx
Summ11 useinterx
 
Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails:Latest Trends in Bioscience Literature SearchText, Tags and Thumbnails:Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Search
 
Hci Overview
Hci OverviewHci Overview
Hci Overview
 
UXPABOS2013_FABRIZI
UXPABOS2013_FABRIZIUXPABOS2013_FABRIZI
UXPABOS2013_FABRIZI
 
Know Thy User: The Missing Element in SharePoint Solutions (User Centered Des...
Know Thy User: The Missing Element in SharePoint Solutions (User Centered Des...Know Thy User: The Missing Element in SharePoint Solutions (User Centered Des...
Know Thy User: The Missing Element in SharePoint Solutions (User Centered Des...
 
Parents
ParentsParents
Parents
 
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
hcid2011 - Creativity for open spaces - Dr Sara Jones (HCID)
 
Uid formative evaluation
Uid formative evaluationUid formative evaluation
Uid formative evaluation
 
Advanced Methods for User Evaluation in Enterprise AR
Advanced Methods for User Evaluation in Enterprise ARAdvanced Methods for User Evaluation in Enterprise AR
Advanced Methods for User Evaluation in Enterprise AR
 
Usability testing through the decades
Usability testing through the decadesUsability testing through the decades
Usability testing through the decades
 
PhD proposal: Specialized heuristics for crowdsourcing website design
PhD proposal: Specialized heuristics for crowdsourcing website designPhD proposal: Specialized heuristics for crowdsourcing website design
PhD proposal: Specialized heuristics for crowdsourcing website design
 
ECE695DVisualAnalyticsprojectproposal (2)
ECE695DVisualAnalyticsprojectproposal (2)ECE695DVisualAnalyticsprojectproposal (2)
ECE695DVisualAnalyticsprojectproposal (2)
 
Alex wright mons_workshop_051214
Alex wright mons_workshop_051214Alex wright mons_workshop_051214
Alex wright mons_workshop_051214
 
Visual thinking colin_ware_lectures_2013_10_research methods
Visual thinking colin_ware_lectures_2013_10_research methodsVisual thinking colin_ware_lectures_2013_10_research methods
Visual thinking colin_ware_lectures_2013_10_research methods
 
The power of example
The power of exampleThe power of example
The power of example
 
Design & Evaluation of the Goal-Oriented Design Knowledge Library
Design & Evaluation of the Goal-Oriented Design Knowledge LibraryDesign & Evaluation of the Goal-Oriented Design Knowledge Library
Design & Evaluation of the Goal-Oriented Design Knowledge Library
 
Standardization: Overcoming Design by Committee
Standardization: Overcoming Design by CommitteeStandardization: Overcoming Design by Committee
Standardization: Overcoming Design by Committee
 
Synopsis 48hour-test
Synopsis 48hour-testSynopsis 48hour-test
Synopsis 48hour-test
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
 
Introduction to OpenSemcq
Introduction to OpenSemcqIntroduction to OpenSemcq
Introduction to OpenSemcq
 

Kürzlich hochgeladen

QATAR Pills for Abortion -+971*55*85*39*980-in Dubai. Abu Dhabi.
QATAR Pills for Abortion -+971*55*85*39*980-in Dubai. Abu Dhabi.QATAR Pills for Abortion -+971*55*85*39*980-in Dubai. Abu Dhabi.
QATAR Pills for Abortion -+971*55*85*39*980-in Dubai. Abu Dhabi.
hyt3577
 
+971565801893>>SAFE ORIGINAL ABORTION PILLS FOR SALE IN DUBAI,RAK CITY,ABUDHA...
+971565801893>>SAFE ORIGINAL ABORTION PILLS FOR SALE IN DUBAI,RAK CITY,ABUDHA...+971565801893>>SAFE ORIGINAL ABORTION PILLS FOR SALE IN DUBAI,RAK CITY,ABUDHA...
+971565801893>>SAFE ORIGINAL ABORTION PILLS FOR SALE IN DUBAI,RAK CITY,ABUDHA...
Health
 
abortion pills in Riyadh Saudi Arabia (+919707899604)cytotec pills in dammam
abortion pills in Riyadh Saudi Arabia (+919707899604)cytotec pills in dammamabortion pills in Riyadh Saudi Arabia (+919707899604)cytotec pills in dammam
abortion pills in Riyadh Saudi Arabia (+919707899604)cytotec pills in dammam
samsungultra782445
 

Kürzlich hochgeladen (20)

Seeman_Fiintouch_LLP_Newsletter_May-2024.pdf
Seeman_Fiintouch_LLP_Newsletter_May-2024.pdfSeeman_Fiintouch_LLP_Newsletter_May-2024.pdf
Seeman_Fiintouch_LLP_Newsletter_May-2024.pdf
 
Technology industry / Finnish economic outlook
Technology industry / Finnish economic outlookTechnology industry / Finnish economic outlook
Technology industry / Finnish economic outlook
 
QATAR Pills for Abortion -+971*55*85*39*980-in Dubai. Abu Dhabi.
QATAR Pills for Abortion -+971*55*85*39*980-in Dubai. Abu Dhabi.QATAR Pills for Abortion -+971*55*85*39*980-in Dubai. Abu Dhabi.
QATAR Pills for Abortion -+971*55*85*39*980-in Dubai. Abu Dhabi.
 
FE Credit and SMBC Acquisition Case Studies
FE Credit and SMBC Acquisition Case StudiesFE Credit and SMBC Acquisition Case Studies
FE Credit and SMBC Acquisition Case Studies
 
Female Escorts Service in Hyderabad Starting with 5000/- for Savita Escorts S...
Female Escorts Service in Hyderabad Starting with 5000/- for Savita Escorts S...Female Escorts Service in Hyderabad Starting with 5000/- for Savita Escorts S...
Female Escorts Service in Hyderabad Starting with 5000/- for Savita Escorts S...
 
Shrambal_Distributors_Newsletter_May-2024.pdf
Shrambal_Distributors_Newsletter_May-2024.pdfShrambal_Distributors_Newsletter_May-2024.pdf
Shrambal_Distributors_Newsletter_May-2024.pdf
 
Q1 2024 Conference Call Presentation vF.pdf
Q1 2024 Conference Call Presentation vF.pdfQ1 2024 Conference Call Presentation vF.pdf
Q1 2024 Conference Call Presentation vF.pdf
 
cost-volume-profit analysis.ppt(managerial accounting).pptx
cost-volume-profit analysis.ppt(managerial accounting).pptxcost-volume-profit analysis.ppt(managerial accounting).pptx
cost-volume-profit analysis.ppt(managerial accounting).pptx
 
Famous No1 Amil Baba Love marriage Astrologer Specialist Expert In Pakistan a...
Famous No1 Amil Baba Love marriage Astrologer Specialist Expert In Pakistan a...Famous No1 Amil Baba Love marriage Astrologer Specialist Expert In Pakistan a...
Famous No1 Amil Baba Love marriage Astrologer Specialist Expert In Pakistan a...
 
uk-no 1 kala ilam expert specialist in uk and qatar kala ilam expert speciali...
uk-no 1 kala ilam expert specialist in uk and qatar kala ilam expert speciali...uk-no 1 kala ilam expert specialist in uk and qatar kala ilam expert speciali...
uk-no 1 kala ilam expert specialist in uk and qatar kala ilam expert speciali...
 
Black magic specialist in Canada (Kala ilam specialist in UK) Bangali Amil ba...
Black magic specialist in Canada (Kala ilam specialist in UK) Bangali Amil ba...Black magic specialist in Canada (Kala ilam specialist in UK) Bangali Amil ba...
Black magic specialist in Canada (Kala ilam specialist in UK) Bangali Amil ba...
 
Webinar on E-Invoicing for Fintech Belgium
Webinar on E-Invoicing for Fintech BelgiumWebinar on E-Invoicing for Fintech Belgium
Webinar on E-Invoicing for Fintech Belgium
 
+971565801893>>SAFE ORIGINAL ABORTION PILLS FOR SALE IN DUBAI,RAK CITY,ABUDHA...
+971565801893>>SAFE ORIGINAL ABORTION PILLS FOR SALE IN DUBAI,RAK CITY,ABUDHA...+971565801893>>SAFE ORIGINAL ABORTION PILLS FOR SALE IN DUBAI,RAK CITY,ABUDHA...
+971565801893>>SAFE ORIGINAL ABORTION PILLS FOR SALE IN DUBAI,RAK CITY,ABUDHA...
 
20240419-SMC-submission-Annual-Superannuation-Performance-Test-–-design-optio...
20240419-SMC-submission-Annual-Superannuation-Performance-Test-–-design-optio...20240419-SMC-submission-Annual-Superannuation-Performance-Test-–-design-optio...
20240419-SMC-submission-Annual-Superannuation-Performance-Test-–-design-optio...
 
Strategic Resources May 2024 Corporate Presentation
Strategic Resources May 2024 Corporate PresentationStrategic Resources May 2024 Corporate Presentation
Strategic Resources May 2024 Corporate Presentation
 
7 tips trading Deriv Accumulator Options
7 tips trading Deriv Accumulator Options7 tips trading Deriv Accumulator Options
7 tips trading Deriv Accumulator Options
 
Call Girls Howrah ( 8250092165 ) Cheap rates call girls | Get low budget
Call Girls Howrah ( 8250092165 ) Cheap rates call girls | Get low budgetCall Girls Howrah ( 8250092165 ) Cheap rates call girls | Get low budget
Call Girls Howrah ( 8250092165 ) Cheap rates call girls | Get low budget
 
abortion pills in Riyadh Saudi Arabia (+919707899604)cytotec pills in dammam
abortion pills in Riyadh Saudi Arabia (+919707899604)cytotec pills in dammamabortion pills in Riyadh Saudi Arabia (+919707899604)cytotec pills in dammam
abortion pills in Riyadh Saudi Arabia (+919707899604)cytotec pills in dammam
 
falcon-invoice-discounting-unlocking-prime-investment-opportunities
falcon-invoice-discounting-unlocking-prime-investment-opportunitiesfalcon-invoice-discounting-unlocking-prime-investment-opportunities
falcon-invoice-discounting-unlocking-prime-investment-opportunities
 
Lion One Corporate Presentation May 2024
Lion One Corporate Presentation May 2024Lion One Corporate Presentation May 2024
Lion One Corporate Presentation May 2024
 

Usability Evaluation Considered Harmful (Some of the Time)

Hinweis der Redaktion

  1. This presentation was given at the ACM CHI Conference, April 2008, in Florence, Italy. It was immediately followed by a panel that discussed it (Moderator: Beth Mynatt. Panelists: Tom Rodden, Bonnie John, and Dan Olson). Detailed speaking notes are included in the slide deck.