SlideShare ist ein Scribd-Unternehmen logo
1 von 22
Downloaden Sie, um offline zu lesen
HCI: evaluatie
KU Leuven, B, 17 February 2014
!

Erik Duval
http://erikduval.wordpress.com
@ErikDuval

1
2

http://www.slideshare.net/erik.duval
Criteria for evaluation:
what do you think?
criteria
•
Usefulness	

•
Meaning	

•
(aesthetic) Qualities	

•
Sociability
•
Usability
http://semanticstudios.com/publications/semantics/000029.php
Usability
• Learnability: time to learn the application	

• Efficiency: time to perform task	

• Memorability: timethat users remember how and what	

• Accuracy: number and kind of errors	

• satisfaction: subjective feeling

Often a compromise - important to make explicit
•
tijdens het ontwikkelen	

•
om te verbeteren	

•
summatief	

•
op het einde	

•
om te bewijzen dat “het (niet) werkt”
•
formatief
methods
!

- questionnaire
- usability engineering
- by experts
- usage tracking
questionnaires

http://hcibib.org/perlman/question.html
http://www.cc.gatech.edu/gvu/images/lab/usability-lab.jpg

Usability Lab
Usability engineering
• ‘Think-aloud protocol‘	

• Video recording with annotation	

• Log, remarks, etc. for analysis	

• ‘Discount usability engineering’	

• Comparative test of user interface
By experts
•
•
•
•

in HCI or domain 	

very effective 	

delicate relation with developers	

target	

• identify problems	

• suggest solutions	

• through checklist of guidelines
User tracking
•
google analytics
•

“attention metadata”
Participants
• representative	

• computer experience, language, task,
motivation, education, etc. 	

• gender, age	

• have to know they are not being evaluated	

• relationship	

• colleagues, friends, family, ...
they are ... human beings	

!
how many?

Text

http://www.useit.com/alertbox/20000319.html

http://www.useit.com/alertbox/20000319.html
• every test user finds fraction L of usability
issues	

• independent test users

n	

n users find fraction 1-(1-L)
• L=31%
L=8%

85% for n=5, 99% for n=15

35% for n=5
Factors that influence usability:
what do you think?
Factoren: Cognitief
• cognitive	

• fatigue, boredom, stress, fear, ...	

• personality	

• gender (‘abort’)	

• cultural	

• i18n
Trash can in Thailand
?
@ErikDuval	

http://erikduval.wordpress.com
22

Weitere ähnliche Inhalte

Ähnlich wie HCI: evaluation

20130219 chi evaluatie
20130219 chi evaluatie20130219 chi evaluatie
20130219 chi evaluatie
Erik Duval
 
How to Integrate UX and Agile
How to Integrate UX and AgileHow to Integrate UX and Agile
How to Integrate UX and Agile
UserZoom
 
Track a 215_fry_liberman
Track a 215_fry_libermanTrack a 215_fry_liberman
Track a 215_fry_liberman
BentleyDUC
 
Next Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-LearningNext Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-Learning
Jon Rosewell
 
INSEMTIVES Tutorial ISWC2011 - Session3
INSEMTIVES Tutorial ISWC2011 - Session3INSEMTIVES Tutorial ISWC2011 - Session3
INSEMTIVES Tutorial ISWC2011 - Session3
INSEMTIVES project
 

Ähnlich wie HCI: evaluation (20)

20130219 chi evaluatie
20130219 chi evaluatie20130219 chi evaluatie
20130219 chi evaluatie
 
CHI: evaluation
CHI: evaluationCHI: evaluation
CHI: evaluation
 
Heuristic evaluation
Heuristic evaluationHeuristic evaluation
Heuristic evaluation
 
Usability&UX
Usability&UXUsability&UX
Usability&UX
 
How to Integrate UX and Agile
How to Integrate UX and AgileHow to Integrate UX and Agile
How to Integrate UX and Agile
 
The Power of the UX Evaluation
The Power of the UX EvaluationThe Power of the UX Evaluation
The Power of the UX Evaluation
 
Track a 215_fry_liberman
Track a 215_fry_libermanTrack a 215_fry_liberman
Track a 215_fry_liberman
 
Evaluation methods
Evaluation methodsEvaluation methods
Evaluation methods
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
 
ui42 World Usability Day 2013 Martin Krupa Ako zapojit UX do vyvoja SW
ui42 World Usability Day 2013 Martin Krupa Ako zapojit UX do vyvoja SWui42 World Usability Day 2013 Martin Krupa Ako zapojit UX do vyvoja SW
ui42 World Usability Day 2013 Martin Krupa Ako zapojit UX do vyvoja SW
 
Website Usability & Eye-tracking by Marco Pretorious (Certified Usability Ana...
Website Usability & Eye-tracking by Marco Pretorious (Certified Usability Ana...Website Usability & Eye-tracking by Marco Pretorious (Certified Usability Ana...
Website Usability & Eye-tracking by Marco Pretorious (Certified Usability Ana...
 
The current state of accessibility of MOOCs: What are the next steps?
The current state of accessibility of MOOCs: What are the next steps?The current state of accessibility of MOOCs: What are the next steps?
The current state of accessibility of MOOCs: What are the next steps?
 
Jan Moons at WUD16
Jan Moons at WUD16Jan Moons at WUD16
Jan Moons at WUD16
 
ICS3211 Lecture 9
ICS3211 Lecture 9ICS3211 Lecture 9
ICS3211 Lecture 9
 
Next Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-LearningNext Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-Learning
 
Maximizing student learning with multimedia assignments
Maximizing student learning with multimedia assignmentsMaximizing student learning with multimedia assignments
Maximizing student learning with multimedia assignments
 
Heuristic evaluation principles
Heuristic evaluation principlesHeuristic evaluation principles
Heuristic evaluation principles
 
INSEMTIVES Tutorial ISWC2011 - Session3
INSEMTIVES Tutorial ISWC2011 - Session3INSEMTIVES Tutorial ISWC2011 - Session3
INSEMTIVES Tutorial ISWC2011 - Session3
 
Instructional Design and Development
Instructional Design and DevelopmentInstructional Design and Development
Instructional Design and Development
 
Open Source Design Pattern Library, Spreading Communities Thick: Open Source ...
Open Source Design Pattern Library, Spreading Communities Thick: Open Source ...Open Source Design Pattern Library, Spreading Communities Thick: Open Source ...
Open Source Design Pattern Library, Spreading Communities Thick: Open Source ...
 

Mehr von Erik Duval

InfoVis1415: slides sessie 3, 23 Feb 2015
InfoVis1415: slides sessie 3, 23 Feb 2015InfoVis1415: slides sessie 3, 23 Feb 2015
InfoVis1415: slides sessie 3, 23 Feb 2015
Erik Duval
 

Mehr von Erik Duval (20)

eCloud newspapers
eCloud newspaperseCloud newspapers
eCloud newspapers
 
InfoVis1415: slides sessie 12, 18 mei 2015
InfoVis1415: slides sessie 12, 18 mei 2015InfoVis1415: slides sessie 12, 18 mei 2015
InfoVis1415: slides sessie 12, 18 mei 2015
 
InfoVis1415: slides sessie 11, 11 mei 2015
InfoVis1415: slides sessie 11, 11 mei 2015InfoVis1415: slides sessie 11, 11 mei 2015
InfoVis1415: slides sessie 11, 11 mei 2015
 
InfoVis1415: slides sessie 10, 4 mei 2015
InfoVis1415: slides sessie 10, 4 mei 2015InfoVis1415: slides sessie 10, 4 mei 2015
InfoVis1415: slides sessie 10, 4 mei 2015
 
Evaluation
 of information visualisation
Evaluation
 of information visualisationEvaluation
 of information visualisation
Evaluation
 of information visualisation
 
InfoVis1415: slides sessie 9, 27 april 2015
InfoVis1415: slides sessie 9, 27 april 2015InfoVis1415: slides sessie 9, 27 april 2015
InfoVis1415: slides sessie 9, 27 april 2015
 
Social Media and Science a wedding made in Heaven...
 or in Hell?
Social Media and Science a wedding made in Heaven...
 or in Hell?Social Media and Science a wedding made in Heaven...
 or in Hell?
Social Media and Science a wedding made in Heaven...
 or in Hell?
 
Information visualisation: 
Data ink design principles
Information visualisation: 
Data ink design principlesInformation visualisation: 
Data ink design principles
Information visualisation: 
Data ink design principles
 
InfoVis1415: slides sessie 8, 20 april 2015
InfoVis1415: slides sessie 8, 20 april 2015InfoVis1415: slides sessie 8, 20 april 2015
InfoVis1415: slides sessie 8, 20 april 2015
 
A short history (and even shorter future)
 of information visualisation
A short history (and even shorter future)
 of information visualisationA short history (and even shorter future)
 of information visualisation
A short history (and even shorter future)
 of information visualisation
 
InfoVis1415: slides sessie 7, 30 March 2015
InfoVis1415: slides sessie 7, 30 March 2015InfoVis1415: slides sessie 7, 30 March 2015
InfoVis1415: slides sessie 7, 30 March 2015
 
InfoVis1415: slides sessie 6, 23 March 2015
InfoVis1415: slides sessie 6, 23 March 2015InfoVis1415: slides sessie 6, 23 March 2015
InfoVis1415: slides sessie 6, 23 March 2015
 
History of Human Computer Interaction
History of Human Computer InteractionHistory of Human Computer Interaction
History of Human Computer Interaction
 
InfoVis1415: slides sessie 5, 9 March 2015
InfoVis1415: slides sessie 5, 9 March 2015InfoVis1415: slides sessie 5, 9 March 2015
InfoVis1415: slides sessie 5, 9 March 2015
 
InfoVis1415: slides sessie 4, 2 March 2015
InfoVis1415: slides sessie 4, 2 March 2015InfoVis1415: slides sessie 4, 2 March 2015
InfoVis1415: slides sessie 4, 2 March 2015
 
InfoVis1415: slides sessie 3, 23 Feb 2015
InfoVis1415: slides sessie 3, 23 Feb 2015InfoVis1415: slides sessie 3, 23 Feb 2015
InfoVis1415: slides sessie 3, 23 Feb 2015
 
InfoVis1415: slides sessie 2, 16 Feb 2015
InfoVis1415: slides sessie 2, 16 Feb 2015InfoVis1415: slides sessie 2, 16 Feb 2015
InfoVis1415: slides sessie 2, 16 Feb 2015
 
Technology that makes HUMANS smarter
Technology that makes HUMANS smarterTechnology that makes HUMANS smarter
Technology that makes HUMANS smarter
 
InfoVis1415: slides sessie 1, 10 Feb 2015
InfoVis1415: slides sessie 1, 10 Feb 2015InfoVis1415: slides sessie 1, 10 Feb 2015
InfoVis1415: slides sessie 1, 10 Feb 2015
 
201502010 pen ocw_les1_erik
201502010 pen ocw_les1_erik201502010 pen ocw_les1_erik
201502010 pen ocw_les1_erik
 

Kürzlich hochgeladen

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Kürzlich hochgeladen (20)

ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 

HCI: evaluation