SlideShare ist ein Scribd-Unternehmen logo
1 von 12
Downloaden Sie, um offline zu lesen
Usability – Assuring Quality in Use


        Marko Nieminen
        Professor of Usability and User Interfaces, D.Sc.(Tech.)
        Aalto University School of Science
        Department of Computer Science and Engineering
        SoberIT - Software Business and Engineering Laboratory
Test and Testing

•  A qualitative or quantitative procedure that consists of
   determination of one or more characteristics of a given
   product, process or service according to a specified
   procedure

•  Why testing? For instance,

•  Determine if, or verify that, the requirements of a
   specification, regulation, or contract are met
•  Decide if a new product development program is on track:
   Demonstrate proof of concept
•  Validate suitability for end-use
Quality in Use – Related to Usability and
User Experience


                The capability of a system
                 to enable specified users
                to achieve specified goals
 with effectiveness, productivity, safety, and satisfaction
               in specified contexts of use.
Usability Test: Lab




                      http://www.sigchi.org/chi97/proceedings/overview/tst.htm
                                           Usability Lab at Fidelity Investments
Watching Television – On-site
Scenario: Mobile Ticketing


1       Matti sees Madonna’s concert
        promotion at bar in Tampere




         He takes a picture of promotion
    2    poster by using his mobile phone



              Matti logs in to service for buying
         3    tickets. Service identifies
              Madonna’s concert proposition.



                 4     He buys the concert ticket and
                       travel ticket at the same time   6
…and the scenario continues

5       Mikko checks his route and
        tickets through mobile phone



         He validates travel ticket by
    6    using a mobile phone when he
         walks in to train at Tampere



              Mikko decides to stop for one
         7    beer and buy it by using mobile
              phone


                     He validates concert ticket by
                 8   using mobile phone when he
                     arrives to gate of concert       7
Field Tests




              (Tamminen & Oulasvirta 2005)
Testing for ”Quality in Use” Addresses

•    Real users
•    Real settings
•    Real tasks
•    Real events
•    Real process
•    Real details
•    Real effects
•    Real outcome

•  Expected (quantitative) and unexpected (qualitative) issues
Usability Metrics: System Usability Scale
(SUS)
1.   I think that I would like to use this system frequently.
2.   I found the system unnecessarily complex.
3.   I thought the system was easy to use.
4.   I think that I would need the support of a technical person to be able
     to use this system.
5.  I found the various functions in this system were well integrated.
6.  I thought there was too much inconsistency in this system.
7.  I would imagine that most people would learn to use this system very
     quickly.
8.  I found the system very cumbersome to use.
9.  I felt very confident using the system.
10.  I needed to learn a lot of things before I could get going with this
     system.
                                                                           Sauro (2011)
                                             http://www.measuringusability.com/sus.php
Processes for Managing Quality in Use:
Usability Maturity Model

•    HCD1 Ensure HCD content in system strategy
•    HCD2 Plan the HCD process
•    HCD3 Specify user and organisational requirements
•    HCD4 Understand and specify the context of use
•    HCD5 Produce design solutions
•    HCD6 Evaluate designs against requirements
•    HCD7 Facilitate human-system implementation
Usability – Assuring Quality in Use


        Marko Nieminen
        Professor of Usability and User Interfaces, D.Sc.(Tech.)
        Aalto University School of Science
        Department of Computer Science and Engineering
        SoberIT - Software Business and Engineering Laboratory

Weitere ähnliche Inhalte

Ähnlich wie Pmc usability-testing

Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience
UserZoom
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
SOASTA
 
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERVUbiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Iiro Jantunen
 
Context detection and effects on behavior
Context detection and effects on behaviorContext detection and effects on behavior
Context detection and effects on behavior
Timo Smura
 

Ähnlich wie Pmc usability-testing (20)

Why Remote Research Is (or isn't) Right for your project
Why Remote Research Is (or isn't) Right for your projectWhy Remote Research Is (or isn't) Right for your project
Why Remote Research Is (or isn't) Right for your project
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usability
 
User Testing by Alvin Chai
User Testing by Alvin ChaiUser Testing by Alvin Chai
User Testing by Alvin Chai
 
Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience
 
classmar2.ppt
classmar2.pptclassmar2.ppt
classmar2.ppt
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
 
Suman_Cv
Suman_CvSuman_Cv
Suman_Cv
 
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERVUbiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
 
Ranjith S
Ranjith SRanjith S
Ranjith S
 
Dey alexander usability_training_notes_01
Dey alexander usability_training_notes_01Dey alexander usability_training_notes_01
Dey alexander usability_training_notes_01
 
Best practices for mobile app testing neobric
Best practices for mobile app testing neobricBest practices for mobile app testing neobric
Best practices for mobile app testing neobric
 
Language learning using augmented reality
Language learning using augmented realityLanguage learning using augmented reality
Language learning using augmented reality
 
Unit 3_Evaluation Technique.pptx
Unit 3_Evaluation Technique.pptxUnit 3_Evaluation Technique.pptx
Unit 3_Evaluation Technique.pptx
 
Context detection and effects on behavior
Context detection and effects on behaviorContext detection and effects on behavior
Context detection and effects on behavior
 
An Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingAn Introduction To Mobile Software Testing
An Introduction To Mobile Software Testing
 
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios  Stephen BrightSUS - ease of use perceptions and eportfoliostfolios  Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
 
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios  Stephen BrightSUS - ease of use perceptions and eportfoliostfolios  Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
 
Four Best Practices for Modern Performance Testing
Four Best Practices for Modern Performance TestingFour Best Practices for Modern Performance Testing
Four Best Practices for Modern Performance Testing
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practices
 
Caveon Webinar Series: The Good and Bad of Online Proctoring
Caveon Webinar Series: The Good and Bad of Online ProctoringCaveon Webinar Series: The Good and Bad of Online Proctoring
Caveon Webinar Series: The Good and Bad of Online Proctoring
 

Kürzlich hochgeladen

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Kürzlich hochgeladen (20)

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 

Pmc usability-testing

  • 1. Usability – Assuring Quality in Use Marko Nieminen Professor of Usability and User Interfaces, D.Sc.(Tech.) Aalto University School of Science Department of Computer Science and Engineering SoberIT - Software Business and Engineering Laboratory
  • 2. Test and Testing •  A qualitative or quantitative procedure that consists of determination of one or more characteristics of a given product, process or service according to a specified procedure •  Why testing? For instance, •  Determine if, or verify that, the requirements of a specification, regulation, or contract are met •  Decide if a new product development program is on track: Demonstrate proof of concept •  Validate suitability for end-use
  • 3. Quality in Use – Related to Usability and User Experience The capability of a system to enable specified users to achieve specified goals with effectiveness, productivity, safety, and satisfaction in specified contexts of use.
  • 4. Usability Test: Lab http://www.sigchi.org/chi97/proceedings/overview/tst.htm Usability Lab at Fidelity Investments
  • 6. Scenario: Mobile Ticketing 1 Matti sees Madonna’s concert promotion at bar in Tampere He takes a picture of promotion 2 poster by using his mobile phone Matti logs in to service for buying 3 tickets. Service identifies Madonna’s concert proposition. 4 He buys the concert ticket and travel ticket at the same time 6
  • 7. …and the scenario continues 5 Mikko checks his route and tickets through mobile phone He validates travel ticket by 6 using a mobile phone when he walks in to train at Tampere Mikko decides to stop for one 7 beer and buy it by using mobile phone He validates concert ticket by 8 using mobile phone when he arrives to gate of concert 7
  • 8. Field Tests (Tamminen & Oulasvirta 2005)
  • 9. Testing for ”Quality in Use” Addresses •  Real users •  Real settings •  Real tasks •  Real events •  Real process •  Real details •  Real effects •  Real outcome •  Expected (quantitative) and unexpected (qualitative) issues
  • 10. Usability Metrics: System Usability Scale (SUS) 1.  I think that I would like to use this system frequently. 2.  I found the system unnecessarily complex. 3.  I thought the system was easy to use. 4.  I think that I would need the support of a technical person to be able to use this system. 5.  I found the various functions in this system were well integrated. 6.  I thought there was too much inconsistency in this system. 7.  I would imagine that most people would learn to use this system very quickly. 8.  I found the system very cumbersome to use. 9.  I felt very confident using the system. 10.  I needed to learn a lot of things before I could get going with this system. Sauro (2011) http://www.measuringusability.com/sus.php
  • 11. Processes for Managing Quality in Use: Usability Maturity Model •  HCD1 Ensure HCD content in system strategy •  HCD2 Plan the HCD process •  HCD3 Specify user and organisational requirements •  HCD4 Understand and specify the context of use •  HCD5 Produce design solutions •  HCD6 Evaluate designs against requirements •  HCD7 Facilitate human-system implementation
  • 12. Usability – Assuring Quality in Use Marko Nieminen Professor of Usability and User Interfaces, D.Sc.(Tech.) Aalto University School of Science Department of Computer Science and Engineering SoberIT - Software Business and Engineering Laboratory