SlideShare ist ein Scribd-Unternehmen logo
1 von 12
Downloaden Sie, um offline zu lesen
Usability – Assuring Quality in Use


        Marko Nieminen
        Professor of Usability and User Interfaces, D.Sc.(Tech.)
        Aalto University School of Science
        Department of Computer Science and Engineering
        SoberIT - Software Business and Engineering Laboratory
Test and Testing

•  A qualitative or quantitative procedure that consists of
   determination of one or more characteristics of a given
   product, process or service according to a specified
   procedure

•  Why testing? For instance,

•  Determine if, or verify that, the requirements of a
   specification, regulation, or contract are met
•  Decide if a new product development program is on track:
   Demonstrate proof of concept
•  Validate suitability for end-use
Quality in Use – Related to Usability and
User Experience


                The capability of a system
                 to enable specified users
                to achieve specified goals
 with effectiveness, productivity, safety, and satisfaction
               in specified contexts of use.
Usability Test: Lab




                      http://www.sigchi.org/chi97/proceedings/overview/tst.htm
                                           Usability Lab at Fidelity Investments
Watching Television – On-site
Scenario: Mobile Ticketing


1       Matti sees Madonna’s concert
        promotion at bar in Tampere




         He takes a picture of promotion
    2    poster by using his mobile phone



              Matti logs in to service for buying
         3    tickets. Service identifies
              Madonna’s concert proposition.



                 4     He buys the concert ticket and
                       travel ticket at the same time   6
…and the scenario continues

5       Mikko checks his route and
        tickets through mobile phone



         He validates travel ticket by
    6    using a mobile phone when he
         walks in to train at Tampere



              Mikko decides to stop for one
         7    beer and buy it by using mobile
              phone


                     He validates concert ticket by
                 8   using mobile phone when he
                     arrives to gate of concert       7
Field Tests




              (Tamminen & Oulasvirta 2005)
Testing for ”Quality in Use” Addresses

•    Real users
•    Real settings
•    Real tasks
•    Real events
•    Real process
•    Real details
•    Real effects
•    Real outcome

•  Expected (quantitative) and unexpected (qualitative) issues
Usability Metrics: System Usability Scale
(SUS)
1.   I think that I would like to use this system frequently.
2.   I found the system unnecessarily complex.
3.   I thought the system was easy to use.
4.   I think that I would need the support of a technical person to be able
     to use this system.
5.  I found the various functions in this system were well integrated.
6.  I thought there was too much inconsistency in this system.
7.  I would imagine that most people would learn to use this system very
     quickly.
8.  I found the system very cumbersome to use.
9.  I felt very confident using the system.
10.  I needed to learn a lot of things before I could get going with this
     system.
                                                                           Sauro (2011)
                                             http://www.measuringusability.com/sus.php
Processes for Managing Quality in Use:
Usability Maturity Model

•    HCD1 Ensure HCD content in system strategy
•    HCD2 Plan the HCD process
•    HCD3 Specify user and organisational requirements
•    HCD4 Understand and specify the context of use
•    HCD5 Produce design solutions
•    HCD6 Evaluate designs against requirements
•    HCD7 Facilitate human-system implementation
Usability – Assuring Quality in Use


        Marko Nieminen
        Professor of Usability and User Interfaces, D.Sc.(Tech.)
        Aalto University School of Science
        Department of Computer Science and Engineering
        SoberIT - Software Business and Engineering Laboratory

Weitere ähnliche Inhalte

Ähnlich wie Pmc usability-testing

Why Remote Research Is (or isn't) Right for your project
Why Remote Research Is (or isn't) Right for your projectWhy Remote Research Is (or isn't) Right for your project
Why Remote Research Is (or isn't) Right for your projectGreenlight Guru
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityUser Vision
 
User Testing by Alvin Chai
User Testing by Alvin ChaiUser Testing by Alvin Chai
User Testing by Alvin ChaiCHI UX Indonesia
 
Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience UserZoom
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopiaSOASTA
 
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERVUbiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERVIiro Jantunen
 
Dey alexander usability_training_notes_01
Dey alexander usability_training_notes_01Dey alexander usability_training_notes_01
Dey alexander usability_training_notes_01danamato
 
Best practices for mobile app testing neobric
Best practices for mobile app testing neobricBest practices for mobile app testing neobric
Best practices for mobile app testing neobricNeobric
 
Language learning using augmented reality
Language learning using augmented realityLanguage learning using augmented reality
Language learning using augmented realityAmritanshu Sawarn
 
Unit 3_Evaluation Technique.pptx
Unit 3_Evaluation Technique.pptxUnit 3_Evaluation Technique.pptx
Unit 3_Evaluation Technique.pptxssuser50f868
 
Context detection and effects on behavior
Context detection and effects on behaviorContext detection and effects on behavior
Context detection and effects on behaviorTimo Smura
 
An Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingAn Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingStephen Janaway
 
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios  Stephen BrightSUS - ease of use perceptions and eportfoliostfolios  Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios Stephen BrightePortfolios Australia
 
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios  Stephen BrightSUS - ease of use perceptions and eportfoliostfolios  Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios Stephen BrightePortfolios Australia
 
Four Best Practices for Modern Performance Testing
Four Best Practices for Modern Performance TestingFour Best Practices for Modern Performance Testing
Four Best Practices for Modern Performance TestingSOASTA
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practicesRakesh Jha
 
Caveon Webinar Series: The Good and Bad of Online Proctoring
Caveon Webinar Series: The Good and Bad of Online ProctoringCaveon Webinar Series: The Good and Bad of Online Proctoring
Caveon Webinar Series: The Good and Bad of Online ProctoringCaveon Test Security
 

Ähnlich wie Pmc usability-testing (20)

Why Remote Research Is (or isn't) Right for your project
Why Remote Research Is (or isn't) Right for your projectWhy Remote Research Is (or isn't) Right for your project
Why Remote Research Is (or isn't) Right for your project
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usability
 
User Testing by Alvin Chai
User Testing by Alvin ChaiUser Testing by Alvin Chai
User Testing by Alvin Chai
 
Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience
 
classmar2.ppt
classmar2.pptclassmar2.ppt
classmar2.ppt
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
 
Suman_Cv
Suman_CvSuman_Cv
Suman_Cv
 
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERVUbiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
 
Ranjith S
Ranjith SRanjith S
Ranjith S
 
Dey alexander usability_training_notes_01
Dey alexander usability_training_notes_01Dey alexander usability_training_notes_01
Dey alexander usability_training_notes_01
 
Best practices for mobile app testing neobric
Best practices for mobile app testing neobricBest practices for mobile app testing neobric
Best practices for mobile app testing neobric
 
Language learning using augmented reality
Language learning using augmented realityLanguage learning using augmented reality
Language learning using augmented reality
 
Unit 3_Evaluation Technique.pptx
Unit 3_Evaluation Technique.pptxUnit 3_Evaluation Technique.pptx
Unit 3_Evaluation Technique.pptx
 
Context detection and effects on behavior
Context detection and effects on behaviorContext detection and effects on behavior
Context detection and effects on behavior
 
An Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingAn Introduction To Mobile Software Testing
An Introduction To Mobile Software Testing
 
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios  Stephen BrightSUS - ease of use perceptions and eportfoliostfolios  Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
 
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios  Stephen BrightSUS - ease of use perceptions and eportfoliostfolios  Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
 
Four Best Practices for Modern Performance Testing
Four Best Practices for Modern Performance TestingFour Best Practices for Modern Performance Testing
Four Best Practices for Modern Performance Testing
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practices
 
Caveon Webinar Series: The Good and Bad of Online Proctoring
Caveon Webinar Series: The Good and Bad of Online ProctoringCaveon Webinar Series: The Good and Bad of Online Proctoring
Caveon Webinar Series: The Good and Bad of Online Proctoring
 

Kürzlich hochgeladen

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 

Kürzlich hochgeladen (20)

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 

Pmc usability-testing

  • 1. Usability – Assuring Quality in Use Marko Nieminen Professor of Usability and User Interfaces, D.Sc.(Tech.) Aalto University School of Science Department of Computer Science and Engineering SoberIT - Software Business and Engineering Laboratory
  • 2. Test and Testing •  A qualitative or quantitative procedure that consists of determination of one or more characteristics of a given product, process or service according to a specified procedure •  Why testing? For instance, •  Determine if, or verify that, the requirements of a specification, regulation, or contract are met •  Decide if a new product development program is on track: Demonstrate proof of concept •  Validate suitability for end-use
  • 3. Quality in Use – Related to Usability and User Experience The capability of a system to enable specified users to achieve specified goals with effectiveness, productivity, safety, and satisfaction in specified contexts of use.
  • 4. Usability Test: Lab http://www.sigchi.org/chi97/proceedings/overview/tst.htm Usability Lab at Fidelity Investments
  • 6. Scenario: Mobile Ticketing 1 Matti sees Madonna’s concert promotion at bar in Tampere He takes a picture of promotion 2 poster by using his mobile phone Matti logs in to service for buying 3 tickets. Service identifies Madonna’s concert proposition. 4 He buys the concert ticket and travel ticket at the same time 6
  • 7. …and the scenario continues 5 Mikko checks his route and tickets through mobile phone He validates travel ticket by 6 using a mobile phone when he walks in to train at Tampere Mikko decides to stop for one 7 beer and buy it by using mobile phone He validates concert ticket by 8 using mobile phone when he arrives to gate of concert 7
  • 8. Field Tests (Tamminen & Oulasvirta 2005)
  • 9. Testing for ”Quality in Use” Addresses •  Real users •  Real settings •  Real tasks •  Real events •  Real process •  Real details •  Real effects •  Real outcome •  Expected (quantitative) and unexpected (qualitative) issues
  • 10. Usability Metrics: System Usability Scale (SUS) 1.  I think that I would like to use this system frequently. 2.  I found the system unnecessarily complex. 3.  I thought the system was easy to use. 4.  I think that I would need the support of a technical person to be able to use this system. 5.  I found the various functions in this system were well integrated. 6.  I thought there was too much inconsistency in this system. 7.  I would imagine that most people would learn to use this system very quickly. 8.  I found the system very cumbersome to use. 9.  I felt very confident using the system. 10.  I needed to learn a lot of things before I could get going with this system. Sauro (2011) http://www.measuringusability.com/sus.php
  • 11. Processes for Managing Quality in Use: Usability Maturity Model •  HCD1 Ensure HCD content in system strategy •  HCD2 Plan the HCD process •  HCD3 Specify user and organisational requirements •  HCD4 Understand and specify the context of use •  HCD5 Produce design solutions •  HCD6 Evaluate designs against requirements •  HCD7 Facilitate human-system implementation
  • 12. Usability – Assuring Quality in Use Marko Nieminen Professor of Usability and User Interfaces, D.Sc.(Tech.) Aalto University School of Science Department of Computer Science and Engineering SoberIT - Software Business and Engineering Laboratory