SlideShare a Scribd company logo
1 of 7
Adaptive Web Accessibility Metrics
                      Markel Vigo1 and Giorgio Brajnik2




       1 Laboratory
                  of Human Mobility               2 University   of Udine
              and Technology


BCS HCI Workshop: The socio‐technological issues of adaptive interfaces and user
                          profiling for accessibility


                                                      September 6, Dundee (Scotland)
1. Motivation for Adaptive Accessibility Metrics
 • We’d like to know the answer to this question:
   “To what extent is accessible a web page…
      - for a determined user with their own abilities
      - using a determined Assistive Technology and user agent
      - operating a specific device
      - and carrying out a determined task”
 • …equals to measuring accessibility in use or contextual accessibility
 • There are some scenarios that could benefit
      - As a way to measure interface adaptations
      - Adaptive hypermedia techniques
      - Accessibility observatories and QA
 • Traditional web accessibility metrics aim at measuring accessibility
   wrt to conformance
Adaptive Web Accessibility Metrics                          Vigo &Brajnik, 2010
1. Motivation for Adaptive Accessibility Metrics
 • Why adaptive accessibility scores?
      - Do conformance scores capture the accessibility perceived by users?
      - Traditional metrics are based on general purpose guidelines
      - Assuming metrics are adequate and valid many error-rates are introduced
      - Trusting in guidelines is risky
      - Guidelines do not capture all users’ needs and interaction context

• We need accessibility scores that capture the interaction context
 • Metrics are tied to evaluation process

 • Adaptive evaluation would produce user-tailored scores

 • Better if scores are automatically obtained

Adaptive Web Accessibility Metrics                                      Vigo &Brajnik, 2010
2. Challenges and Engineering solutions
Challenge 1: how to capture interaction context data (non intrusively)

   • Select only those guidelines that impact on a determined user group
   • Not enough
   • Context is key for adaptive evaluations
   •Detecting installed Assistive Technology and user agents is a step
   forward

   • Evaluation tools need a user profile as an input




Adaptive Web Accessibility Metrics                          Vigo &Brajnik, 2010
2. Challenges and Engineering solutions
Challenge 2: quantify severity of violated accessibility barriers

     • Weight barriers for a specific user context
     • Application scenarios require real-time scores
     • How to quantify barriers automatically?
     • Make use of infrastructures such as Accessibility Commons
     • Accessibility metadata stored beforehand
     • Triples: <accessibility problem, context, severity>




Adaptive Web Accessibility Metrics                           Vigo &Brajnik, 2010
2. Challenges and Engineering solutions
Challenge 3: reasoning over guidelines
     • Not to tie the metric to a determined guideline set
     • No matter which guideline set is used the metric should adapt to it
     • Guidelines have to be specified in a common language so that
     evaluation tools can understand them interoperability
     • Metrics require parameters such as number of applied
     guidelines, severities, etc inference
     • Interoperability + inference = ontologies?




Adaptive Web Accessibility Metrics                           Vigo &Brajnik, 2010
Adaptive Web Accessibility Metrics
                      Markel Vigo1 and Giorgio Brajnik2




       1 Laboratory
                  of Human Mobility               2 University   of Udine
              and Technology


BCS HCI Workshop: The socio‐technological issues of adaptive interfaces and user
                          profiling for accessibility


                                                      September 6, Dundee (Scotland)

More Related Content

Similar to Adaptive web accessibility metrics

Methods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users NeedsMethods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users Needs
Luis Carlos Aceves
 
Web Site Accessibility: Identifying and Fixing Accessibility Problems in Clie...
Web Site Accessibility: Identifying and Fixing Accessibility Problems in Clie...Web Site Accessibility: Identifying and Fixing Accessibility Problems in Clie...
Web Site Accessibility: Identifying and Fixing Accessibility Problems in Clie...
Porfirio Tramontana
 
DAI Framework_CEII_2022.pptx
DAI Framework_CEII_2022.pptxDAI Framework_CEII_2022.pptx
DAI Framework_CEII_2022.pptx
IakovosIoannou1
 
Self-adaptation Challenges for Cloud-based Applications (Feedback Computing 2...
Self-adaptation Challenges for Cloud-based Applications (Feedback Computing 2...Self-adaptation Challenges for Cloud-based Applications (Feedback Computing 2...
Self-adaptation Challenges for Cloud-based Applications (Feedback Computing 2...
Soodeh Farokhi
 
W4a11 accessibility at early stages insights from the designer perspective-ma...
W4a11 accessibility at early stages insights from the designer perspective-ma...W4a11 accessibility at early stages insights from the designer perspective-ma...
W4a11 accessibility at early stages insights from the designer perspective-ma...
adry60
 
Mobile Computing - Research Survey May 05 2012
Mobile Computing - Research Survey May 05 2012Mobile Computing - Research Survey May 05 2012
Mobile Computing - Research Survey May 05 2012
Joseph Hennawy
 
The Potential of Adaptive Interfaces as an Accessibility Aid for Older Web Users
The Potential of Adaptive Interfaces as an Accessibility Aid for Older Web UsersThe Potential of Adaptive Interfaces as an Accessibility Aid for Older Web Users
The Potential of Adaptive Interfaces as an Accessibility Aid for Older Web Users
David Sloan
 

Similar to Adaptive web accessibility metrics (20)

A MDD approach for modelling web accessibility
A MDD approach for modelling web accessibilityA MDD approach for modelling web accessibility
A MDD approach for modelling web accessibility
 
IT351_Mid.pdf
IT351_Mid.pdfIT351_Mid.pdf
IT351_Mid.pdf
 
Integrating HCI in a Web accessibility engineering approach
Integrating HCI in a Web accessibility engineering approachIntegrating HCI in a Web accessibility engineering approach
Integrating HCI in a Web accessibility engineering approach
 
New regulations, new risks
New regulations, new risksNew regulations, new risks
New regulations, new risks
 
ICS3211_lecture 03 2023.pdf
ICS3211_lecture 03 2023.pdfICS3211_lecture 03 2023.pdf
ICS3211_lecture 03 2023.pdf
 
Hons Proposal Slides '12
Hons Proposal Slides '12Hons Proposal Slides '12
Hons Proposal Slides '12
 
Methods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users NeedsMethods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users Needs
 
Web Site Accessibility: Identifying and Fixing Accessibility Problems in Clie...
Web Site Accessibility: Identifying and Fixing Accessibility Problems in Clie...Web Site Accessibility: Identifying and Fixing Accessibility Problems in Clie...
Web Site Accessibility: Identifying and Fixing Accessibility Problems in Clie...
 
Advances in testing and evaluation using Human-Biometric sensor interaction m...
Advances in testing and evaluation using Human-Biometric sensor interaction m...Advances in testing and evaluation using Human-Biometric sensor interaction m...
Advances in testing and evaluation using Human-Biometric sensor interaction m...
 
DAI Framework_CEII_2022.pptx
DAI Framework_CEII_2022.pptxDAI Framework_CEII_2022.pptx
DAI Framework_CEII_2022.pptx
 
ICS3211_lecture_week62023.pdf
ICS3211_lecture_week62023.pdfICS3211_lecture_week62023.pdf
ICS3211_lecture_week62023.pdf
 
Inclusive Usability Techniques in Requirements Analysis of Accessible Web App...
Inclusive Usability Techniques in Requirements Analysis of Accessible Web App...Inclusive Usability Techniques in Requirements Analysis of Accessible Web App...
Inclusive Usability Techniques in Requirements Analysis of Accessible Web App...
 
Contribution to proactivity in mobile context-aware recommender systems
Contribution to proactivity in mobile context-aware recommender systemsContribution to proactivity in mobile context-aware recommender systems
Contribution to proactivity in mobile context-aware recommender systems
 
Self-adaptation Challenges for Cloud-based Applications (Feedback Computing 2...
Self-adaptation Challenges for Cloud-based Applications (Feedback Computing 2...Self-adaptation Challenges for Cloud-based Applications (Feedback Computing 2...
Self-adaptation Challenges for Cloud-based Applications (Feedback Computing 2...
 
W4a11 accessibility at early stages insights from the designer perspective-ma...
W4a11 accessibility at early stages insights from the designer perspective-ma...W4a11 accessibility at early stages insights from the designer perspective-ma...
W4a11 accessibility at early stages insights from the designer perspective-ma...
 
Mobile Computing - Research Survey May 05 2012
Mobile Computing - Research Survey May 05 2012Mobile Computing - Research Survey May 05 2012
Mobile Computing - Research Survey May 05 2012
 
The Potential of Adaptive Interfaces as an Accessibility Aid for Older Web Users
The Potential of Adaptive Interfaces as an Accessibility Aid for Older Web UsersThe Potential of Adaptive Interfaces as an Accessibility Aid for Older Web Users
The Potential of Adaptive Interfaces as an Accessibility Aid for Older Web Users
 
The Potential of Adaptive Interfaces as an Accessibility Aid for Older Web Users
The Potential of Adaptive Interfaces as an Accessibility Aid for Older Web UsersThe Potential of Adaptive Interfaces as an Accessibility Aid for Older Web Users
The Potential of Adaptive Interfaces as an Accessibility Aid for Older Web Users
 
COBWEB - infrastructure and platform for Environmental Crowd Sensing and Big ...
COBWEB - infrastructure and platform for Environmental Crowd Sensing and Big ...COBWEB - infrastructure and platform for Environmental Crowd Sensing and Big ...
COBWEB - infrastructure and platform for Environmental Crowd Sensing and Big ...
 
Building Code 2.0 project
Building Code 2.0 projectBuilding Code 2.0 project
Building Code 2.0 project
 

More from Markel Vigo

Challenging Information Foraging Theory: Screen Reader Users are not Always D...
Challenging Information Foraging Theory: Screen Reader Users are not Always D...Challenging Information Foraging Theory: Screen Reader Users are not Always D...
Challenging Information Foraging Theory: Screen Reader Users are not Always D...
Markel Vigo
 
Considering People with Disabilities as Überusers for Eliciting Generalisable...
Considering People with Disabilities as Überusers for Eliciting Generalisable...Considering People with Disabilities as Überusers for Eliciting Generalisable...
Considering People with Disabilities as Überusers for Eliciting Generalisable...
Markel Vigo
 
Evaluating Web Accessibility For Specific Mobile Devices
Evaluating Web Accessibility For Specific Mobile DevicesEvaluating Web Accessibility For Specific Mobile Devices
Evaluating Web Accessibility For Specific Mobile Devices
Markel Vigo
 

More from Markel Vigo (11)

Inferring visual behaviour from user interaction data on a medical dashboard
Inferring visual behaviour from user interaction data on a medical dashboardInferring visual behaviour from user interaction data on a medical dashboard
Inferring visual behaviour from user interaction data on a medical dashboard
 
Constructing Conceptual Knowledge Artefacts: 
 Activity Patterns in the Ontol...
Constructing Conceptual Knowledge Artefacts: 
 Activity Patterns in the Ontol...Constructing Conceptual Knowledge Artefacts: 
 Activity Patterns in the Ontol...
Constructing Conceptual Knowledge Artefacts: 
 Activity Patterns in the Ontol...
 
Protégé4US: Harvesting Ontology Authoring Data with Protégé
Protégé4US: Harvesting Ontology Authoring Data with ProtégéProtégé4US: Harvesting Ontology Authoring Data with Protégé
Protégé4US: Harvesting Ontology Authoring Data with Protégé
 
Design Insights for the Next Wave Ontology Authoring Tools
Design Insights for the Next Wave Ontology Authoring ToolsDesign Insights for the Next Wave Ontology Authoring Tools
Design Insights for the Next Wave Ontology Authoring Tools
 
Identifying ontology authoring strategies and patterns
Identifying ontology authoring strategies and patternsIdentifying ontology authoring strategies and patterns
Identifying ontology authoring strategies and patterns
 
Detecting Problematic Interactions on the Web. The COPE Project: Coping strat...
Detecting Problematic Interactions on the Web. The COPE Project: Coping strat...Detecting Problematic Interactions on the Web. The COPE Project: Coping strat...
Detecting Problematic Interactions on the Web. The COPE Project: Coping strat...
 
Challenging Information Foraging Theory: Screen Reader Users are not Always D...
Challenging Information Foraging Theory: Screen Reader Users are not Always D...Challenging Information Foraging Theory: Screen Reader Users are not Always D...
Challenging Information Foraging Theory: Screen Reader Users are not Always D...
 
Considering People with Disabilities as Überusers for Eliciting Generalisable...
Considering People with Disabilities as Überusers for Eliciting Generalisable...Considering People with Disabilities as Überusers for Eliciting Generalisable...
Considering People with Disabilities as Überusers for Eliciting Generalisable...
 
Evaluating Accessibility-in-Use
Evaluating Accessibility-in-UseEvaluating Accessibility-in-Use
Evaluating Accessibility-in-Use
 
Benchmarking Web Accessibility Evaluation Tools: Measuring the Harm of Sole R...
Benchmarking Web Accessibility Evaluation Tools: Measuring the Harm of Sole R...Benchmarking Web Accessibility Evaluation Tools: Measuring the Harm of Sole R...
Benchmarking Web Accessibility Evaluation Tools: Measuring the Harm of Sole R...
 
Evaluating Web Accessibility For Specific Mobile Devices
Evaluating Web Accessibility For Specific Mobile DevicesEvaluating Web Accessibility For Specific Mobile Devices
Evaluating Web Accessibility For Specific Mobile Devices
 

Recently uploaded

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 

Recently uploaded (20)

Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 

Adaptive web accessibility metrics

  • 1. Adaptive Web Accessibility Metrics Markel Vigo1 and Giorgio Brajnik2 1 Laboratory of Human Mobility 2 University of Udine and Technology BCS HCI Workshop: The socio‐technological issues of adaptive interfaces and user profiling for accessibility September 6, Dundee (Scotland)
  • 2. 1. Motivation for Adaptive Accessibility Metrics • We’d like to know the answer to this question: “To what extent is accessible a web page… - for a determined user with their own abilities - using a determined Assistive Technology and user agent - operating a specific device - and carrying out a determined task” • …equals to measuring accessibility in use or contextual accessibility • There are some scenarios that could benefit - As a way to measure interface adaptations - Adaptive hypermedia techniques - Accessibility observatories and QA • Traditional web accessibility metrics aim at measuring accessibility wrt to conformance Adaptive Web Accessibility Metrics Vigo &Brajnik, 2010
  • 3. 1. Motivation for Adaptive Accessibility Metrics • Why adaptive accessibility scores? - Do conformance scores capture the accessibility perceived by users? - Traditional metrics are based on general purpose guidelines - Assuming metrics are adequate and valid many error-rates are introduced - Trusting in guidelines is risky - Guidelines do not capture all users’ needs and interaction context • We need accessibility scores that capture the interaction context • Metrics are tied to evaluation process • Adaptive evaluation would produce user-tailored scores • Better if scores are automatically obtained Adaptive Web Accessibility Metrics Vigo &Brajnik, 2010
  • 4. 2. Challenges and Engineering solutions Challenge 1: how to capture interaction context data (non intrusively) • Select only those guidelines that impact on a determined user group • Not enough • Context is key for adaptive evaluations •Detecting installed Assistive Technology and user agents is a step forward • Evaluation tools need a user profile as an input Adaptive Web Accessibility Metrics Vigo &Brajnik, 2010
  • 5. 2. Challenges and Engineering solutions Challenge 2: quantify severity of violated accessibility barriers • Weight barriers for a specific user context • Application scenarios require real-time scores • How to quantify barriers automatically? • Make use of infrastructures such as Accessibility Commons • Accessibility metadata stored beforehand • Triples: <accessibility problem, context, severity> Adaptive Web Accessibility Metrics Vigo &Brajnik, 2010
  • 6. 2. Challenges and Engineering solutions Challenge 3: reasoning over guidelines • Not to tie the metric to a determined guideline set • No matter which guideline set is used the metric should adapt to it • Guidelines have to be specified in a common language so that evaluation tools can understand them interoperability • Metrics require parameters such as number of applied guidelines, severities, etc inference • Interoperability + inference = ontologies? Adaptive Web Accessibility Metrics Vigo &Brajnik, 2010
  • 7. Adaptive Web Accessibility Metrics Markel Vigo1 and Giorgio Brajnik2 1 Laboratory of Human Mobility 2 University of Udine and Technology BCS HCI Workshop: The socio‐technological issues of adaptive interfaces and user profiling for accessibility September 6, Dundee (Scotland)

Editor's Notes

  1. Accessibility in use: the property of a site to support the same level of effectiveness for people with disabilities as it does for non-disabled peopleUser context and would consist of the user profileCheck the effectiveness of interface adaptationsprecisely in numeric/qualitative terms. It is useful to meet laws that enforce inclusive design
  2. BUT why we need adaptive metrics?There is a plethora of research stating that guidelines conformance does not necessarily ensure accessibilitySome scenarios require real time scoresBefore we obtain user-tailored scores there are some challenges that should be faced by both adaptive evaluation/measurement
  3. To do so we need to address the following challenges Intuitive solution and initial approachwe need a dynamic selection of guidelines that do applyencapsulating in a CC/PP profile
  4. Some proposed methods can weight violations applying human intervention
  5. As a conclusion,Do we need an adaptive evaluation method and then apply common metrics?or we need traditional methods and apply adaptive accessibility metrics?Do we need both?What do you think?