SlideShare ist ein Scribd-Unternehmen logo
1 von 32
Downloaden Sie, um offline zu lesen
Achieving a Safe and Seamless
         User Experience
Through Accessible Web Applications

       Alejandro Piñeiro Iglesias
2
    Topics
    ●   Accessibility-based solutions to improve safety

    ●   Implementation via accessibility APIs

    ●   Applicable standards and existing support




             Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                              Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
Accessibility-Based Solutions
     to Improve Safety
               `
4
    Safety First?
    9 November 2012                                 8 November 2012
    “Off-duty officer killed, Cal Trans             “Police say a distracted driver caused
    flagger seriously hurt in chain                 a head-on crash.... The driver of the
    reaction crash.... Cal Trans said the           second truck and his passenger had to
    accident was likely caused by a                 be extricated from the vehicle by
    distracted driver."                             firefighters."

    3 November 2012                                 31 October 2012
    “Authorities say a driver distracted            “An eastern Utah man was charged
    by his cell phone caused a head-on              Wednesday with hitting and killing a
    crash that killed an elderly man and            Vernal teenager with his car while
    seriously injured an elderly woman in           texting behind the wheel.”
    central California."



                Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                                 Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
5



    "In 2010, 3092 people were killed in crashes
    involving a distracted driver and an estimated
    additional 416,000 were injured in motor
    vehicle crashes involving a distracted driver."
             U.S. National Highway Traffic Safety Administration




            Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                             Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
6
    Hands-Free via Speech Input
    For:

     ●   Users who cannot use a keyboard and/or
         touch screen (i.e. due to disability)

     ●   Users who should not use a keyboard
         and/or touch screen (i.e. due to driving)




             Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                              Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
7
    Eyes-Minimal via Simplified UI
    For:

     • Users who have difficulty visually accessing
       screen contents (i.e. due to disability)

     • Users who have difficulty visually accessing
       screen contents (i.e. due to driving)




           Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                            Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
8
    Eyes-Free via Speech Output
    For:

     • Users who cannot visually access screen
       contents (i.e. due to disability)

     • Users who should not visually access
       screen contents (i.e. due to driving)




           Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                            Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
9
    Eyes-Free via Gestures
    For:

     • Users who cannot activate on-screen
       elements directly (i.e. due to disability)

     • Users who should not activate on-screen
       elements directly (i.e. due to driving)




           Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                            Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
10



     “Since driving ... is primarily a visual-spatial-
     motor task, it is predicted (and observed) to be
     fairly efficiently time shared with tasks that are
     auditory and language based.”

         Models of Attention, Distraction, and Highway Hazard Avoidance




               Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                                Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
Implementation
via Accessibility APIs
          `
12
     Accessibility APIs
     Accessibility APIs allow you to interact with
     applications programmatically on behalf of the
     end user.




            Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                             Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
13
     Example: Remember the Milk
     1. Remember The Milk displays an alert that the
        driver is in an area with an associated task.

     2. Device checks the car's speed to be sure it is
        safe, then speaks the displayed alert.

     3. Driver says “No” to indicate he does not want to
        be given navigation directions.

     4. Device clicks on the “No” button for the driver.

            Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                             Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
14
     Accessibility API Events
     • Focus changes
     • Selection changes
     • Text changes
     • Value changes
     • Visual appearance changes
     • Addition and removal of new objects
     • Etc.

              Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                               Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
15
     Accessibility API Actions
     • Press, release, and click on a button
     • Toggle the state of a widget
     • Drag and drop an item
     • Etc.




              Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                               Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
16
     Accessibility API Interfaces
     ●   Application                              ●   Selection
     ●   Component                                ●   Streamable Content
     ●   Desktop                                  ●   Text
     ●   Document                                 ●   Editable Text
     ●   Hypertext                                ●   Table
     ●   Image                                    ●   Value



             Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                              Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
17
     Accessibility API Use Cases
     • Provide access to users with disabilities

     • Automated testing

     • (Distraction-free access for drivers?)




            Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                             Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
18
     Requirements
     • Developers: create accessible web apps.

     • Layout engine: implement accessibility
       support for the platform.

     • Platform: provide a means to expose that
       support to end-user tools.




           Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                            Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
Applicable Standards and
    Existing Support
            `
20
     For Web Application Developers
     W3C Mobile Web Initiative

      • Mobile Web Best Practices
       http://www.w3.org/TR/mobile-bp


      • Mobile Web Application Best Practices
       http://www.w3.org/TR/mwabp




               Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                                Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
21
     For Web Application Developers
     W3C Web Accessibility Initiative

      • Mobile Accessibility Overview
       http://www.w3.org/WAI/mobile/Overview.html


      • Web Content Accessibility Guidelines
       http://www.w3.org/TR/WCAG20


      • Accessible Rich Internet Applications (ARIA)
       http://www.w3.org/TR/wai-aria




               Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                                Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
22
     For Web Application Developers
     W3C HTML Speech Incubator Group

     • Speech Input API Specification
      http://lists.w3.org/Archives/Public/public-xg-htmlspeech/2011Feb/att-0020/api-draft.html


     • HTML Text to Speech (TTS) API Specification
      http://lists.w3.org/Archives/Public/public-xg-htmlspeech/2011Feb/att-0022/htmltts-draft.html


     • Speech JavaScript API Specification
      http://lists.w3.org/Archives/Public/public-webapps/2011OctDec/att-1696/speechapi.html


     • Final Report
      http://www.w3.org/2005/Incubator/htmlspeech/XGR-htmlspeech/


                 Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                                  Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
23
     Layout Engines Supporting ARIA
     ●   Trident
     ●   WebKit
     ●   Gecko
     ●   Presto




              Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                               Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
24
     Choosing One
     ●   Trident
     ●   WebKit
     ●   Gecko
     ●   Presto




              Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                               Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
25
     WebKit: Free as in Freedom
     ●   Primarily BSD-style and LGPL licenses
     ●   http://svn.webkit.org/repository/webkit/trunk




              Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                               Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
26
     WebKit: Embedded-Friendly
     ●   Desktop (Safari, Chromium, Epiphany, etc.)
     ●   iPhone, iPad, iPod Touch
     ●   Android
     ●   Palm Pre
     ●   Amazon Kindle
     ●   Others



              Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                               Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
27
     WebKit: Developer Community
     9000
             8151
     8000

     7000
                       6099
     6000
                               5083
     5000

     4000

     3000
                                        2026
     2000
                                                 1465
                                                           924                                        1104
     1000                                                          749
                                                                             375      315      313
        0
            Chromium   Apple   WebKit   Google   Igalia   Gmail    Nokia   OpenBossa Samsung   RIM    Others


                                   Commits Per Affiliation in 2011

                       Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                                        Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
28
     WebKit: Accessibility
     • Mature, platform-independent core support

     • Adaptations from WebCore to platform, e.g.:
      – Macintosh                                     – EFL

      – Chromium                                      – Qt

      – GTK                                           – Win




              Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                               Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
29   The Indie UI Working Group
     “The mission of the Indie UI Working Group ...
     is to develop event models for Application
     Programming Interfaces (APIs) that facilitate
     interaction in Web applications that are input
     method independent, and hence accessible to
     people with disabilities.”
                               W3C Web Accessibility Initiative



            Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                             Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
30

     Indie UI Working Group Members:
     ●   Access Co, LTD                          ●   Nokia
     ●   Apple                                   ●   Opera
     ●   Google                                  ●   Univ. Catholique de Louvain
     ●   IBM                                     ●   Univ. of Manchester
     ●   Institut Telecom                        ●   Invited (accessibility) experts


          Representation from the Automotive Industry?
           http://www.w3.org/WAI/IndieUI/participation

                  Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                                   Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
31
         Summary
     ●   In-vehicle device applications can be used more
         safely via alternative input and/or output.

     ●   The alternatives are quite similar to, and may
         even be thought of as, assistive technologies.

     ●   Accessibility APIs and standards for accessible
         web applications are established and being used.

     ●   The automotive industry should evaluate this
         solution.
                Achieving a Safe and Seamless User Experience Through Accessible Web Applications
                                 Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
Questions?

Weitere ähnliche Inhalte

Mehr von Igalia

Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia
Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por IgaliaIntroducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia
Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia
Igalia
 

Mehr von Igalia (20)

To crash or not to crash: if you do, at least recover fast!
To crash or not to crash: if you do, at least recover fast!To crash or not to crash: if you do, at least recover fast!
To crash or not to crash: if you do, at least recover fast!
 
Implementing a Vulkan Video Encoder From Mesa to GStreamer
Implementing a Vulkan Video Encoder From Mesa to GStreamerImplementing a Vulkan Video Encoder From Mesa to GStreamer
Implementing a Vulkan Video Encoder From Mesa to GStreamer
 
8 Years of Open Drivers, including the State of Vulkan in Mesa
8 Years of Open Drivers, including the State of Vulkan in Mesa8 Years of Open Drivers, including the State of Vulkan in Mesa
8 Years of Open Drivers, including the State of Vulkan in Mesa
 
Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia
Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por IgaliaIntroducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia
Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia
 
2023 in Chimera Linux
2023 in Chimera                    Linux2023 in Chimera                    Linux
2023 in Chimera Linux
 
Building a Linux distro with LLVM
Building a Linux distro        with LLVMBuilding a Linux distro        with LLVM
Building a Linux distro with LLVM
 
turnip: Update on Open Source Vulkan Driver for Adreno GPUs
turnip: Update on Open Source Vulkan Driver for Adreno GPUsturnip: Update on Open Source Vulkan Driver for Adreno GPUs
turnip: Update on Open Source Vulkan Driver for Adreno GPUs
 
Graphics stack updates for Raspberry Pi devices
Graphics stack updates for Raspberry Pi devicesGraphics stack updates for Raspberry Pi devices
Graphics stack updates for Raspberry Pi devices
 
Delegated Compositing - Utilizing Wayland Protocols for Chromium on ChromeOS
Delegated Compositing - Utilizing Wayland Protocols for Chromium on ChromeOSDelegated Compositing - Utilizing Wayland Protocols for Chromium on ChromeOS
Delegated Compositing - Utilizing Wayland Protocols for Chromium on ChromeOS
 
MessageFormat: The future of i18n on the web
MessageFormat: The future of i18n on the webMessageFormat: The future of i18n on the web
MessageFormat: The future of i18n on the web
 
Replacing the geometry pipeline with mesh shaders
Replacing the geometry pipeline with mesh shadersReplacing the geometry pipeline with mesh shaders
Replacing the geometry pipeline with mesh shaders
 
I'm not an AMD expert, but...
I'm not an AMD expert, but...I'm not an AMD expert, but...
I'm not an AMD expert, but...
 
Status of Vulkan on Raspberry
Status of Vulkan on RaspberryStatus of Vulkan on Raspberry
Status of Vulkan on Raspberry
 
Enable hardware acceleration for GL applications without glamor on Xorg modes...
Enable hardware acceleration for GL applications without glamor on Xorg modes...Enable hardware acceleration for GL applications without glamor on Xorg modes...
Enable hardware acceleration for GL applications without glamor on Xorg modes...
 
Async page flip in DRM atomic API
Async page flip in DRM  atomic APIAsync page flip in DRM  atomic API
Async page flip in DRM atomic API
 
From the proposal to ECMAScript – Step by Step
From the proposal to ECMAScript – Step by StepFrom the proposal to ECMAScript – Step by Step
From the proposal to ECMAScript – Step by Step
 
Migrating Babel from CommonJS to ESM
Migrating Babel     from CommonJS to ESMMigrating Babel     from CommonJS to ESM
Migrating Babel from CommonJS to ESM
 
The rainbow treasure map: Advanced color management on Linux with AMD/Steam D...
The rainbow treasure map: Advanced color management on Linux with AMD/Steam D...The rainbow treasure map: Advanced color management on Linux with AMD/Steam D...
The rainbow treasure map: Advanced color management on Linux with AMD/Steam D...
 
Freedreno on Android – XDC 2023
Freedreno on Android          – XDC 2023Freedreno on Android          – XDC 2023
Freedreno on Android – XDC 2023
 
On-going challenges in the Raspberry Pi driver stack – XDC 2023
On-going challenges in the Raspberry Pi driver stack – XDC 2023On-going challenges in the Raspberry Pi driver stack – XDC 2023
On-going challenges in the Raspberry Pi driver stack – XDC 2023
 

Kürzlich hochgeladen

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Kürzlich hochgeladen (20)

The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 

Achieving a Safe and Seamless User Experience Through Accessible Web Applications (Rome 2012 W3C Web&Automotive Workshop)

  • 1. Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro Iglesias
  • 2. 2 Topics ● Accessibility-based solutions to improve safety ● Implementation via accessibility APIs ● Applicable standards and existing support Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 3. Accessibility-Based Solutions to Improve Safety `
  • 4. 4 Safety First? 9 November 2012 8 November 2012 “Off-duty officer killed, Cal Trans “Police say a distracted driver caused flagger seriously hurt in chain a head-on crash.... The driver of the reaction crash.... Cal Trans said the second truck and his passenger had to accident was likely caused by a be extricated from the vehicle by distracted driver." firefighters." 3 November 2012 31 October 2012 “Authorities say a driver distracted “An eastern Utah man was charged by his cell phone caused a head-on Wednesday with hitting and killing a crash that killed an elderly man and Vernal teenager with his car while seriously injured an elderly woman in texting behind the wheel.” central California." Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 5. 5 "In 2010, 3092 people were killed in crashes involving a distracted driver and an estimated additional 416,000 were injured in motor vehicle crashes involving a distracted driver." U.S. National Highway Traffic Safety Administration Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 6. 6 Hands-Free via Speech Input For: ● Users who cannot use a keyboard and/or touch screen (i.e. due to disability) ● Users who should not use a keyboard and/or touch screen (i.e. due to driving) Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 7. 7 Eyes-Minimal via Simplified UI For: • Users who have difficulty visually accessing screen contents (i.e. due to disability) • Users who have difficulty visually accessing screen contents (i.e. due to driving) Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 8. 8 Eyes-Free via Speech Output For: • Users who cannot visually access screen contents (i.e. due to disability) • Users who should not visually access screen contents (i.e. due to driving) Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 9. 9 Eyes-Free via Gestures For: • Users who cannot activate on-screen elements directly (i.e. due to disability) • Users who should not activate on-screen elements directly (i.e. due to driving) Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 10. 10 “Since driving ... is primarily a visual-spatial- motor task, it is predicted (and observed) to be fairly efficiently time shared with tasks that are auditory and language based.” Models of Attention, Distraction, and Highway Hazard Avoidance Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 12. 12 Accessibility APIs Accessibility APIs allow you to interact with applications programmatically on behalf of the end user. Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 13. 13 Example: Remember the Milk 1. Remember The Milk displays an alert that the driver is in an area with an associated task. 2. Device checks the car's speed to be sure it is safe, then speaks the displayed alert. 3. Driver says “No” to indicate he does not want to be given navigation directions. 4. Device clicks on the “No” button for the driver. Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 14. 14 Accessibility API Events • Focus changes • Selection changes • Text changes • Value changes • Visual appearance changes • Addition and removal of new objects • Etc. Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 15. 15 Accessibility API Actions • Press, release, and click on a button • Toggle the state of a widget • Drag and drop an item • Etc. Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 16. 16 Accessibility API Interfaces ● Application ● Selection ● Component ● Streamable Content ● Desktop ● Text ● Document ● Editable Text ● Hypertext ● Table ● Image ● Value Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 17. 17 Accessibility API Use Cases • Provide access to users with disabilities • Automated testing • (Distraction-free access for drivers?) Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 18. 18 Requirements • Developers: create accessible web apps. • Layout engine: implement accessibility support for the platform. • Platform: provide a means to expose that support to end-user tools. Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 19. Applicable Standards and Existing Support `
  • 20. 20 For Web Application Developers W3C Mobile Web Initiative • Mobile Web Best Practices http://www.w3.org/TR/mobile-bp • Mobile Web Application Best Practices http://www.w3.org/TR/mwabp Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 21. 21 For Web Application Developers W3C Web Accessibility Initiative • Mobile Accessibility Overview http://www.w3.org/WAI/mobile/Overview.html • Web Content Accessibility Guidelines http://www.w3.org/TR/WCAG20 • Accessible Rich Internet Applications (ARIA) http://www.w3.org/TR/wai-aria Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 22. 22 For Web Application Developers W3C HTML Speech Incubator Group • Speech Input API Specification http://lists.w3.org/Archives/Public/public-xg-htmlspeech/2011Feb/att-0020/api-draft.html • HTML Text to Speech (TTS) API Specification http://lists.w3.org/Archives/Public/public-xg-htmlspeech/2011Feb/att-0022/htmltts-draft.html • Speech JavaScript API Specification http://lists.w3.org/Archives/Public/public-webapps/2011OctDec/att-1696/speechapi.html • Final Report http://www.w3.org/2005/Incubator/htmlspeech/XGR-htmlspeech/ Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 23. 23 Layout Engines Supporting ARIA ● Trident ● WebKit ● Gecko ● Presto Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 24. 24 Choosing One ● Trident ● WebKit ● Gecko ● Presto Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 25. 25 WebKit: Free as in Freedom ● Primarily BSD-style and LGPL licenses ● http://svn.webkit.org/repository/webkit/trunk Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 26. 26 WebKit: Embedded-Friendly ● Desktop (Safari, Chromium, Epiphany, etc.) ● iPhone, iPad, iPod Touch ● Android ● Palm Pre ● Amazon Kindle ● Others Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 27. 27 WebKit: Developer Community 9000 8151 8000 7000 6099 6000 5083 5000 4000 3000 2026 2000 1465 924 1104 1000 749 375 315 313 0 Chromium Apple WebKit Google Igalia Gmail Nokia OpenBossa Samsung RIM Others Commits Per Affiliation in 2011 Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 28. 28 WebKit: Accessibility • Mature, platform-independent core support • Adaptations from WebCore to platform, e.g.: – Macintosh – EFL – Chromium – Qt – GTK – Win Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 29. 29 The Indie UI Working Group “The mission of the Indie UI Working Group ... is to develop event models for Application Programming Interfaces (APIs) that facilitate interaction in Web applications that are input method independent, and hence accessible to people with disabilities.” W3C Web Accessibility Initiative Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 30. 30 Indie UI Working Group Members: ● Access Co, LTD ● Nokia ● Apple ● Opera ● Google ● Univ. Catholique de Louvain ● IBM ● Univ. of Manchester ● Institut Telecom ● Invited (accessibility) experts Representation from the Automotive Industry? http://www.w3.org/WAI/IndieUI/participation Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility
  • 31. 31 Summary ● In-vehicle device applications can be used more safely via alternative input and/or output. ● The alternatives are quite similar to, and may even be thought of as, assistive technologies. ● Accessibility APIs and standards for accessible web applications are established and being used. ● The automotive industry should evaluate this solution. Achieving a Safe and Seamless User Experience Through Accessible Web Applications Alejandro Piñeiro | apinheiro@igalia.com | www.igalia.com/accessibility