Unblocking The Main Thread Solving ANRs and Frozen Frames
Â
Accessibility of Mainstream E-Book Readers - CSUN 2014
1. Accessibility of Mainstream
E-Book Readers
Ken Petri, The Ohio State University
Hadi Rangin, University of Illinois, Urbana-
Champaign
CSUN 2014 Conference
2. CSUN 2014 E-Book-Related
Presentations
⢠Today
â 9:20: âTesting Mainstream eBook Systems: Which is Most
Accessibleâ (Kindle, Kobo, Nook)
â 1:50, presentation by Amazon on cross-platform a11y with
Kindle products
â 3:10, George Kerscherâs âReading System Showdownâ
⢠Tomorrow
â Two 8 AM sessions, one on challenges publishers face in
producing accessible books, one about consumer
acceptance of them
â 10:40, looking at EPUB3 cross platform accessibility
(VitalSource)
â (And three sessions on accessible math in e-books)
3. Formats Considered: PDF/UA
⢠Technical standard for PDF software
developers, defining how to render PDF so
that they are accessible
⢠âMatterhorn Protocolâ lists the ways PDF/UA
can be failed
- Reverse engineered, it suggests implementation
guidelines
4. Formats: iBooks and KF8
⢠iBooks
â Proprietary implementation of EPUB 3
â Not (currently) transformable to EPUB 3
⢠But iBooks reader renders a lot of EPUB 3 (and on iOS makes
that pretty accessible)
⢠Amazon KF8 (Kindle Format 8)
â Proprietary. Similar to EPUB 3: implements HTML5
and CSS3 subsets
â Missing: Video, audio, SVG (though has full-page
graphics), media overlays (?, Audible synchronized
reading), MathML
â Book ecosystem lock-in
5. Formats: EPUB 3
⢠Overhaul of EPUB 2
⢠Incorporates all major DAISY features (replacing DAISY?)
â Accessibility pedigree: Key DAISY Consortium and other a11y
personnel
⢠Video, audio, SVG, MathML, Media Overlays, JavaScript (interactivity),
print-faithful pagination, HTML5 and CSS3 (large subset, including ARIA
and forms), Fixed layout or reflowable, footnotes
⢠Canonical Fragment Identifiers (CFI)
â Precise indexing of location and ranges intra-ebook and from
external references. Could also be for things like notes, highlights,
bookmarks?: Cross-platform notes, highlights, and bookmarks a
possibility.
⢠âDictionariesâ (glossaries) and âIndexesâ are new proposed extensions
6. Current EPUB3 Implementation Issues
⢠No viable TTS/Braille+math across platforms
(though lots of good work coming from
MathPlayer Alpha and Google ChromeVox)
⢠No cross-platform/reader solution for
bookmarks, progress, notes, highlights (CFI a
possible candidate?)
⢠Video and audio may require custom solution
until wide support for HTML5 video captions
â And what about audio description (AD) support?
7. Existing E-Book A11y Criteria
⢠NISO DTB prioritized features list (1999)
â Informed NLS player features
⢠W3C UAAG 2.0 (last call, Nov. 2013)
â Browsers, media players, other internet apps that render web content
⢠EPUB 3 Accessibility Guidelines (IDPF, updated 2014)
â Checklist and Best Practices for EPUB 3 authoring
⢠BISG, DAISY Consortium and IDPF EPUBTest.org (2014)
â Comparative EPUB 3 support grid, reader by reader
⢠Accessibility Screening Methodology Guidelines and Checklist (May
2013)
â DAISY Consortium with Tech for All
â Functional criteria and tests for file management, reading, reading
visual adjustment, navigation, annotation, and media playback for
eReaders and digital reading systems
9. Goals of Our Functional Criteria
⢠Derived from existing criteria, esp. Screening
Methodology Checklist
⢠End-user oriented criteria (like EPUBTest.org)
â Comparative grid
â Want novice to be able to read (and contribute?)
⢠Focus on functional accessibility, arranged by
disability categories
⢠Goal of an organization/individual being able to
use this in adoption/selection of a platform
⢠Presupposes that EPUB 3 is long term solution
11. Readers Surveyed
⢠Initial survey: More than 40 readers/systems
â First cut: down to 14
â Matrix very âsparseâ (that is, we did a lot of
testing, but itâs not filled out <frown>)
⢠HoweverâŚ. We will discuss: Kindle, iBooks,
Azardi, VitalSource (PC), Blio, Google Play,
Adobe Digital Editions, Nook Study, Readium
project
12. Criteria: Global
⢠Independent setup and activation by PwD
⢠Import/load/purchase e-book accessible
⢠List and search titles and authors
⢠Discover e-book metadata (author, publisher, reading progress, etc.)
⢠Simple and minimal controls
⢠Rich navigation by bookmark, highlight, note, chapter, sub-section
⢠Make/remove bookmarks, highlights, notes
⢠Remembered reading progress and indication of progress in book
easily discoverable
⢠For TTS, book reading resumable from previous paused position
13. Select Criteria: Blind/Severe Visual
Impairment
⢠All functionality available through reader built-in TTS or 3rd-party
screen reader
⢠Direct access to book text (to select, copy)
⢠Set highlights, make notes
⢠Adjustable speech rate, mute, pause
⢠Controls identifiable/discoverable by touch
⢠Accessible MathML
⢠Image alternatives voiced
⢠Fine-grained navigation: headings, tables, markup, lists, words,
characters
⢠Navigation by book structure: Table of Contents
⢠Media players with accessible controls and audio description
capability
14. Criteria: âLow Visionâ
⢠Distinguishable controls (by touch or voiced)
⢠Font face choices
⢠Enlargeable book text
⢠Full typographic control of book text
⢠User-interface type/icons enlargeable
⢠Set high contrast or adopts native OS high-
contrast settings
16. Criteria: Motor Disability
⢠Devices light, durable, mountable
⢠Touch screen allows for non-human (pointer
stick, etc.) interactivity and emulation of
multiple touch via single point
⢠Navigable by voice (3rd-party or built-in)
⢠Touch screen allows for loose precision,
controls cycleable
⢠Controls actuated by alternative pointing
devices
17. Criteria: Cognitive/Non-Vision Reading
⢠Synchronized highlighting of TTS, including media
overlays
⢠Page indication aligns/can align with paper book
⢠Text manipulation or other settings can create
low visual ânoiseâ/non-distracting page views
⢠Notes, highlights, progress, bookmarks sync
across platform/instance
⢠Reference lookup in 3rd-party sources
⢠If quizzing or other interactivity, no imposed time
limits or time can be extended
18. Criteria: Deaf and Hard of Hearing
⢠Essential audio-only cues/alerts have visual
equivalents (book syncs with server, bookmark
set/removed, etc., should get visual
notification)
⢠Synchronized captions for embedded
video/multimedia presentations
⢠Mono audio output configurable
19. Subset for Discussion
⢠Screen reader access (to interface and contents)
⢠Text control: Contrast, font face, text size,
margins, kerning, line height, work spacing
⢠Highlighted synchronized reading
⢠Notes and highlights
⢠Cross-platform sync
⢠Captioned video (and AD?)
⢠Math rendering and accessibility
⢠Accessible interactivity
20. Not (Currently) Considered
⢠Blio PC/Mac: Crashes, poor SR suppoort, XPS (very little
support in readers)
⢠Adobe Reader: Good for PDF, but a document reader, not a
reading system
⢠Specialized: Poor or no support for EPUB 3
â Dolphin EasyReader and gh ReadHear
â Darwin Reader and GoRead on Android
â Read2Go on iOS
⢠Academic: Proprietary formats
â CourseSmart:
â Inkling
â Illinois E-Text
â Courseload (appears to be moving toward EPUB 3)
21. Adobe Digital Editions
⢠EPUB 2, only (no math, video, interactivity)
⢠Screen reader accessibility to reading, but text
selection buggy
⢠Only size control of text, but does adopt OS high-
contrast mode
⢠Notes and highlights (but not for screen readers
⢠Isolated, no syncing since is stand-alone
⢠Adobe appears to have no plans to move forward
with ADE
22. Blio
⢠Installed version showed initial promise, but unclear if
platform is progressing
⢠On iOS, notes and highlighting very similar to Kindle
(usable)
⢠Only EPUB 2 capable, almost no support for EPUB 3
(outside of simple import â through iTunes on iOS)
⢠Need to buy voice to get highlighted, synced reading.
Limited control of speed, synchronization issues
apparent
⢠Android version: Canât find a way to set a highlight
using TalkBack
23. Azardi
⢠Nearly equivalent functionality in web-based and
installed versions
⢠Strong support of EPUB 3 rendering, including
Math, video (currently no captions due to Mozilla
dependency), audio, interactivity, and text styling.
Support for media overlays with speed
adjustments
⢠Good control of layout, fonts, and sizing
⢠Multiple built-in contrast settings and accepts
Windows high-contrast
24. iBooks Mac
⢠iBooks Mac: âFeels betaâ
â essentially impossible to use effectively with VO,
lots of unlabeled controls and difficulty getting
into text
â Good EPUB 3 rendering: Basic MathML, video,
audio (but no captions, since depends on native
player
â Highlights, notes, etc.
â Decent text styling
25. iBooks iOS
⢠Can import EPUB 3 via iTunes and most
complete rendering on iOS, including MathML
(MathML is accessible with VoiceOver if
rendered in Safari iOS), video, audio (not
media overlays)
⢠Notes and highlights not available with EPUB 3
sideloaded content, only on iBooks Textbooks
â Note-taking and highlighting probably not as
simple or controlable as on Kindle iOS
26. Google Play
⢠Four killer features:
â Sync of highlights, notes, progress, bookmarks across all platforms
â Import PDF or EPUB and share seamlessly across platforms (no vendor
lock-in or sync restrictions)
â EPUB books get highlighted reading
â Print faithful pagination (and can get some books with photocopy of
original pages (good for archival work))
⢠Weak/no support for EPUB 3: no video, audio, math, overlays, etc.
⢠Good adjustability of control and text + font choices (browser and
player cooperate to give large range of text sizing)
⢠Generally poor screen reader accessibility on all platforms
27. Kindle
⢠KF8 (so, no video, audio, MathML at this point) and
experience vendor lock-in
⢠Very solid accessibility on Android with TalkBack and
probably most VO accessible mainstream reader on iOS
(esp. for highlights and notes)
⢠Kindle Fire HDX has best TalkBack support on an
Android platform, and book reader works better on
HDX than on, say, Nexus 7
⢠Limitations on PC (âKindle for PC with accessibility
plug-inâ) only allows for built-in TTS navigation and
note-taking on a per-page level, with minimal control
of reading granularity
29. Nook Study
⢠No EPUB 3 support
⢠ButâŚ.
â PDF and EPUB books can be sideloaded and both support word-by-
word TTS-synced highlighting playback (Google Play only highlights
with EPUB)
â TTS moves by sentence, with ability to skip and replay (like Kindle for
PC)
â Interface can be set to be fully âtabbableâ
â Book-faithful pagination
â 6 font choices and multiple layout and contrast options
â Killer feature: Dual-book view
â Solid note-taking, highlighting, searching, etc.
⢠Screen reader will conflict with built in TTS
⢠No SR access to book text
33. VitalSource (PC)
⢠Supports most of EPUB 3 and makes that contents
screen reader and keyboard only accessible
⢠Uses IEâs video player for captioned, multi-lingual
subtitled video (only rendering TTML currently (bug in
IE 11?)
⢠Renders MathML and can use MathPlayer (if your
version of IE supports MathPlayer, that is)
⢠Adopts Windows High-Contrast settings
⢠Can sideload EPUB 3
⢠TTS read-aloud and SR accessible highlighting and
note-taking (only with VS books)
34. Readium
⢠EPUB 3 reference implementation: video &
audio, MathML (via MathJax), media overlays,
layouts, styling, interactivity, SVG, pages, etc.
⢠No screen reader access, even with
ChromeVox
35. Whither E-Book Readers?
Readium JS (for browser implementations)
Readium SDK (for native app implementations)
A bright future, so long as vendors fully consider
accessibility (like VitalSource is doing)