SlideShare ist ein Scribd-Unternehmen logo
1 von 21
Creating Accessible
Research Papers
Erin Brady1,2,4, Yu Zhong1,2,3, and Jeffrey P. Bigham1
Carnegie Mellon University, University of Rochester, Google, IUPUI
Research is Disseminated as PDFs
Research is Disseminated as PDFs
Video by NCSU IT Accessibility, available at https://www.youtube.com/watch?v=GaNwnsT4B5s
Without Tags Reading Can Be Confusing
What is the state of accessibility for
conference PDFs?
Automated check of all papers from 2011-2014: 1,811 papers
Manual checks on ASSETS, W4A papers from 2014: 26 papers
Automated Checks
More documents with tags
0
10
20
30
40
50
60
70
80
90
100
2011 2012 2013 2014
Percent of Documents with Tags, 2011 - 2014
0
10
20
30
40
50
60
70
80
90
100
2011 2012 2013 2014
Percent of Documents with Heading Tags, 2011 - 2014
Automated Checks
More documents with heading tags
0
10
20
30
40
50
60
70
80
90
100
2011 2012 2013 2014
Percent of Documents with Language Specified, 2011-2014
Automated Checks
More documents with the language specified
Automated Checks
• Automated checks show improvement
– drops may be due to expanding community,
prevalence of Mac Word
– W4A now requires accessible PDFs
• However, automated checks are measuring
metadata presence, not correctness
Manual Checks: Room to Improve
26 papers in 2014 (ASSETS, W4A technical track)
• 62% passed Acrobat’s full accessibility check
Manual Checks: Room to Improve
26 papers in 2014 (ASSETS, W4A technical track)
• 62% passed Acrobat’s full accessibility check
• Also examined specific metrics:
– 73% had alt-text for all images
– 85% had tab order specified
– 11.5% had title tagged as a H1
• Tagged 25 papers for other authors
• Process could be done by non-author
– structural tags, image and figure descriptions
• Time costs were mostly front-loaded
Making CHI 2015 Accessible
Making PDFs of research accessible
is important,
but expensive and difficult.
http://chi2015.acm.org/authors/guide
-to-an-accessible-submission/
Financial Cost of PDF Accessibility
103 pages 160 pages 800+ pages
Time-Intensive to Learn
Time-Intensive and Confusing to Verify
Tagged as text
Tagged as H1
Embedding Tagged Fonts
Open Preflight1 2 Run “Embed fonts (even if text is invisible)”
3 Preflight lists unembedded fonts
4 Locate each instance of an unembedded font 5 Delete artifact
Hard to Master
Discussion
• Automated measures are improving
• Papers are not fully accessible
• How can we keep improving?
– Better tools
– Alternative Doc formats
– Include in publication process
Creating Accessible PDFs for
Conference Proceedings
Erin Brady (University of Rochester/IUPUI)
Yu Zhong (University of Rochester/Google)
Jeffrey P. Bigham (Carnegie Mellon University)

Weitere ähnliche Inhalte

Ähnlich wie Creating Accessible Research Papers

Cloud-based research collaboration with Paperpile
Cloud-based research collaboration with PaperpileCloud-based research collaboration with Paperpile
Cloud-based research collaboration with PaperpilePaperpile
 
Collaboration to enhance digital accessibility
Collaboration to enhance digital accessibility Collaboration to enhance digital accessibility
Collaboration to enhance digital accessibility E.A. Draffan
 
Digital Tools - What's out there?
Digital Tools - What's out there?Digital Tools - What's out there?
Digital Tools - What's out there?Yum Studio
 
Co-op Presentation Fall_Winter_2014 FINAL VERSION
Co-op Presentation Fall_Winter_2014 FINAL VERSIONCo-op Presentation Fall_Winter_2014 FINAL VERSION
Co-op Presentation Fall_Winter_2014 FINAL VERSIONJoyce Lu
 
Philippe Langlais - 2017 - Users and Data: The Two Neglected Children of Bili...
Philippe Langlais - 2017 - Users and Data: The Two Neglected Children of Bili...Philippe Langlais - 2017 - Users and Data: The Two Neglected Children of Bili...
Philippe Langlais - 2017 - Users and Data: The Two Neglected Children of Bili...Association for Computational Linguistics
 
Bringing Consistency to Digital Resource Evaluation
Bringing Consistency to Digital Resource EvaluationBringing Consistency to Digital Resource Evaluation
Bringing Consistency to Digital Resource EvaluationPaula Weaver
 
Presentation to 2014 University of Guelph Accessibility Conference Perspectiv...
Presentation to 2014 University of Guelph Accessibility Conference Perspectiv...Presentation to 2014 University of Guelph Accessibility Conference Perspectiv...
Presentation to 2014 University of Guelph Accessibility Conference Perspectiv...Shawna Reibling
 
OALT- Create.Collaborate.Communicate
OALT- Create.Collaborate.CommunicateOALT- Create.Collaborate.Communicate
OALT- Create.Collaborate.CommunicateKathy Hicks
 
James, Robertson & Bell - Why, why, why DELILA? A project to promote the open...
James, Robertson & Bell - Why, why, why DELILA? A project to promote the open...James, Robertson & Bell - Why, why, why DELILA? A project to promote the open...
James, Robertson & Bell - Why, why, why DELILA? A project to promote the open...IL Group (CILIP Information Literacy Group)
 
Leveraging Academic Networks for Promotion and Tenure
Leveraging Academic Networks for Promotion and Tenure Leveraging Academic Networks for Promotion and Tenure
Leveraging Academic Networks for Promotion and Tenure Linda Galloway
 
Supporting PDF accessibility evaluation: Early results from the FixRep project
 Supporting PDF accessibility evaluation: Early results from the FixRep project Supporting PDF accessibility evaluation: Early results from the FixRep project
Supporting PDF accessibility evaluation: Early results from the FixRep projectUKOLN (dev), University of Bath
 
Legal Update: Understanding the Latest Findings on Access to Online Learnin...
Legal Update: Understanding the Latest Findings on Access to Online Learnin...Legal Update: Understanding the Latest Findings on Access to Online Learnin...
Legal Update: Understanding the Latest Findings on Access to Online Learnin...Raymond Rose
 
eBooks for Everyone: Inclusive Publishing
eBooks for Everyone: Inclusive PublishingeBooks for Everyone: Inclusive Publishing
eBooks for Everyone: Inclusive PublishingDAISY Consortium
 
Capture All the URLS: First Steps in Web Archiving
Capture All the URLS: First Steps in Web ArchivingCapture All the URLS: First Steps in Web Archiving
Capture All the URLS: First Steps in Web ArchivingKristen Yarmey
 
E-Assessment ~ Vet Development Centre
E-Assessment ~ Vet Development CentreE-Assessment ~ Vet Development Centre
E-Assessment ~ Vet Development CentreYum Studio
 
Reference management : trends and tricks
Reference management : trends and tricks Reference management : trends and tricks
Reference management : trends and tricks Alison McNab
 

Ähnlich wie Creating Accessible Research Papers (20)

Cloud-based research collaboration with Paperpile
Cloud-based research collaboration with PaperpileCloud-based research collaboration with Paperpile
Cloud-based research collaboration with Paperpile
 
Collaboration to enhance digital accessibility
Collaboration to enhance digital accessibility Collaboration to enhance digital accessibility
Collaboration to enhance digital accessibility
 
Digital Tools - What's out there?
Digital Tools - What's out there?Digital Tools - What's out there?
Digital Tools - What's out there?
 
Eewoww in research 1 2-3 20161127
Eewoww in research 1 2-3 20161127Eewoww in research 1 2-3 20161127
Eewoww in research 1 2-3 20161127
 
Co-op Presentation Fall_Winter_2014 FINAL VERSION
Co-op Presentation Fall_Winter_2014 FINAL VERSIONCo-op Presentation Fall_Winter_2014 FINAL VERSION
Co-op Presentation Fall_Winter_2014 FINAL VERSION
 
Philippe Langlais - 2017 - Users and Data: The Two Neglected Children of Bili...
Philippe Langlais - 2017 - Users and Data: The Two Neglected Children of Bili...Philippe Langlais - 2017 - Users and Data: The Two Neglected Children of Bili...
Philippe Langlais - 2017 - Users and Data: The Two Neglected Children of Bili...
 
Bringing Consistency to Digital Resource Evaluation
Bringing Consistency to Digital Resource EvaluationBringing Consistency to Digital Resource Evaluation
Bringing Consistency to Digital Resource Evaluation
 
Presentation to 2014 University of Guelph Accessibility Conference Perspectiv...
Presentation to 2014 University of Guelph Accessibility Conference Perspectiv...Presentation to 2014 University of Guelph Accessibility Conference Perspectiv...
Presentation to 2014 University of Guelph Accessibility Conference Perspectiv...
 
OALT- Create.Collaborate.Communicate
OALT- Create.Collaborate.CommunicateOALT- Create.Collaborate.Communicate
OALT- Create.Collaborate.Communicate
 
James, Robertson & Bell - Why, why, why DELILA? A project to promote the open...
James, Robertson & Bell - Why, why, why DELILA? A project to promote the open...James, Robertson & Bell - Why, why, why DELILA? A project to promote the open...
James, Robertson & Bell - Why, why, why DELILA? A project to promote the open...
 
Leveraging Academic Networks for Promotion and Tenure
Leveraging Academic Networks for Promotion and Tenure Leveraging Academic Networks for Promotion and Tenure
Leveraging Academic Networks for Promotion and Tenure
 
Supporting PDF accessibility evaluation: Early results from the FixRep project
 Supporting PDF accessibility evaluation: Early results from the FixRep project Supporting PDF accessibility evaluation: Early results from the FixRep project
Supporting PDF accessibility evaluation: Early results from the FixRep project
 
Legal Update: Understanding the Latest Findings on Access to Online Learnin...
Legal Update: Understanding the Latest Findings on Access to Online Learnin...Legal Update: Understanding the Latest Findings on Access to Online Learnin...
Legal Update: Understanding the Latest Findings on Access to Online Learnin...
 
eBooks for Everyone: Inclusive Publishing
eBooks for Everyone: Inclusive PublishingeBooks for Everyone: Inclusive Publishing
eBooks for Everyone: Inclusive Publishing
 
Capture All the URLS: First Steps in Web Archiving
Capture All the URLS: First Steps in Web ArchivingCapture All the URLS: First Steps in Web Archiving
Capture All the URLS: First Steps in Web Archiving
 
QQML presentation
QQML presentationQQML presentation
QQML presentation
 
MOOC.pptx
MOOC.pptxMOOC.pptx
MOOC.pptx
 
E-Assessment ~ Vet Development Centre
E-Assessment ~ Vet Development CentreE-Assessment ~ Vet Development Centre
E-Assessment ~ Vet Development Centre
 
Reference management : trends and tricks
Reference management : trends and tricks Reference management : trends and tricks
Reference management : trends and tricks
 
Designing e-Learning Objects
Designing e-Learning ObjectsDesigning e-Learning Objects
Designing e-Learning Objects
 

Creating Accessible Research Papers

Hinweis der Redaktion

  1. Our research is disseminated as PDFs. This is what appears on the ACM digital library, and it’s what appears on our web pages. People with disabilities are under-represented in science. Papers that cannot be easily assessed and used by people with disabilities cannot be helping.
  2. But, perhaps this is okay, because you can make a PDF accessible by adding structural tags and metadata to a PDF document. While screenreaders can make basic automatic assumptions about how to read a document, it cannot generate information like alternative text for images or figures, and often is incorrect.
  3. This is a video created by NCSU’s accessibility team, which shows how a screenreader reads an untagged two-column document. The visual reading order for the text is [read paragraphs], but due to the two-column format, the screenreader reads each line as a whole, rather than reading each column separately.
  4. In order to see how to improve accessibility of conferences, we first wanted to check how accessible current conference proceedings are. We examined the proceedings of three conferences - CHI, W4A, and ASSETS – from 2011 to 2014, looking at a total of 1,811 papers. We chose these conferences specifically – CHI gave us access to a large amount of data, with close to 400 papers per year, while the communities of W4A and ASSETS are focused around accessibility, and may be more representative of what accessible conference proceedings could look like when information is generated by the authors.
  5. We ran both automated and manual checks. The automated checks mostly revealed improvements, with more documents being tagged
  6. We ran both automated and manual checks. The automated checks mostly revealed improvements, with more documents being tagged
  7. We ran both automated and manual checks. The automated checks mostly revealed improvements, with more documents being tagged
  8. We also performed manual accessibility checks on the 26 papers from ASSETS 2014 and the W4A technical track in 2014. We ran a full accessibility check in Adobe Acrobat, which 62% of papers passed; this check is usually the first indicator that things are accessible, and for papers that were not
  9. We then checked for certain indicators of accessibility – alternative text on all images, tab order specified, and correct use of tags. Alt-text and tab order, two common things mentioned in ACM accessibility guides, were relatively well covered, having more compliance than papers that passed the full check. However, things like structural tags were much less predictable – for example, only 12% of papers had their headings tagged as an H1. There’s clearly room to improve on these types of manual accessibility tags.
  10. In order to explore this in practice, we began an effort to improve the accessibility of CHI 2015. We allowed authors to send camera-ready papers to us, which we tagged to make more accessible. We tagged 25 papers, and while we did not record any metadata about the papers to analyze, we can reflect on the experience here. For the most part, the process of tagging could be done by a non-author of the paper – structural tags are clear from the ACM format, and image and figure descriptions were (for the most part) easy to generate, sometimes requiring a little reading through the text of the paper. The biggest time cost was the process of learning the intricacies of Acrobat in order to tag the documents well.
  11. So while we want to make sure our conference proceedings are accessible, we know it’s a resource-intensive process and that many people may struggle to tag their documents correctly.
  12. First is the financial cost – it’s easiest to add additional metadata to a PDF using Adobe Acrobat, which is a relatively expensive piece of software for an individual. While Microsoft Word users can add metadata before exporting their documents to PDFs, this option is not available for LaTeX or other authoring tools, and there’s no way to verify or edit the accessibility tags without Acrobat.
  13. PDF accessibility can also result in time costs. It takes a long time to learn how to make PDFs accessible – there are long online guides, and many 100+ page books exist to try to teach the principles of accessible PDFs.
  14. It’s also time-intensive to verify that a document is accessible, since automated checkers can only catch simple errors (e.g., an image has no alternative text) but cannot verify the correctness of tags or metadata.
  15. It’s also hard to master these skills – even for this paper on PDF accessibility, we didn’t get the tagging completely correct, and had to do some last-minute corrections.