The document discusses research on augmenting paper with audio and other digital media. It describes past work augmenting photographs with audio ("audiophotography") and prototypes developed in the 1990s-2000s. More recent work involved augmenting newspaper articles with audio annotations and interactive elements. The researcher's vision is to develop "webpaper" that connects paper to supplemental digital web content through touch-sensitive paper interfaces. Current and future work aims to support both optical and electronic paper technologies in a common framework and apply this to travel guidebooks. The role of audio is to add narrative, context and interactivity to printed materials.
4. www.surrey.ac.uk/dwrc/
Technology: Augmented paper
Electronic paper (e-books) versus Augmented paper
DIGITAL PAPER-AND-DIGITAL
“While the electronic paper approach aims to make existing devices as
paper-like as possible, the augmented or interactive paper approach
focuses on augmenting regular paper by linking it to supplemental digital
information”. (Signer & Norrie 2010 Interactive paper: Past, present and
future. UbiComp ‘10)
7. www.surrey.ac.uk/dwrc/
Research questions for this talk
1. What is the role of augmenting paper with audio?
2. How can we combine the best of print and web media more
generally?
www.surrey.ac.uk/dwrc/
17. www.surrey.ac.uk/dwrc/
Feedback from audiophoto trials
(Frohlich & Tallyn 1999, Frohlich 2004)
• All participants liked both screen and paper ‘playback’ .. for
different purposes. People still like tangible prints.
• The audioscanner was seen as personal, intimate and
accessible to older users
• The audioprint player was seen as a vehicle for playback of
sounds but also recording voice messages on photos
• The audioprint album was seen as too heavy to carry and more
suitable for special event collections and gifts.
• The audio cards were prefered to audio frames especially for
sending to others
20. www.surrey.ac.uk/dwrc/
Feedback from an
audiophoto desk trial (Lindley & Monk 2004)
• Sound adds humour to the interaction especially when it doesn’t
match the image
• Mixing sounds and images on the desk
made the interaction more engaging
• Sound affects the conversation around
photographs
• Music was left playing in the background
for atmosphere and mood
• Ambient sounds became a talking point
in their own right
• Voiceover inhibits conversation
• Sound adds humour to the interaction especially when it doesn’t
match the image
• Mixing sounds and images on the desk
made the interaction more engaging
• Sound affects the conversation around
photographs
• Music was left playing in the background
for atmosphere and mood
• Ambient sounds became a talking point
in their own right
• Voiceover inhibits conversation
28. www.surrey.ac.uk/dwrc/
Feedback from interactive
newsprint experiment (Frohlich et al 2017)
• Responses varied depended on users’ existing news reading
habits (paper v screen)
• There were perceived values of audio in providing extra
information, local commentary in a regional ‘voice’, and access
to original interviews and other evidence for the stories
• Users would often read and listen out of synch, to consume the
material faster ( a ‘radio-newspaper’)
• Print formats with interactive ’extras’ were seen as most
attractive. Extras should give free added value.
• Some users wanted the printed paper to be more pictorial with
textual content moving to speech
32. www.surrey.ac.uk/dwrc/
Objectives: To generalise
audiopaper to ‘webpaper’
1. To connect complementary print and web media through touch
2. To support audio and visual playback of associated web media
on a variety of devices. Make paper interact with the devices
around it.
3. To develop and integrate two big classes of augmented paper in
a common architectural framework (c.f. 1G passive paper)
1. 2G optically recognised paper
2. 3G touch sensitive paper
4. To create and test compelling demonstrations for BOOKS in the
travel and tourism domain
5. To research and develop new business models www.surrey.ac.uk/dwrc/
36. www.surrey.ac.uk/dwrc/
Answers to research questions
What is the role of augmenting paper with audio?
• Mixed up with augmenting text and image with audio (on e-
books)
• Audio annotation can have all kinds of values from adding
atmosphere, emotion, triggering memory, storytelling and
elaboration.
• In a news context audio can add extra information with a
regional voice, and provide access to source interviews
• Audiopaper is interactively intuitive because you read printed
material as usual, whilst listening to sounds
• It is seen as tangible, sharable, accessible, novel and
attractive, and complements other forms of screen-based
playback
37. www.surrey.ac.uk/dwrc/
Answers to research questions
How can we combine the best of print and web media more
generally?
• Generalising ‘audiopaper’ to ‘webpaper’ leads to a vision of
paper interacting with audiovisual content on a variety of
devices nearby
• Two types of technology need to be supported in a common
framework: optical (2G) and printed electronic (3G)
• Eventually links could be two-way allowing web material to be
printed with working hotlinks, or apps with paper interfaces
39. www.surrey.ac.uk/dwrc/
References
www.surrey.ac.uk/dwrc/
Frohlich, D.M. (2004) Audiophotography: Bringing photos to life with sounds. Kluwer Academic
Publishers.
Frohlich, D.M. (2015) Fast design, slow innovation: Audiophotography ten years on. Springer.
Frohlich, D.M. & Tallyn E. (1999) Audiophotography: Practice and prospects. CHI ’99 Extended
Abstracts: 296-297. New York, ACM Press.
Frohlich D.M., Clancy T., Robinson J. & Costanzo E. (2004) The audiophoto desk. Proceedings of
2AD: Second International Conference on Appliance Design (p139).
Frohlich, D.M. et al (2017) Designing interactive newsprint. International Journal of Human
Computer Studies 104:36-49.
Lindley, S. E., & Monk, A. F. (2005). Augmenting photographs with sound for collocated sharing.
In Home-Oriented Informatics and Telematics (pp. 155-170). Springer US.
Signer & Norrie 2010 Interactive paper: Past, present and future. UbiComp ‘10