Living Room of the Future workshop for the xR Madrid fest 2019 This workshop will be given by Ian Forrester , producer for the R & D area of ​​the BBC. It will offer an overview of the future of immersive technologies and how they will allow greater interaction with their users. Through the project ' Perceptive podcast Project' , Forrester will explain how the internet of things will revolutionize both the content and the services of an international company such as BBC. It will explain to us how these perceptual technologies analyze in real time through sensors and user data the reaction to content and how they coexist with the necessary protection of each other's privacy. It will also detail the research on the ' Living Room of the Future ' project, to understand the impact that the living room of the future can have with its hyper-personalized contents and its multisensory surfaces from the wall to the dining room table. https://espacio.fundaciontelefonica.com/evento/xr-fest-taller-como-impactar-a-tu-audiencia/?ide=65988

1. xR fest: Audiences of the future
Ian Forrester
Senior Firestarter, BBC R&D
@cubicgarden
@cubicgarden | https://twitter.com/bit_LAV/status/1141258445418565633

2. Rethinking storytelling in the internet age
@cubicgarden | http://www.nehrlich.com/blog/2008/07/04/living-in-the-future/

3. New media experiences
http://www.flickr.com/photos/feuilllu/302001867/@cubicgarden

4. @cubicgarden
Living Room of The Future

6. The Living Room of the Future
...Is an environment that is both driven by
and adapts to personal data
@cubicgarden

7. How does it work?
It uses various IOT objects in the living room, ethically using
personal data to personalise the media experience surrounding the
people
@cubicgarden

8. How it works
OBM
Adaptive
media
HDI
databox
IOT
Physical
devices
@cubicgarden

12. Why the living room?
It’s a connected and shared environment
Sensitive and private area
Existing social hierarchies
Small audience (personalisation within small groups)
@cubicgarden

13. @cubicgarden

15. Journey to Sarajevo
@cubicgarden

16. Support from FACT
@cubicgarden | FACT’s film talent development programme

17. Support from the British Council
@cubicgarden | https://www.flickr.com/photos/37996583811@N01/29758741765/ | https://www.slideshare.net/cubicgarden/perceptive-media-ethics-dreams-hyper-reality

18. Partners & collaborators
@cubicgarden
● Foundation for Art and Creative Technology (FACT)
● Mixed Reality Lab Nottingham University (Databox)
● Imagination Lancaster University (IOT)
● University of York’s Digital Creativity Labs (DC labs)
● British Council’s PlayUK programme
● University of York (Cutting room tool)

19. Sarajevo unlimited workshop
@cubicgarden

20. Sarajevo unlimited workshop
@cubicgarden

21. West balkans residents
@cubicgarden | Mladen Rakonjac & Ilija Tiricovski

22. Working in Liverpool, UK
@cubicgarden

23. How is it created?
OBM
Adaptive
media
HDI
databox
IOT
Physical
devices
@cubicgarden | http://www.databoxproject.uk/

24. OBM
Adaptive
media
Object based media?
@cubicgarden

25. Object based media
@cubicgarden | https://www.flickr.com/photos/nickpiggott/5212959770

26. Media + Metadata = Objects
The idea behind ‘object-based’ media is that you take all the
assets for a given TV or radio show – the video clips, the
accompanying audio, any music soundtrack, and extras like
subtitles and sign language translations
wrap it up in useful metadata and then use software to ‘remix’
it as needed
@cubicgarden | https://www.flickr.com/photos/nickpiggott/5212959770

27. Media
@cubicgarden

28. Metadata
@cubicgarden

29. The objects make the story
@cubicgarden

30. Let’s talk about storytelling
@cubicgarden

31. The future of storytelling
@cubicgarden | https://commons.wikimedia.org/wiki/File:Salvatore_Postiglione_Motiv_aus_dem_Decamerone.jpg

32. Storytelling timeline
@cubicgarden | http://www.flickr.com/photos/feuilllu/302001867/

33. Oral storytelling
@cubicgarden | http://www.flickr.com/photos/smcgee/234278571

34. Immersive, engaging, participatory & adaptive
@cubicgarden | https://www.flickr.com/photos/140034174@N05/26077478920

35. Storytelling with variables
@cubicgarden

36. Context, location, environment...
@cubicgarden | https://www.flickr.com/photos/haaijk/14196995087

37. Context is king
@cubicgarden

38. Perceptive Radio
@cubicgarden | https://www.bbc.co.uk/rd/projects/perceptive-radio

39. Processing at the edge
@cubicgarden

40. Sensors everywhere
@cubicgarden

41. Narrative on Rails
@cubicgarden | http://www.flickr.com/photos/ag2r/4437697015

42. Reinventing podcasting
@cubicgarden | https://www.flickr.com/photos/giuseppemilo/14525042460

43. Perceptive podcasting
@cubicgarden | https://www.bbc.co.uk/rd/projects/perceptive-radio

44. Reference specification & implementation
@cubicgarden | https://www.bbc.co.uk/rd/projects/perceptive-radio

45. Android app *beta
https://tinyurl.com/perceptivepodcast
@cubicgarden

46. Entering your podcast feed
@cubicgarden

47. Questions?

48. What other podcasts could be created?
@cubicgarden
Spend 5 mins in groups of 2 or 3, discussing what great
experiences could be created
Think about the remixing the audio objects based on implicit
data from a smartphone
We will feedback afterwards...

49. Crafting storyworlds which stories sit in
@cubicgarden

50. Engaging
@cubicgarden | https://www.punchdrunk.org.uk/sleep-no-more

51. Adaptive
@cubicgarden | https://www.punchdrunk.org.uk/sleep-no-more

52. Participatory
@cubicgarden | https://www.londontheatre.co.uk/theatre-news/news/immersive-zombie-experience-variant-31-to-have-world-premiere-in-the-west-end

53. Immersive
@cubicgarden | https://www.vice.com/en_us/article/ywm8gk/dr-edson-burton-afrofuturist-immersive-theater-lost-astronaut

54. Alternative reality gaming

55. Extended reality experiences
@cubicgarden | https://www.atlasobscura.com/articles/alternate-reality-games-could-still-take-over-the-world-and-your-life
Also known as unfiction, transmedia storytelling, extended
experiences, chaotic fiction, pervasive gaming, immersive
fiction, beasting, etc...

56. Extended reality experiences
@cubicgarden | https://en.wikipedia.org/wiki/Masquerade_(book)
Searchers often dug up public and private
property acting on hunches
The solution to the Masquerade puzzle is
elaborate: in each painting, lines should be
drawn from each animal's eyes through
their longest digits to a letter in the border

57. Extended reality experiences
@cubicgarden | http://news.bbc.co.uk/1/hi/sci/tech/1274487.stm | http://www.imdb.com/name/nm0972095/
Jeanine Salla is a fictional character
who was created as part of a
marketing scheme for the film
"Artificial Intelligence". Jeanine Salla
was a name placed in countless
clues in film posters, websites,
previews, and commercials. Starting
from her name, people were drawn
into a highly complex interactive
"game" that involved websites,
phone calls, emails, faxes, and
teams of "players" working around
the world to solve the clues

58. The death of alternative reality gaming
@cubicgarden | http://www.slideshare.net/picnicfestival/everything-we-know-transmedia-wrong-by-dan-hon
No More…
Viewing source code, “De-stegging”, Waiting,
Codebreaking, More codebreaking, Esoteric
knowledge, Viewing more source code, Solving
stupid puzzles, More waiting, Not telling me
what to do, “This is not a f***ing game”, Lazy
calls to action, Helping a teenage girl, Helping
an attractive teenage girl, Helping an attractive
amnesiac teenage girl, Treasure hunts, Millions
of blog entries, Jumping through f***ing hoops
and finally Masturbatory platform excitement

59. Storyboarding in Liverpool
@cubicgarden

60. Human Data Interaction?
@cubicgarden

61. Human data interaction
@cubicgarden
HDI
databox

62. More than an experience
@cubicgarden | https://www.bbc.co.uk/rd/projects/human-data-interaction | https://www.bbc.co.uk/rd/projects/databox
● Future data driven media experience
● Research probe for social adaptive experiences
○ Trusted data platform
■ Separation of Concerns
● Exploring attitudes
○ Human Data Interaction (HDI)
○ Shared data experience
○ Trusted platform

63. Databox
Databox has its origins in an emerging school of thought
called ‘Human Data Interaction’ which sees personal data
as an object in its own right rather than a by-product of our
mundane interactions with third parties, systems and
services
@cubicgarden | https://www.databoxproject.uk/about/

64. Databox project
@cubicgarden | https://www.youtube.com/watch?v=hJQiIrkJniU

65. Human Data Interaction
@cubicgarden | https://sachi.cs.st-andrews.ac.uk/research/interaction/human-data-interaction/

66. Trust is vital
Trust is the foundation of the BBC:
we are independent, impartial and honest
@cubicgarden | https://www.flickr.com/photos/noodlepie/7256071790

67. Data, ethical & social degradation
@cubicgarden | https://www.flickr.com/photos/theknowlesgallery/5504383766

68. Graceful degradation is a must
@cubicgarden | https://www.themoviedb.org/movie/2649-the-game/images/backdrops

69. Personalised media
@cubicgarden | http://www.dailymail.co.uk/sciencetech/article-3350076/BBC-experimenting-smart-shows-adapt-personality-male-female.html

70. Shared social experiences

71. Learning opportunities
@cubicgarden | https://www.youtube.com/watch?v=2RlGXcueDss

72. Ethics of personal data videos
@cubicgarden | https://www.youtube.com/watch?v=naaDBNSx610&list=PLq2q3WUhlO_yyt8A0PUTOChCgyEoOqhfM

73. Showing what’s really happening with data
@cubicgarden

74. @cubicgarden | https://www.flickr.com/photos/cjc/3140642627
Learn how people understand personal data
Opportunity to educate
Deliver transparency

75. Understand new models for data negotiation
Moving away from binary options
More freedom to users
@cubicgarden | https://www.flickr.com/photos/dodnewsfeatures/28742900754

76. Making data visual, understandable & actionable
@cubicgarden

77. Using an ethical design approach
@cubicgarden | https://www.bbc.co.uk/rd/blog/2017-11-sarajevo-unlimited-workshop
Guided by key questions:
○ How to communicate a change in the environment?
○ How to communicate the data driving this change?

78. @cubicgarden | https://www.bbc.co.uk/rd/blog/2017-11-sarajevo-unlimited-workshop
HDI elements

79. Early storyboard
@cubicgarden

80. Internet of things
@cubicgarden
IOT
Physical
devices

81. @cubicgarden | https://www.nytimes.com/2018/10/23/business/media/fever-advertisements-medicine-clorox.html
Internet of sh*t

82. Good use of the Internet of Things?
@cubicgarden

83. @cubicgarden
What IOT objects?

84. @cubicgarden
Feedback from the room

85. Offering transparency
@cubicgarden

86. In a data receipt
@cubicgarden

87. Everything together
OBM
Adaptive
media
HDI
databox
IOT
Physical
devices
@cubicgarden | http://www.databoxproject.uk/

88. Living room complete storyboard
@cubicgarden

89. The future living room
@cubicgarden

90. https://twitter.com/carolinemeaby/status/982481189779988480

91. Feedback

92. Initial feedbackInitial feedback

93. @cubicgarden | https://www.youtube.com/watch?v=yneprnGCRm0

94. What we found
@cubicgarden

95. A “magical” experience
@cubicgarden
...Immersive, engaging, nostalgic
Self-reflection. Eg., Quantified Self
Kitchen. Eg., CAKE that helps with cooking

96. Concerns over privacy
@cubicgarden
….“Scary”, “Creepy”, “Being watched”
Sensitivity in the Context of the Home
Data Sharing with Third Parties
“Organisations pushing in”
Lack of Transparency
“Suddenly the couch became suspicious”.

97. Agency Concerns
@cubicgarden
….“Maybe if it was more controlled by the user
itself instead of, like, someone else having
control over it [P36] ”
Need for Negotiability
Binary to Granular Choices
Need for Active and Informed Data Control
Provision of Freedom. Eg., Filter Bubbles
Autonomy over ones life

98. Trust
@cubicgarden
….Privacy + Agency Concerns = Loss of Trust
Lack of Control and Transparency
Loss of Trust in Personalised Services
Risks : Hacking/ Unethical data use

99. @cubicgarden
Ian Forrester
@cubicgarden
ian.forrester@bbc.co.uk
Questions?

100. What’s in your living room of the future?

101. Living room of the future workshops
@cubicgarden

102. Living room of the future workshops
@cubicgarden

103. Think about the narrative
Think about the group experience
Think about what people would learn
Split into groups, spend 15 minutes deciding then feedback
What’s in your living room of the future?
@cubicgarden

104. Living room of the future
Ian Forrester
@cubicgarden
@cubicgarden