How the new interfaces are demanding us to think outside the screen and consider both the digital and the physical spaces. How is this more than user context? How to apply Design principles to the physical world? Are we ready for that?

1. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

2. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
AI, VR, AR, MR…
The digital industry is obsessed with experiences,
predictions, and also fear.

3. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
We are NOT sure of what’s coming
But there’s lots of new start-ups, devices & apps

4. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
That fear reminds me of Dolly
It seemed sci-fi, we really didn’t know what to think
This was just a sheep, but she was in human
territory

5. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
So this is not about VR, AR or anything like that
It’s about change
How it brings such uncertainty that some tend to
celebrate, others fear, others ignore

6. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
Technology is not neutral
Change is at our doorstep
Artificial Intelligence is not one thing
Artificial Intelligence is not the best name yet
Can we build a human-like computer?
Machines find the nuggets of info that humans can’t
Machines are one-trick ponies
And most designers are already in the loop
How can we tell?
A deep insight is still something very human

7. Technology is not neutral
It can profoundly change the way we live
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

8. Predictions tend to
extremes: when the
electric bulb came,
some people said
that is was a golden
new era without
crime and more
reading, others said
it there would be
more work
exploitation, since
factories would
labor day and night.

9. Change is at our doorstep
And it’s not just about carrying powerful devices in our pockets
That was yesterday’s news
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

10. Artificial Intelligence
is now out of the
incubator and into
our living rooms.
Roomba, a now
common vacuuming
robot knows when
to work, calls for
help only when it’s
stuck and returns to
the base when it’s
done.

11. Artificial Intelligence is not one thing
It comprises machine and deep learning, image and speech
recognition, natural language processing, predictive analytics…
More than that, companies cook a mix of these tools to solve a
specific problem at hand
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

12. Artificial Intelligence is not the best name yet
It is a spooky term, and it reminds us of Terminator
The term suggests that machines can think, something
inherently human
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
Oscar Schwartz:
Can a computer
write poetry?
TED Talk | ted.com

13. Can we build a human-like computer?
We should not be asking if we can build it, but
“what kind of human do we want reflected to us?”
Oscar Schwartz:
Can a computer
write poetry?
TED Talk | ted.com
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

14. Machines find the nuggets of info that humans can’t
They recognize patterns in data,
and then predict similar patterns in new data
This is called machine learning
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

15. Netflix studied 25
shows in 16
countries to
understand after
which episodes
viewers were more
likely to be hooked.
They disclosed a list
of those episodes,
but not their
findings on what
makes a “hook
episode”.

16. Machines are one-trick ponies
They are doing tasks once reserved for humans, but they’re
essentially doing the things we build them to do.
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

17. And most designers are already in the loop
You most likely have already designed for products with some
form of artificial intelligence (navigational apps or
context-intelligent chatbots for instance)
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

18. How can we tell?
“We, designers, have been creating user flowcharts, if-this-then-that
scripts, and templates for dynamic information to populate. We design
ways for users to indicate explicitly if they like or dislike something and
ways for the computer to understand implicitly what users are
interested in.”
Elaine Lee:
You Can Be an AI
Designer
Medium Post |
uxdesign.cc
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

19. AI has been
revealed as the
secret sauce to
many brands:
Amazon, Spotify &
Netflix
recommendations;
Facebook’s image
recognition; voice
assistants like Siri,
or Google Home,
keeping waiting
times short in Uber
and more.

20. And one of these
days, maybe Alexa
gets off the script.

21. A deep insight is still something very human
We’re sometimes bad at predictions, like with the electric light,
but we’re good in bringing a different view, context and meaning
into our customer’s challenges
And then empathy
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

22. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
Where is the new interface?
How did we get here?
People seek experiences, not technology
The process shifts intrinsically
One thing is the environment, another is the interface
The environment facilitates a personal experience
The interface must find a balance between the old and the
new

23. Where is the new interface?
The needs of our users is moving target
VR and AR and MR are bringing massive shifts to human-computer
interactions
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

24. A week after the
release Pokémon
Go, around 65
million people were
playing it. This is a
strong statement
about how humans
are interacting with
machines.

25. How did we get here?
Usability: reducing friction between the user and the technology
UX: designing for users and trying to inspire a sense of delight
Experience Design: “tipping over to the experience side of UX”
Chad Calease:
VR, AR and MR -
Designing the New
Reality Experience
InVision Blog |
invisionapp.com
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

26. Getting the UX right
is not going to be
enough. New
platforms are not
being used in the
traditional sense
anymore. Fitbit’s
SmartTrack
recognizes and
records our
exercises for us
without ever having
to push a button.

27. People seek experiences, not technology
Designers must shift focus this way
But what is the skillset for that?
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

28. Designers need a
sixth sense into
human sensibilities.
Not just being able
to listen to what
people want, need
and fear, but being
able to
communicate with
them.

29. Empathy plays a big
part. Those gifted
with it and with
social insight will be
one step ahead.

30. The process shifts intrinsically
As the experience unfolds, the user decides if he stays or goes
But immersive formats are slower, users need to adjust
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

31. Designers must find
a set of new best
practices, set
around new ways to
interact with
technology. Ideally,
users step into
these worlds so
naturally as a
toddler using an
iPad.

32. One thing is the environment, another is the interface
The environment is making our body to enter the app
The interface is 100% relevant to the user’s spatial relationship
to the environment
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

33. The environment facilitates a personal experience
Immersive experiences are non-linear and non-narrative
The creator has to give up the control
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

34. The interface must find the balance between the old and
the new
Print design is more relevant again
Organize the screen according to the targets
Mockups are still a must have
Feedback is everything
Reuse patterns from other platforms, so that the interface
balances the weirdness of the environment
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

35. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
Robots cannot replace humans, not completely
Data will allow designers to do better research
Tools will allow designers to do better work
The right formula merges AI with UX
But there are big challenges ahead
The designer’s answer is still the same
Wrapping up

36. Robots cannot replace humans, not completely
From designers, AI can expect the anticipation of the weirdness
and ambiguity that can arise from the systems
From AI, designers can expect new tools and fruitful collaboration
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

37. Meet TheGrid.io, a
design platform
based on an
algorithm. It is built
around the concept
of continuous A/B
testing.

38. Data will allow designers to do better research
Predictive analysis will help them understand users and mapped
them according to their behavior
Data will be the foundation for personas, journey mapping and
other research activities
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

39. Tools will allow designers to do better work
Repetitive and lower-value creative tasks will be handled by the tools
Fresh options will be served, and the designer will make the decisions
Critical or strategic decisions are still human territory
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

40. Netflix generates
layouts through an
algorithm.
Designers map out
the visual guidelines
and provide the raw
graphic elements,
the system is then
capable of
combining the 2.

41. The right formula merges AI with UX
Designers need to supply the system with additional info like
business rules or questions and this will change the way it
analyses data
Merging AI with UX can result in infusing intelligence to both
processes
Machines can be our new apprentices
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

42. But there are big challenges ahead
What to do with so much data?
How to address user frustration in interaction?
How to design for experiences that far from being seamless?
How to prevent biases coming from the machines?
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

43. The designer’s answer is still the same
“UX research at an unprecedented scale”
Sheena Lyonnais:
The Rise of Artificial
Intelligence
Adobe Blog |
adobe.com
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

44. Wrapping Up 1
We always wanted to design technology as an extension of human
capabilities: get things done and be as transparent as possible in the
process
We were never this close to achieving it
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

45. Wrapping Up 2
We know for a while that computing is a changing and ubiquitous
concept, and that we would soon be beyond desktop; and would take
place without keyboards, mice or monitors
We were never so far beyond
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

46. Wrapping Up 3
We start to notice that embodied interaction involves our body with
technology in a way that traditional screens don’t, putting the action in
the real world
We were never so physical about it
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

47. Wrapping Up 4
We always wanted to be free from the repetitive work, and have more
time to research and to create
We were never this free to do it
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

48. Wrapping Up 5
We suck at predictions, we will be fine
OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

49. CALL JANE
Remember? This was the road to high school
The house of your
best friend Jane

50. Remember? This was the road to high school
The house of your
best friend Jane
CALL JANE
And what about your endless
conversations about Dolly, the
sheep?
GOOGLE “DOLLY THE SHEEP”

51. thank you
SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN

52. find me on LinkedIn and Medium
find these slides on SlideShare
SÍLVIA OTTO SEQUEIRA
UX BEYOND THE SCREEN