Keynote for World IA Day, answering the question "When, Where and How does Understanding occur?" Specifically, this talk discussed (1) interactions (and embodiement) (2) how new technology is changing the "information environments" we design for, and (3) a bit about perceptions and cognition.
6. What is the purpose of a map?
Navigation
Orientation
Discovery
DeïŹnition
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
-paths and core
-iPhone navigation example
8. âŠor this map?
By studying the similarities and diïŹerences between human genes and those of other
organisms, researchers can discover the functions of particular genes and identify
which genes are critical for life.
11. What is the purpose of a map?
Navigation
Orientation
Discovery
DeïŹnition
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
-paths and core
-iPhone navigation example
12. What is the purpose of a map?
Navigation
Orientation
Discovery
DeïŹnition
Understanding
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
What patterns do I
see? How do things
relate? What can I
infer from this?
-paths and core
-iPhone navigation example
13. DESIGN FOR
UNDERSTANDING
Navigation
Orientation
Discovery
DeïŹnition
Understanding
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
What patterns do I
see? How do things
relate? What can I
infer from this?
-paths and core
-iPhone navigation example
Learning through playful,
visual interactions.
22. âThe approach to teaching without
words that Iâm proposing makes heavy
use of interactivity and instant
informative feedback.â
STMath
http://www.creativitypost.com/education/teaching_without_words
25. from âToward a Deeper Understanding of the Role of Interaction in Information Visualizationâ
26. Name
User Intent
Select
mark something as interesting
Explore
show me something else
Reconfigure
show me a different arrangement
Encode
show me a different
representation
Abstract/Elaborate
show me more or less detail
Filter
show me something
conditionally
Connect
show me related items
from âToward a Deeper Understanding of the Role of Interaction in Information Visualizationâ
28. 3 Basic Interactions:
Conversing
conveying intended actions to a VR through language
(i.e., the mouth and talking).
Manipulating
touching, grasping, or handling visually perceptible
aspectsofaVR(i.e.,thehandsandhandling)
Navigating
moving from one location or piece of information in a
VR to another (i.e., the feet and walking).
from âInteraction and the epistemic potential of digital librariesâ
29. 3 Basic Interactions:
Conversing
conveying intended actions to a VR through language
(i.e., the mouth and talking).
Manipulating
touching, grasping, or handling visually perceptible
13 Task-Based Interactions:
aspectsofaVR(i.e.,thehandsandhandling)
Navigating
Animating
Composing
moving from one initiatingor piece of information in a creating a new VR by putting
location and, optionally,
VR to another (i.e., the feet and walking).
controlling motion in a VR.
together independent visual
elements.
Annotating
placing informative marks, or
Cutting
meta-information, on or around a
removing extraneous elements
VR.
from a VR.
Chunking
grouping independent, but related,
visual elements into a uniïŹed
visual structure.
Cloning
creating an identical copy of a VR,
in whole or in part.
Filtering
exposing, concealing, or
transforming elements of a VR
that possess certain characteristics
or match certain criteria.
Fragmenting
dismantling aVR into its
component parts.
Collecting
gathering visual elements for
future use.
from âInteraction and the epistemic potential of digital librariesâ
Probing
acquiring more detailed
information from a VR.
Rearranging
altering the spatial position and/or
the orientation of a VR, or the
components within it.
Repicturing
displaying a VR in a new or
different way
Searching
looking for, or ascertaining the
position of, speciïŹc features,
elements or structures in a VR.
30. When, Where and How does
Understanding occur?
through interactions
directly with information
that help reveal patterns
Interactions
31. When, Where and How does
Understanding occur?
through interactions
directly with information
that help reveal patterns
Embodied Interactions
41. PRAGMATIC
(Actions performed to bring one physically closer to a goal)
VS
EPISTEMIC ACTIONS
(Actions that use the world to improve cognition)
Thinking, then doing.
Thinking through doing.
from âInteraction and the epistemic potential of digital librariesâ
42. When, Where and How does
Understanding occur?
through interactions
directly with information
that help reveal patterns
Embodied Interactions
43. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Information Environments
that help reveal patterns
57. âThe âpolar bear bookâ as it came to be known helped a
generation of information architects and user experience
designers make sense of the Web through structure,
organization, navigation, and search. Today, much of what
we wrote remains relevant, and yet new questions arise as
the world and the Web intertwingleâŠ
How do we rise to the new challenges of creating paths and
places that bridge physical, digital, and cognitive spaces?â
TOOLS / OBJECTS
âP E T E R M O RV I L L E
!
OTHER
PEOPLE
PHYSICAL
ENVIRONMENTS
(from the foreward to Pervasive Information Architecture)
âthe structural design of information environmentsâ
60. Line between Digital and Physical is blurring
The world is becoming our information environment
61. Line between Digital and Physical is blurring
The world is becoming our information environment
Interactions will be much richer (and complex)
62. Line between Digital and Physical is blurring
The world is becoming our information environment
Interactions will be much richer (and complex)
#EXCITING!!
66. 10 distinct sensory modalities:
1. Visual (seeing)
2. Auditory (hearing)
3. Olfactory (smelling)
4. Gustatory (tasting)
5. Vestibular (sense of balance and body movement)
Everything your brain knows, it knows
because of your body (your senses)
6. Tactile (touching)
7. Thermoreceptive (feeling temperature)
8. Proprioceptive (positioning and movement of the extremities)
9. Introceptive (body condition and organ activity)
10. Nocioceptive (feeling pain)
(from Michael Haverkamp)
76. Dan Rubin
@Dan_Rubin_NY
Enchanted objects are incredibly purpose built - and you won't
need nav or a ui #enchantobj #SXSW
âFrom Human-Computer Interaction
to Human-Information Interactionâ
78. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Information Environments
that help reveal patterns
79. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
81. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
82. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
Internal Representations
86. HEARING
TASTE
SMELL
TOUCH
VISION
(THE WORLD OUT THERE)
STIMULUS
(THE WORLD YOU PERCEIVE)
SENSORY ORGANS
PERCEPTUAL ORGAN
ICONIC
MEMORY
SHORT-TERM
MEMORY
BALANCE
Reality
PAIN
TIME
TEMPERATURE
AND
MORE!
Simulation
LONG-TERM
MEMORY
87. (THE WORLD YOU PERCEIVE)
(THE WORLD OUT THERE)
Reality
Simulation
101. Your brain constructs (an experience) of reality.
Perception is not a process of active
absorption but of active construction based
on prior experiences and memories.
102. Why do we know these are all the letter A?
A A A
A
A A A A
A AA A
111. âMessage of Love from the Dolpinsâ
(Message dâAmour des Dauphins)
If you look at the vase youâll probably agree
that it depicts a man holding and kissing a
woman from behind. What if I told you that
the image in fact depicts a number of
dolphins?
In fact it depicts both - itâs all a matter of how
your brain interprets it. Kids, who are
âinexperiencedâ tend to see the dolphins.
Grownups tend to see the loving couple, Some
grownups canât even see the dolphins if they
try really hard.
Itâs all about what the brain expects and
knows. If you know how to see a certain
pattern, youâre more likely to see that pattern.
112. âMessage of Love from the Dolpinsâ
(Message dâAmour des Dauphins)
If you look at the vase youâll probably agree
that it depicts a man holding and kissing a
woman from behind. What if I told you that
the image in fact depicts a number of
dolphins?
In fact it depicts both - itâs all a matter of how
your brain interprets it. Kids, who are
âinexperiencedâ tend to see the dolphins.
Grownups tend to see the loving couple, Some
grownups canât even see the dolphins if they
try really hard.
Itâs all about what the brain expects and
knows. If you know how to see a certain
pattern, youâre more likely to see that pattern.
113. Changing the label on wine
bottles changes the taste
http://www.psychologytoday.com/blog/brainstorm/200803/is-5000-prostitute-worth-the-price
114. brain scans confirmed that
people don't just think the
more expensive (but identical)
wine tasted betterâit actually
really did taste betterâŠ
Changing the label on wine
bottles changes the taste
http://www.psychologytoday.com/blog/brainstorm/200803/is-5000-prostitute-worth-the-price
115.
116. âHow fast was the car going when
it hit the other car?â
âHow fast was the car going when
it smashed into the other car?â
117. âHow fast was the car going when
it hit the other car?â
âHow fast was the car going when
it smashed into the other car?â
118. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
Internal Representations
122. MACHINES TALKING TO MACHINES
INFORMATION ENVIRONMENTS
âŠand that whole
âpervasive IAâ thing
Wearables
Digital
Things
Digital
Environments
PEOPLE
TOOLS / OBJECTS
Connected Media /
Devices
The World âOutsideâ
INTERACTIONS
The World âInsideâ
REPRESENTATIONS
Perception & Cognition
PHYSICAL
ENVIRONMENTS
124. We need new maps.
Maps that help us, as practictioners,
architect exciting new information systems.
125. We need new maps.
Maps that help us, as practictioners,
architect exciting new information systems.
Maps that celebrate and amplify
human ingenuity.
126. We need new maps.
Maps that help us, as practictioners,
architect exciting new information systems.
Maps that celebrate and amplify
human ingenuity.
Maps that help us to understand
what is unknown.