A talk from the Design Track at AWE USA 2017 - the largest conference for AR+VR in Santa Clara, California May 31- June 2, 2017.
Christopher Stapleton (Simiosys, Real World Labs): The Language of VR, Incorporating the Interplay of Story, Games and Free-play in Virtual Worlds
Virtual Reality is a mature 50-year media technology still searching for its unique voice in advancing the human experience. Tapping diverse industry practices from entertainment, training, scientific and medical practice, Virtuality requires a unique range of performance and expression. By engaging the full bandwidth of human experience, immersive media integrates the mind, body and emotions into defining the future of individual performance. This session shares how the real world integration of Virtual Reality is scaffolding a common language of VR from the expertise of all disciplines. From training elite athletes to engaging the wonder of a child, VR becomes a convergence of all forms of media and tapping into a primitive human connection we have for storytelling, game mastery and free-play inquiry. Attendees will learn how to tap into the intuitive interplay of story play and game to provide a framework of how to orchestrate collaborative teams to systematically innovate diverse VR applications.
http://AugmentedWorldExpo.com
Boost Fertility New Invention Ups Success Rates.pdf
Christopher Stapleton (Simiosys, Real World Labs): The Language of VR
1. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
The Language of VR
Incorporating the InterPlay of
Story, Games & Play in
Virtual Worlds
Christopher Stapleton, MFA,
SIMIOSYS, Experience Architect
Virtual World Society, CIO
International VR Research Institute (IVRI),
Creative Director
ChristopherStapleton @Simiosys
2. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
The Language of VR: From experience to transformation
The InterPlay of story, play & game has been the framework to apply this
emergent language of VR to transcend applications and transforms lives
Training
Enterprise
Medical Rehabilitation
TherapyEducation & Entertainment
3. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Language as exclusion:
The efficiency of traditional language has limited the breadth & depth of
communication & connection causing conflict, confusion and isolation
from efficiency to isolation
www.awesomestories.com http://www.nuiguru-me.com
Aphasia, isolation due to loss of language Deep-space travel, loss of human connection
4. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Virtuality is not a destination, but a continuum between us and our creations (Mimesis)
Reality
Augmented Reality Augmented Virtuality
VR (Mimesis)
Mixed Reality: Virtuality Continuum
What is VR exactly?
5. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Its less about what we perceive externally, than it is about what we believe internally
Reality Virtuality
Imaginality
The Language of VR: Full bandwidth of human experience
6. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
The Language of Virtuality
Language is as much about who we are as where we are
Reality Virtuality
Simulating Identities
Robot Agent Human Avatar
Imaginality
7. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
The Language of Experience
Language is orchestrating human connection and social engagement with our imagination
Reality Virtuality
Imaginality
Human Connection
8. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Language as exchange:
Language was the ancient disruptive technology that transformed an
insignificant species into a social world order dominating the earth
Expression of Experience, Empathy & Enterprise
www.awesomestories.com
Gesture Pictures
www.themarysue.com
Sounds
Neanderthal Museum, Croatia www.themarysue.com
Symbols
9. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Language as experience:
Before language: All senses, all dimensions, all directions and all
realities to engage and expand our social identities through…
Human connection and and social engagement
Play Games
Aztec Ball Game
Story Music & Dance
http://www.cherylhunter.com
Performing Arts Center For African Cultures
Akha children www.roughguides.com
10. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Language as empathy:
Each new medium of language makes our society more aware and connected
but at the same time, individuals disengaged and more isolated
From function to purpose
www.awesomestories.com
Internet
http://www.business2community.com
Writing
Oriental Institute
Speech Broadcast
4Moms.gr
11. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Language as engagement:
So Virtuality is not a destination you need to choose,
Its an author’s palette of physical, virtual and imagined elements
Melting the boundaries between worlds
VirtualityContinuum
Experience Mimesis
12. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
The Language as Entertainment:
Stimulating, engaging, transporting & sharing the Audience Imagination
The collective Imagination
Music & DanceGames FieldsPlaygrounds StoryWorlds
13. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
I
R
V
Book
V
I R
Film
V
I R
Game Park
V
I
R
Real IR V Virtual Imagined
The Language as Exploitation: Leveraging the audience imagination
Literary Experience = 1/8 Virtual + 7/8 Imagination
Cinematic Experience = 7/8 Virtual + 1/8 Imagination
Game Experience = 3/8 Virtual + 2/8 Imagination + 1/8 Reality
Theme Park Experience = 2/8 virtual + 2/8 Imagination + 4/8 reality
MetaVerse Experience = Virtual x Imagined x Real
15. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Language of StoryTroves: Medium for Conversational Story Creation
Public History Center Aphasia House Clinic SCALE Aphasia Center
Aphasia Bank Conversational Story Creation Capture
16. Presented by Aphasia House, Aphasia Bank, Snyder Center for Aphasia Life Enhancement (SCALE) and Simiosys Real World Laboratory
StoryTroves Scaling to Serve the World
• Expanding to
millions
• What do you lose
with Virtuality?
• What can you gain
with Virtuality?
• Rabbit Trails to other
virtual worlds.
• From Aphasia to
Astronauts
17. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
The Language of Exploration: Its not real until we are aware its real
Language in all its forms took hundreds to thousands of years to evolve
Empathetic
ImaginationI think, I know
this story
Expressive
Imagination
18. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
The Language of Exposition: Does it matter if no one understands?
Language succeeded because we wanted to connect
Expressive
ImaginationThis is what
I think…
I wonder what
he is thinking?
Empathetic
Imagination
Story Listener StoryTeller
Talk, Listen, Talk, Listen, Talk…
19. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Express
Interpret
Interpret
Express
The Language of Expostulation: Its not successful unless it brings us together
Language in all its forms took hundreds to thousands of years to evolve
Expressive
Imagination
Talk, Listen, Talk, Listen, Talk…
Empathetic
Imagination
Conversation
20. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Express
Interpret
Interpret
Express
The Language of Exposition: We want to share our story with others as one
However, we do not think in words…We think in simulations (Mental Models)
Talk, Listen, Talk, Listen, Talk…
Human
Connection
Share Expand
?
21. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
The Language of Exponentially: Our larger collective story (fact & fiction)
Imaginality becomes larger than the sum of the real, virtual and imagined
StoryTeller
StoryTeller
Story Listener
Story Trance
Story Listener
Story
Collaboration
22. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Story
Participation
Authoring Acting Absorbing
Author Novel Video Games
“Artificial
Intelligence”
Actor Improv Stage Play
Interactive
Performance
Audience RPG
Participatory
Theater
Cinema
The Language of elicitation: Convergence of Media Agency
23. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Heart
Head
Hands
VIRTUAL
IMAGINED
REAL
STORY
PLAY
GAME
Authoring Experience: Interplay of Story, Play & Game
Story Flow
Game Flow
Play Flow
The Language of InterPlay: Convergence of Imagined, Real & Virtual
24. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Heart
Head
Hands
VIRTUAL
IMAGINEDREAL
STORYPLAY
GAME
How?What?
Why?
InterPlay: Experiential Media Creative Conventions
The Language of InterPlay: Convergence of Hearts, Hands & Heads
25. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Heart
Head
Hands
STORYPLAY
GAME
How?What?
Why?
InterPlay: Experiential Learning Strategy
Response
Consequence
Stimulus
Characters
Worlds
Events
Rules
Tools
Goals
AssessmentStrategy
Objectives
The Language of InterPlay: Convergence of Story, Play & Game
26. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
Insights
Feedback
Skills
Plan/Decide
Cognitive Skills
Know/Sense
Communication
Team Skills
Act/Do
Technical Skills
InterPLAY
ST
OR
Y
PLAY
G
AME
Virtuality
DataVirtualization
Reality
Tools
Imaginality
Mental Model
The Language of InterPlay:Convergence of human connection & engagement
27. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
The Language of Imagination:From comprehension to creation to collaboration
As a child, I was rewarded as a consumer of knowledge, not a creator
They labeled me as a slow reader…
but realized I was a luxurious reader
I loved learning…
but hated school
We need to think anew about
the language of VR
28. Christopher@Stapleton.net @MixingRealities #IMAGINALITY copyright 2017 SIMIOSYS.com
The Gymnasium for the Imagination
Christopher Stapleton, MFA,
SIMIOSYS, Experience Architect
Virtual World Society, CIO
International VR Research Institute (IVRI),
Creative Director
ChristopherStapleton @Simiosys
V I R T U A L
W O R L D
S O C I E T Y
AWE June 2nd,
Virtual World Society
VR for Good, Speaker Series
@VRWorldSociety