Presentation of the

1. CSCW 2011 - Hangzhou, China
March 19–23, 2011
MIXED REALITY LAB
SINGAPORE
A Genealogy of Lab Projects
Employing the Blue Sky Innovation Research Methodology
Adrian David Cheok , Jeffrey Tzu Kwan Valino Koh, Roshan Lalintha Peiris, Owen Noel Newton Fernando
http://www.mixedrealitylab.org/
Tuesday, April 17, 12

2. Tuesday, April 17, 12

3. Tuesday, April 17, 12

4. Tuesday, April 17, 12

5. Tuesday, April 17, 12

6. Tuesday, April 17, 12

7. Logical / Verbal
Communication Feeling / Non-Verbal
Communication
Experience Sharing
Information Sharing
PARADIGM SHIFT
Source: Nakatsu et al.
Tuesday, April 17, 12

8. Sharing Information
Conventional image
of communications
Sharing Experiences
New image
of communications
SHARING EXPERIENCES
Tuesday, April 17, 12

9. At the Mixed Reality Lab and Keio-NUS CUTE Center we
research ways to engage all our senses over the network
Tuesday, April 17, 12

10. BLUE-SKY THINKING
Tuesday, April 17, 12

11. The train of thought was this...
Tuesday, April 17, 12

12. We have projects
that explore living
things as media...
Tuesday, April 17, 12

13. Other than purple cabbage,
which we already use as a
display embodiment for the
Babbage Cabbage project, are
there any other organisms
that possess color-changing
properties?
Tuesday, April 17, 12

14. Certain reptiles change color,
as do some aquatic animals
such as fish and octopuses...
Tuesday, April 17, 12

15. ...Aquatic... meaning
fluid, right?
Tuesday, April 17, 12

16. Hey did you see those
ferrofluid sculptures that
Sachiko Kodama
made?
Tuesday, April 17, 12

17. She uses magnetism
to form them.
Tuesday, April 17, 12

18. They are pretty,
but you can’t directly
interact with
the material.
Tuesday, April 17, 12

19. Maybe we can use
the controllability of
magnetic fields to shape
the ferrofluid
to whatever we want...
Tuesday, April 17, 12

20. ...much like Magneto
does to metal in
THE X-MEN!
Tuesday, April 17, 12

21. Together with
Hall Effect sensing,
we can use the same
magnetic field that
agitates the ferrofluid
to also sense
and actuate it.
Tuesday, April 17, 12

22. This would enable
us to create a shape
changing,
three-dimensional
and organic
user interface!
Tuesday, April 17, 12

23. And thus the Liquid Interface project was born.
Tuesday, April 17, 12

24. BLUE-SKY THINKING IS...
Tuesday, April 17, 12

25. a process in which to develop as imaginative concepts as
possible without being constrained by technical feasibility,
commercial marketability or any other practical boundary
Tuesday, April 17, 12

26. Human
Pacman
Solar Plant Kyoto
3D Live
System Story Garden
Living Metazoa Poultry Huggy Age
MediaME
Media Ludens Internet Pajama Invaders
Confucius
Blogwall
Computer
Petimo AmbiKraf
Paper Smell & Food Liquid
Lovotics
Interface Taste Media Interface
A GENEALOGY OF MXR
Chronological & Genealogical Organization
Tuesday, April 17, 12

27. Human
Pacman
Solar Plant Kyoto
3D Live
System Story Garden
Living Metazoa Poultry Huggy Age
MediaME
Media Ludens Internet Pajama Invaders
Time
Confucius
Blogwall
Computer
Petimo AmbiKraf
Paper Smell & Food Liquid
Lovotics
Interface Taste Media Interface
LINEAR ORGANIZATION
Timeline reveals progression and development
Tuesday, April 17, 12

28. Human
Proto-Project
Pacman
Solar Plant Kyoto
Gen-I System Story Garden
3D Live
Living Metazoa Poultry Huggy Age
Gen-II Media Ludens Internet Pajama Invaders
MediaME
Time
Confucius
Gen-III Computer
Blogwall
Gen-IV Petimo AmbiKraf
Paper Smell & Food Liquid
Gen-V Interface Taste Media Interface
Lovotics
GENERATIONS OF PROJECTS
Projects are separated by themes and influences
Tuesday, April 17, 12

29. Human
Pacman
HUMAN PACMAN
The Proto-Project
Tuesday, April 17, 12

30. THE PROTO-PROJECT
Human
Pacman
Tuesday, April 17, 12

31. THE PROTO-PROJECT
• Contains many themes that
filter down to other MXR
projects
• Embodiment, mixed reality,
physical computing, UbiComp,
Human
social interaction, cultural Pacman
reference
• From this project inspiration for
future research themes emerge
Tuesday, April 17, 12

32. Plant Kyoto
Story Garden
Solar
3d Live
System
GEN-1 PROJECTS
Exploring the Burgeoning Field of Mixed Reality
Tuesday, April 17, 12

33. GEN-1 PROJECTS
Kyoto
3d Live
Garden
Tuesday, April 17, 12

34. GEN-1 PROJECTS
• Explores foundational
concepts in mixed reality Plant Kyoto
Story Garden
• First attempt to explore
themes in education,
entertainment and culture
• projects remain tied to Solar
computing, where interaction 3d Live
System
is considered secondary
Tuesday, April 17, 12

35. Living Metazoa Poultry
Media Ludens Internet
Huggy Age
MediaME
Pajama Invaders
GEN-II PROJECTS
Projects that Explore the Real World
Tuesday, April 17, 12

36. GEN-II PROJECTS
Age Poultry
Invaders Internet
Tuesday, April 17, 12

37. GEN-II PROJECTS
• Movement away from traditional
computer graphics to exploration of the
“real world” through physical, tangible
embodiments and natural user interfaces
Living Metazoa Poultry
Media Ludens Internet
• New modalities such as haptics
• Communication and social issues are now
considered
Huggy Age
• new types of interaction, such as human- MediaME
Pajama Invaders
human, human-pet, human-plant and
cross-generational are explored
• A reaction to the previous generation’s
focus on computer graphics and virtuality
Tuesday, April 17, 12

38. Confucius
Blogwall
Computer
GEN-III PROJECTS
Socio-Cultural Themes in the Virtual World
Tuesday, April 17, 12

39. GEN-III PROJECTS
Confucius
Blogwall
Computer
Tuesday, April 17, 12

40. GEN-III PROJECTS
• Cultural computing takes
center stage Blogwall
• Heavily influenced by
eastern traditions
• Need to contemporize Confucius
eastern ideologies such as Computer
Confucian teachings and
Haiku making
Tuesday, April 17, 12

41. Petimo AmbiKraf
GEN-IV PROJECTS
Extending Socio-Cultural Computing Into the Real World
Tuesday, April 17, 12

42. AmbiKraf
Tuesday, April 17, 12

43. GEN-IV PROJECTS
• Extends the socio-cultural
exploration of themes developed in
Gen-3 but now embodied physically
Petimo
in the real-world
• Projects become more product
oriented
• Influences from Japanese culture
and collaboration with Keio AmbiKraf
University
• Design begins to play a defining role
Tuesday, April 17, 12

44. Paper Smell & Food
Interface Taste Media
Liquid
Lovotics
Interface
GEN-V PROJECTS
Quantum-Step Motivated
Tuesday, April 17, 12

45. Paper
Interface
Tuesday, April 17, 12

46. GEN-V PROJECTS
• Radical shift from previous
works
Paper Smell & Food
• Encompasses many previously Interface Taste Media
explored themes but in
completely new ways
Liquid
Lovotics
• Synergies between art, design Interface
and technology reach maturity
• Effort is placed into Quantum-
Step movements in research
Tuesday, April 17, 12

47. RECAP
• Talked about a paradigm shift in everyday communication
• Introduced the Mixed Reality Lab
• Discussed Blue Sky Thinking as a way to conceive projects
• Explained how we categorized lab projects by genealogy
• Showcased some projects from each generation
Tuesday, April 17, 12

48. CSCW 2011 - Hangzhou, China
March 19–23, 2011
^_^
THANK YOU!
twitter:
@smallcaps
@cutecenter
http://www.mixedrealitylab.org/
Tuesday, April 17, 12