the body and the brain as controller (lecture, Finland, 15 April 2013)

1. the body and the brain
as controller
Talk to Digital Culture students
@University of Jyvaskyla, Finland
15 April 2013
erik champion
http://erikchampion.wordpress.com
nzerik@gmail.com

2. Civilization comprises the laws that allow
people to live close together, in a city, civitas.
Culture is what is cultivated or allows one to
cultivate a setting, a local domain.
Osvald Spengler

3. virtual heritage
•
•
…the use of computer-based interactive technologies to
record, preserve, or recreate artefacts, sites and actors of
historic, artistic, religious, of cultural significance and to
deliver the results openly to a global audience in such a way
as to provide formative educational experiences through
electronic manipulations of time and space.
Stone, Robert, and Takeo Ojika. 2000. Virtual heritage: what
next? Multimedia, IEEE no. 7 (2):73-74.

4. irtual meetings no more interesting than re
ones so why recreate mundality?

5. Non digital-interactivity sometimes better than the digital

6. Goodbye body
• Spengler wrote “This machine technics will
end with the Faustian civilization and one
day will lie in fragments, forgotten -- our
railways and steamships as dead as the
Roman roads and the Chinese wall, our
giant cities and skyscrapers in ruins like old
Memphis and Babylon.”

7. scale is also important

8. the brain
• space and memory are inextricably linked
• memory is more a jigsaw than filing cabinet
• memory decay can be challenged
• games help multi-tasking
• biofeedback can help evaluation

9. Caption: The flow of object information in a monkey brain (left) and a human brain.
Credit: Sabine Kastner, Princeton University
Humans See Tools Differently Than Other

10. RNA Game (Wired magazine) “EteRNA”
• Computers don’t have flashes of insight. But the
human brain can..for gamifying RNA.
• One proposal they kicked around was to have
snippets of RNA fight each other to the death,
in the style of a Japanese combat game called
Senshuken; another was to create a first-person
experience in which players navigated the world
as RNA molecules of their own design.

11. use lego to discover?

12. http://publicvr.org/html/pro_oracle.html

13. prototyping for ownership
Klaus Birk Roman Grasy
media architecture biennale
http://www.mediaarchitecture.org/biennale-2012-workshops/
or http://moritzbehrens.com/2013/mab12/
15 November 2012, Aarhus

14. sketchy sketches

15. Xbox Kinect+Projector+VVV
and Crazy dancers..

16. dance projection
•
imagine...
•
•
•
public squares
flashmob dance mixes
crowdsourcing VJs

17. machinima tools

18. MOODLE-unity

19. kinect, jibe, drawing
interfaces

20. peripheral projection

21. warped screen
peripheral fear
our peripheral vision is not
colour, it reacts to movement
how to best utilize this?

22. biofeedback

24. biofeedback

25. Skyrim game can host virtual recreations
(of Nordic stories or any other), the player
can control the avatar, and issue voice
commands recognised by the game).
Inhabitants can be easily reprogrammed to
share stories. Trading, praying, conversing
healing etc are possible, not just violence.
Skyrim + body

26. Oblivion
Eric Fassbender PhD thesis project, scripted
tour guide of lighthouse, Macquarie
University

27. mixed reality
Second Life and VR tracker and googles see
Georgia Tech Project

28. 2006 calligraphic
interfaces
University of Queensland: project by year 3
multimedia students, Amy and Isaac, Team
AI studios

29. Journey to the West

30. touch screen taoism
@Vsmm2012, MILAN

31. “new media…offers enormous possibilities
for the enhancement and enrichment of
heritage experience and interpretation”
Y. E. Kalay, T. Kvan, & J. Affleck, New Heritage: new media and cultural
heritage. New York: Routledge, 2008.

32. http://chinablog.cc/2009/10/siyi-four-arts-of-the-chinese-scholar/
“Qin” literally refers to a unique seven-string Chinese music
instrument “Guqin”, which was invented 3,000 years ago in
ancient China.
http://www.youtube.com/watch?v=nvhKTFzQG8Y
https://eee.uci.edu/programs/rgarfias/sound-recordings/qin/index.html

33. http://chinablog.cc/2009/10/siyi-four-arts-of-the-chinese-scholar/
Daoism is an ancient Chinese combination of religion, philosophy, and folk
beliefs, including ritual healing. Its different strands of belief date far back in
history. Daoism is deeply entwined with Chinese culture and history.

34. • to be a scholar or a master is to be an
artist, measured by one’s grasp of the “Four
Arts”.
• The “Four Arts” are Music (“Qin”), the
board game (“Qi”), calligraphy (“Shu”), and
brush painting (“Hua”).
• Helped “perceive the ultimate doctrine of
the heavens”, “make themselves [be]
enlightened”, “express their emotions/their
understanding of the doctrine”, and “inspire
others” so that their lives achieve peace and
harmony.
Z. Dainian, Key Concepts in Chinese Philosophy. Beijing: Foreign Languages Press, 2002.

35. youtube links
•
•
•
•
•
•
Opening http://youtu.be/gFYG4zTn4Js
Game Hua http://youtu.be/DiGDezTM8hY
Game Qi1 http://youtu.be/jP9nfdUFDTU
Game Qi2 http://youtu.be/orCga2CQBjs
Game Qin http://youtu.be/iC2BGT5IbDE
Game Shu http://youtu.be/dv_TOnl_sbc

36. •
What are the Five Elements in the traditional Chinese
culture?
•
What are the Five Basic Tones in the traditional Chinese
music?
•
What are the traditional Chinese philosophical concepts
revealed by Go?
•
Which one of the following features is one of the main
features of Chinese character writing system? ]
Cuneiform / [ ] Alphabet / [ ] Pictography / [ ]
Phonology?
•
What are the tools for Chinese traditional painting?

37. •
Very difficult to recreate original action scenes and
moments of discovery as game devices.
•
Chinese players, familiar with a distorted version of
the original, not aware their cultural knowledge was
not accurate, did not appreciate being told this.
•
Recreating linear narrative via game design is
torturous.
•
OR: simulate the procedural knowledge of rituals
and symbol-making via thematically-akin interaction..

38. •
•
•
•
•
•
•
what is needed: more comprehensive pre-test and post-test questionnaire.
•
•
Ambient movies react to the player’s physiological changes -by biosensors.
The general questions are too vague.
Consider changing from rating games to ranking them.
Test extrapolated knowledge rather than memory of simple facts.
Examine how tacit knowledge can be learnt and evaluated.
Compare tests between touch-screen and non-touch screen games.
A more 3D interface: sculptures, HD projection on rice paper or liquid
media, with 3D audio effects and ambient movies projection.
Can interactive digital media convey and evaluate tacit knowledge?

39. crazy ideas

40. •
Dutch thriller App sends
to your phone additional
storyline information..
•
why not have
biofeedback sent back to
the movie..

41. fps...
• when your character dies, why not have the
death spasms relate to the heartbeat-GSR?
• or only respawn when you calm down..
• reactions relate to heartbeat
• enemies attack peripherally sensing fear

42. RPGs-chameleon effect
• when you start shaking you lose your
character or change between ethnic profile
• Cinematic camera views=biofeedback
• you can only convince NPCs when calm

43. sew some characters
•
http://lilypadarduino.org/

44. reflective games
Kuthodaw Paya: must walk around Buddhist
description of universe-biggest book in the worldbut aesthetic experience being eroded

45. http://www.dreamingmethods.com/
IF+3D model+body