SlideShare ist ein Scribd-Unternehmen logo
1 von 13
Lori Landay
Professor of Cultural Studies
Berklee College of Music
SCMS13
Innovative
sound can
bridge the
gaps between
the physical
body,
represented
body, and
imagined
body in video
games.
Do you feel the wind? Where? Why?




Grand Theft Auto IV: The Battle of Gay Tony
Rockstar North, 2009
Do you feel the wind? Where? Why?




Flower, thatgamecompany, 2009
Walter Murch’s aural spectrum




                                http://transom.org/?page_id=7006
unified sound, image, action in a virtual environment




Char Davies, Osmose (1994-96)
LIMBO, Playdead, 2010
GAPS BETWEEN
the physical body of the player,


the screen body represented on the screen,
perhaps by an avatar, and


the imagined body comprised of the mental image
and nonconscious sensory-motor processes of
the physical body and also the virtual body

Sound has the potential to bridge the points of
disconnection among these embodiment perspectives in a
way that image and action cannot.
Sound effects & music in Portal 2

               sound of soaring through the air after bouncing on “Aerial
               Faith Plate,” a sound effect that can be better understood
               as a musical event than a diegetic sound




Dan Bruno http://cruiseelroy.net/2011/06/portal-2-music/
Speech as sound effects in Portal 2
Portal 2, Valve, 2011
“Technology mirrors our desires;
interactive technologies, in
particular, reflect our desire to
feel engaged.”

David Rokeby, “Transforming Mirrors:
Subjectivity and Control in Interactive
Media,” 1996
Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

Weitere ähnliche Inhalte

Andere mochten auch

Yanai doctor final
Yanai doctor finalYanai doctor final
Yanai doctor final
moan
 
Digital Narrative Theory & Practice: Recap
Digital Narrative Theory & Practice: RecapDigital Narrative Theory & Practice: Recap
Digital Narrative Theory & Practice: Recap
LoriLanday
 
I Love Ricky: Music & Otherness in i love Lucy
I Love Ricky: Music & Otherness in i love LucyI Love Ricky: Music & Otherness in i love Lucy
I Love Ricky: Music & Otherness in i love Lucy
LoriLanday
 
March of DImes, March for Babies – Fundraising Tips from Team Levine
March of DImes, March for Babies – Fundraising Tips from Team LevineMarch of DImes, March for Babies – Fundraising Tips from Team Levine
March of DImes, March for Babies – Fundraising Tips from Team Levine
Josh Levine
 
Virtual Art/Virtual Aura
Virtual Art/Virtual AuraVirtual Art/Virtual Aura
Virtual Art/Virtual Aura
LoriLanday
 
Your Account Director Solution
Your Account Director SolutionYour Account Director Solution
Your Account Director Solution
pjlakeside
 
Charting the Successful Redesign of an Independent Ecommerce Small Business —...
Charting the Successful Redesign of an Independent Ecommerce Small Business —...Charting the Successful Redesign of an Independent Ecommerce Small Business —...
Charting the Successful Redesign of an Independent Ecommerce Small Business —...
Josh Levine
 

Andere mochten auch (14)

Yanai doctor final
Yanai doctor finalYanai doctor final
Yanai doctor final
 
Teaching with Digital Media: Reboot Institute 2011
Teaching with Digital Media: Reboot Institute 2011Teaching with Digital Media: Reboot Institute 2011
Teaching with Digital Media: Reboot Institute 2011
 
Digital Narrative Theory & Practice: Recap
Digital Narrative Theory & Practice: RecapDigital Narrative Theory & Practice: Recap
Digital Narrative Theory & Practice: Recap
 
Appearance & Reality in A Virtual World
Appearance & Reality in A Virtual WorldAppearance & Reality in A Virtual World
Appearance & Reality in A Virtual World
 
I Love Ricky: Music & Otherness in i love Lucy
I Love Ricky: Music & Otherness in i love LucyI Love Ricky: Music & Otherness in i love Lucy
I Love Ricky: Music & Otherness in i love Lucy
 
March of DImes, March for Babies – Fundraising Tips from Team Levine
March of DImes, March for Babies – Fundraising Tips from Team LevineMarch of DImes, March for Babies – Fundraising Tips from Team Levine
March of DImes, March for Babies – Fundraising Tips from Team Levine
 
Practicas parlamentarias chilenas 1981 1925
Practicas parlamentarias chilenas 1981  1925Practicas parlamentarias chilenas 1981  1925
Practicas parlamentarias chilenas 1981 1925
 
Virtual Art/Virtual Aura
Virtual Art/Virtual AuraVirtual Art/Virtual Aura
Virtual Art/Virtual Aura
 
Your Account Director Solution
Your Account Director SolutionYour Account Director Solution
Your Account Director Solution
 
Digital Narrative: Game Design & Player Experience
Digital Narrative: Game Design & Player ExperienceDigital Narrative: Game Design & Player Experience
Digital Narrative: Game Design & Player Experience
 
Dramatic Construction in Film/MacKendrick Highlights
Dramatic Construction in Film/MacKendrick HighlightsDramatic Construction in Film/MacKendrick Highlights
Dramatic Construction in Film/MacKendrick Highlights
 
Charting the Successful Redesign of an Independent Ecommerce Small Business —...
Charting the Successful Redesign of an Independent Ecommerce Small Business —...Charting the Successful Redesign of an Independent Ecommerce Small Business —...
Charting the Successful Redesign of an Independent Ecommerce Small Business —...
 
Digital Narrative: The Monomyth
Digital Narrative: The MonomythDigital Narrative: The Monomyth
Digital Narrative: The Monomyth
 
The 8 Principles of Design – How to Leverage the Power of Design and Turn Con...
The 8 Principles of Design – How to Leverage the Power of Design and Turn Con...The 8 Principles of Design – How to Leverage the Power of Design and Turn Con...
The 8 Principles of Design – How to Leverage the Power of Design and Turn Con...
 

Mehr von LoriLanday

Art & Technology, 1950 to the Present, Day 1 Introduction
Art & Technology, 1950 to the Present, Day 1 IntroductionArt & Technology, 1950 to the Present, Day 1 Introduction
Art & Technology, 1950 to the Present, Day 1 Introduction
LoriLanday
 

Mehr von LoriLanday (6)

Art & Technology, 1950 to the Present, Day 1 Introduction
Art & Technology, 1950 to the Present, Day 1 IntroductionArt & Technology, 1950 to the Present, Day 1 Introduction
Art & Technology, 1950 to the Present, Day 1 Introduction
 
Ready for Metaverse: NOTES version
Ready for Metaverse: NOTES versionReady for Metaverse: NOTES version
Ready for Metaverse: NOTES version
 
Ready for the Metaverse: Immersive and Interactive Experiences in Virtual Wo...
Ready for the Metaverse:  Immersive and Interactive Experiences in Virtual Wo...Ready for the Metaverse:  Immersive and Interactive Experiences in Virtual Wo...
Ready for the Metaverse: Immersive and Interactive Experiences in Virtual Wo...
 
Storytelling and New Media -- Lori Landay
Storytelling and New Media -- Lori LandayStorytelling and New Media -- Lori Landay
Storytelling and New Media -- Lori Landay
 
What Is Digital Narrative?
What Is Digital Narrative?What Is Digital Narrative?
What Is Digital Narrative?
 
Early Cinema
Early CinemaEarly Cinema
Early Cinema
 

Kürzlich hochgeladen

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
MateoGardella
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
MateoGardella
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 

Kürzlich hochgeladen (20)

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 

Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

  • 1. Lori Landay Professor of Cultural Studies Berklee College of Music SCMS13
  • 2. Innovative sound can bridge the gaps between the physical body, represented body, and imagined body in video games.
  • 3. Do you feel the wind? Where? Why? Grand Theft Auto IV: The Battle of Gay Tony Rockstar North, 2009
  • 4. Do you feel the wind? Where? Why? Flower, thatgamecompany, 2009
  • 5. Walter Murch’s aural spectrum http://transom.org/?page_id=7006
  • 6. unified sound, image, action in a virtual environment Char Davies, Osmose (1994-96)
  • 8. GAPS BETWEEN the physical body of the player, the screen body represented on the screen, perhaps by an avatar, and the imagined body comprised of the mental image and nonconscious sensory-motor processes of the physical body and also the virtual body Sound has the potential to bridge the points of disconnection among these embodiment perspectives in a way that image and action cannot.
  • 9. Sound effects & music in Portal 2 sound of soaring through the air after bouncing on “Aerial Faith Plate,” a sound effect that can be better understood as a musical event than a diegetic sound Dan Bruno http://cruiseelroy.net/2011/06/portal-2-music/
  • 10. Speech as sound effects in Portal 2
  • 12. “Technology mirrors our desires; interactive technologies, in particular, reflect our desire to feel engaged.” David Rokeby, “Transforming Mirrors: Subjectivity and Control in Interactive Media,” 1996