13. Kinect (Development)
Community
• Gaming and Virtuality
• Medicine
• Surveillance, Security, Facial Recognition
• Robotics
• 3D Scanning and Printing
• Avant-Garde Art, Music, and Performance
15. My Configuration
• Kinect Sensor (2011); Model 1414, EN/ES US HD
(this is the most ‘open’ one!)
• Synapse Middleware (converts skeleton to OSC)
• PureData v. 0.43.4-Extended (incl. MrPeach library)
• Quartz Composer v. 4.0 (+ old FW400 SD
camcorder)
• 2011 MBP, 2.4mHz, running OSX 7.5 “Lion”.
16. Approaches to Performance
• One-Person Band (virtuoso!)
– One person, one controller
– Controls both audio and visual
Video on YouTube
http://www.youtube.com/watch?v=1ge7RcIBWsc
18. Approaches to Performance
• Division of Labor (conventional ensembles)
“For every new technology that comes along, make
an ensemble out of it!”—JB, EMV (2011)
19. Approaches to Performance
• Division of Labor (conventional ensembles)
“For every new technology that comes along, make
an ensemble out of it!”—JB, EMV (2011)
• Applied to Kinect:
–Multiple controllers
–Dedicate separate software to audio and visuals
–Multiple performers for audio and visuals
20. What Do You Want to
Control?
SONIC COMPONENTS
Background: ambient • sustained •
slow rate of change • non-pitched
(environments) or pitched (“harmonic”)
Middleground: active • patterned
/predictable rates of change • motor
rhythm + overlays + articulation
points (“rhythmic”)
Foreground: solo • draws attention
• contrasting ‘change vocabulary’ •
contrasting timbre (“melodic”)
VISUAL COMPONENTS
Background: abstract • blurry, fuzzy,
indistinct • textures • slow rate of
change
Middleground: referential, pictoral
images • abstractions of geometry or
biology • text / motion graphics •
Foreground: interactive visuals (may
also be referential, pictoral, live,
connected to sound events)
21. How Do You Want To Control It?
• Discontinuous, trigger events
– model: keyboard
• Continuous, gradual events
– model: theremin
• Hybrid Control: multiple parameters
– model: sample player
29. Variations
• Figure
– Simple Camera Figure and Skeleton
– Primitives, 3D Objects, Video Mapped to Skeleton
• Paint Brush/Image Hose (Effects Mapped to Skeleton)
• Background (Texture or Stylized Video Controlled by Skeleton)
----- Meeting Notes (2/1/14 16:06) -----
A quick word of thanks to Dileana Alexander and everyone at Filmgate for hosting a really fantastic array of events in this conference,
Also thanks to Lolo Resnick and eveyone at Sweat Records for hosting this event!
----- Meeting Notes (2/1/14 16:06) -----
In the domain of sound, I'm trying to use a language that can be applied across a wide spectrum of genres—pop, jazz, world music, classical, electronic, experimental, avant-garde, etc. Kinect has already found its way into the world of dubstep and experimental eletronic performance.
