This document discusses using the Microsoft Kinect depth camera for interactive 3D graphics in Cycling '74 Max. It provides background on Max as a visual patching environment, describes the Kinect's depth camera capabilities, and explains basic 3D computer graphics concepts like OpenGL. It then outlines several example patches that could be created to display OpenGL shapes, add color, and make the graphics interactive based on Kinect input. The goal is to demonstrate how these technologies can be combined for interactive 3D graphics applications.

1. Interaction and OpenGL®
3D
graphics using Microsoft®
Kinect®
and Cycling ’74 Max®
Dale Phurrough

2. Hello World:
Procedural Languages
#include <stdio.h>
int main()
{
printf("Hello World");
return 0;
}
program Hello;
begin
write('Hello World');
end.
do
puts "Hello World"
end
<?
echo "Hello World";
?>

3. Hello World:
Visual Patching Languages

4. Cycling '74 Max
● Visual patching environment/language with 23
year history
● Original ancestor from IRCAM; French institute
for science about music and sound
● World-wide use by musicians, developers,
researchers, and visual artists
● Enhancements (extensions) are both open
source and commercial
● Available for Windows and OS X

5. Microsoft Kinect
●
Released Nov 2010 for Xbox 360®
gaming
● Quickly hacked for art and robotics
● Microsoft responded with hardware refresh and
SDK
● Includes 4 sensors
– Depth camera for 3D
– Color camera
– Accelerometer (gravity rotation)
– Audio microphone array

6. Depth Camera for Kinect
● Position in real
distance (meters)
● Coordinates in X, Y, Z
● Head = 0.0, 0.8, 2.0
2.0 m
0.8m

7. 3D Computer Graphics
● Commonly used
today in all media
● Range of power from
handys clusters of→
computers
● Two common
programming
standards: OpenGL
and Direct3D

8. OpenGL 3D graphics
● Cross-platform
(Windows, Android,
Linux®
, OS X, and
more)
● Coordinates in X, Y, Z

9. Max OpenGL Kinect↔ ↔
X
Y
Z

10. Time to Code...Time to Patch
Patching time...

11. Patch 1: Hello World

12. Patch 2: Hello World in OpenGL

13. Path 3: OpenGL shapes and color

14. Path 4: Kinect Interactive OpenGL

15. Cycling '74 Max
Slides and code are available on my website:
http://hidale.com  Seminars

16. Credit Notices
● Max/MSP and Jitter are trademarks of Cycling '74
● Mac, Mac OS, and OS X are trademarks of Apple Inc.
● Windows is a registered trademark of Microsoft
Corporation in the United States and other countries.
● Linux is the registered trademark of Linus Torvalds in the
U.S. and other countries.
● OpenGL is a registered trademark of Silicon Graphics, Inc.
● All other product and company names are trademarks or
registered trademarks of their respective owners.