This document provides an overview of using the Kinect motion capture device with KinectToPin software to capture and import motion data into After Effects. It discusses the hardware and software needed, including the Kinect sensor, OpenNI driver, and KinectToPin application. It then covers the motion capture process from setting up the capture space to acting for the Kinect and importing the tracking data into After Effects. Guidelines are provided for rigging characters and using the Puppet Tool for animation. The document concludes by mentioning some other free and commercial tools for motion capture and animation beyond After Effects.
3. Getting Started: Hardware
You will need:
• A Kinect, or generic equivalent such as the Asus Xtion
• USB adapter cable, if you have a Kinect that was bundled with
the Xbox (don’t buy the Microsoft adapter, the cheap ones work
fine)
• Enough space to perform
10. Capturing
• Record 15-point 3D skeletal
tracking data
• Capture in sync to dialogue
• Remote control with a standard
presentation remote
• Open source and cross-platform:
runs on OpenNI, built in
Processing, also works with
generic sensors like the Asus
Xtion
11.
12. Acting for Kinect
• The Kinect can’t record what it can’t see.
• Keep your entire body in the camera’s range
• Face the camera when capturing
• Watch out for occluded joints (sitting down, putting your hands behind
your back etc. can cause it to lose the track)
• It’s surprisingly good at picking up subtle posture shifts, but not
smaller motions like laughter.
• Use a different performer for each character if possible
14. Getting data into After Effects
Data format options:
• 3D Point Controls (CS5.5+)
• 2D Point Controls (CS4+)
• Puppet pins
• Raw XML and JSON
15. UI Panel
• Create character
templates
• 2D and 3D setups
• Native XML import
(SLOW)
• Automatically add
expressions to smooth
tracking data
• Automate rigging
17. The Puppet Tool
THREE OR MORE PINS ON ONE LAYER: TWO PINS EACH, MULTIPLE LAYERS:
Elbows don’t bend this way. Ow. Rotation with stretch and squash!
18. AE Puppet best practices
• Work BIG. Start high-res, scale down in the puppet comp, then
scale back up in the project comp (enable Collapse
Transformations).
• Precompose if you’re using vectors or shape layers
• Keep multiple angles of the same character in sync
High-res
Start big. Character
Layers
Project Comp
End big.
Rigging
Template
20. Quick auto-lip sync
1. Convert audio amplitude to keyframes
2. Connect to mouth animation
3. Size the audio data to fit. Use this expression:
linear(source,sourceMin,sourceMax,targetMin,targetMax)
23. Further non-K2P tools
FREE COMMERCIAL
Brekel Kinect iPi Soft
Open-source capture for 3D Uses two Kinects to record
animation (Windows-only) www.ipisoft.com
www.brekel.com
NI Mate
Duik
Kinect for OSC/MIDI/Blender
Inverse kinematics plugin for AE
www.ni-mate.com
www.duduf.net
26. Contact Us
Nick Fox-Gieg Victoria Nece
www.fox-gieg.com www.victorianece.com
@N1ckFG @FakeGreenDress
Editor's Notes
Why DIY MoCap?Motion capture is now cheap and accessibleNo longer need a giant studioIt’s FAST.Ideal use cases: short-turnaround animation, rapid prototyping etc.
Microsoft SDK vs. OpenNI
Can add multiple motion tracks and duplicate nullsPin names need to match control nulls
2D vs. 3D: Avoiding the “Uncanny Valley”Awesome glitches
