3. INTRODUCTION
ïKinect motion technology uses a sensor device called
kinect,a 3D scanner which interprets 3D scene information
from a continuously projected infrared structured light.
ïIs used for:
âXbox 360 console
âWindows PCs
âRobots
4. Contd
ïKinect was developed by microsoft .
ïEnables users to control and interact with the
application/game.
âWithout the need to touch a game controller .
âThrough a natural user interface .
âUsing gestures and spoken commands .
5. What is NUI ?
Natural User Interface:
ï An Invisible Interface
ïDirect Manipulation
ï Gestural interfaces
6. LITERATURE SURVEY
ï PAPER 1
Skeleton Tracking using Kinect Sensor &Displaying in 3D
Virtual Scene
-ChanjiraSinthanayothin, Nonlapas Wongwaen, Wisarut
Bholsithi.
(IJACT-2012).
7. ïPAPER 2
Motion Detection Real Time 3D Walkthrough in Limkokwing
University of Creative Technology (Modet-Walk) using
Kinect XBox
-Behrang Parhizkari,Kanammal Sandrasekaran and Arash
Habibi Lashkari(IJCSI-2012).
10. ï 3-D depth sensors
Three-dimensional sensors tracks the body within the play
space.
ï RGB camera
An RGB (640 Ă 480) pixels
helps identify and takes in-game pictures and videos.
ïMultiple microphones
An array of microphones along the bottom, front edge of the
Kinect sensor are used for speech recognition and chat.
ïMotorized tilt
A mechanical drive in the base of the Kinect sensor
12. Kinect Features
ïFull-body 3D motion capture
ïGesture recognition
ïFacial recognition
ïVoice recognition capabilities
13. Light Coding With Kinect:
ïStructured light is a form of active
triangulation.
ïIn structured light,a known pattern
is projected onto the scene, and the
depth is calculated on the basis of the
triangulation between a known reference
pattern and observed reflected pattern.
17. Software:
The poses of human skeleton is recognized with the help
of machine learning algorithm called decision tree .
Construction of skeleton
image
18. CASE STUDY
ïThe TurtleBot is a customizable mobile robotic platform
that rides on an iRobot Create platform .
ïThe TurtleBot uses the Kinect to see the world in 3D and
for detecting and tracking people.
20. COMPARISIONS:
Topic NUI GUI
Ease User can learn features
easily through natural
movements
New users may have a
difficult time learning to
use the mouse and all
GUI features.
Speed Depends on the user User must operate using
mouse and keyboard
Strain No strain Shortcut keys are used
Example 3D immersive touch Gnome shell
23. RESULT ANALYSIS
ïDetection and tracking of one or two people moving in
the field of view of the sensor, using the tracking of parts
of the skeleton.
ïCapture audio with noise and echo cancellation.
ïSpeech Recognition.
24. CONCLUSION
ïThis technique aims to provide an application that uses
gestures to interact with virtual objects in an Augmented
Reality application.
ï Providing a way for using the gesture-based
interactions to manage operations in a virtual walkthrough
environment is a promising approach.