1. Shikhar Rastogi
CSE 3rd Year
1350110022

2. Content
• Human Computer Interaction
• What is Leap
• Hardware and software specifiation
• Classification of gestures
• Behind Leap: SVM & HMM
• Features
• Applications
• Conclusion

3. Evolution Of
Human Computer Interaction
Effort
Technical
performance
Mouse
Touch Screen
Gesture
Recognition

5. “It’s more accurate than a mouse, as reliable as a keyboard,
and more sensitive than a touchscreen” (Leap Motion, 2012).
• Small rectangular gadget of size 7x3 CM.
• Equipped with tiny cameras and IR sensors.
• Designed to sit right in front of your system and
sense movements with startling accuracy.

6. Gestures
classification
Action
Gestures
Parameterised
Gestures
static dynamic
global local mixed
global local mixed
Gestures

7. H/w and S/w Specification
Software:
• Windows 7 and 8
• Mac OS
Hardware:
• Intel i3/i5/i7 Processor
• RAM 2GB
• USB 2.0 Port

8. Behind Leap:
Michael Buchwald and David Holz

9. SVM: Support Vector Machine
Leap
motion
controller
Pre-processing
Computing
Feature set
SVM Postprocessing
Recognised
Static gesture
Processing blocks of a static gesture recognition

10. HMM: Hidden Markov Model
• A finite N-element set of states(graph),which are
associated with probability distribution.
• Markov model is based on Markov property.
• Markov Property:-The next, future state depends
on previous state and transition probability
between those states.

11. • HMM consists of (T,E, π(pi))-
a. Transition probabilities stored in NxN matrix T.
b. K- element observation set stored in NxK matrix E.
c. N-element vector of initial state probabilities π (pi).
• Algorithms used in HMM:-
a. Forward-Backward Algo.
b. Viterbi Algo.
c. Baum-Welch Algo.
Contd…

12. Record video
Convert into frames
Hand Segmentation
Feature Extraction
Pattern recognition
Perform Associated
Tasks
Based on
Skin colour
detection
Pattern
match
Processing Blocks of HMM based system

13. Common Dynamic Gestures
NextClose Previous Zoom -in
Rotate Anti-
clockwise by 90
Zoom -
out
Rotate clockwise
by 90
Print

14. Features
• Using a USB connection, it creates 4-8 cubic feet of space to interact with
your computer.
• It can sense movements 150 degrees lengthways and widthways and to a
depth of 120 degrees from top to bottom.
• It can differentiate Chopsticks and fingers.
• 200 times more accurate than existing Microsoft’s Kinect.

15. Applications

16. Educational Applications
• 3D modelling.
• Manipulating 3D diagrams and molecules.
• Signing a digital document.

17. Gaming

18. Music and Video
• Learning and playing instruments.
• DJ-Music mixing.
• Video editing.

19. Medical
• Manipulating screens
• Viewing reports
Robotics
• Self navigation
• Mimic human movements

20. Conclusion
1. Plug it in
2. Load it up
3. Calibrate it
Enjoy!

21. THANK YOU