La battaglia del touchless: quale è la migliore tecnologia oggi disponibile e come sceglierla. Mostreremo le caratteristiche di vari device disponibili sul mercato (Kinect2, RealSense, Myo, Leap) e analizzeremo i casi d'uso dei diversi device evidenziandone vantaggi e svantaggi (distanza, precisione, supporto...) e come possono essere combinati tra loro. La sessione si concluderà con alcuni criteri di scelta che devono essere considerati prima di iniziare lo sviluppo e che possono evitare problemi e migliorare il risultato finale.

1. DEV09 – LA BATTAGLIA DEL TOUCHLESS
Matteo Valoriani
@MatteoValoriani
Clemente Giorio
@Tinux80

2. #CDays15 – Milano 24, 25 e 26 Marzo 2015
Grazie a
Platinum
Sponsor

3. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
Who we are…
Matteo Valoriani
Microsoft MVP Kinect for
Windows
Intel Software Innovator
PhD on HCI @Politecnico
di Milano
CEO of Fifth Ingenium
Consultant
Clemente Giorio
Microsoft MVP Kinect for
Windows
Senior Developer at Crionet srl
Instructor at Overnet
Author at Packt Publishing
Consultant

4. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
Agenda
• HCI evolution
• Microsoft Kinect
• Intel Real Sense
• Myo
• Leap Motion
• …..
• Duo3D
• Kinetics
• … ….. Eye… eeg

5. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
CLI

6. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
GUI interface

7. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
Touch Interface

8. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
Natura User Interface

9. #CDays15 – Milano 24, 25 e 26 Marzo 2015
You have to be a
magician…
or at least a good
illusionist

10. #CDays14 – Milano 25, 26 e 27 Febbraio 2014

11. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
Xbox One - Kinect 2
http://youtu.be/Hi5kMNfgDS4

12. #CDays15 – Milano 24, 25 e 26 Marzo 2015
Kinect 2 - Specs
3D DEPTH SENSOR
RGB CAMERA
MULTI-ARRAY MIC
Hardware:
Depth resolution:
512×424
RGB resolution:
1920×1080 (16:9)
FrameRate:
60 FPS
Latency:
60 ms

13. #CDays15 – Milano 24, 25 e 26 Marzo 2015
Kinect 2 vs Kinect 1
Version 1 Version 2
Depth range 0.4m → 4.0m 0.4m → 4.5m
Color stream 640×480 1920×1080
Depth stream 320×240 512×424
Infrared stream None 512×424
Audio stream 4-mic array 16 kHz 4-mic array 48 kHz
USB 2.0 3.0
Hand Traking External tools Yes
Face Traking Yes Yes+Expressions
FOV 57° H 43° V 70° H 60° V
Tilt Motorized Manual

14. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
demo
Titolo demo

15. Cons:
The device is large
A dedicated power cord is required
The amount of data generated by the
sensor also tends to saturate a USB
controller
Kinect cannot easily distinguish individual
fingers on a hand
Most of the features listed above require
the Microsoft SDK, which is only
supported for desktop applications on
Windows 7 and 8.
Pros Vs. Cons
Pros:
• Skeletal tracking
• Face tracking
• Multiple sensors:
• Raw data
• Voice control
Best for:
Kiosks, installations, and digital
signage projects where the user will
be standing fairly far away from the
display.

16. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
Pros Vs. Cons

17. #CDays14 – Milano 25, 26 e 27 Febbraio 2014

18. Understands 4 basic types of input
19Intel® RealSense™ Hands-On Lab - Milan
Categories of Input Capabilities Features
Hands • Hand and Finger Tracking
• Gesture Recognition
• 22-point Hand and Finger Tracking
• 9 static and dynamic mid-air gestures
Face • Face Detection and
Tracking
• Multiple Face Detection and tracking
• 78-point Landmark Detection (facial features)
• Emotion Recognition (7 emotions, coming post-Beta)
• Pulse Estimation
• Face Recognition (Coming post-beta)
Speech • Speech Recognition • Command and Control
• Dictation
• Text to Speech
Environment • Segmentation
• 3D Scanning
• Augmented Reality
• Background Removal
• 3D Object / Face / Room Scanning (Coming post-beta)
• 2D/3D Object Tracking
• Scene Perception (coming post-beta)

19. Understands Hardware Limits
20Intel® RealSense™ Hands-On Lab - Milan

20. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
demo
Titolo demo

21. Cons:
Getting some of the deeper features (like
age and gender detection) to work is a bit
tricky.
Device and software are in beta.
Due to the close range of the tracking
system, hand gestures must be designed
such that a user’s hand doesn’t occlude
their own view of the display.
Pros Vs. Cons
Pros:
Smaller and less expensive
Close-range tracking
Hand posture/gesture recognition
Facial analysis
Speech (built-in support for speech
synthesis powered by Nuance).
Raw data
Framework support: Processing,
Unity and OpenFrameworks
Best for:
Desktop/laptop applications where the user will be seated in front of the PC.
Close range applications where features, apart from hand tracking and
recognition, are necessary without too much precision or accuracy.

22. #CDays14 – Milano 25, 26 e 27 Febbraio 2014

23. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
demo
Titolo demo

24. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
Pros Vs. Cons

25. #CDays14 – Milano 25, 26 e 27 Febbraio 2014

26. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
demo
Titolo demo
https://www.youtube.com/watch?v=gby6hGZb3ww&t=27

27. Cons:
Sensing range is fairly limited.
Only fingers are tracked.
There is no skeleton or face tracking.
No access to the raw sensor data.
Pros Vs. Cons
Pros:
Finger tracking is fast and
accurate.
Smaller and less expensive
Framework support: .NET,
Processing, Cinder, etc.
Compatible: Mac OS and Windows
Best for:
Controlled kiosk environments with a pointing-based UI.
Generally best for general audience desktop apps which can be distributed in the
Airspace store.

28. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
Recap
• Devices
• NUI
• Usability

29. Leap, RealSense, Kinect
30Intel® RealSense™ Hands-On Lab - Milan
2,5 cm 60 cm 2 m 4 m

30. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
Q&A
Tutto il materiale di questa sessione su
http://www.communitydays.it/
Lascia subito il feedback su questa sessione,
potrai essere estratto per i nostri premi!
Seguici su
Twitter @CommunityDaysIT
Facebook http://facebook.com/cdaysit
#CDays15