3. 3D Facial Imaging
Best-in-Class Facial Imaging Analytics
29/08/13 Copyright nViso SA 2013. All rights reserved.
2
Founded 2009, SwitzerlandFounded 2009, Switzerland
12+ years research at EPFL12+ years research at EPFL
1Million+ subjects worldwide1Million+ subjects worldwide
Realtime on IBM SmartCloudRealtime on IBM SmartCloud
5. 3D Facial Imaging
Fundamental Emotion Research
29/08/13 Copyright nViso SA 2013. All rights reserved.
4
Investment in Emotion
60Mio CHF
Interaction with computers
Study of emotion
Spin-offs
nViso (emotion)
Koemei (speech)
Kooaba (mobile content)
Future Invesment
110Mio CHF
Global neurosciene hub
Human brain project
FutureFuture2001 2005 2009 2011 20122001 2005 2009 2011 2012
IM2
Study of human
computer
interaction
Affective Sciences
Study of emotions
Founding of nViso
Spin-out from EPFL
Deployment on
IBM SmartCloud
In-market trials
Creation of
Neuropole in
Lausanne, global
Neuroscience hub.
6. 3D Facial Imaging
Language
Emotion Fundamental in Daily Life
5
Face
Speech
Head
Gesture
Touch
Body Pose EMOTION
How To
Measure and
Understand?
System1 by
Design
System2 by
Design
?
29/08/13 Copyright nViso SA 2013. All rights reserved.
7. 3D Facial Imaging
The Face as a Sensor
29/08/13 Copyright nViso SA 2013. All rights reserved.
6
EmotionEmotion
AttentionAttention
GesturesGestures
BehavioursBehaviours
2D-3D Face Rec2D-3D Face Rec
IdentityIdentity
8. 3D Facial Imaging
The Facial Nerve : The Link to the Brain
7
Difficult to measure areas :
– Emotion (amygdala)
– Long Term Memory (hippocampus)
What can be measured :
– Facial expressions
– Involuntary micro-expressions
– Head and eye movements
– Blood flow (heart rate)
29/08/13 Copyright nViso SA 2013. All rights reserved.
Unique Measure of Affective StateUnique Measure of Affective State
9. 3D Facial Imaging
From Great Artists to Scientists
29/08/13 Copyright nViso SA 2013. All rights reserved.
8
10. 3D Facial Imaging
Facial Coding : Ekman
happiness surprise fear anger disgust sadness
29/08/13
Universal expressions of emotion
Facial Action Coding System
Problem – requires manual coding
Copyright nViso SA 2013. All rights reserved.
9
11. 3D Facial Imaging
nViso 3D Facial Imaging Software
29/08/13 Copyright nViso SA 2013. All rights reserved.
10
Artificial intelligence precisely detects facial muscles
Facial muscles movements encoded based on FACS
Machine learning system decodes facial behavior
Software maps 143
points in the
image directly to
facial muscles
12. 3D Facial Imaging
nViso In Action
29/08/13 Copyright nViso SA 2011. All rights reserved.
Webcam Feed
Real-time Emotional State
Stimulus Video
11
13. 3D Facial Imaging
Mix of Emotions
(Heineken : Walk in Fridge)
29/08/13 Copyright nViso SA 2013. All rights reserved.
12
Course of time
Was Drop Expected?
(channel switching)
Was Drop Expected?
(channel switching)
10
Brand Impact
(measure of brand)
Brand Impact
(measure of brand)
30
Peak Expected?
(branding moment)
Peak Expected?
(branding moment)
22
