This document discusses applications of emotion recognition technology across several domains: 1) Medicine - To help monitor patients and enhance healthcare like rehabilitation, companion robots, and counseling. It could also help with autism therapy and music therapy. 2) E-learning - To adjust an online tutor's presentation based on a learner's emotions, making the tutoring experience more interactive and effective. 3) Monitoring - Such as detecting emotions in car drivers to alert other cars, warning employees before angry emails, and prioritizing angry calls at call centers. 4) Entertainment - Like music players that satisfy users based on recognized moods. 5) Marketing - To improve advertising by understanding emotional impacts and engagement

1. Applications of
Emotions Recognition
Francesco Bonadiman
franzbona@hotmail.it
30 January 2015
Computer-Supported Interaction

2. Emotion Recognition
EEG + Brain Computer Interfaces
upload.wikimedia.org/wikipedia/commons/b/bf/EEG_cap.jpg
2

3. Emotion Recognition
EEG + Brain Computer Interfaces
ECG + Cardiovascular signals
atrialfibrillation.org.uk
upload.wikimedia.org/wikipedia/commons/b/bf/EEG_cap.jpg
2

4. Emotion Recognition
EEG + Brain Computer Interfaces
ECG + Cardiovascular signals
Electrodermal activity
ycanaustralia.com
atrialfibrillation.org.uk
upload.wikimedia.org/wikipedia/commons/b/bf/EEG_cap.jpg
2

5. Emotion Recognition
Speech + Voice intonation
www-03.ibm.com
3

6. Emotion Recognition
Speech + Voice intonation
Facial expressions
chilloutpoint.com
www-03.ibm.com
3

7. Emotion Recognition
Speech + Voice intonation
Facial expressions
Body language
chilloutpoint.com
www-03.ibm.com
winwithvictory.com
3

8. Human vs. Human
arabianindustry.com
4

9. Human vs. Machine
orbitmedia.com
5

10. Human vs. Machine
orbitmedia.com
EMOTIONS?
5

11. davenussbaum.com
6

12. Applications of Emotion Recognition
Medicine E-learning Monitoring
Entertainment Law Marketing
7

13. 1. Medicine
baysidecarecenter.com
Rehabilitation →
help monitoring
8

14. 1. Medicine
baysidecarecenter.com iavrpt.org
Companion →
enhance realism
8

15. 1. Medicine
baysidecarecenter.com iavrpt.org degreequery.com
Counseling
→ client’s
emotional
state
8

16. 1. Medicine
baysidecarecenter.com iavrpt.org degreequery.com masainternational.com
Health care → patients’
feelings about treatment
8

17. Autism
- struggling to
interpret
expressions
mychildwithoutlimits.org
9

18. Autism
- struggling to
interpret
expressions
- game with this
same purpose
mychildwithoutlimits.org
9

19. Autism
- struggling to
interpret
expressions
- game with this
same purpose
- develop a system
→ therapy
mychildwithoutlimits.org
9

20. http://youtu.be/Suc5B79qjfE?t=40s
10

21. Music Therapy
- help patients
deal with stress,
anxiety and
depression
musictherapy.orggaryradler.com
11

22. Music Therapy
- help patients
deal with stress,
anxiety and
depression
- positive effects
on Alzheimer
musictherapy.orggaryradler.com
11

23. Music Therapy
- help patients
deal with stress,
anxiety and
depression
- positive effects
on Alzheimer
- EEG = real-time
musictherapy.orggaryradler.com
11

24. 2. E-learning
- adjust the
presentation
style of an
online tutor
educed.org
12

25. 2. E-learning
- adjust the
presentation
style of an
online tutor
- detect the
state of the
learner
educed.org
12

26. Tutoring system
- positive attitude to
maximize learning
skypeteachingjobs.com
13

27. Tutoring system
- positive attitude to
maximize learning
- more interactive
and effective
skypeteachingjobs.com
13

28. Tutoring system
- positive attitude to
maximize learning
- more interactive
and effective
- provide feedback
and guide towards
a solution
skypeteachingjobs.com
13

29. 3. Monitoring
sbtjapan.com
Car driver →
detect state and
alert other cars
14

30. 3. Monitoring
sbtjapan.com manage.grabweb.net
Agent → warning
before angry email +
invite to calm down
14

31. 3. Monitoring
sbtjapan.com manage.grabweb.net s3.amazonaws.com
ATM not dispensing
money when scared
14

32. Call-center system
- recognize
voices
lovemoneylaw.com
15

33. Call-center system
- recognize
voices
- detect
anger in
speech
lovemoneylaw.com
15

34. Call-center system
- recognize
voices
- detect
anger in
speech
- prioritize
angry calls
lovemoneylaw.com
15

35. Remote Love
- globalization → mobility
weknowmemes.com
16

36. Remote Love
- globalization → mobility
- long distance relations
weknowmemes.com
16

37. Remote Love
- globalization → mobility
- long distance relations
- recognize partner’s true
emotional state
weknowmemes.com
16

38. Remote Love
- globalization → mobility
- long distance relations
- recognize partner’s true
emotional state
- heartbeat pulsing rings
weknowmemes.com
16

39. Remote Love
- globalization → mobility
- long distance relations
- recognize partner’s true
emotional state
- heartbeat pulsing rings
- phone detecting affection
weknowmemes.com
16

40. 4. Entertainment
i.ytimg.com
17

41. jonlieffmd.com
- Recognize mood
and emotions of
the users
Music Player
18

42. jonlieffmd.com
- Recognize mood
and emotions of
the users
- satisfy needs
Music Player
18

43. 5. Law
deeper
discovery of
depositions
cdn2.hubspot.net
19

44. 6. Marketing
- impact of ads
redorbit.com
20

45. 6. Marketing
- impact of ads
- attention and
engagement
redorbit.com
20

46. 6. Marketing
- impact of ads
- attention and
engagement
- emotion vital in
purchasing
decisions
redorbit.com
20

47. 6. Marketing
- impact of ads
- attention and
engagement
- emotion vital in
purchasing
decisions
→ improve sales
redorbit.com
20

48. References
1. Yoon W.-J. , Park K.-S., A Study of Emotion Recognition and Its Applications, 4th International Conference,
MDAI, Springer, 2007
2. Yoon W.-J. , Park K.-S., A study of speech emotion recognition and its application to mobile services, 4th
International Conference, UIC, Springer, 2007
3. Rached T.S., Perkusich A., Emotion Recognition Based on Brain-Computer Interface Systems, Brain-Computer
Interface Systems, 2013
4. Ntombikayise B., Robinson P., Multimodal Affect Recognition in Intelligent Tutoring Systems, Proceedings of
the 4th international conference on Affective computing and intelligent interaction, 2011
5. Petrushin V., Emotion recognition in speech signal: experimental study, development, and application, ICSLP,
2000
6. Liu Y., Sourina O., Nguyen M.K., Real-time EEG-based Emotion Recognition and its Applications, Special Issue
on Cyberworlds, 2011
7. ExtremeTech:extremetech.com/extreme/189259-real-time-emotion-detection-with-google-glass-an-
awesome-creepy-taste-of-the-future-of-wearable-computers
8. Speech emotion recognition: emospeech.net
9. Emotient, leading authority on emotion detection and sentiment analysis technologies: emotient.com
10. Wikipedia: en.wikipedia.org/wiki/Affective_computing
21

49. 22