How do you display emotion on a Smartphone? A test case with stress, from Empatica. The speech given by Matteo Lai at UXconference2013

1. iLens
EXTREME
ANGER
MATTEO, TRY THIS:
‘I swear!
I really wasn’t
smiling at that
blonde’

3. 28 MM
21+ MM
patients are treated for ANXIETY
DISORDERS (stress included) each year
people suffer from DEPRESSION each
year in the US only

4. NO DATA!

5. AUTOMATIC TRACKING
SIGNALS
LOCATION
ACTIVITY
EMOTIONS

6. WHAT WE DO
Empatica E3
Heart Rate
GSR
Temperature
Accelerometers

7. DEVICE
Sensors
Flash memory
PhotoPletismography (PPG)
Bluetooth LE
(Smart)
3-axis Accelerometer
Temperature + Heat flux
Galvanic Skin Response (GSR)

8. DATA COLLECTION

9. DATA COLLECTION PROJECTS
- Stress monitoring in everyday life
- Safety for elderly population
- Stress monitoring in the workplace
- Autism on kids
- Child and teenage obesity
- Parkinson’s early detection
- Improve care delivery: relationship
- Monitor and predict urban security
physician-patient
- Mother-infant care and relationship
- Biofeedback stress training
- Impact of commuting and transportation
- Psychologist therapy monitoring
- Hypertension prediction and therapy
- Health gaming biofeedback for PTSD
- Driving safety monitoring
- Chronic pain monitoring
- Monitoring everyday life for elite sports
- Monitoring flow and relaxation
players
- Group interaction
- Physical rehab support tool
- Student engagement

10. SOME CLIENTS
This list is not complete due to confidentiality agreements

11. HOW WE DO IT
Raw signals from sensors
Extracted features
Emotional states
Filtering +
Features extraction
Alghorithms +
Statistical models
Blood Volume Pulse
Heart Rate Variability
Stress
Galvanic Skin
Response
Breathing Rate
Excitement
Temperature
Movement
Ongoing research
Accelerometers
Metabolic Equivalent (MET)

12. OUR UX
1 Medical-Consumer convergence
2 Medical quality + Consumer Experience
3 Simple, Simple, Simple

13. CHALLENGES
1 Data complexity
2 Engagement
3 Interface

14. COLLECTIVE
AWARENESS
TEAMS
COUPLES
FAMILIES

15. Experience flow
BEHAVIOR
CHANGE
AWARENESS
INSIGHTS/
ACTIONS
DATA/
FEEDBACK

16. Experience flow
BEHAVIOR
CHANGE
AWARENESS
INSIGHTS/
ACTIONS
DATA/
FEEDBACK

17. BRAVE NEW SCREENS
DESKTOP
SMARTPHONE
WEARABLE
DISPLAYS

18. HOW TO LOOK AT IT?
DATA VIZ
MAP
DASHBOARD

19. TEAM FINGERPRINT

20. TEAM FINGERPRINT

21. TEAM FINGERPRINT

22. SMARTPHONE

23. SMARTPHONE

24. WEARABLE

25. TNX!
Matteo Lai
fb: matteo.lai
t: @matteolai
www.empatica.com

26. Q?