Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

1. Artificial Intelligence: Building
Emotion & Context aware
Real-time Applications
Filip Maertens
Founder
http://www.arguslabs.com
filip.maertens@arguslabs.com
@fmaertens

2. A CURRENT STATE OF AFFAIRS

3. The perfect storm called ubiquitous computing
“ Computing is everywhere
and anywhere. ”

4. Clarifying the ambient intelligence paradigm
a pervasive computing principle that is sensitive and responsive
Artificial Intelligence  Affective Computing

5. Putting some numbers in perspective
Wearables
30B units by 2018
Up to 10 sensors
Connected Devices
US$ 290B by 2018
Up to 6 sensors
Smart-phones
2,8B units by 2016
Up to 12 sensors

6. Context-awareness explained
what I tell my grandma what I do
“ We help your phone know you so
well, it helps you to interface with
the world in a much more natural,
proactive, and personalized
manner, so it behaves
like a sixth sense ”

7. The era of a smart-phone agent
Intelligent capabilities need to be interfacing with the end user, as
an overall service layer. Good privacy controls are required, but
most importantly added value must be shown through the use of
intelligent and sensing apps.
This might feel strange today, but remember the last time you didn’t
allow this?

8. Engage in a context-aware manner
Engaging at the right m o m e n t , under the right c i r c u m s t a n c e s .
Time
Feeling
…
Activities
Habit
Mood
Weather
Road type
…
Behavior

9. How context upgrades your content
Know what you are
listening to
Understand the
circumstances you
are listening to

10. CONTEXTUAL COMPUTING WITH ARGUS LABS

11. “ Argus Labs has created a sensor fusion platform
capable of near real-time contextualization
and profiling using deep learning ”

12. “ Argus Labs is capable of sensing, understanding
and predicting the context, behavior and mood
of a mobile audience ”

13. The sensor storm: sensors are everywhere
Sensors are a device’s equivalent to possessing human-like sensing
capabilities and allow to sense and understand contextual cues.
Automatic gender detection, through walking patterns
Mood detection, through mobile handling
Sound source detection (gyroscope sampling)
Activity detection (walking, running, sitting, …)
…
Automatic in- versus outdoor detection
Mood detection, through heart rate and oxygen level detection
…
@arguslabs

14. Turning sensor data into behavioral, context,
and emotional awareness
ARGUS MOBILE SENSING
SD
K
ARGUS
PLATFORM
…
LVL 3
PROFILE
S
LVL 2
MOMENTS
LVL 1
EVENTS

15. EVENTS
Sense and interpret the
contextual cues of a mobile user
MOMENTS
Uncover habits and predict
human behavior
PROFILES
Learn about the ever-changing
personalities of a
mobile user
LAYER 3
ACTIVENESS
DRIVING STYLE BEHAVIOUR
LAYER 2
ARRIVING AT HOME, WORK, ..
LAYER 1
…
WAKING UP …
…
SOCIALNESS
SLEEPING
IN A MEETING
DRIVING (CAR) TRAIN SUBWAY
WALKING RUNNING
BUS
SITTING STANDING
TRAM MOTORCYCLE
AIRPLANE BIKING
BUSY
BORED TIRED
LOUD ENVIRONMENT
ALONE
HOME
WORK
COMPANY
COMMUTING TYPE
CHATTY
CALM
DRIVING
BEHAVIOUR
FOR EXAMPLE PROFILES

16. Self-learning
biking – running – depression – stress – happy – excited –
petrol head – soccer mom – car – party – music – meeting
room – busy
day – and much, much more

17. 2013
processing nonverbal
cues
2000
carrying verbal
communication

18. Know who you’re sharing a ride with
Has the driver a normal driving style? Or is the passenger heading home
after a stressful and long day at the office. Wouldn’t you want to know
who you’re getting in the car with? Being able to use these kinds of
behavioral insights and use this to make a safer or more personalized
rideshare, can make the difference between a ride from hell or a high
quality experience.
Added value features
1. Profile and score the driving behavior
2. Learn what influences the passenger’s behavioral
3. Negotiate better insurance premiums based on actual driver risk
scores
Case study: driving behavior
Industries: Insurance, Fleet, Peer to Peer Ride Sharing

19. Case study: emotions in music
Industries: Context-aware recommender systems

20. Apps are changing
Service layers are emerging as background apps that only
interface with a mobile users when it’s really relevant.
User experiences become non-linear.

21. Turning context-awareness in mobile engagement

22. Argus Labs is already transforming industries …
Usage Based Insurance // Insurance
Transforming the insurance industry into a personalized care taker.
Context-Aware Media Recommendations // Media
Providing personalized and intelligent media discovery experiences
Consumer & Professional Healthcare // Healthcare
Turning multi-dimensional sensor layers into a reliable diagnosis

23. … and growing in following industries
Deep Platform Integration // IOT/OEM
Being the cognitive layer that understands sensor packed wearables
Mobile Advertising // Advertising & Marketing Automation
Turning ads into meaningful and precision targeted advice.
Mobile Fleet Tracking // Fleet & Mobility
Combining driver and vehicle behavior in a new and holistic manner.

24. Every object becomes a
channel

25. We did it !
The first time ever people can start
making machines and software cognitive,
context and emotionally aware of their human users

26. Artificial Intelligence: Building
Emotion & Context aware
Real-time Applications
Filip Maertens
Founder
http://www.arguslabs.com
filip.maertens@arguslabs.com
@fmaertens