Business and public-sector entities use individual and aggregated data to understand customer/constituent wants and needs. This can range from basic satisfaction survey data to analyzing movement in physical spaces and tracking shopping cart habits online. There is no shortage of data to analyze and use for planning and prediction. The challenge has always been to understand the context that explains behavior in order to deliver a more personalized experience. Traditionally, that has required an expensive “high touch” approach with staff who can “read” and respond to non-verbal cues. Today, some of this context can be captured using sentiment analysis of text but we are rapidly approaching the point where systems will be able to digitally interpret the parts of human communication that have long been elusive: gestures and the emotions they represent in context. This webinar will present an overview of emerging software and sensor technologies that enable perception and personality-trait analysis. In this webinar, participants will learn: Why sentiment analysis from social media streams is just the beginning for hyper-personalized customer engagement, How technologies to detect and classify gestures and emotions will mature from science fiction and the entertainment-industry to become critical requirements for business applications, and How to incrementally deploy advanced human-computer interface (HCI) technologies in your applications

1. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sense and Sensors - From Perception to Personality
Adrian Bowles, PhD
Founder, STORM Insights, Inc.
info@storminsights.com

2. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sensor…
A device that detects the presence of a signal
and reports/signals data about that signal/event
Sensors are Event-driven
May be Stationary or Mobile

3. Sensors
Algorithms
Data
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
AlgorithmsSignal Sensors
Insights
Noise

4. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

5. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

6. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

7. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

8. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
How We Imagine & Implement the User Interface Constrains HCI

9. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
How We Imagine & Implement the User Interface Constrains HCI
Batch
Command Line
GUI
Gestures
Input Output
Human
Machine Batch
Streams

10. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
CCTV SmartPhone
Traffic
Counter Fitbit
Data
Complexity
Stationary Mobile
Low
High
Weather
Station
Telematic
Device

11. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
In the news…

12. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

13. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

14. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

15. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

16. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

17. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

18. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

19. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Alex Coppel / Herald Sun/Getty Images
Fernando Alonso Walks Away from a 46G Impact

20. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

21. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sensors in Your Smartphone (iPhone example)
Type Typical Current Use Potential Use
Accelerometer/motion
Rotate screen, Switch screen to
landscape/portrait
Ambient Light Adjust screen brightness
Barometer Measure altitude
Geo-Location (wifi/cellular) Location/Alerts
3-Axis Gyroscope Rotation rate for games, VR…
Proximity
Turn off screen when phone is by
your head
Touch ID fingerprint Security

22. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

23. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

24. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

25. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

26. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

27. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

28. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
So your phone/app knows your
Location
Acceleration
.
.
.
.
Motivation?
Motivation
reflection
inference
Natural Cognitive Processes
deduction
reasoning
Learning
Perception

29. Narrative Generation
Voice/NLP
Video/Images
Gestures
Emotions
Text/NLP
• Affectiva
• BeyondVerbal
• Emotient Apple!
• Nviso
• Gridspace
• IBM
• Maluuba
• Nuance
• PopupArchive
• Skymind
• Viv Labs
• Wit.ai
• ABBYY
• Altilia
• Cortical.io
• IBM
• Kaypok
• Luminoso
• Maluuba
• Wit.ai
• APX Labs
• BRS Labs
• Clarifai
• Dextro
• Madbits (twitter)
• Mindops
• Skymind
• Teradeep
• Visenze
• Narrative Science
• OnlyBoth
• APX Labs
• EyeSight
• LeapMotion
• Nod
• Intel
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Analytics/Visualization
• 1010data
• Adatao
• Alpine Data Labs
• Alteryx
• Altilia
• Angoss
• Attivio
• Birst
• Civis Analytics
• ClearStoryData
• Connotate
• Context Relevant
• Dataiku
• Datameer
• Emerald Logic
• Finch Computing
(was Synthos)
• First Rain
• ForeSee
• Fractal Analytics
• Guavus
• IBM
• indico
• KNIME
• KXEN (SAP)
• LiftIgniter
• MathWorks (Matlab)
• Microsoft
• Mu Sigma Nara Logics
• NuTonian
• Opera Solutions
• Oracle
• Palantir
• Pentaho
• Prediction IO
• Predixion
• Qliktech
• Quid
• Rapid Miner
• Revolution Analytics(MSFT)
• Salford Systems
• SAP
• SAS Institute
• SiSense
• Spark Beyond
• Spotfire (Tibco)
• StatSoft (Dell)
• Teradata
• Versium
• Wolfram Mathematica
• Yhat
Data Management
• Actian
• Aerospike
• Alation
• Basho
• Caspio
• Cognizant Technology
• Couchbase
• CrowdFlower
• CumuLogic
• Data Bricks
• DataRPM
• DataStax
• DataWeb, Inc.
• DDN
• diffbot
• GigaSpaces
• GridGain
• Hortonworks
• IBM
• import io
• kimono
• MapR
• MarkLogic
• MongoDB
• NeoTechnology
• Oracle
• Paxata
• RainStor
• SAP
Alt/Neuromorphic
Hardware
• Artificial Learning
• DWave
• HRL Laboratories
• IBM
• Nervana Systems
• Nvidia
• Qualcomm
• Teradeep

30. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sentiment/Emotion Analysis
vs
Theme/Concept Analysis

31. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.Source: IBM Bluemix June 9, 2016

32. GestureRecognition/Analytics
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

33. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
EmotionRecognition/Analytics

34. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
My Results
on the
Affectiva Demo
Affectiva: 7 Emotions
Anger
Sadness
Disgust
Joy
Surprise
Fear
Contempt

35. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

36. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sense and Sensors - Findings & Recommendations

37. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sometimes the wisdom of crowds
leads to
Unintended Consequences
Findings & Recommendations

38. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
According to MaxMind…
This farm is home to
600,000,000 IP Addresses
Watch Out for Unintended Consequences,
Especially With Big Data
Findings & Recommendations

39. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Where there are sensors,
there are data.
Where there are data, there
should be sensors.
Findings & Recommendations
More applications create more
value for data, more data create
more value for applications.
Evaluate all data sources for
new applications, always look
to expand your data portfolio.

40. For more information:
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
adrian@storminsights.com
Twitter @ajbowles
Skype ajbowles
Upcoming Webinar Dates & Topics
July 13 Modern AI & the Future of Work
August 11 Advances in Natural Language Processing
September 8 Autonomous Systems, from Science Fiction to Commercial Solutions
October 13 Deep QA (Question/Answer) - Lessons From Watson and Jeopardy!
November 10 Emerging Hardware Choices for Modern AI Data Management
December 8 Leverage the IOT to Build a Smart Data Ecosystem