Mobile data analytics is still in the early stages of development but brings opportunities for innovative new features in smartphones and transforming businesses. Future mobile devices will be built on analytics platforms to deliver intelligent, personalized, and context-aware features. Virtual assistants, text, image, video, gesture, and multi-model analytics were discussed along with trends and enabling technologies in each area.

1. Trends in Mobile Data Analytics
Satnam Singh, PhD
Senior Chief Engineer,
Samsung India Software Operations, Bangalore
[Thanks – Ravindra Guntur, Jithendra Vepa, Balvinder Singh
and other researchers mentioned in References]

2. Motivation: Context-Aware Intelligent Devices
Image/
Music Video Speech Location
Gesture
Text
Acceleration
Transform mobile devices into
intelligent context-aware systems
Learn from user’s context,
history of interactions, and state
of the physical environment
2

3. Speech Analytics: Trends
• Current Virtual
Assistants (VAs):
S-Voice [Samsung] Siri [Apple] – Local Search and maps
– Weather
– Voice dialing, SMS and
email, etc.
• Future VAs - knowledge-
centric
Google Voice &
Vlingo [Nuance] Google Now • Understand user’s intent
[Google]
[Beyond Siri]
3

4. Virtual Assistants Technology
Text
Text
• Future VAs need to perform well in noisy environment
4

5. Text Analytics: Trends
[SGI]- Twitter's 'heartbeat • B2B Applications: Brand
building and Social
Marketing
• Social network-driven
Recommendation Engines
[Socialbakers]
5

6. Text Analytics: Technology
Unstructured Lexiconsor
Lexicon or
Text Corpus Dictionaries or
taxonomy or
Ontology
Ontologies
Text Term
Representation Clustering
and
Classification
• Beyond “searching”
• Enables What-If Analysis, Information Retrieval and
Detection
6

7. Image Analytics: Trends
Saveup
• SaveUp -Visual Search:
[recognize.im]
Vivino
• Vivino app- Wine Search [Kooaba]
• Viewing crowdsourced content
CrowdOptic [CrowdOptic]
• Google Goggles, Nokia Point,
Amazon Snaptell, Ricoh iCandy,
7

8. Image Analytics: Technology
[B. Girod]
Crowd Optic
[A. Stefan]
Object Recognition
Detect and Cluster Events

9. Video Analytics: Trends and Technology
Video Motion Detection
• B2B Applications in Surveillance and
Remote Monitoring
• Video Enhancements
Intrusion Detection
• Technology: Image and Object
Recognition, Machine Learning
Video Panorama
[IntelliVision]
9

10. Gesture Analytics: Trends
• Navigate a smart TV with
hand gestures [Tarsier]
• Hand gesture-based start
and stop music [Flutter] Fluttter
• Goodbye to your Mouse
and Keyboard [Leap
Motion]
• Various Users: Surgeons,
Gamers, Artists, Engineers
10

11. Gesture Analytics: Technology
• Computer Vision - Template Matching use
Semaphores – sign language, Tracking and
morphing
Feature Extraction
and hand detection
Pattern
Matching with
Existing
Templates Gesture-
(Hidden Markov Driven
Models) Control/Action
11

12. Multi-Model Analytics: Trends
• Indoor Maps – airports,
hospitals, etc.
• 3D Maps- Cool 3D Maps
[eeGeo]
• Activity Recognition: Detect
walking, driving, biking, climbing
stairs, standing, etc. [Alohar
mobile, ActiServ]
12

13. Multi-Model Analytics: Technology
• Indoor Map Technology- Wi-Fi fingerprinting: Cisco Systems,
Qualcomm and indoor map developer Meridian
• Indoor Map Startups – [Aisle411,Wifarer, Micello, Meridian, Point
Inside and MapEverywhere]
• Activity Recognition Technology : A combination of
Accelerometer/GPS, timing and wifi data
[ActiServ]
13

14. Summary
• Mobile data analytics is still in infancy stage
• Mobile Data Analytics:
– Would bring innovative features in next generation
smartphones (B2C Opportunities)
– Transform the businesses through their deep
integration in B2B solutions
• Future mobile devices would be build on
analytics platform and deliver intelligent,
personalized, context-aware features and
services
14

15. References
• Beyond Siri, http://www.visionmobile.com/blog/2012/06/infographic-beyond-siri-the-next-
frontier-in-user-interfaces/
• Nuance Communications,
• https://www.recognize.im/site/showcaseApps
• B. Girod, “Mobile Visual Search,” IEEE Signal Processing Magazine, July 2011.
• http://www.usatoday.com/story/tech/2012/11/26/indoor-map-technology-poses-challenges-
and-opportunities/1698739/
• Tarsier Inc. http://www.moveeye.info/
• LeapMotion, https://leapmotion.com/
• SGI -Global Twitter Heartbeat, http://www.sgi.com/go/twitter/
• Flutter, https://flutterapp.com/
• A. Stefan, V. Athitsos, J. Alon, and S. Sclaroff, “Translation and scale-invariant gesture
recognition in complex scenes,” ACM PETRA '08
• 3D Maps, http://www.mapply.com/ , http://recce.at/
• IntelliVision, http://www.intelli-vision.com/products/intelligent-video-analytics/intelligent-video-
motion-detector
• ActiServ: Activity Recognition Service for Mobile Phones,
www.teco.kit.edu/~gordon/publications/ISWC10_berch.pdf
15