SlideShare ist ein Scribd-Unternehmen logo
1 von 47
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Modeling Human Activity with Opportunistic Analytics
Fahim Kawsar
Scalable Systems, Bell Labs
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Bell Labs
A Heritage of Innovation
lightRadio
UNIX
Operating
system
C & C++
Programming
languages
The
telephone
Communications
satellites
Digital signal
processing
CCD
(digital
camera)
Cellular
telephony
DSL PONWDM
The TRANSISTOR
The LASER
LEADING EDGE RESEARCH
30,700
ACTIVE
PATENTS
TR50
MOST INNOVATIVE
Companies
2012
8
COUNTRIES
2,900
PATENTS
IN 2012
R&D BUDGET
€2.3b
7
NOBEL
PRIZES
COLLABORATE
WITH
250+
universities
Research by Development, KISS Principle, Top Down and End-to-End approach.
Research Objective
Research Methodology
Design and Development of Large Scale Distributed Systems for Next Generation Communication and Data Driven
Telecom Services.
Scalable Systems
Department
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Audience Participation
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Smart !!
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Plethora of User Generated Trajectories
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Quantifying Yourself
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Activity Aware Search Experience
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Better Experience with Pervasive Spaces
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Contextual Notification
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Predictive Appliance Management of Homes
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Collective Measure
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Activity Aware Recommendation
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Smart Pricing
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Collective Measure
Network Resource Planning
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Business Intelligence
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
You Own Your Data
You Sell Your Data
Gerd Kortuem and Fahim Kawsar "Market-based
User Innovation for the Internet of Things";
Internet of Things 2010 Conference
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Opportunistic Analytics
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Opportunistic Analytics
Methodology
Data Collection
and Dimension
Reduction
Segmentation and
Behavioral
Profiling
Trajectory
Inference
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
On Body + Add-on Sensors are used to
collect data and ML techniques are used
to model and predict activity.
Classical Approach
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Your Noise is my Signal
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Location + Time + Venue Type = Activity
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Location + Time + Application Type = Activity
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Location + Time + Application Type = Activity
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Opportunistic Observation
By observing an individual’s engagement with semantically rich applications annotated with
temporal and spatial information, we can infer an individuals activity.
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Opportunistic Analytics
‣ Evaluate Available Data Sources
‣ Identify Unique Characteristics
‣ Extract Relevant Data Filed
‣ Combine Co-Related Data Sources
to increase information Density
‣ Perform Segmentation based on
Spatial/Temporal/Activity Regularity
‣ Determine Behavioral Attributes of
Different Segments
Methodology ‣ Leverage Behavioral
Regularity to Identify and
Infer Activity Trajectory
Data Collection
and Dimension
Reduction
Segmentation and
Behavioral
Profiling
Activity Trajectory
Inference
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Case Studies
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Collecting Smart Phone Trajectories was not trivial, so instead we have
collected social network and home network activity traces for our research.
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Case Studies I
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Location-Aware Social Activity
Dataset
LBSN - Foursquare and Twitter - Traces
Custom collected Geo-Fenced Tweets, and Foursquare Tweets
are analyzed to construct activity trajectory.
825 Users
79431 Check-ins
1 Year
157806 Geo-Tweets
30 KM
Geo tagged Tweets with
embedded Foursquare
check-in URL
Longitude, Latitude,
Timestamp, Location
Name, and Category
Dataset
Location + Time + Venue Type = Activity
“Primary FourSqaure venue categories
are analyzed with 325 locations to
extract 10 distinct activity types”.
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Density Enhancement
Multiple Traces can be combined by co-relating their spatio-temporal properties to increase
information density.
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
“Foursquare traces are semantically rich
and hence Geo-Tweets can be annotated
with FourSqaure activities by co-relating
spatio-temporal properties”
Shhhhhh!!
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Density Improvement of the FourSqaure Trace by including custom annotated Geo-Tweets
that were originated from previously checked-in locations.
0
10000
20000
30000
40000
50000
60000
70000
5 10 20 50 100 200 500 1000
y = 8071.1x - 4439.4
R² = 0.9654
NumberofPointsAdded
Distance in Meters
Enhancement of Information Density
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
0
75
150
225
300
6 AM 8 AM 10 AM 12 PM 2 PM 4 PM 6 PM 8 PM 10 PM 12 AM 2 AM 4AM
Arts and Entertainment
Universities
Breakfast
Lunch
Fast Food
Dinner
Outdoor
Nightlife
Shopping
Travelling
Time of the Day
NoofUsers
Activity Trajectory
0
75
150
225
300
6AM 8AM 10AM 12PM 2PM 4PM 6PM 8PM 10PM 12AM 2AM 4AM
NoofUsers
Without Density Enhancement
With Density Enhancement (20m)
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Opportunistic Analytics
Data Collection
and Dimension
Reduction
‣ Evaluate Available Data Sources
‣ Identify Unique Characteristics
‣ Extract Relevant Data Filed
‣ Combine Co-Related Data Sources
to increase information Density
‣ Perform Segmentation based on
Spatial/Temporal/Activity Regularity
‣ Determine Behavioral Attributes of
Different Segments
Methodology ‣ Leverage Behavioral
Regularity to Identify and
Infer Activity Trajectory
Data Collection
and Dimension
Reduction
Segmentation and
Behavioral
Profiling
Activity Trajectory
Inference
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Case Studies II
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
In-Home Web Activity
Dataset : Project LeYLab
In-Home Internet Activity Traces
Living Lab for Fiber based Services in the City of Kortrijk, Belgium.
ALU 7750 Service Router with Report and Analysis Manager (RAM) was used in the backbone.
86 Households
75 Applications
60 Days
9288000 Data Points
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Heuristic : Time + Application Type = Activity
“Semantically identical applications are
grouped together to reduce data
dimensionality, as well as to shift analysis
focus to activity. 75 Applications are mapped
into 8 distinct activity types”
Accumulated activity footprint of a representative household, activity is spread over through
out the day, with higher engagements during evenings
Activity Trajectory
0
5
10
15
20
25
6 AM 8 AM 10 AM 12 PM 2 PM 4 PM 6 PM 8 PM 10 PM 12 AM 2 AM 4 AM
Web Communication
Soical Networking
Online Gaming
Home Working
Online Shopping
Video Watching
Time of the Day
NoofDays
We have observed an inverse relationship between application usage frequency and
corresponding traffic load.
Accordingly, we model activity using interaction frequency and temporal regularity. This
measure identifies how a household engages with a distinct activity.
Recurrence Measure
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Trajectory Prediction
Trajectory Prediction Algorithm
The algorithm predicts activity patterns of future hour slots of current day by matching
patterns of similar days in the past.
Prediction Performance
60% of households activities can be predicted accurately 70% of times.
CumulativeDistributionFunction(CDF)
0
0.2
0.4
0.6
0.8
1.0
0 0.2 0.4 0.6 0.8 1.0
F-Measure
Opportunistic Observation
By observing an individual’s engagement with semantically rich applications annotated with
temporal and spatial information, we can infer an individuals activity.
Key Points
Density Enhancement
Multiple Traces can be combined by co-relating their spatio-temporal properties to increase
information density.
Trajectory Prediction
The algorithm predicts activity patterns of future hour slots of current day by matching
patterns of similar days in the past.
COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Thank You
Email : fahim.kawsar@alcatel-lucent.com
WWW : http://www.fahim-kawsar.net
http://www.linkedin.com/in/fahimkawsar
@raswak

Weitere ähnliche Inhalte

Was ist angesagt?

cloud of things Presentation
cloud of things Presentation cloud of things Presentation
cloud of things Presentation
Assem mousa
 
Big Data, Analytics, Cloud..and Smart+Connected Communities
Big Data, Analytics, Cloud..and Smart+Connected CommunitiesBig Data, Analytics, Cloud..and Smart+Connected Communities
Big Data, Analytics, Cloud..and Smart+Connected Communities
Rick Huijbregts
 

Was ist angesagt? (20)

Data Modelling and Knowledge Engineering for the Internet of Things
Data Modelling and Knowledge Engineering for the Internet of ThingsData Modelling and Knowledge Engineering for the Internet of Things
Data Modelling and Knowledge Engineering for the Internet of Things
 
Arpan pal u world2012
Arpan pal u world2012Arpan pal u world2012
Arpan pal u world2012
 
Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications
Tutorial on Internet of Thing (IoT) Paradigm in Consumer ApplicationsTutorial on Internet of Thing (IoT) Paradigm in Consumer Applications
Tutorial on Internet of Thing (IoT) Paradigm in Consumer Applications
 
Privacy Mindset for Developing Internet of Things Applications for Social Sen...
Privacy Mindset for Developing Internet of Things Applications for Social Sen...Privacy Mindset for Developing Internet of Things Applications for Social Sen...
Privacy Mindset for Developing Internet of Things Applications for Social Sen...
 
Fog Computing: Helping the Internet of Things Realize its Potential
Fog Computing: Helping the Internet of Things Realize its PotentialFog Computing: Helping the Internet of Things Realize its Potential
Fog Computing: Helping the Internet of Things Realize its Potential
 
Executive Summit for ISV & Application builders - Internet of Things
Executive Summit for ISV & Application builders - Internet of ThingsExecutive Summit for ISV & Application builders - Internet of Things
Executive Summit for ISV & Application builders - Internet of Things
 
Microsoft Azure-powered IoT & AI Solution To Help Farmer
Microsoft Azure-powered IoT & AI Solution To Help FarmerMicrosoft Azure-powered IoT & AI Solution To Help Farmer
Microsoft Azure-powered IoT & AI Solution To Help Farmer
 
The internet of things
The internet of thingsThe internet of things
The internet of things
 
Internet of things (IoT) and big data- r.nabati
Internet of things (IoT) and big data- r.nabatiInternet of things (IoT) and big data- r.nabati
Internet of things (IoT) and big data- r.nabati
 
IoT Architecture for Water Resources Industry
IoT Architecture for Water Resources IndustryIoT Architecture for Water Resources Industry
IoT Architecture for Water Resources Industry
 
Cloud-centric Internet of Things
Cloud-centric Internet of ThingsCloud-centric Internet of Things
Cloud-centric Internet of Things
 
Digital twins: the power of a virtual visual copy - Unite Copenhagen 2019
Digital twins: the power of a virtual visual copy - Unite Copenhagen 2019Digital twins: the power of a virtual visual copy - Unite Copenhagen 2019
Digital twins: the power of a virtual visual copy - Unite Copenhagen 2019
 
cloud of things Presentation
cloud of things Presentation cloud of things Presentation
cloud of things Presentation
 
IoT Methodology Co-creation Workshop with Kraak de Krook and Smart City Ghent...
IoT Methodology Co-creation Workshop with Kraak de Krook and Smart City Ghent...IoT Methodology Co-creation Workshop with Kraak de Krook and Smart City Ghent...
IoT Methodology Co-creation Workshop with Kraak de Krook and Smart City Ghent...
 
Big Data, Analytics, Cloud..and Smart+Connected Communities
Big Data, Analytics, Cloud..and Smart+Connected CommunitiesBig Data, Analytics, Cloud..and Smart+Connected Communities
Big Data, Analytics, Cloud..and Smart+Connected Communities
 
Arduino, Open Source and The Internet of Things Landscape
Arduino, Open Source and The Internet of Things LandscapeArduino, Open Source and The Internet of Things Landscape
Arduino, Open Source and The Internet of Things Landscape
 
The IoT Methodology & An Introduction to the Intel Galileo, Edison and SmartL...
The IoT Methodology & An Introduction to the Intel Galileo, Edison and SmartL...The IoT Methodology & An Introduction to the Intel Galileo, Edison and SmartL...
The IoT Methodology & An Introduction to the Intel Galileo, Edison and SmartL...
 
Evolution and Trends in Edge AI Systems and Architectures for the Internet of...
Evolution and Trends in Edge AI Systems and Architectures for the Internet of...Evolution and Trends in Edge AI Systems and Architectures for the Internet of...
Evolution and Trends in Edge AI Systems and Architectures for the Internet of...
 
05 internet-of-things-io t-cloudcomputing
05 internet-of-things-io t-cloudcomputing05 internet-of-things-io t-cloudcomputing
05 internet-of-things-io t-cloudcomputing
 
Iot and cloud computing
Iot and cloud computingIot and cloud computing
Iot and cloud computing
 

Andere mochten auch

Network Intelligence Driven Human Behavior Modeling
Network Intelligence Driven Human Behavior ModelingNetwork Intelligence Driven Human Behavior Modeling
Network Intelligence Driven Human Behavior Modeling
Fahim Kawsar
 
UbiComp 2013 Talk on Device Dynamics at Home
UbiComp 2013 Talk on Device Dynamics at HomeUbiComp 2013 Talk on Device Dynamics at Home
UbiComp 2013 Talk on Device Dynamics at Home
Fahim Kawsar
 

Andere mochten auch (6)

Research Talk at Bell Labs - IoT System Architecture and Interactions
Research Talk at Bell Labs - IoT System Architecture and InteractionsResearch Talk at Bell Labs - IoT System Architecture and Interactions
Research Talk at Bell Labs - IoT System Architecture and Interactions
 
Network Intelligence Driven Human Behavior Modeling
Network Intelligence Driven Human Behavior ModelingNetwork Intelligence Driven Human Behavior Modeling
Network Intelligence Driven Human Behavior Modeling
 
Pervasive 2011 Talk on Situated Glyphs
Pervasive 2011 Talk on Situated GlyphsPervasive 2011 Talk on Situated Glyphs
Pervasive 2011 Talk on Situated Glyphs
 
UbiComp 2013 Talk on Device Dynamics at Home
UbiComp 2013 Talk on Device Dynamics at HomeUbiComp 2013 Talk on Device Dynamics at Home
UbiComp 2013 Talk on Device Dynamics at Home
 
MobileHCI 2010 Talk on Smart Object Interaction
MobileHCI 2010 Talk on Smart Object Interaction MobileHCI 2010 Talk on Smart Object Interaction
MobileHCI 2010 Talk on Smart Object Interaction
 
IoT 3.0 : Connected Living in an Everything-Digital World
IoT 3.0 : Connected Living in an Everything-Digital WorldIoT 3.0 : Connected Living in an Everything-Digital World
IoT 3.0 : Connected Living in an Everything-Digital World
 

Ähnlich wie Creative Media Days 2012 Talk on Opportunistic Activity Modeling

2015_06_17_Alcatel-Lucent Going Paperless_Enforcing global regulations while ...
2015_06_17_Alcatel-Lucent Going Paperless_Enforcing global regulations while ...2015_06_17_Alcatel-Lucent Going Paperless_Enforcing global regulations while ...
2015_06_17_Alcatel-Lucent Going Paperless_Enforcing global regulations while ...
Guillaume Hatt
 

Ähnlich wie Creative Media Days 2012 Talk on Opportunistic Activity Modeling (20)

Ciudades inteligentes Perú Guillermo Jimenez
Ciudades inteligentes Perú Guillermo JimenezCiudades inteligentes Perú Guillermo Jimenez
Ciudades inteligentes Perú Guillermo Jimenez
 
Smart Cells
Smart CellsSmart Cells
Smart Cells
 
Architecting IoT by Mathew - Alcatel Lucent @ MIMOS IoT TWG Day1
Architecting IoT by Mathew - Alcatel Lucent @ MIMOS IoT TWG Day1Architecting IoT by Mathew - Alcatel Lucent @ MIMOS IoT TWG Day1
Architecting IoT by Mathew - Alcatel Lucent @ MIMOS IoT TWG Day1
 
Sivan Barzily - Carrier Cloud Management via OpenStack
Sivan Barzily - Carrier Cloud Management via OpenStackSivan Barzily - Carrier Cloud Management via OpenStack
Sivan Barzily - Carrier Cloud Management via OpenStack
 
Hoe groot is een Zettabyte (2012)
Hoe groot is een Zettabyte (2012)Hoe groot is een Zettabyte (2012)
Hoe groot is een Zettabyte (2012)
 
How big is a Zettabyte (2012)
How big is a Zettabyte (2012)How big is a Zettabyte (2012)
How big is a Zettabyte (2012)
 
2015_06_17_Alcatel-Lucent Going Paperless_Enforcing global regulations while ...
2015_06_17_Alcatel-Lucent Going Paperless_Enforcing global regulations while ...2015_06_17_Alcatel-Lucent Going Paperless_Enforcing global regulations while ...
2015_06_17_Alcatel-Lucent Going Paperless_Enforcing global regulations while ...
 
Leclerc keynote intrapreneurshipconference dec2013
Leclerc keynote intrapreneurshipconference dec2013Leclerc keynote intrapreneurshipconference dec2013
Leclerc keynote intrapreneurshipconference dec2013
 
What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...
What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...
What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...
 
Ramin elahi fog_computing_ecosystem_final_dec22_updated
Ramin elahi fog_computing_ecosystem_final_dec22_updatedRamin elahi fog_computing_ecosystem_final_dec22_updated
Ramin elahi fog_computing_ecosystem_final_dec22_updated
 
Hybrid Cloud Strategy for Big Data and Analytics
Hybrid Cloud Strategy for Big Data and Analytics Hybrid Cloud Strategy for Big Data and Analytics
Hybrid Cloud Strategy for Big Data and Analytics
 
Internet of Things (IoT) is a King, Big data is a Queen and Cloud is a Palace
Internet of Things (IoT) is a King, Big data is a Queen and Cloud is a PalaceInternet of Things (IoT) is a King, Big data is a Queen and Cloud is a Palace
Internet of Things (IoT) is a King, Big data is a Queen and Cloud is a Palace
 
SRV304 IoT Building Blocks From Edge Devices to Analytics in the Cloud
SRV304 IoT Building Blocks From Edge Devices to Analytics in the Cloud SRV304 IoT Building Blocks From Edge Devices to Analytics in the Cloud
SRV304 IoT Building Blocks From Edge Devices to Analytics in the Cloud
 
Greenclouds Presentation for Jury Meeting TIMMIE Award.
Greenclouds Presentation for Jury Meeting TIMMIE Award.Greenclouds Presentation for Jury Meeting TIMMIE Award.
Greenclouds Presentation for Jury Meeting TIMMIE Award.
 
gogonetlive 4 conference keynote on Internet of Things
gogonetlive 4 conference keynote on Internet of Thingsgogonetlive 4 conference keynote on Internet of Things
gogonetlive 4 conference keynote on Internet of Things
 
Ruben rodriguez best practices implementing oracle mobile cloud service
Ruben rodriguez   best practices implementing oracle mobile cloud serviceRuben rodriguez   best practices implementing oracle mobile cloud service
Ruben rodriguez best practices implementing oracle mobile cloud service
 
World of many (OpenStack) clouds - the Making of the Intercloud
World of many (OpenStack) clouds - the Making of the IntercloudWorld of many (OpenStack) clouds - the Making of the Intercloud
World of many (OpenStack) clouds - the Making of the Intercloud
 
Harness your cloud transformation opportunities
Harness your cloud transformation opportunities Harness your cloud transformation opportunities
Harness your cloud transformation opportunities
 
Gregory Touretsky - Intel IT- Open Cloud Journey
Gregory Touretsky - Intel IT- Open Cloud JourneyGregory Touretsky - Intel IT- Open Cloud Journey
Gregory Touretsky - Intel IT- Open Cloud Journey
 
How datadog was born in and grew with the cloud
How datadog was born in and grew with the cloud How datadog was born in and grew with the cloud
How datadog was born in and grew with the cloud
 

Kürzlich hochgeladen

Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
Chris Hunter
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 

Kürzlich hochgeladen (20)

Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural ResourcesEnergy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 

Creative Media Days 2012 Talk on Opportunistic Activity Modeling

  • 1. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Modeling Human Activity with Opportunistic Analytics Fahim Kawsar Scalable Systems, Bell Labs
  • 2. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Bell Labs A Heritage of Innovation lightRadio UNIX Operating system C & C++ Programming languages The telephone Communications satellites Digital signal processing CCD (digital camera) Cellular telephony DSL PONWDM The TRANSISTOR The LASER LEADING EDGE RESEARCH 30,700 ACTIVE PATENTS TR50 MOST INNOVATIVE Companies 2012 8 COUNTRIES 2,900 PATENTS IN 2012 R&D BUDGET €2.3b 7 NOBEL PRIZES COLLABORATE WITH 250+ universities
  • 3. Research by Development, KISS Principle, Top Down and End-to-End approach. Research Objective Research Methodology Design and Development of Large Scale Distributed Systems for Next Generation Communication and Data Driven Telecom Services. Scalable Systems Department
  • 4. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Audience Participation
  • 5. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Smart !!
  • 6. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Plethora of User Generated Trajectories
  • 7. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
  • 8. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Quantifying Yourself
  • 9. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Activity Aware Search Experience
  • 10. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Better Experience with Pervasive Spaces
  • 11. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Contextual Notification
  • 12. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Predictive Appliance Management of Homes
  • 13. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Collective Measure
  • 14. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Activity Aware Recommendation
  • 15. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Smart Pricing
  • 16. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Collective Measure Network Resource Planning
  • 17. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Business Intelligence
  • 18. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
  • 19. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. You Own Your Data You Sell Your Data Gerd Kortuem and Fahim Kawsar "Market-based User Innovation for the Internet of Things"; Internet of Things 2010 Conference
  • 20. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Opportunistic Analytics
  • 21. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Opportunistic Analytics Methodology Data Collection and Dimension Reduction Segmentation and Behavioral Profiling Trajectory Inference
  • 22. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. On Body + Add-on Sensors are used to collect data and ML techniques are used to model and predict activity. Classical Approach
  • 23. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Your Noise is my Signal
  • 24. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Location + Time + Venue Type = Activity
  • 25. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Location + Time + Application Type = Activity
  • 26. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Location + Time + Application Type = Activity
  • 27. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Opportunistic Observation By observing an individual’s engagement with semantically rich applications annotated with temporal and spatial information, we can infer an individuals activity. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
  • 28. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Opportunistic Analytics ‣ Evaluate Available Data Sources ‣ Identify Unique Characteristics ‣ Extract Relevant Data Filed ‣ Combine Co-Related Data Sources to increase information Density ‣ Perform Segmentation based on Spatial/Temporal/Activity Regularity ‣ Determine Behavioral Attributes of Different Segments Methodology ‣ Leverage Behavioral Regularity to Identify and Infer Activity Trajectory Data Collection and Dimension Reduction Segmentation and Behavioral Profiling Activity Trajectory Inference
  • 29. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Case Studies COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Collecting Smart Phone Trajectories was not trivial, so instead we have collected social network and home network activity traces for our research.
  • 30. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Case Studies I COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Location-Aware Social Activity
  • 31. Dataset LBSN - Foursquare and Twitter - Traces Custom collected Geo-Fenced Tweets, and Foursquare Tweets are analyzed to construct activity trajectory. 825 Users 79431 Check-ins 1 Year 157806 Geo-Tweets 30 KM Geo tagged Tweets with embedded Foursquare check-in URL Longitude, Latitude, Timestamp, Location Name, and Category Dataset
  • 32. Location + Time + Venue Type = Activity “Primary FourSqaure venue categories are analyzed with 325 locations to extract 10 distinct activity types”.
  • 33. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Density Enhancement Multiple Traces can be combined by co-relating their spatio-temporal properties to increase information density.
  • 34. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. “Foursquare traces are semantically rich and hence Geo-Tweets can be annotated with FourSqaure activities by co-relating spatio-temporal properties” Shhhhhh!!
  • 35. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Density Improvement of the FourSqaure Trace by including custom annotated Geo-Tweets that were originated from previously checked-in locations. 0 10000 20000 30000 40000 50000 60000 70000 5 10 20 50 100 200 500 1000 y = 8071.1x - 4439.4 R² = 0.9654 NumberofPointsAdded Distance in Meters Enhancement of Information Density
  • 36. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. 0 75 150 225 300 6 AM 8 AM 10 AM 12 PM 2 PM 4 PM 6 PM 8 PM 10 PM 12 AM 2 AM 4AM Arts and Entertainment Universities Breakfast Lunch Fast Food Dinner Outdoor Nightlife Shopping Travelling Time of the Day NoofUsers Activity Trajectory 0 75 150 225 300 6AM 8AM 10AM 12PM 2PM 4PM 6PM 8PM 10PM 12AM 2AM 4AM NoofUsers Without Density Enhancement With Density Enhancement (20m)
  • 37. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Opportunistic Analytics Data Collection and Dimension Reduction ‣ Evaluate Available Data Sources ‣ Identify Unique Characteristics ‣ Extract Relevant Data Filed ‣ Combine Co-Related Data Sources to increase information Density ‣ Perform Segmentation based on Spatial/Temporal/Activity Regularity ‣ Determine Behavioral Attributes of Different Segments Methodology ‣ Leverage Behavioral Regularity to Identify and Infer Activity Trajectory Data Collection and Dimension Reduction Segmentation and Behavioral Profiling Activity Trajectory Inference
  • 38. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Case Studies II COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. In-Home Web Activity
  • 39. Dataset : Project LeYLab In-Home Internet Activity Traces Living Lab for Fiber based Services in the City of Kortrijk, Belgium. ALU 7750 Service Router with Report and Analysis Manager (RAM) was used in the backbone. 86 Households 75 Applications 60 Days 9288000 Data Points
  • 40. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Heuristic : Time + Application Type = Activity “Semantically identical applications are grouped together to reduce data dimensionality, as well as to shift analysis focus to activity. 75 Applications are mapped into 8 distinct activity types”
  • 41. Accumulated activity footprint of a representative household, activity is spread over through out the day, with higher engagements during evenings Activity Trajectory 0 5 10 15 20 25 6 AM 8 AM 10 AM 12 PM 2 PM 4 PM 6 PM 8 PM 10 PM 12 AM 2 AM 4 AM Web Communication Soical Networking Online Gaming Home Working Online Shopping Video Watching Time of the Day NoofDays
  • 42. We have observed an inverse relationship between application usage frequency and corresponding traffic load. Accordingly, we model activity using interaction frequency and temporal regularity. This measure identifies how a household engages with a distinct activity. Recurrence Measure
  • 43. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Trajectory Prediction
  • 44. Trajectory Prediction Algorithm The algorithm predicts activity patterns of future hour slots of current day by matching patterns of similar days in the past.
  • 45. Prediction Performance 60% of households activities can be predicted accurately 70% of times. CumulativeDistributionFunction(CDF) 0 0.2 0.4 0.6 0.8 1.0 0 0.2 0.4 0.6 0.8 1.0 F-Measure
  • 46. Opportunistic Observation By observing an individual’s engagement with semantically rich applications annotated with temporal and spatial information, we can infer an individuals activity. Key Points Density Enhancement Multiple Traces can be combined by co-relating their spatio-temporal properties to increase information density. Trajectory Prediction The algorithm predicts activity patterns of future hour slots of current day by matching patterns of similar days in the past.
  • 47. COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED.COPYRIGHT © 2012 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Thank You Email : fahim.kawsar@alcatel-lucent.com WWW : http://www.fahim-kawsar.net http://www.linkedin.com/in/fahimkawsar @raswak