SlideShare ist ein Scribd-Unternehmen logo
1 von 29
Downloaden Sie, um offline zu lesen
Social Event Detection
V.A. Traag1, A. Browet1, F. Calabrese2, F. Morlot3
1Department of Applied Mathematics
UCL, Louvain-la-neuve, Belgium
2SENSEable City Lab
MIT, Cambridge, USA
3Orange Labs
Issy-les-Moulineaux, France
24 February 2011
Outline
1 Motivation
2 Bayesian Location Inference
3 Identification of frequent location
4 Event detection
5 Presence probability
Introduction
Purpose
Analyze mobility and social behaviour of mobile phone users:
1 Detect social events i.e. unsual large gatherings of poeple.
2 Identify frequent location such as home or office.
Motivation
1 Between 70% & 80% of human mobility is explain by the daily
home-office routine (Barabasi et al.). Analyze the
out-of-ordinary behaviour.
2 Anticipate the impact of large events on urban transit for traffic
regulation or public transportation.
3 Identification/Classification of users and their habits for
telecommunication company.
Introduction
Purpose
Analyze mobility and social behaviour of mobile phone users:
1 Detect social events i.e. unsual large gatherings of poeple.
2 Identify frequent location such as home or office.
Motivation
1 Between 70% & 80% of human mobility is explain by the daily
home-office routine (Barabasi et al.). Analyze the
out-of-ordinary behaviour.
2 Anticipate the impact of large events on urban transit for traffic
regulation or public transportation.
3 Identification/Classification of users and their habits for
telecommunication company.
Introduction
Purpose
Analyze mobility and social behaviour of mobile phone users:
1 Detect social events i.e. unsual large gatherings of poeple.
2 Identify frequent location such as home or office.
Motivation
1 Between 70% & 80% of human mobility is explain by the daily
home-office routine (Barabasi et al.). Analyze the
out-of-ordinary behaviour.
2 Anticipate the impact of large events on urban transit for traffic
regulation or public transportation.
3 Identification/Classification of users and their habits for
telecommunication company.
Introduction
Purpose
Analyze mobility and social behaviour of mobile phone users:
1 Detect social events i.e. unsual large gatherings of poeple.
2 Identify frequent location such as home or office.
Motivation
1 Between 70% & 80% of human mobility is explain by the daily
home-office routine (Barabasi et al.). Analyze the
out-of-ordinary behaviour.
2 Anticipate the impact of large events on urban transit for traffic
regulation or public transportation.
3 Identification/Classification of users and their habits for
telecommunication company.
Introduction
Available data
1 Precise location of antennas but no orientation information.
2 Record for each connection to the networks (calls, text
messages, mobile internet,...)
Compute 2 probability measures
1 φi (x) to be connected to antenna i given a position x
2 ψi (x) to be in position x given that the user was connected to
antenna i
Location Inference
The signal strength at position x of an antenna i at position Xi is
defined by:
• the power of the antenna pi ; but pi = p;
• the loss of signal strength over distance:
Li (x) =
1
x − Xi
β
;
• a stochastic fading of the signal i.e. the Rayleigh fading Ri :
Pr(Ri ≤ r) = F(r) = 1 − e−r
.
Location Inference
The signal strength of antenna i is then given by
Si (x) = pi Li (x)Ri .
Further assumptions:
• Ri ⊥⊥ Rj ∀i = j.
• given a position x, the user connects to the antenna i with the
highest signal strength:
Si (x) ≥ Sj (x) ∀j ∈ X
Si (x) = max
j∈X
Sj (x)
Location Inference
Let ai denote the fact that a user connects to antenna i.
Pr(ai |x) = Pr(Si (x) = maxj∈X Sj (x))
=
j∈X
j=i
Pr (pi Li (x)Ri ≥ pj Lj (x)Rj )
If we assume that the random variable Ri realize a specific value r,
Pr(ai |x, Ri = r) =
j∈X
j=i
Pr Rj ≤ Li (x)
Lj (x) r
=
j∈X
j=i
F Li (x)
Lj (x) r
Location Inference
Then, it follows that
φi (x) = Pr(ai |x) =
∞
0
f (r)Pr(ai |x, Ri = r)dr
=
∞
0
e−r
j∈X
j=i
1 − exp −r
||x−Xj ||β
||x−Xi ||β dr
≈
∞
0
e−r
j∈Xi
1 − exp −r
||x−Xj ||β
||x−Xi ||β dr
How to choose the local neighborhood and what is its impact ?
Location Inference
Delaunay Radius:
ρi = max{d(Xi , Xj )| j Delaunay of i}
The domain Di is define by
Di = {x|rρi ≥ d(x, Xi )}
The neighborhood is computed as
Xi = {j|Xj ∈ Di , j ∈ X}
Location Inference
Average error on 1000 random points
1 1.5 2 2.5 3
0
0.002
0.004
0.006
0.008
0.01
0.012
0.014
r
Averageerror
Location Inference
Based on Bayes rule, we can obtain
ψi (x) = Pr(x|ai ) =
Pr(ai |x)Pr(x)
Pr(ai )
The value Pr(x)
Pr(ai ) is not known but can be assumed constant over
the domain Di . It follows that
ψi (x) =
φi (x)
Di
φi (x)dx
Location Inference
Probability density ψi (x)
Frequent Location Indentification
Probability that a user connects to antenna i is φi (x)
Probability that he made ki calls with antenna i is then φi (x)ki
The likelihood of observing those calling frequencies is
L(x|k) =
i∈H
φi (x)ki
log L(x|k) =
i∈H
ki log φi (x)
Maximum Likelihood Estimator(MLE)
ˆxh(u) = arg max
x
log L(x|k(u))
Overview Event Detection
General
• Looking for unusual large gatherings of people.
• Which people are likely to be attending an (possible) event?
• Should be present at the event location with high probability.
• Should not be often there.
Presence probability
Given calls in the neighbourhood, what is the probability the user
was present during the time interval of an event?
Ordinary probability
What is the average probability a user was present during other
weeks.
Presence probability
Derivation
• Probability user in area A at time tc for a call c is pc.
• Assume constant leave and arrival rate γ
• Then for t = tc we have e−γ|t−tc |pc.
• Take max over all calls c for a user
pp =
1
te − ts
te
ts
max
c
e−γ|t−tc |
pcdt
Motivation
• More calls ⇒ higher presence probability
• Calls close by ⇒ higher presence probability
• Don’t take into account calls outside of area.
Presence probability
← First call
← Second call
Time
Probability
13 14 15 16 17 18 19
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
Ordinary probability
How regularly is user in the area?
(Consider only same weekday, same time of day)
April
1 2
3 4 5 6 7 8 9
10 11 12 13 14 15 16
17 18 19 20 21 22 23
24 25 26 27 28 29 30
Was not present, i.e. pp(i) = 0
Was in area with probability pp(2)
Was in area with probability pp(5)
Ordinary probability
Ordinary probability defined as average probability, i.e.
po = 1
W
W
i=1 pp(i)
Probability of attending
Maximum ordinary probability
• Should be present with relatively high probability
• Relatively rarely present ⇒ small po (i.e. only for the event)
• What is theoretical maximum ordinary probability ¯po?
• Theoretical maximum: make infinite number of calls with ‘best’
antenna.
Probability of attending
• Probability user attended then calculated as
pa = pp(1 − po/¯po)
Event detection
Number of attendees
• Mark user as (possible) attendee if pa high enough
• Number of (possible) attendees at week w given by nw
• Mark week w as event if nw is high enough.
Example: Stadium
0 10 20 30 40 50 60
−2
−1
0
1
2
3
4
5
Week
Z−score
Example: Stadium
0 2 4 6 8 10 12 14 16 18 20 22 24
0
50
100
150
200
250
300
350
Hour
No.ofCalls
Not attending
Attending
Regular
Example: Park
0 10 20 30 40 50 60
−4
−3
−2
−1
0
1
2
3
4
Week
Z−score
Example: Park
0 2 4 6 8 10 12 14 16 18 20 22 24
0
50
100
150
200
250
300
350
Hour
No.ofCalls
Not Attending
Attending
Regular
Example: Rural area
0 10 20 30 40 50 60
−4
−3
−2
−1
0
1
2
3
4
Week
Z−score
Sensitivity
Conclusions
Conclusions
• Possible to detect ‘social events’ in mobile phone data
• Robust to antenna positioning and switching
• Interesting observation: non-routine behaviour seems massive
Further considerations
• Use simpler (faster) method to detect irregularities
• Refine location estimation by likelihood inference
Questions? Suggestions? Remarks?

Weitere ähnliche Inhalte

Ähnlich wie Social Event Detection

Properties and Impact of Vicinity in Mobile Opportunistic Networks
Properties and Impact of Vicinity in Mobile Opportunistic NetworksProperties and Impact of Vicinity in Mobile Opportunistic Networks
Properties and Impact of Vicinity in Mobile Opportunistic Networkstiphainepn
 
(121013) #fitalk locating the source of diffusion in large-scale network
(121013) #fitalk   locating the source of diffusion in large-scale network(121013) #fitalk   locating the source of diffusion in large-scale network
(121013) #fitalk locating the source of diffusion in large-scale networkINSIGHT FORENSIC
 
(121013) #fitalk locating the source of diffusion in large-scale network
(121013) #fitalk   locating the source of diffusion in large-scale network(121013) #fitalk   locating the source of diffusion in large-scale network
(121013) #fitalk locating the source of diffusion in large-scale networkINSIGHT FORENSIC
 
Poisson distribution assign
Poisson distribution assignPoisson distribution assign
Poisson distribution assignAbdul Kader
 
Temporal dynamics of human behavior in social networks (ii)
Temporal dynamics of human behavior in social networks (ii)Temporal dynamics of human behavior in social networks (ii)
Temporal dynamics of human behavior in social networks (ii)Esteban Moro
 
Anomaly detection
Anomaly detectionAnomaly detection
Anomaly detection철 김
 
Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...
Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...
Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...Eswar Publications
 
Privacy for Continual Data Publishing
Privacy for Continual Data PublishingPrivacy for Continual Data Publishing
Privacy for Continual Data PublishingJunpei Kawamoto
 
An Efficient Unsupervised AdaptiveAntihub Technique for Outlier Detection in ...
An Efficient Unsupervised AdaptiveAntihub Technique for Outlier Detection in ...An Efficient Unsupervised AdaptiveAntihub Technique for Outlier Detection in ...
An Efficient Unsupervised AdaptiveAntihub Technique for Outlier Detection in ...theijes
 
ZunqiuPresentationOct05
ZunqiuPresentationOct05ZunqiuPresentationOct05
ZunqiuPresentationOct05Chen Zunqiu
 
Chap10 Anomaly Detection
Chap10 Anomaly DetectionChap10 Anomaly Detection
Chap10 Anomaly Detectionguest76d673
 
A Study on Privacy Level in Publishing Data of Smart Tap Network
A Study on Privacy Level in Publishing Data of Smart Tap NetworkA Study on Privacy Level in Publishing Data of Smart Tap Network
A Study on Privacy Level in Publishing Data of Smart Tap NetworkHa Phuong
 
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...PAPIs.io
 
Presentation_Binomial and poisson distribution (1).pdf
Presentation_Binomial and poisson distribution (1).pdfPresentation_Binomial and poisson distribution (1).pdf
Presentation_Binomial and poisson distribution (1).pdfMalika Fatma
 

Ähnlich wie Social Event Detection (20)

Properties and Impact of Vicinity in Mobile Opportunistic Networks
Properties and Impact of Vicinity in Mobile Opportunistic NetworksProperties and Impact of Vicinity in Mobile Opportunistic Networks
Properties and Impact of Vicinity in Mobile Opportunistic Networks
 
(121013) #fitalk locating the source of diffusion in large-scale network
(121013) #fitalk   locating the source of diffusion in large-scale network(121013) #fitalk   locating the source of diffusion in large-scale network
(121013) #fitalk locating the source of diffusion in large-scale network
 
(121013) #fitalk locating the source of diffusion in large-scale network
(121013) #fitalk   locating the source of diffusion in large-scale network(121013) #fitalk   locating the source of diffusion in large-scale network
(121013) #fitalk locating the source of diffusion in large-scale network
 
Poisson distribution assign
Poisson distribution assignPoisson distribution assign
Poisson distribution assign
 
Temporal dynamics of human behavior in social networks (ii)
Temporal dynamics of human behavior in social networks (ii)Temporal dynamics of human behavior in social networks (ii)
Temporal dynamics of human behavior in social networks (ii)
 
Anomaly detection
Anomaly detectionAnomaly detection
Anomaly detection
 
C sanlitalk lvhash_spike_fromdatatoknowledge_mons2015
C sanlitalk lvhash_spike_fromdatatoknowledge_mons2015C sanlitalk lvhash_spike_fromdatatoknowledge_mons2015
C sanlitalk lvhash_spike_fromdatatoknowledge_mons2015
 
Poisson's distribution
Poisson's distributionPoisson's distribution
Poisson's distribution
 
Glowworm Swarm Optimisation
Glowworm Swarm OptimisationGlowworm Swarm Optimisation
Glowworm Swarm Optimisation
 
Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...
Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...
Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...
 
Remote sensing
Remote sensingRemote sensing
Remote sensing
 
Social dynamic behaviour patterns_long
Social dynamic behaviour patterns_longSocial dynamic behaviour patterns_long
Social dynamic behaviour patterns_long
 
Privacy for Continual Data Publishing
Privacy for Continual Data PublishingPrivacy for Continual Data Publishing
Privacy for Continual Data Publishing
 
An Efficient Unsupervised AdaptiveAntihub Technique for Outlier Detection in ...
An Efficient Unsupervised AdaptiveAntihub Technique for Outlier Detection in ...An Efficient Unsupervised AdaptiveAntihub Technique for Outlier Detection in ...
An Efficient Unsupervised AdaptiveAntihub Technique for Outlier Detection in ...
 
Dissertation
DissertationDissertation
Dissertation
 
ZunqiuPresentationOct05
ZunqiuPresentationOct05ZunqiuPresentationOct05
ZunqiuPresentationOct05
 
Chap10 Anomaly Detection
Chap10 Anomaly DetectionChap10 Anomaly Detection
Chap10 Anomaly Detection
 
A Study on Privacy Level in Publishing Data of Smart Tap Network
A Study on Privacy Level in Publishing Data of Smart Tap NetworkA Study on Privacy Level in Publishing Data of Smart Tap Network
A Study on Privacy Level in Publishing Data of Smart Tap Network
 
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...
 
Presentation_Binomial and poisson distribution (1).pdf
Presentation_Binomial and poisson distribution (1).pdfPresentation_Binomial and poisson distribution (1).pdf
Presentation_Binomial and poisson distribution (1).pdf
 

Mehr von Vincent Traag

Peer review uncertainty at the institutional level
Peer review uncertainty at the institutional levelPeer review uncertainty at the institutional level
Peer review uncertainty at the institutional levelVincent Traag
 
Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?Vincent Traag
 
Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...Vincent Traag
 
Uncovering important intermediate publications
Uncovering important intermediate publicationsUncovering important intermediate publications
Uncovering important intermediate publicationsVincent Traag
 
Complex contagion of campaign donations
Complex contagion of campaign donationsComplex contagion of campaign donations
Complex contagion of campaign donationsVincent Traag
 
Polarization and consensus in citation networks
Polarization and consensus in citation networksPolarization and consensus in citation networks
Polarization and consensus in citation networksVincent Traag
 
Community structure in complex networks
Community structure in complex networksCommunity structure in complex networks
Community structure in complex networksVincent Traag
 
Introduction to complex networks
Introduction to complex networksIntroduction to complex networks
Introduction to complex networksVincent Traag
 
Public thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networksPublic thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networksVincent Traag
 
Structure of media attention
Structure of media attentionStructure of media attention
Structure of media attentionVincent Traag
 
Dynamics of Media Attention
Dynamics of Media AttentionDynamics of Media Attention
Dynamics of Media AttentionVincent Traag
 
Dynamical Models Explaining Social Balance
Dynamical Models Explaining Social BalanceDynamical Models Explaining Social Balance
Dynamical Models Explaining Social BalanceVincent Traag
 
Significant scales in community structure
Significant scales in community structureSignificant scales in community structure
Significant scales in community structureVincent Traag
 
Reconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from NewspapersReconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from NewspapersVincent Traag
 
Reputation Dynamics Through Gossiping
Reputation Dynamics Through GossipingReputation Dynamics Through Gossiping
Reputation Dynamics Through GossipingVincent Traag
 
Limits of community detection
Limits of community detectionLimits of community detection
Limits of community detectionVincent Traag
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingVincent Traag
 
Resolution-free community detection
Resolution-free community detectionResolution-free community detection
Resolution-free community detectionVincent Traag
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingVincent Traag
 
Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Vincent Traag
 

Mehr von Vincent Traag (20)

Peer review uncertainty at the institutional level
Peer review uncertainty at the institutional levelPeer review uncertainty at the institutional level
Peer review uncertainty at the institutional level
 
Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?
 
Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...
 
Uncovering important intermediate publications
Uncovering important intermediate publicationsUncovering important intermediate publications
Uncovering important intermediate publications
 
Complex contagion of campaign donations
Complex contagion of campaign donationsComplex contagion of campaign donations
Complex contagion of campaign donations
 
Polarization and consensus in citation networks
Polarization and consensus in citation networksPolarization and consensus in citation networks
Polarization and consensus in citation networks
 
Community structure in complex networks
Community structure in complex networksCommunity structure in complex networks
Community structure in complex networks
 
Introduction to complex networks
Introduction to complex networksIntroduction to complex networks
Introduction to complex networks
 
Public thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networksPublic thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networks
 
Structure of media attention
Structure of media attentionStructure of media attention
Structure of media attention
 
Dynamics of Media Attention
Dynamics of Media AttentionDynamics of Media Attention
Dynamics of Media Attention
 
Dynamical Models Explaining Social Balance
Dynamical Models Explaining Social BalanceDynamical Models Explaining Social Balance
Dynamical Models Explaining Social Balance
 
Significant scales in community structure
Significant scales in community structureSignificant scales in community structure
Significant scales in community structure
 
Reconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from NewspapersReconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from Newspapers
 
Reputation Dynamics Through Gossiping
Reputation Dynamics Through GossipingReputation Dynamics Through Gossiping
Reputation Dynamics Through Gossiping
 
Limits of community detection
Limits of community detectionLimits of community detection
Limits of community detection
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & Gossiping
 
Resolution-free community detection
Resolution-free community detectionResolution-free community detection
Resolution-free community detection
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & Gossiping
 
Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.
 

Kürzlich hochgeladen

GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)Areesha Ahmad
 
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptxSOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptxkessiyaTpeter
 
Biological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfBiological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfmuntazimhurra
 
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCESTERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCEPRINCE C P
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSarthak Sekhar Mondal
 
Chromatin Structure | EUCHROMATIN | HETEROCHROMATIN
Chromatin Structure | EUCHROMATIN | HETEROCHROMATINChromatin Structure | EUCHROMATIN | HETEROCHROMATIN
Chromatin Structure | EUCHROMATIN | HETEROCHROMATINsankalpkumarsahoo174
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...Sérgio Sacani
 
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls AgencyHire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls AgencySheetal Arora
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​kaibalyasahoo82800
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksSérgio Sacani
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...Sérgio Sacani
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...RohitNehra6
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfSumit Kumar yadav
 
Orientation, design and principles of polyhouse
Orientation, design and principles of polyhouseOrientation, design and principles of polyhouse
Orientation, design and principles of polyhousejana861314
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPirithiRaju
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfSumit Kumar yadav
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )aarthirajkumar25
 

Kürzlich hochgeladen (20)

GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptxSOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
 
Biological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfBiological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdf
 
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCESTERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
 
Chromatin Structure | EUCHROMATIN | HETEROCHROMATIN
Chromatin Structure | EUCHROMATIN | HETEROCHROMATINChromatin Structure | EUCHROMATIN | HETEROCHROMATIN
Chromatin Structure | EUCHROMATIN | HETEROCHROMATIN
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
 
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls AgencyHire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
 
The Philosophy of Science
The Philosophy of ScienceThe Philosophy of Science
The Philosophy of Science
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
 
Engler and Prantl system of classification in plant taxonomy
Engler and Prantl system of classification in plant taxonomyEngler and Prantl system of classification in plant taxonomy
Engler and Prantl system of classification in plant taxonomy
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdf
 
Orientation, design and principles of polyhouse
Orientation, design and principles of polyhouseOrientation, design and principles of polyhouse
Orientation, design and principles of polyhouse
 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdf
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )
 

Social Event Detection

  • 1. Social Event Detection V.A. Traag1, A. Browet1, F. Calabrese2, F. Morlot3 1Department of Applied Mathematics UCL, Louvain-la-neuve, Belgium 2SENSEable City Lab MIT, Cambridge, USA 3Orange Labs Issy-les-Moulineaux, France 24 February 2011
  • 2. Outline 1 Motivation 2 Bayesian Location Inference 3 Identification of frequent location 4 Event detection 5 Presence probability
  • 3. Introduction Purpose Analyze mobility and social behaviour of mobile phone users: 1 Detect social events i.e. unsual large gatherings of poeple. 2 Identify frequent location such as home or office. Motivation 1 Between 70% & 80% of human mobility is explain by the daily home-office routine (Barabasi et al.). Analyze the out-of-ordinary behaviour. 2 Anticipate the impact of large events on urban transit for traffic regulation or public transportation. 3 Identification/Classification of users and their habits for telecommunication company.
  • 4. Introduction Purpose Analyze mobility and social behaviour of mobile phone users: 1 Detect social events i.e. unsual large gatherings of poeple. 2 Identify frequent location such as home or office. Motivation 1 Between 70% & 80% of human mobility is explain by the daily home-office routine (Barabasi et al.). Analyze the out-of-ordinary behaviour. 2 Anticipate the impact of large events on urban transit for traffic regulation or public transportation. 3 Identification/Classification of users and their habits for telecommunication company.
  • 5. Introduction Purpose Analyze mobility and social behaviour of mobile phone users: 1 Detect social events i.e. unsual large gatherings of poeple. 2 Identify frequent location such as home or office. Motivation 1 Between 70% & 80% of human mobility is explain by the daily home-office routine (Barabasi et al.). Analyze the out-of-ordinary behaviour. 2 Anticipate the impact of large events on urban transit for traffic regulation or public transportation. 3 Identification/Classification of users and their habits for telecommunication company.
  • 6. Introduction Purpose Analyze mobility and social behaviour of mobile phone users: 1 Detect social events i.e. unsual large gatherings of poeple. 2 Identify frequent location such as home or office. Motivation 1 Between 70% & 80% of human mobility is explain by the daily home-office routine (Barabasi et al.). Analyze the out-of-ordinary behaviour. 2 Anticipate the impact of large events on urban transit for traffic regulation or public transportation. 3 Identification/Classification of users and their habits for telecommunication company.
  • 7. Introduction Available data 1 Precise location of antennas but no orientation information. 2 Record for each connection to the networks (calls, text messages, mobile internet,...) Compute 2 probability measures 1 φi (x) to be connected to antenna i given a position x 2 ψi (x) to be in position x given that the user was connected to antenna i
  • 8. Location Inference The signal strength at position x of an antenna i at position Xi is defined by: • the power of the antenna pi ; but pi = p; • the loss of signal strength over distance: Li (x) = 1 x − Xi β ; • a stochastic fading of the signal i.e. the Rayleigh fading Ri : Pr(Ri ≤ r) = F(r) = 1 − e−r .
  • 9. Location Inference The signal strength of antenna i is then given by Si (x) = pi Li (x)Ri . Further assumptions: • Ri ⊥⊥ Rj ∀i = j. • given a position x, the user connects to the antenna i with the highest signal strength: Si (x) ≥ Sj (x) ∀j ∈ X Si (x) = max j∈X Sj (x)
  • 10. Location Inference Let ai denote the fact that a user connects to antenna i. Pr(ai |x) = Pr(Si (x) = maxj∈X Sj (x)) = j∈X j=i Pr (pi Li (x)Ri ≥ pj Lj (x)Rj ) If we assume that the random variable Ri realize a specific value r, Pr(ai |x, Ri = r) = j∈X j=i Pr Rj ≤ Li (x) Lj (x) r = j∈X j=i F Li (x) Lj (x) r
  • 11. Location Inference Then, it follows that φi (x) = Pr(ai |x) = ∞ 0 f (r)Pr(ai |x, Ri = r)dr = ∞ 0 e−r j∈X j=i 1 − exp −r ||x−Xj ||β ||x−Xi ||β dr ≈ ∞ 0 e−r j∈Xi 1 − exp −r ||x−Xj ||β ||x−Xi ||β dr How to choose the local neighborhood and what is its impact ?
  • 12. Location Inference Delaunay Radius: ρi = max{d(Xi , Xj )| j Delaunay of i} The domain Di is define by Di = {x|rρi ≥ d(x, Xi )} The neighborhood is computed as Xi = {j|Xj ∈ Di , j ∈ X}
  • 13. Location Inference Average error on 1000 random points 1 1.5 2 2.5 3 0 0.002 0.004 0.006 0.008 0.01 0.012 0.014 r Averageerror
  • 14. Location Inference Based on Bayes rule, we can obtain ψi (x) = Pr(x|ai ) = Pr(ai |x)Pr(x) Pr(ai ) The value Pr(x) Pr(ai ) is not known but can be assumed constant over the domain Di . It follows that ψi (x) = φi (x) Di φi (x)dx
  • 16. Frequent Location Indentification Probability that a user connects to antenna i is φi (x) Probability that he made ki calls with antenna i is then φi (x)ki The likelihood of observing those calling frequencies is L(x|k) = i∈H φi (x)ki log L(x|k) = i∈H ki log φi (x) Maximum Likelihood Estimator(MLE) ˆxh(u) = arg max x log L(x|k(u))
  • 17. Overview Event Detection General • Looking for unusual large gatherings of people. • Which people are likely to be attending an (possible) event? • Should be present at the event location with high probability. • Should not be often there. Presence probability Given calls in the neighbourhood, what is the probability the user was present during the time interval of an event? Ordinary probability What is the average probability a user was present during other weeks.
  • 18. Presence probability Derivation • Probability user in area A at time tc for a call c is pc. • Assume constant leave and arrival rate γ • Then for t = tc we have e−γ|t−tc |pc. • Take max over all calls c for a user pp = 1 te − ts te ts max c e−γ|t−tc | pcdt Motivation • More calls ⇒ higher presence probability • Calls close by ⇒ higher presence probability • Don’t take into account calls outside of area.
  • 19. Presence probability ← First call ← Second call Time Probability 13 14 15 16 17 18 19 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35
  • 20. Ordinary probability How regularly is user in the area? (Consider only same weekday, same time of day) April 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 Was not present, i.e. pp(i) = 0 Was in area with probability pp(2) Was in area with probability pp(5) Ordinary probability Ordinary probability defined as average probability, i.e. po = 1 W W i=1 pp(i)
  • 21. Probability of attending Maximum ordinary probability • Should be present with relatively high probability • Relatively rarely present ⇒ small po (i.e. only for the event) • What is theoretical maximum ordinary probability ¯po? • Theoretical maximum: make infinite number of calls with ‘best’ antenna. Probability of attending • Probability user attended then calculated as pa = pp(1 − po/¯po)
  • 22. Event detection Number of attendees • Mark user as (possible) attendee if pa high enough • Number of (possible) attendees at week w given by nw • Mark week w as event if nw is high enough.
  • 23. Example: Stadium 0 10 20 30 40 50 60 −2 −1 0 1 2 3 4 5 Week Z−score
  • 24. Example: Stadium 0 2 4 6 8 10 12 14 16 18 20 22 24 0 50 100 150 200 250 300 350 Hour No.ofCalls Not attending Attending Regular
  • 25. Example: Park 0 10 20 30 40 50 60 −4 −3 −2 −1 0 1 2 3 4 Week Z−score
  • 26. Example: Park 0 2 4 6 8 10 12 14 16 18 20 22 24 0 50 100 150 200 250 300 350 Hour No.ofCalls Not Attending Attending Regular
  • 27. Example: Rural area 0 10 20 30 40 50 60 −4 −3 −2 −1 0 1 2 3 4 Week Z−score
  • 29. Conclusions Conclusions • Possible to detect ‘social events’ in mobile phone data • Robust to antenna positioning and switching • Interesting observation: non-routine behaviour seems massive Further considerations • Use simpler (faster) method to detect irregularities • Refine location estimation by likelihood inference Questions? Suggestions? Remarks?