SlideShare a Scribd company logo
1 of 30
Neal Lathia
University College London
web: personalisation is everywhere




offline: where are user preferences?
Mining Public Transport Usage for
Personalised Intelligent Transport Systems

            Neal Lathia1, Jon Froehlich2, Licia Capra1
    1
      Dept of Computer Science, University College London
 2
  Computer Science and Engineering, University of Washington
               IEEE ICDM 2010, Sydney, Australia

                         @neal_lathia
                    n.lathia@cs.ucl.ac.uk
mobility and sustainable transport
           is both aided and encouraged with
           info systems:

           why are they not personalised?


traveller information systems
why personalise?

                   a wide range of people, with different
                   needs, preferences, constraints

                   only 46-62% of the travel time is spent
                   sitting on trains

                   majority of notifications, updates, &
                   events are irrelevant to travellers
why personalise?

                   a wide range of people, with different
                   needs, preferences, constraints

                   only 46-62% of the travel time is spent
                   sitting on trains

                   majority of notifications, updates, &
                   events are irrelevant to travellers
using                to infer

dataset: <user, origin, destination, date, start, end>


what can we learn about user preferences from
fare collection systems?

what sort of personalised systems can be built?

what prediction/ranking algorithms can we use?
2 x ~300,000 travellers (5%), ~7,000,0000
tube trips: aggregate
2 x ~300,000 travellers (5%), ~7,000,0000
tube trips: aggregate
transport research focuses on
what this data tells us about the
system:

demand modelling
service reliability measurements
average travel time estimation
station transfer analysis

what does it tell us about the
travellers?
2 x ~300,000 travellers (5%), ~7,000,0000
tube trips: hierarchical clustering
2 x ~300,000 travellers (5%), ~7,000,0000
tube trips: hierarchical clustering
2 x ~300,000 travellers (5%), ~7,000,0000
tube trips: hierarchical clustering
2 x ~300,000 travellers (5%),
~7,000,0000 tube trips
hierarchical clustering




         the data shows:
         a huge diversity of travellers

         measurable ranges of habits and
         preferences: when & where to
         travel, how long travel takes..

         next step?
using                to build

        what applications?


        personalised travel time: how long
        will it take me to get there?

        personalised notifications: which
        stations' events are relevant to me?

        ...and more in our future work
using                to build

        what applications?


        personalised travel time: how long
        will it take me to get there?

        personalised notifications: which
        stations' events are relevant to me?

        ...and more in our future work
personalised trip time – 3 methods


     self-similarity: implicitly capture route
     choices, walk time
     (weighted geometric mean of traveller's history)
personalised trip time – 3 methods


                       self-similarity: implicitly capture route
                       choices, walk time




familiarity: similar users
(neighbourhood model of travellers who are
similarly familiar)
personalised trip time – 3 methods


                    self-similarity: implicitly capture route
                    choices, walk time




familiarity: similar users




                             context: implicitly capture
                             historical trends in current trip
                             (two-sided sliding window moving average
                             model)
personalised trip time –
          evaluation




evaluation

split data:
74 day training set (90%)
9 day test set (10%)

metrics:
mean absolute error (MAE)
mean absolute percentage error (MAPE)
personalised
evaluation (MAE)                     trip time –
            evaluation
global mean – 11.45 mins
zone mean – 8.56 mins
journey planner – 6 mins (preliminary)


trip mean – 3.109 mins
familiarity – 2.989 mins
context – 2.986 mins
self-similarity – 2.924 mins

combined – 2.922 mins
personalised
evaluation (MAE)                     trip time –
            evaluation
global mean – 11.45 mins                   error ~ trip time
zone mean – 8.56 mins
journey planner – 6 mins (preliminary)     error highest for people
                                           who only travel on
trip mean – 3.109 mins                     weekends
familiarity – 2.989 mins
context – 2.986 mins                       more trips reduces error
self-similarity – 2.924 mins

combined – 2.922 mins
using                to build

        what applications?


        personalised travel time: how long
        will it take me to get there?

        personalised notifications: which
        stations' events are relevant to me?

        ...and more in our future work
station interest ranking


predict (and rank) the stations that
travellers will visit in their future trips
for personalised notifications

current system: free travel alerts –
manually set up by traveller
station interest ranking


can we automate this?

baseline: rank by visit popularity

proposal: station similarity
neighbourhood (visit co-occurrence)
and traveller trip history
station interest ranking


1. begin with baseline ranking

2. add proportional weighting for
stations user has visited in the past

3. transform dataset into station-
station co-occurrence matrix, increase
weight of similar stations

metric: percentile ranking
station interest ranking
without knowing who travellers are, the
network topology, train schedule,
disruptions and closures, we designed


   personalised information services

                            for intelligent transport systems
2 x ~300,000 travellers (5%),
~7,000,0000 tube trips
hierarchical clustering
         what next?

         larger, multi-modal datasets to
         investigate and improve the
         algorithms we evaluate here;

         implementations for mobile
         devices to study these
         applications in the field;

         examine other facets of travel
         behaviour (e.g., ticket purchasing)
Mining Public Transport Usage for
Personalised Intelligent Transport Systems



   We are hiring! interested? get in touch!

                 @neal_lathia
            n.lathia@cs.ucl.ac.uk

More Related Content

Viewers also liked

Instalaciones eléctricas
Instalaciones eléctricasInstalaciones eléctricas
Instalaciones eléctricasYazmin Venegas
 
Prestación final de instalaciones electricas monofásicas y normativas efi
Prestación final de instalaciones electricas monofásicas y normativas efiPrestación final de instalaciones electricas monofásicas y normativas efi
Prestación final de instalaciones electricas monofásicas y normativas efiNéstor Daniel Chicas Monroy
 
Taller Mecánico Automotriz - Gerencia de Servicios
Taller Mecánico Automotriz  - Gerencia de ServiciosTaller Mecánico Automotriz  - Gerencia de Servicios
Taller Mecánico Automotriz - Gerencia de Servicioswladdy66
 
Elementos básicos de una instalacion eléctrica y características de una vivie...
Elementos básicos de una instalacion eléctrica y características de una vivie...Elementos básicos de una instalacion eléctrica y características de una vivie...
Elementos básicos de una instalacion eléctrica y características de una vivie...PaquiRP
 
PROYECTO TALLER SENA
PROYECTO TALLER  SENAPROYECTO TALLER  SENA
PROYECTO TALLER SENAguestcd2f3254
 
Diseño de instalaciones para un taller de mecánica rápida de vehículos
Diseño de instalaciones para un taller de mecánica rápida de vehículosDiseño de instalaciones para un taller de mecánica rápida de vehículos
Diseño de instalaciones para un taller de mecánica rápida de vehículosErik Demian Díaz Kaas-Nielsen
 
Instalaciones eléctricas
Instalaciones eléctricas Instalaciones eléctricas
Instalaciones eléctricas Espoch
 
Tema 2. instalaciones eléctricas en viviendas
Tema 2. instalaciones eléctricas en viviendasTema 2. instalaciones eléctricas en viviendas
Tema 2. instalaciones eléctricas en viviendasmabr36
 
Instalaciones en viviendas y edificios
Instalaciones en viviendas y edificiosInstalaciones en viviendas y edificios
Instalaciones en viviendas y edificiosKoldo Parra
 
Instalación de relés en circuitos de control
Instalación de relés en circuitos de controlInstalación de relés en circuitos de control
Instalación de relés en circuitos de controlUtp arequipa
 
Instalación eléctrica semivisible con tubos de pvc
Instalación eléctrica semivisible con tubos de pvcInstalación eléctrica semivisible con tubos de pvc
Instalación eléctrica semivisible con tubos de pvcUtp arequipa
 
Manual de-instalaciones-electricas-en-bt-2009
Manual de-instalaciones-electricas-en-bt-2009Manual de-instalaciones-electricas-en-bt-2009
Manual de-instalaciones-electricas-en-bt-2009Edinson Sánchez
 
Manual de-instalaciones-electricas-mod. 3
Manual de-instalaciones-electricas-mod. 3Manual de-instalaciones-electricas-mod. 3
Manual de-instalaciones-electricas-mod. 3Noni Gus
 
INSTALACIONES ELECTRICAS UTEC
INSTALACIONES ELECTRICAS UTECINSTALACIONES ELECTRICAS UTEC
INSTALACIONES ELECTRICAS UTECDavis Alfaro
 
Instalaciones Electricas
Instalaciones  ElectricasInstalaciones  Electricas
Instalaciones ElectricasDavis Alfaro
 
Exposicion instalaciones electricas
Exposicion instalaciones electricasExposicion instalaciones electricas
Exposicion instalaciones electricasAndru GuarniiZo
 

Viewers also liked (20)

Instalaciones eléctricas
Instalaciones eléctricasInstalaciones eléctricas
Instalaciones eléctricas
 
Prestación final de instalaciones electricas monofásicas y normativas efi
Prestación final de instalaciones electricas monofásicas y normativas efiPrestación final de instalaciones electricas monofásicas y normativas efi
Prestación final de instalaciones electricas monofásicas y normativas efi
 
Alcances y objetivos inst. electricas
Alcances y objetivos inst. electricasAlcances y objetivos inst. electricas
Alcances y objetivos inst. electricas
 
Taller Mecánico Automotriz - Gerencia de Servicios
Taller Mecánico Automotriz  - Gerencia de ServiciosTaller Mecánico Automotriz  - Gerencia de Servicios
Taller Mecánico Automotriz - Gerencia de Servicios
 
Elementos básicos de una instalacion eléctrica y características de una vivie...
Elementos básicos de una instalacion eléctrica y características de una vivie...Elementos básicos de una instalacion eléctrica y características de una vivie...
Elementos básicos de una instalacion eléctrica y características de una vivie...
 
PROYECTO TALLER SENA
PROYECTO TALLER  SENAPROYECTO TALLER  SENA
PROYECTO TALLER SENA
 
Diseño de instalaciones para un taller de mecánica rápida de vehículos
Diseño de instalaciones para un taller de mecánica rápida de vehículosDiseño de instalaciones para un taller de mecánica rápida de vehículos
Diseño de instalaciones para un taller de mecánica rápida de vehículos
 
Instalaciones eléctricas
Instalaciones eléctricas Instalaciones eléctricas
Instalaciones eléctricas
 
Tema 2. instalaciones eléctricas en viviendas
Tema 2. instalaciones eléctricas en viviendasTema 2. instalaciones eléctricas en viviendas
Tema 2. instalaciones eléctricas en viviendas
 
Alcance y limitaciones del proyecto
Alcance y limitaciones del proyectoAlcance y limitaciones del proyecto
Alcance y limitaciones del proyecto
 
Instalaciones en viviendas y edificios
Instalaciones en viviendas y edificiosInstalaciones en viviendas y edificios
Instalaciones en viviendas y edificios
 
Instalación de relés en circuitos de control
Instalación de relés en circuitos de controlInstalación de relés en circuitos de control
Instalación de relés en circuitos de control
 
Presentacio2
Presentacio2Presentacio2
Presentacio2
 
Presentacion1
Presentacion1Presentacion1
Presentacion1
 
Instalación eléctrica semivisible con tubos de pvc
Instalación eléctrica semivisible con tubos de pvcInstalación eléctrica semivisible con tubos de pvc
Instalación eléctrica semivisible con tubos de pvc
 
Manual de-instalaciones-electricas-en-bt-2009
Manual de-instalaciones-electricas-en-bt-2009Manual de-instalaciones-electricas-en-bt-2009
Manual de-instalaciones-electricas-en-bt-2009
 
Manual de-instalaciones-electricas-mod. 3
Manual de-instalaciones-electricas-mod. 3Manual de-instalaciones-electricas-mod. 3
Manual de-instalaciones-electricas-mod. 3
 
INSTALACIONES ELECTRICAS UTEC
INSTALACIONES ELECTRICAS UTECINSTALACIONES ELECTRICAS UTEC
INSTALACIONES ELECTRICAS UTEC
 
Instalaciones Electricas
Instalaciones  ElectricasInstalaciones  Electricas
Instalaciones Electricas
 
Exposicion instalaciones electricas
Exposicion instalaciones electricasExposicion instalaciones electricas
Exposicion instalaciones electricas
 

Similar to Mining Public Transport for Personalised Intelligent Transport Systems

A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...University of Piraeus
 
Comparative framework for activity-travel diary collection systems
Comparative framework for activity-travel diary collection systemsComparative framework for activity-travel diary collection systems
Comparative framework for activity-travel diary collection systemsAdrian C. Prelipcean
 
Anomaly Detection - Catch me if you can
Anomaly Detection - Catch me if you canAnomaly Detection - Catch me if you can
Anomaly Detection - Catch me if you canYousef Fadila
 
4.5_poster_STIC_OmarDib_AB
4.5_poster_STIC_OmarDib_AB4.5_poster_STIC_OmarDib_AB
4.5_poster_STIC_OmarDib_ABOmar Dib
 
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...Deja Lewis
 
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...Adrian C. Prelipcean
 
Travel route scheduling based on user’s preferences using simulated annealing
Travel route scheduling based on user’s preferences using simulated annealingTravel route scheduling based on user’s preferences using simulated annealing
Travel route scheduling based on user’s preferences using simulated annealingIJECEIAES
 
School Bus Alerting System for parents .pptx
School Bus Alerting System for parents .pptxSchool Bus Alerting System for parents .pptx
School Bus Alerting System for parents .pptxNagraj Tondchore
 
T drive enhancing driving directions with taxi drivers’ intelligence
T drive enhancing driving directions with taxi drivers’ intelligenceT drive enhancing driving directions with taxi drivers’ intelligence
T drive enhancing driving directions with taxi drivers’ intelligenceIEEEFINALYEARPROJECTS
 
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...IEEEGLOBALSOFTTECHNOLOGIES
 
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)Future Cities Project
 
IRJET - Driving Safety Risk Analysis using Naturalistic Driving Data
IRJET - Driving Safety Risk Analysis using Naturalistic Driving DataIRJET - Driving Safety Risk Analysis using Naturalistic Driving Data
IRJET - Driving Safety Risk Analysis using Naturalistic Driving DataIRJET Journal
 
IRJET- Fuzzy Logic based Route Choice Behaviour Modelling
IRJET-  	  Fuzzy Logic based Route Choice Behaviour ModellingIRJET-  	  Fuzzy Logic based Route Choice Behaviour Modelling
IRJET- Fuzzy Logic based Route Choice Behaviour ModellingIRJET Journal
 
A New Perspective Of Traffic Assignment A Game Theoretical Approach
A New Perspective Of Traffic Assignment  A Game Theoretical ApproachA New Perspective Of Traffic Assignment  A Game Theoretical Approach
A New Perspective Of Traffic Assignment A Game Theoretical ApproachAnita Miller
 
Bertrand Fontaine - Deep Learning for driver/passenger detection of car trips
Bertrand Fontaine - Deep Learning for driver/passenger detection of car tripsBertrand Fontaine - Deep Learning for driver/passenger detection of car trips
Bertrand Fontaine - Deep Learning for driver/passenger detection of car tripsHendrik D'Oosterlinck
 
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...Vasileios Komianos
 
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...University of Piraeus
 
Hybrid recommendation technique for automated personalized poi selection
Hybrid recommendation technique for automated personalized poi selectionHybrid recommendation technique for automated personalized poi selection
Hybrid recommendation technique for automated personalized poi selectionIAEME Publication
 

Similar to Mining Public Transport for Personalised Intelligent Transport Systems (20)

Ticketing Application
Ticketing ApplicationTicketing Application
Ticketing Application
 
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
 
Comparative framework for activity-travel diary collection systems
Comparative framework for activity-travel diary collection systemsComparative framework for activity-travel diary collection systems
Comparative framework for activity-travel diary collection systems
 
Anomaly Detection - Catch me if you can
Anomaly Detection - Catch me if you canAnomaly Detection - Catch me if you can
Anomaly Detection - Catch me if you can
 
4.5_poster_STIC_OmarDib_AB
4.5_poster_STIC_OmarDib_AB4.5_poster_STIC_OmarDib_AB
4.5_poster_STIC_OmarDib_AB
 
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...
 
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...
 
Travel route scheduling based on user’s preferences using simulated annealing
Travel route scheduling based on user’s preferences using simulated annealingTravel route scheduling based on user’s preferences using simulated annealing
Travel route scheduling based on user’s preferences using simulated annealing
 
School Bus Alerting System for parents .pptx
School Bus Alerting System for parents .pptxSchool Bus Alerting System for parents .pptx
School Bus Alerting System for parents .pptx
 
T drive enhancing driving directions with taxi drivers’ intelligence
T drive enhancing driving directions with taxi drivers’ intelligenceT drive enhancing driving directions with taxi drivers’ intelligence
T drive enhancing driving directions with taxi drivers’ intelligence
 
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...
 
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)
 
IRJET - Driving Safety Risk Analysis using Naturalistic Driving Data
IRJET - Driving Safety Risk Analysis using Naturalistic Driving DataIRJET - Driving Safety Risk Analysis using Naturalistic Driving Data
IRJET - Driving Safety Risk Analysis using Naturalistic Driving Data
 
IRJET- Fuzzy Logic based Route Choice Behaviour Modelling
IRJET-  	  Fuzzy Logic based Route Choice Behaviour ModellingIRJET-  	  Fuzzy Logic based Route Choice Behaviour Modelling
IRJET- Fuzzy Logic based Route Choice Behaviour Modelling
 
Travel cost model warawut
Travel cost model warawutTravel cost model warawut
Travel cost model warawut
 
A New Perspective Of Traffic Assignment A Game Theoretical Approach
A New Perspective Of Traffic Assignment  A Game Theoretical ApproachA New Perspective Of Traffic Assignment  A Game Theoretical Approach
A New Perspective Of Traffic Assignment A Game Theoretical Approach
 
Bertrand Fontaine - Deep Learning for driver/passenger detection of car trips
Bertrand Fontaine - Deep Learning for driver/passenger detection of car tripsBertrand Fontaine - Deep Learning for driver/passenger detection of car trips
Bertrand Fontaine - Deep Learning for driver/passenger detection of car trips
 
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...
 
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
 
Hybrid recommendation technique for automated personalized poi selection
Hybrid recommendation technique for automated personalized poi selectionHybrid recommendation technique for automated personalized poi selection
Hybrid recommendation technique for automated personalized poi selection
 

More from Neal Lathia

Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)Neal Lathia
 
Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)Neal Lathia
 
Using language models to supercharge Monzo’s customer support
 Using language models to supercharge Monzo’s customer support Using language models to supercharge Monzo’s customer support
Using language models to supercharge Monzo’s customer supportNeal Lathia
 
Making Better Decisions Faster
Making Better Decisions FasterMaking Better Decisions Faster
Making Better Decisions FasterNeal Lathia
 
Machine Learning, Faster
Machine Learning, FasterMachine Learning, Faster
Machine Learning, FasterNeal Lathia
 
AI & Personalised Experiences
AI & Personalised ExperiencesAI & Personalised Experiences
AI & Personalised ExperiencesNeal Lathia
 
Opportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised TravelOpportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised TravelNeal Lathia
 
Bootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation EngineBootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation EngineNeal Lathia
 
Machine Learning for Product Managers
Machine Learning for Product ManagersMachine Learning for Product Managers
Machine Learning for Product ManagersNeal Lathia
 
Mining Smartphone Data (with Python)
Mining Smartphone Data (with Python)Mining Smartphone Data (with Python)
Mining Smartphone Data (with Python)Neal Lathia
 
Happier and Healthier with Smartphone Data
Happier and Healthier with Smartphone DataHappier and Healthier with Smartphone Data
Happier and Healthier with Smartphone DataNeal Lathia
 
Data Science in Digital Health
Data Science in Digital HealthData Science in Digital Health
Data Science in Digital HealthNeal Lathia
 
Using Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily LifeUsing Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily LifeNeal Lathia
 
Analysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone DataAnalysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone DataNeal Lathia
 
Cambridge Quantified Self Meetup
Cambridge Quantified Self MeetupCambridge Quantified Self Meetup
Cambridge Quantified Self MeetupNeal Lathia
 
Data Science in #mHealth
Data Science in #mHealthData Science in #mHealth
Data Science in #mHealthNeal Lathia
 
Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport Neal Lathia
 
Emotion Sense: From Design to Deployment
Emotion Sense: From Design to DeploymentEmotion Sense: From Design to Deployment
Emotion Sense: From Design to DeploymentNeal Lathia
 
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...Neal Lathia
 
Using Smartphones to Research Daily Life
Using Smartphones to Research Daily LifeUsing Smartphones to Research Daily Life
Using Smartphones to Research Daily LifeNeal Lathia
 

More from Neal Lathia (20)

Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)
 
Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)
 
Using language models to supercharge Monzo’s customer support
 Using language models to supercharge Monzo’s customer support Using language models to supercharge Monzo’s customer support
Using language models to supercharge Monzo’s customer support
 
Making Better Decisions Faster
Making Better Decisions FasterMaking Better Decisions Faster
Making Better Decisions Faster
 
Machine Learning, Faster
Machine Learning, FasterMachine Learning, Faster
Machine Learning, Faster
 
AI & Personalised Experiences
AI & Personalised ExperiencesAI & Personalised Experiences
AI & Personalised Experiences
 
Opportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised TravelOpportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised Travel
 
Bootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation EngineBootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation Engine
 
Machine Learning for Product Managers
Machine Learning for Product ManagersMachine Learning for Product Managers
Machine Learning for Product Managers
 
Mining Smartphone Data (with Python)
Mining Smartphone Data (with Python)Mining Smartphone Data (with Python)
Mining Smartphone Data (with Python)
 
Happier and Healthier with Smartphone Data
Happier and Healthier with Smartphone DataHappier and Healthier with Smartphone Data
Happier and Healthier with Smartphone Data
 
Data Science in Digital Health
Data Science in Digital HealthData Science in Digital Health
Data Science in Digital Health
 
Using Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily LifeUsing Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily Life
 
Analysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone DataAnalysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone Data
 
Cambridge Quantified Self Meetup
Cambridge Quantified Self MeetupCambridge Quantified Self Meetup
Cambridge Quantified Self Meetup
 
Data Science in #mHealth
Data Science in #mHealthData Science in #mHealth
Data Science in #mHealth
 
Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport
 
Emotion Sense: From Design to Deployment
Emotion Sense: From Design to DeploymentEmotion Sense: From Design to Deployment
Emotion Sense: From Design to Deployment
 
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
 
Using Smartphones to Research Daily Life
Using Smartphones to Research Daily LifeUsing Smartphones to Research Daily Life
Using Smartphones to Research Daily Life
 

Recently uploaded

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfhans926745
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 

Recently uploaded (20)

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 

Mining Public Transport for Personalised Intelligent Transport Systems

  • 2. web: personalisation is everywhere offline: where are user preferences?
  • 3. Mining Public Transport Usage for Personalised Intelligent Transport Systems Neal Lathia1, Jon Froehlich2, Licia Capra1 1 Dept of Computer Science, University College London 2 Computer Science and Engineering, University of Washington IEEE ICDM 2010, Sydney, Australia @neal_lathia n.lathia@cs.ucl.ac.uk
  • 4. mobility and sustainable transport is both aided and encouraged with info systems: why are they not personalised? traveller information systems
  • 5. why personalise? a wide range of people, with different needs, preferences, constraints only 46-62% of the travel time is spent sitting on trains majority of notifications, updates, & events are irrelevant to travellers
  • 6. why personalise? a wide range of people, with different needs, preferences, constraints only 46-62% of the travel time is spent sitting on trains majority of notifications, updates, & events are irrelevant to travellers
  • 7. using to infer dataset: <user, origin, destination, date, start, end> what can we learn about user preferences from fare collection systems? what sort of personalised systems can be built? what prediction/ranking algorithms can we use?
  • 8. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips: aggregate
  • 9. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips: aggregate
  • 10. transport research focuses on what this data tells us about the system: demand modelling service reliability measurements average travel time estimation station transfer analysis what does it tell us about the travellers?
  • 11. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips: hierarchical clustering
  • 12. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips: hierarchical clustering
  • 13. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips: hierarchical clustering
  • 14. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips hierarchical clustering the data shows: a huge diversity of travellers measurable ranges of habits and preferences: when & where to travel, how long travel takes.. next step?
  • 15. using to build what applications? personalised travel time: how long will it take me to get there? personalised notifications: which stations' events are relevant to me? ...and more in our future work
  • 16. using to build what applications? personalised travel time: how long will it take me to get there? personalised notifications: which stations' events are relevant to me? ...and more in our future work
  • 17. personalised trip time – 3 methods self-similarity: implicitly capture route choices, walk time (weighted geometric mean of traveller's history)
  • 18. personalised trip time – 3 methods self-similarity: implicitly capture route choices, walk time familiarity: similar users (neighbourhood model of travellers who are similarly familiar)
  • 19. personalised trip time – 3 methods self-similarity: implicitly capture route choices, walk time familiarity: similar users context: implicitly capture historical trends in current trip (two-sided sliding window moving average model)
  • 20. personalised trip time – evaluation evaluation split data: 74 day training set (90%) 9 day test set (10%) metrics: mean absolute error (MAE) mean absolute percentage error (MAPE)
  • 21. personalised evaluation (MAE) trip time – evaluation global mean – 11.45 mins zone mean – 8.56 mins journey planner – 6 mins (preliminary) trip mean – 3.109 mins familiarity – 2.989 mins context – 2.986 mins self-similarity – 2.924 mins combined – 2.922 mins
  • 22. personalised evaluation (MAE) trip time – evaluation global mean – 11.45 mins error ~ trip time zone mean – 8.56 mins journey planner – 6 mins (preliminary) error highest for people who only travel on trip mean – 3.109 mins weekends familiarity – 2.989 mins context – 2.986 mins more trips reduces error self-similarity – 2.924 mins combined – 2.922 mins
  • 23. using to build what applications? personalised travel time: how long will it take me to get there? personalised notifications: which stations' events are relevant to me? ...and more in our future work
  • 24. station interest ranking predict (and rank) the stations that travellers will visit in their future trips for personalised notifications current system: free travel alerts – manually set up by traveller
  • 25. station interest ranking can we automate this? baseline: rank by visit popularity proposal: station similarity neighbourhood (visit co-occurrence) and traveller trip history
  • 26. station interest ranking 1. begin with baseline ranking 2. add proportional weighting for stations user has visited in the past 3. transform dataset into station- station co-occurrence matrix, increase weight of similar stations metric: percentile ranking
  • 28. without knowing who travellers are, the network topology, train schedule, disruptions and closures, we designed personalised information services for intelligent transport systems
  • 29. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips hierarchical clustering what next? larger, multi-modal datasets to investigate and improve the algorithms we evaluate here; implementations for mobile devices to study these applications in the field; examine other facets of travel behaviour (e.g., ticket purchasing)
  • 30. Mining Public Transport Usage for Personalised Intelligent Transport Systems We are hiring! interested? get in touch! @neal_lathia n.lathia@cs.ucl.ac.uk