SlideShare a Scribd company logo
1 of 18
Activity Recognition from User-Annotated Acceleration Data Ling Bao and Stephen S. Intille Presented by: Hong Lu
Key Questions Can low cost wearable sensors be used for robust, real- time recognition of activity?  Can training data be acquired from the end user without researcher supervision?  Does recognition require user-specific training data?  Do more sensors improve recognition?
Data Collection 13 ♂ + 7♀ = 20 subjects , age from 17 to 48  20 everyday activities  Subjects unsupervised when generating own training data, both in and outside the lab What’s the problem of typical laboratory data? WHY? ,[object Object]
Lab environments may restrict activity, simplifying recognition  !
Making researchers to label training examples does not scaleRecognition rates highly depended on how data is collected       95.6% (laboratory data)                                                            VS                                                                     66.7% (naturalistic settings)
Data Collection What’s an accelerometer ?  An accelerometer is a device that measures the vibration, or acceleration of motion of a structure.
Why Accelerometer ? Many daily activities involve repetitive physical motion of the body or specific postures  E.g. Walking, Running, Scrubbing, Vacuuming Low cost, tiny, energy efficient  Watch Phone, mp3 player Camera computer Game controller, the wii remote
Sensor Placement  ,[object Object]
Right hip
Wrist
upper arm
Ankle
Thigh
Shack to synchronize,[object Object]
Features Why we need them ? Summarize the data bin Capture useful information  What is the desired characteristics of a good feature ? removing irrelevant noise keeping relevant attributes to tell the difference easy to compute ?
Features 512 sample windows (6.7s ?), 50% window overlap  Features:  Mean  Energy  Frequency-domain entropy  Correlation Between x, y accelerometer axes each board Between all pair wise combinations of axes on different boards
Classifiers Tested on decision table, nearest neighbor ( IBL), C4.5 decision tree, and naïve Bayesian classifiers                          Machine Learning Toolkit (Witten & Frank, 1999)
Training Method 1: User-specific training  Train on activity sequence data for each subject  Test on obstacle course data for that subject  Method 2: Leave-one-subject out training Train on activity sequence and activity data for all subjects but one  Test on obstacle course data for left out subject Average for all 20 subjects

More Related Content

Similar to Activity Recognition from User-Annotated Acceleration Data Ling ...

An innovative approach for feature selection based on chicken swarm optimization
An innovative approach for feature selection based on chicken swarm optimizationAn innovative approach for feature selection based on chicken swarm optimization
An innovative approach for feature selection based on chicken swarm optimizationAboul Ella Hassanien
 
Monitoring the cardiac intervals from iOS – an implementation. Mr James Heath...
Monitoring the cardiac intervals from iOS – an implementation. Mr James Heath...Monitoring the cardiac intervals from iOS – an implementation. Mr James Heath...
Monitoring the cardiac intervals from iOS – an implementation. Mr James Heath...Charles Perkins Centre, University of Sydney
 
Digital Biomarkers for Huntington Disease
Digital Biomarkers for Huntington DiseaseDigital Biomarkers for Huntington Disease
Digital Biomarkers for Huntington DiseaseHuntington Study Group
 
Elderly activity recognition and classification for application in assisted l...
Elderly activity recognition and classification for application in assisted l...Elderly activity recognition and classification for application in assisted l...
Elderly activity recognition and classification for application in assisted l...Sara Egidi
 
Use of technology in rehabilitation - Lorna Paul
Use of technology in rehabilitation - Lorna PaulUse of technology in rehabilitation - Lorna Paul
Use of technology in rehabilitation - Lorna PaulMS Trust
 
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”IRJET Journal
 
NYAI #23: Using Cognitive Neuroscience to Create AI (w/ Dr. Peter Olausson)
NYAI #23: Using Cognitive Neuroscience to Create AI (w/ Dr. Peter Olausson)NYAI #23: Using Cognitive Neuroscience to Create AI (w/ Dr. Peter Olausson)
NYAI #23: Using Cognitive Neuroscience to Create AI (w/ Dr. Peter Olausson)Maryam Farooq
 
information retrival evaluation.ppt
information retrival evaluation.pptinformation retrival evaluation.ppt
information retrival evaluation.pptBonnieKabiru
 
Machine Learning Challenges For Automated Prompting In Smart Homes
Machine Learning Challenges For Automated Prompting In Smart HomesMachine Learning Challenges For Automated Prompting In Smart Homes
Machine Learning Challenges For Automated Prompting In Smart HomesBarnan Das
 
RecoFit: Using a Wearable Sensor to Find, Recognize, and Count Repetitive Exe...
RecoFit: Using a Wearable Sensor to Find, Recognize, and Count Repetitive Exe...RecoFit: Using a Wearable Sensor to Find, Recognize, and Count Repetitive Exe...
RecoFit: Using a Wearable Sensor to Find, Recognize, and Count Repetitive Exe...Wookjae Maeng
 
Exercise Recognition System using Facial Image Information from a Mobile Devi...
Exercise Recognition System using Facial Image Information from a Mobile Devi...Exercise Recognition System using Facial Image Information from a Mobile Devi...
Exercise Recognition System using Facial Image Information from a Mobile Devi...sugiuralab
 
Machine Learning, Data Mining, Genetic Algorithms, Neural ...
Machine Learning, Data Mining, Genetic Algorithms, Neural ...Machine Learning, Data Mining, Genetic Algorithms, Neural ...
Machine Learning, Data Mining, Genetic Algorithms, Neural ...butest
 
Exact Data Reduction for Big Data by Jieping Ye
Exact Data Reduction for Big Data by Jieping YeExact Data Reduction for Big Data by Jieping Ye
Exact Data Reduction for Big Data by Jieping YeBigMine
 
WE1.TO9.2.pdf
WE1.TO9.2.pdfWE1.TO9.2.pdf
WE1.TO9.2.pdfgrssieee
 
Probability Forecasting - a Machine Learning Perspective
Probability Forecasting - a Machine Learning PerspectiveProbability Forecasting - a Machine Learning Perspective
Probability Forecasting - a Machine Learning Perspectivebutest
 
HCI 3e - Ch 9: Evaluation techniques
HCI 3e - Ch 9:  Evaluation techniquesHCI 3e - Ch 9:  Evaluation techniques
HCI 3e - Ch 9: Evaluation techniquesAlan Dix
 
Multimodal Cognitive Load Assessment
Multimodal Cognitive Load AssessmentMultimodal Cognitive Load Assessment
Multimodal Cognitive Load AssessmentKeith Lyons
 
Evaluating a Potential Commercial Tool for Healthcare Application for People ...
Evaluating a Potential Commercial Tool for Healthcare Application for People ...Evaluating a Potential Commercial Tool for Healthcare Application for People ...
Evaluating a Potential Commercial Tool for Healthcare Application for People ...Artificial Intelligence Institute at UofSC
 

Similar to Activity Recognition from User-Annotated Acceleration Data Ling ... (20)

An innovative approach for feature selection based on chicken swarm optimization
An innovative approach for feature selection based on chicken swarm optimizationAn innovative approach for feature selection based on chicken swarm optimization
An innovative approach for feature selection based on chicken swarm optimization
 
Monitoring the cardiac intervals from iOS – an implementation. Mr James Heath...
Monitoring the cardiac intervals from iOS – an implementation. Mr James Heath...Monitoring the cardiac intervals from iOS – an implementation. Mr James Heath...
Monitoring the cardiac intervals from iOS – an implementation. Mr James Heath...
 
Digital Biomarkers for Huntington Disease
Digital Biomarkers for Huntington DiseaseDigital Biomarkers for Huntington Disease
Digital Biomarkers for Huntington Disease
 
Elderly activity recognition and classification for application in assisted l...
Elderly activity recognition and classification for application in assisted l...Elderly activity recognition and classification for application in assisted l...
Elderly activity recognition and classification for application in assisted l...
 
Use of technology in rehabilitation - Lorna Paul
Use of technology in rehabilitation - Lorna PaulUse of technology in rehabilitation - Lorna Paul
Use of technology in rehabilitation - Lorna Paul
 
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
 
NYAI #23: Using Cognitive Neuroscience to Create AI (w/ Dr. Peter Olausson)
NYAI #23: Using Cognitive Neuroscience to Create AI (w/ Dr. Peter Olausson)NYAI #23: Using Cognitive Neuroscience to Create AI (w/ Dr. Peter Olausson)
NYAI #23: Using Cognitive Neuroscience to Create AI (w/ Dr. Peter Olausson)
 
information retrival evaluation.ppt
information retrival evaluation.pptinformation retrival evaluation.ppt
information retrival evaluation.ppt
 
Hcs Projects
Hcs ProjectsHcs Projects
Hcs Projects
 
Machine Learning Challenges For Automated Prompting In Smart Homes
Machine Learning Challenges For Automated Prompting In Smart HomesMachine Learning Challenges For Automated Prompting In Smart Homes
Machine Learning Challenges For Automated Prompting In Smart Homes
 
RecoFit: Using a Wearable Sensor to Find, Recognize, and Count Repetitive Exe...
RecoFit: Using a Wearable Sensor to Find, Recognize, and Count Repetitive Exe...RecoFit: Using a Wearable Sensor to Find, Recognize, and Count Repetitive Exe...
RecoFit: Using a Wearable Sensor to Find, Recognize, and Count Repetitive Exe...
 
Exercise Recognition System using Facial Image Information from a Mobile Devi...
Exercise Recognition System using Facial Image Information from a Mobile Devi...Exercise Recognition System using Facial Image Information from a Mobile Devi...
Exercise Recognition System using Facial Image Information from a Mobile Devi...
 
Machine Learning, Data Mining, Genetic Algorithms, Neural ...
Machine Learning, Data Mining, Genetic Algorithms, Neural ...Machine Learning, Data Mining, Genetic Algorithms, Neural ...
Machine Learning, Data Mining, Genetic Algorithms, Neural ...
 
Exact Data Reduction for Big Data by Jieping Ye
Exact Data Reduction for Big Data by Jieping YeExact Data Reduction for Big Data by Jieping Ye
Exact Data Reduction for Big Data by Jieping Ye
 
WE1.TO9.2.pdf
WE1.TO9.2.pdfWE1.TO9.2.pdf
WE1.TO9.2.pdf
 
Probability Forecasting - a Machine Learning Perspective
Probability Forecasting - a Machine Learning PerspectiveProbability Forecasting - a Machine Learning Perspective
Probability Forecasting - a Machine Learning Perspective
 
HCI 3e - Ch 9: Evaluation techniques
HCI 3e - Ch 9:  Evaluation techniquesHCI 3e - Ch 9:  Evaluation techniques
HCI 3e - Ch 9: Evaluation techniques
 
Multimodal Cognitive Load Assessment
Multimodal Cognitive Load AssessmentMultimodal Cognitive Load Assessment
Multimodal Cognitive Load Assessment
 
Seminar nov2017
Seminar nov2017Seminar nov2017
Seminar nov2017
 
Evaluating a Potential Commercial Tool for Healthcare Application for People ...
Evaluating a Potential Commercial Tool for Healthcare Application for People ...Evaluating a Potential Commercial Tool for Healthcare Application for People ...
Evaluating a Potential Commercial Tool for Healthcare Application for People ...
 

More from butest

EL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBEEL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBEbutest
 
1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同butest
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALbutest
 
Timeline: The Life of Michael Jackson
Timeline: The Life of Michael JacksonTimeline: The Life of Michael Jackson
Timeline: The Life of Michael Jacksonbutest
 
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...butest
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALbutest
 
Com 380, Summer II
Com 380, Summer IICom 380, Summer II
Com 380, Summer IIbutest
 
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet JazzThe MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazzbutest
 
MICHAEL JACKSON.doc
MICHAEL JACKSON.docMICHAEL JACKSON.doc
MICHAEL JACKSON.docbutest
 
Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1butest
 
Facebook
Facebook Facebook
Facebook butest
 
Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...butest
 
Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...butest
 
NEWS ANNOUNCEMENT
NEWS ANNOUNCEMENTNEWS ANNOUNCEMENT
NEWS ANNOUNCEMENTbutest
 
C-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.docC-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.docbutest
 
MAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.docMAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.docbutest
 
Mac OS X Guide.doc
Mac OS X Guide.docMac OS X Guide.doc
Mac OS X Guide.docbutest
 
WEB DESIGN!
WEB DESIGN!WEB DESIGN!
WEB DESIGN!butest
 

More from butest (20)

EL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBEEL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBE
 
1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIAL
 
Timeline: The Life of Michael Jackson
Timeline: The Life of Michael JacksonTimeline: The Life of Michael Jackson
Timeline: The Life of Michael Jackson
 
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIAL
 
Com 380, Summer II
Com 380, Summer IICom 380, Summer II
Com 380, Summer II
 
PPT
PPTPPT
PPT
 
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet JazzThe MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
 
MICHAEL JACKSON.doc
MICHAEL JACKSON.docMICHAEL JACKSON.doc
MICHAEL JACKSON.doc
 
Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1
 
Facebook
Facebook Facebook
Facebook
 
Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...
 
Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...
 
NEWS ANNOUNCEMENT
NEWS ANNOUNCEMENTNEWS ANNOUNCEMENT
NEWS ANNOUNCEMENT
 
C-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.docC-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.doc
 
MAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.docMAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.doc
 
Mac OS X Guide.doc
Mac OS X Guide.docMac OS X Guide.doc
Mac OS X Guide.doc
 
hier
hierhier
hier
 
WEB DESIGN!
WEB DESIGN!WEB DESIGN!
WEB DESIGN!
 

Activity Recognition from User-Annotated Acceleration Data Ling ...

  • 1. Activity Recognition from User-Annotated Acceleration Data Ling Bao and Stephen S. Intille Presented by: Hong Lu
  • 2. Key Questions Can low cost wearable sensors be used for robust, real- time recognition of activity? Can training data be acquired from the end user without researcher supervision? Does recognition require user-specific training data? Do more sensors improve recognition?
  • 3.
  • 4. Lab environments may restrict activity, simplifying recognition !
  • 5. Making researchers to label training examples does not scaleRecognition rates highly depended on how data is collected 95.6% (laboratory data) VS 66.7% (naturalistic settings)
  • 6. Data Collection What’s an accelerometer ? An accelerometer is a device that measures the vibration, or acceleration of motion of a structure.
  • 7. Why Accelerometer ? Many daily activities involve repetitive physical motion of the body or specific postures E.g. Walking, Running, Scrubbing, Vacuuming Low cost, tiny, energy efficient Watch Phone, mp3 player Camera computer Game controller, the wii remote
  • 8.
  • 10. Wrist
  • 12. Ankle
  • 13. Thigh
  • 14.
  • 15. Features Why we need them ? Summarize the data bin Capture useful information What is the desired characteristics of a good feature ? removing irrelevant noise keeping relevant attributes to tell the difference easy to compute ?
  • 16. Features 512 sample windows (6.7s ?), 50% window overlap Features: Mean Energy Frequency-domain entropy Correlation Between x, y accelerometer axes each board Between all pair wise combinations of axes on different boards
  • 17. Classifiers Tested on decision table, nearest neighbor ( IBL), C4.5 decision tree, and naïve Bayesian classifiers Machine Learning Toolkit (Witten & Frank, 1999)
  • 18. Training Method 1: User-specific training Train on activity sequence data for each subject Test on obstacle course data for that subject Method 2: Leave-one-subject out training Train on activity sequence and activity data for all subjects but one Test on obstacle course data for left out subject Average for all 20 subjects
  • 19. Results C45 Decision tree wins It shows User-specific training: 71.6 ±7.4 Leave-one-subject-out training: 84.3 ±5.2 Why? Commonalities between people may be more significant than individual variations Larger training set
  • 20. Result Overall, promising Data collected by subjects themselves without supervision Data collected both in and outside of laboratory setting Poorer performance results when… Activities involve less physically characteristic movements , Activities involve little motion or standing still Activities involve similar posture/movement (e.g. watching TV, sitting and relaxing)
  • 21. The dark side The more sensors you placed, the higher accuracy you may achieved, but … cost you look weird hard to deploy more computational horse power
  • 22. Accelerometer Discriminatory Power Tested C4.5 classifier with using subsets of accelerometers: Hip, wrist, arm, ankle, thigh, thigh and wrist, hip and wrist Best single performers: Thigh (-29.5%) Hip (-34.1%) Ankle(-37%)
  • 23. Accelerometer Discriminatory Power With only two accelerometers get good performance: Thigh and wrist (-3.3% compared with all 5) Hip and wrist (-4.8% compared with all 5)
  • 24. Overview The study Activity recognition: 20 household activities Sensors: 5 non-wired accelerometers Data: participants labeled own data Result Good performance with decision tree classifier Subject-specific training data for some activities may not be required Reasonable accuracy can be achieved with only 2 of 5 accelerometers
  • 25. Thank you! The End For some slides, I used content of Emmanuel MunguiaTapia’s presentation