SlideShare ist ein Scribd-Unternehmen logo
1 von 27
Extracting Spatio-Temporal Information
    from Inertial Body Sensor Networks for
             Gait Speed Estimation
     Shanshan Chen, Christopher L. Cunningham, Bradford C. Bennett, John Lach
                          UVA Center for Wireless Health
                               University of Virginia
                                    BSN, 2011




1
Research Statement
     Signal processing challenge to obtain accurate spatial
      information from inertial BSNs
     Gait speed as an example to extract accurate spatio-temporal
      information
       Gait speed is the No. 1 predictor in frailty assessment
         require high gait speed accuracy
         desire for continuous, longitudinal gait speed monitoring




2
Prevailing Technology
     --for Gait Speed Estimation




     Nike+®                          Fit-Bit®:
      Pedometer, cadence                 Accelerometer, cadence




     Garmin Forerunner ®301
      Wearable wrist GPS, velocity                  Stopwatch    and Tape

3
Inertial BSN for Gait Speed Estimation
    




                                TEMPO 3.1 inertial BSN platform
                                 developed at the University of Virginia




4
Contributions
     Refined human gait model by leveraging biomechanics
      knowledge
       Improve accuracy without increasing signal processing
        complexity
     Mounting calibration procedure to correct mounting error
       Practical in experiments
     Improved gait speed estimation accuracy by combining the
      two methods




5
Outline
     Current Gait Speed Estimation Method
       Gait Cycle Extraction and Integration Drift Cancelation
       Stride Length Computation by Reference Model
     Refined Human Gait Model
     Mounting Calibration
     Experiment & Results




6
Gait Cycle & Integration Drift Cancelation
                              Gyroscope signals on the
                               sagittal plane
                              Use foot on ground to find
                               gait cycle boundaries
                                Numerically easy to pick
                                 up – local maximum
                                Helpful for canceling
                                 integration drift
                                  Shank angle is near zero and
                                   does not contribute to the
                                   stride length calculation
                                   when foot is on ground
                                  Assume linear drift

7
Stride Length Computation




                  Reference Model
    S. Miyazaki, “Long-Term Unrestrained Measurement of Stride Length
          and Walking Velocity Utilizing a Piezoelectric Gyroscope”


8
Outline
     Current Gait Speed Estimation Method
       Gait Cycle Extraction & Integration Drift Cancelation
       Stride Length Computation by Reference Model
     Refined Human Gait Model
     Mounting Calibration
     Experiments and Results




9
Inspection of Gait Phase




10
11
Refined Compound Model



                          Reference Model




12
Outline
      Current Gait Speed Estimation Method
        Gait Cycle Extraction and Integration Drift Cancelation
        Stride Length Computation by Reference Model
      Refined Human Gait Model
      Mounting Calibration
      Experiment & Results




13
Mounting Calibration
      Nodes could be rotated 20°~30° from ideal orientation
      Attenuate the signal of interest on the sensitive axis




                                                       Ideal Mounting




14                                                     Non-ideal Mounting
Mounting Calibration Methods
     




15
Validation of Mounting Calibration Algorithm
                                             Mounting           Measured by       Measurement
                                          Position Rotated   Proposed Algorithm   Error of Angle
                                           Around Y-axis

                                                 0°                -0.072°            0.072°

                                                15°               16.286°             1.286°

                                                30°               27.896°             2.104°

                                                45°               43.954°             1.046°

                                                60°               58.078°             1.922°

                                                75°               74.737°             0.263°
      Pendulum Model to simulate               90°               90.461°             0.461°
       node rotation on shank
      Rotate around z-axis with               Measurement Error of Angle
                                         2.5
       controlled degree
                                          2
      Determine the rotation by         1.5
       Mounting Calibration Algorithm     1
                                         0.5
      Achieve an average error of ~1°
                                          0
                                                0° 15° 30° 45° 60° 75° 90°
                                                         Measurement Error of Angle

16
Outline
      Current Gait Speed Estimation Method
        Gait Cycle Extraction and Integration Drift Cancelation
        Stride Length Computation by reference model
      Refined Human Gait Model
      Mounting Calibration
      Experiment & Results




17
Treadmill Control of Speed
      Is gait on treadmill
       different from on
       ground?
        Gyroscope signals
         collected on
         treadmill show no
         significant
         difference from
         those collected on
         ground


18
Experiments on Treadmill
                                             Subject with poorly mounted
                                             Inertial BSN nodes performing
                                             mounting calibration on treadmill




      Two subjects, a taller male subject and a shorter female subject
      Two trials were conducted for each subject, one with well-mounted nodes and
       another with poorly-mounted nodes to validate mounting calibration
      Speeds ranging from 1 to 3 MPH with a 0.2 MPH (0.1m/s) increment for 45
       seconds at each speed



19
Results
Before/After Mounting Calibration
      Before Mounting Calibration                       After Mounting Calibration




       • Badly mounted nodes causes underestimation of gait speed – attenuation of
         signal due to bad mounting
       • Mounting Calibration has correct the significant estimation error
21
Results of Two Subjects




       • Significantly reduced RMSE compared to the reference model
       • Overestimate at lower speeds and underestimate at higher speeds
       • Overestimate taller subject’s speeds more than the shorter subject
22
Gait Model at Different Speeds
       The thigh angle can be critical for controlling the step length


                                      Elimination of thigh angle
                                       results in underestimation of
                                       stride length at high speed
                                      Vice versa at low speed

                 High Speed

      Use thigh nodes to increase accuracy if invasiveness is not a
       concern
      How accurate is accurate enough?
        Depends on application requirement
23
Results of Two Approaches
      Double Pendulum at Initial Swing               Single Pendulum at Toe-Off




                          Single Pendulum Model at Toe-off
                          • Better than the reference model
                          • Still overestimate the gait speed
24
Future Work
      Need more subjects, more gait types, and more gait speeds
        For certain types of pathological gait, include those with
         shuffling, a wide base, and out-of-plane motion
        More refined gait models will be developed based on
         biomechanical knowledge
      Evaluate if a training set of data can be used to calibrate the
       algorithm for each individual subject




25
Conclusion
      Achieving an RMSE of 0.09m/s accuracy with a resolution of
       0.1m/s
      Proposed model shows significant improvement in accuracy
       compared to the reference model
      Mounting calibration corrected the estimation error
      Leveraging biomechanical domain knowledge simplifies
       signal processing




26
Thanks!
 Q&A

Weitere ähnliche Inhalte

Ähnlich wie Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for Gait Speed Estimation

The Application of Gyro in Vehicle Angle Measurement
The Application of Gyro in Vehicle Angle MeasurementThe Application of Gyro in Vehicle Angle Measurement
The Application of Gyro in Vehicle Angle MeasurementIJRES Journal
 
Apresentação IMU (2).pdf
Apresentação IMU (2).pdfApresentação IMU (2).pdf
Apresentação IMU (2).pdfarsalhabib1
 
Final Year Project Presentation
Final Year Project PresentationFinal Year Project Presentation
Final Year Project Presentationfarhan_naseer_1
 
Pose estimation of a mobile robot
Pose estimation of a mobile robotPose estimation of a mobile robot
Pose estimation of a mobile robotAlwin Poulose
 
OPTIMIZING DRILLING & WELLBORE POSITIONING THROUGH AUTOMATION AND DIGITALIZATION
OPTIMIZING DRILLING & WELLBORE POSITIONING THROUGH AUTOMATION AND DIGITALIZATIONOPTIMIZING DRILLING & WELLBORE POSITIONING THROUGH AUTOMATION AND DIGITALIZATION
OPTIMIZING DRILLING & WELLBORE POSITIONING THROUGH AUTOMATION AND DIGITALIZATIONiQHub
 
How the Nintento Wii’s motion plus technology has opened the door to a wave o...
How the Nintento Wii’s motion plus technology has opened the door to a wave o...How the Nintento Wii’s motion plus technology has opened the door to a wave o...
How the Nintento Wii’s motion plus technology has opened the door to a wave o...HitReach
 
Multi-Direction Pedestrian Wind Comfort Analysis
Multi-Direction Pedestrian Wind Comfort AnalysisMulti-Direction Pedestrian Wind Comfort Analysis
Multi-Direction Pedestrian Wind Comfort AnalysisSimScale
 
Smartphone-based Pedestrian Dead Reckoning as an Indoor Positioning System
Smartphone-based Pedestrian Dead Reckoning as an Indoor Positioning SystemSmartphone-based Pedestrian Dead Reckoning as an Indoor Positioning System
Smartphone-based Pedestrian Dead Reckoning as an Indoor Positioning SystemAlwin Poulose
 
Track 4 session 3 - st dev con 2016 - pedestrian dead reckoning
Track 4   session 3 - st dev con 2016 - pedestrian dead reckoningTrack 4   session 3 - st dev con 2016 - pedestrian dead reckoning
Track 4 session 3 - st dev con 2016 - pedestrian dead reckoningST_World
 
International Journal of Engineering and Science Invention (IJESI)
International Journal of Engineering and Science Invention (IJESI)International Journal of Engineering and Science Invention (IJESI)
International Journal of Engineering and Science Invention (IJESI)inventionjournals
 
Motion recognition based 3D pedestrian navigation system using smartphone
Motion recognition based 3D pedestrian navigation system using smartphoneMotion recognition based 3D pedestrian navigation system using smartphone
Motion recognition based 3D pedestrian navigation system using smartphoneAlwin Poulose
 
Methods of movements analysis
Methods of movements analysisMethods of movements analysis
Methods of movements analysisBaneet Sharma
 
Inclinometer by milan kumar rai
Inclinometer by milan kumar raiInclinometer by milan kumar rai
Inclinometer by milan kumar raiMilan Kumar Rai
 
40th_csrs&ga_fredericton2019_ndirlarouche
40th_csrs&ga_fredericton2019_ndirlarouche40th_csrs&ga_fredericton2019_ndirlarouche
40th_csrs&ga_fredericton2019_ndirlaroucheP. Medoune Ndir
 
IRJET- Automated Guided Vehicle using Servo Motor in Indoor Positioning S...
IRJET-  	  Automated Guided Vehicle using Servo Motor in Indoor Positioning S...IRJET-  	  Automated Guided Vehicle using Servo Motor in Indoor Positioning S...
IRJET- Automated Guided Vehicle using Servo Motor in Indoor Positioning S...IRJET Journal
 
Hardware Implementation of Low Cost Inertial Navigation System Using Mems Ine...
Hardware Implementation of Low Cost Inertial Navigation System Using Mems Ine...Hardware Implementation of Low Cost Inertial Navigation System Using Mems Ine...
Hardware Implementation of Low Cost Inertial Navigation System Using Mems Ine...IOSR Journals
 

Ähnlich wie Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for Gait Speed Estimation (20)

The Application of Gyro in Vehicle Angle Measurement
The Application of Gyro in Vehicle Angle MeasurementThe Application of Gyro in Vehicle Angle Measurement
The Application of Gyro in Vehicle Angle Measurement
 
Apresentação IMU (2).pdf
Apresentação IMU (2).pdfApresentação IMU (2).pdf
Apresentação IMU (2).pdf
 
Final Year Project Presentation
Final Year Project PresentationFinal Year Project Presentation
Final Year Project Presentation
 
Pose estimation of a mobile robot
Pose estimation of a mobile robotPose estimation of a mobile robot
Pose estimation of a mobile robot
 
OPTIMIZING DRILLING & WELLBORE POSITIONING THROUGH AUTOMATION AND DIGITALIZATION
OPTIMIZING DRILLING & WELLBORE POSITIONING THROUGH AUTOMATION AND DIGITALIZATIONOPTIMIZING DRILLING & WELLBORE POSITIONING THROUGH AUTOMATION AND DIGITALIZATION
OPTIMIZING DRILLING & WELLBORE POSITIONING THROUGH AUTOMATION AND DIGITALIZATION
 
How the Nintento Wii’s motion plus technology has opened the door to a wave o...
How the Nintento Wii’s motion plus technology has opened the door to a wave o...How the Nintento Wii’s motion plus technology has opened the door to a wave o...
How the Nintento Wii’s motion plus technology has opened the door to a wave o...
 
Multi-Direction Pedestrian Wind Comfort Analysis
Multi-Direction Pedestrian Wind Comfort AnalysisMulti-Direction Pedestrian Wind Comfort Analysis
Multi-Direction Pedestrian Wind Comfort Analysis
 
Smartphone-based Pedestrian Dead Reckoning as an Indoor Positioning System
Smartphone-based Pedestrian Dead Reckoning as an Indoor Positioning SystemSmartphone-based Pedestrian Dead Reckoning as an Indoor Positioning System
Smartphone-based Pedestrian Dead Reckoning as an Indoor Positioning System
 
Lecture 04
Lecture 04Lecture 04
Lecture 04
 
Track 4 session 3 - st dev con 2016 - pedestrian dead reckoning
Track 4   session 3 - st dev con 2016 - pedestrian dead reckoningTrack 4   session 3 - st dev con 2016 - pedestrian dead reckoning
Track 4 session 3 - st dev con 2016 - pedestrian dead reckoning
 
International Journal of Engineering and Science Invention (IJESI)
International Journal of Engineering and Science Invention (IJESI)International Journal of Engineering and Science Invention (IJESI)
International Journal of Engineering and Science Invention (IJESI)
 
Kealy fidaforever
Kealy fidaforeverKealy fidaforever
Kealy fidaforever
 
Lecture 04: Sensors
Lecture 04: SensorsLecture 04: Sensors
Lecture 04: Sensors
 
Motion recognition based 3D pedestrian navigation system using smartphone
Motion recognition based 3D pedestrian navigation system using smartphoneMotion recognition based 3D pedestrian navigation system using smartphone
Motion recognition based 3D pedestrian navigation system using smartphone
 
Methods of movements analysis
Methods of movements analysisMethods of movements analysis
Methods of movements analysis
 
Cutting-edge technology for diagnosis and treatment of Vertigo.pdf
Cutting-edge technology for diagnosis and treatment of Vertigo.pdfCutting-edge technology for diagnosis and treatment of Vertigo.pdf
Cutting-edge technology for diagnosis and treatment of Vertigo.pdf
 
Inclinometer by milan kumar rai
Inclinometer by milan kumar raiInclinometer by milan kumar rai
Inclinometer by milan kumar rai
 
40th_csrs&ga_fredericton2019_ndirlarouche
40th_csrs&ga_fredericton2019_ndirlarouche40th_csrs&ga_fredericton2019_ndirlarouche
40th_csrs&ga_fredericton2019_ndirlarouche
 
IRJET- Automated Guided Vehicle using Servo Motor in Indoor Positioning S...
IRJET-  	  Automated Guided Vehicle using Servo Motor in Indoor Positioning S...IRJET-  	  Automated Guided Vehicle using Servo Motor in Indoor Positioning S...
IRJET- Automated Guided Vehicle using Servo Motor in Indoor Positioning S...
 
Hardware Implementation of Low Cost Inertial Navigation System Using Mems Ine...
Hardware Implementation of Low Cost Inertial Navigation System Using Mems Ine...Hardware Implementation of Low Cost Inertial Navigation System Using Mems Ine...
Hardware Implementation of Low Cost Inertial Navigation System Using Mems Ine...
 

Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for Gait Speed Estimation

  • 1. Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for Gait Speed Estimation Shanshan Chen, Christopher L. Cunningham, Bradford C. Bennett, John Lach UVA Center for Wireless Health University of Virginia BSN, 2011 1
  • 2. Research Statement  Signal processing challenge to obtain accurate spatial information from inertial BSNs  Gait speed as an example to extract accurate spatio-temporal information  Gait speed is the No. 1 predictor in frailty assessment  require high gait speed accuracy  desire for continuous, longitudinal gait speed monitoring 2
  • 3. Prevailing Technology --for Gait Speed Estimation  Nike+®  Fit-Bit®: Pedometer, cadence Accelerometer, cadence  Garmin Forerunner ®301 Wearable wrist GPS, velocity  Stopwatch and Tape 3
  • 4. Inertial BSN for Gait Speed Estimation  TEMPO 3.1 inertial BSN platform developed at the University of Virginia 4
  • 5. Contributions  Refined human gait model by leveraging biomechanics knowledge  Improve accuracy without increasing signal processing complexity  Mounting calibration procedure to correct mounting error  Practical in experiments  Improved gait speed estimation accuracy by combining the two methods 5
  • 6. Outline  Current Gait Speed Estimation Method  Gait Cycle Extraction and Integration Drift Cancelation  Stride Length Computation by Reference Model  Refined Human Gait Model  Mounting Calibration  Experiment & Results 6
  • 7. Gait Cycle & Integration Drift Cancelation  Gyroscope signals on the sagittal plane  Use foot on ground to find gait cycle boundaries  Numerically easy to pick up – local maximum  Helpful for canceling integration drift  Shank angle is near zero and does not contribute to the stride length calculation when foot is on ground  Assume linear drift 7
  • 8. Stride Length Computation Reference Model S. Miyazaki, “Long-Term Unrestrained Measurement of Stride Length and Walking Velocity Utilizing a Piezoelectric Gyroscope” 8
  • 9. Outline  Current Gait Speed Estimation Method  Gait Cycle Extraction & Integration Drift Cancelation  Stride Length Computation by Reference Model  Refined Human Gait Model  Mounting Calibration  Experiments and Results 9
  • 10. Inspection of Gait Phase 10
  • 11. 11
  • 12. Refined Compound Model Reference Model 12
  • 13. Outline  Current Gait Speed Estimation Method  Gait Cycle Extraction and Integration Drift Cancelation  Stride Length Computation by Reference Model  Refined Human Gait Model  Mounting Calibration  Experiment & Results 13
  • 14. Mounting Calibration  Nodes could be rotated 20°~30° from ideal orientation  Attenuate the signal of interest on the sensitive axis Ideal Mounting 14 Non-ideal Mounting
  • 16. Validation of Mounting Calibration Algorithm Mounting Measured by Measurement Position Rotated Proposed Algorithm Error of Angle Around Y-axis 0° -0.072° 0.072° 15° 16.286° 1.286° 30° 27.896° 2.104° 45° 43.954° 1.046° 60° 58.078° 1.922° 75° 74.737° 0.263°  Pendulum Model to simulate 90° 90.461° 0.461° node rotation on shank  Rotate around z-axis with Measurement Error of Angle 2.5 controlled degree 2  Determine the rotation by 1.5 Mounting Calibration Algorithm 1 0.5  Achieve an average error of ~1° 0 0° 15° 30° 45° 60° 75° 90° Measurement Error of Angle 16
  • 17. Outline  Current Gait Speed Estimation Method  Gait Cycle Extraction and Integration Drift Cancelation  Stride Length Computation by reference model  Refined Human Gait Model  Mounting Calibration  Experiment & Results 17
  • 18. Treadmill Control of Speed  Is gait on treadmill different from on ground?  Gyroscope signals collected on treadmill show no significant difference from those collected on ground 18
  • 19. Experiments on Treadmill Subject with poorly mounted Inertial BSN nodes performing mounting calibration on treadmill  Two subjects, a taller male subject and a shorter female subject  Two trials were conducted for each subject, one with well-mounted nodes and another with poorly-mounted nodes to validate mounting calibration  Speeds ranging from 1 to 3 MPH with a 0.2 MPH (0.1m/s) increment for 45 seconds at each speed 19
  • 21. Before/After Mounting Calibration Before Mounting Calibration After Mounting Calibration • Badly mounted nodes causes underestimation of gait speed – attenuation of signal due to bad mounting • Mounting Calibration has correct the significant estimation error 21
  • 22. Results of Two Subjects • Significantly reduced RMSE compared to the reference model • Overestimate at lower speeds and underestimate at higher speeds • Overestimate taller subject’s speeds more than the shorter subject 22
  • 23. Gait Model at Different Speeds  The thigh angle can be critical for controlling the step length  Elimination of thigh angle results in underestimation of stride length at high speed  Vice versa at low speed High Speed  Use thigh nodes to increase accuracy if invasiveness is not a concern  How accurate is accurate enough?  Depends on application requirement 23
  • 24. Results of Two Approaches Double Pendulum at Initial Swing Single Pendulum at Toe-Off Single Pendulum Model at Toe-off • Better than the reference model • Still overestimate the gait speed 24
  • 25. Future Work  Need more subjects, more gait types, and more gait speeds  For certain types of pathological gait, include those with shuffling, a wide base, and out-of-plane motion  More refined gait models will be developed based on biomechanical knowledge  Evaluate if a training set of data can be used to calibrate the algorithm for each individual subject 25
  • 26. Conclusion  Achieving an RMSE of 0.09m/s accuracy with a resolution of 0.1m/s  Proposed model shows significant improvement in accuracy compared to the reference model  Mounting calibration corrected the estimation error  Leveraging biomechanical domain knowledge simplifies signal processing 26

Hinweis der Redaktion

  1. So this research is motivated by two things, one is to overcome the challenges in signal processing for getting accurate spatial information, Another is simply because gait speed itself is an important parameter in gait analysis. Esp. now it’s been identified as no.1 predictor in frailty assessment in geriatrics.Predicting frailty with a couple of tens meters/s.And it’s an application require high accuracy and high resolutionAnd would benefit a lot from longitudinal continuous monitoring
  2. Before we jump into this research, let’s look at the current devices on gait speed estimation.Nike+ provides a pedometer solution to assess cadence, and FitBit uses accelerometer for cadence.Both of the two solutions require a predefined calibration to get step length, And the accuracy remains questionable.Garmin Forerunner provides a GPS solution, and gives an RMS of 0.05m/s in velocity assessment,But it’s limited to outdoor use only.And don’t forget, in clinic, we can always use stopwatch and tape if you don’t have other fancy devices,Needless to say it’ll be limited to clinic use
  3. Then we compute stride length by this reference model, Where they assume human gait can be considered as symmetric single pendulum model.For example, when the shank swing backwards to the maximum, We obtain d1rs.Forward maximum, we get d2rs.By summing left shank step length and right shank step length we can get the stride length based on the trignometry provided here.
  4. By taking this 8 frames/second picture of many gaits, we found when the shank reaches the maximum, the leg isn’t straight.
  5. Based on this observation, we propose this gait model, using only shank length as the hypotenuse at the backward swing, the forward swing remains the same.