SlideShare ist ein Scribd-Unternehmen logo
1 von 17
Downloaden Sie, um offline zu lesen
Simultaneous Localization and Mapping
                  for Pedestrians
     using only Foot-Mounted Inertial Sensors
Patrick Robertson, Michael Angermann, Bernhard Krach
German Aerospace Center (DLR)
B. Krach is now with EADS Germany
Raw NavShoe Odometry Results
   Algorithm: Extended Kalman Filter with Zero Velcocity Updates (Foxlin)




NavShoe INS produced reasonable results         NavShoe INS had larger heading slips;
stand alone, but still unbounded error growth   unbounded error begins to rise earlier
State of the Art: Use Maps
   Inertial sensors used indoors achieve accurate positioning
   when used in conjunction with maps
         Krach, Robertson: WPNC 08, PLANS 08+
         Widyawan, Klepal, Beauregard: WPNC 08
        Woodman, Harle: UbiComp 2008



  But what if the map
  is unknown?
So, could we derive a map from this?




Naïve approach:

“Transfer the raw odometry trace to
a piece of wire and bend it bit by bit
so that similar areas overlap”
SLAM in Robotics
  Simultaneous Localization and Mapping - identified by
  robotics community in mid ‘80s!
  Premise:
         Localization using odometry and sensing of known
         landmarks is easy!

        Mapping of landmarks given known location and
        orientation (pose) is easy!


        Simultaneous Localization and Mapping is hard!
What about SLAM for Humans?
  Human pedestrians are not robots but share
  some similarities with them
          Visual sensors (eyes)
          'Odometry' (in humans: sensed by
          proprioception)
          Path and planning and execution
  In humans, we usually have little or no
  direct 'access' to most of these senses and
  functions
  Our central assumption:
          The pedestrian is able to actively control
          motion without violating physical
          constraints (i.e. walls, etc)
A Person Processes Numerous Visual Inputs
Bayesian Formulation: DBN
                       Time k-1                                Time k                   Time k+1
                Pose
      P                                          P                            P
                 U: Actual step taken
                 (pose change vector)
Measured         U                                         U                            U
  Step                 Error states of
   Zu                  the odometry
     Zu           E                             Zu         E                Zu          E



          Int                                        Int                          Int
                      Intention
                      „what the person
                      wants to do“
          Vis                                        Vis                          Vis
                 Visual information
                 „what the person sees“

                                                 “Environment” = Map … constant over time
                                          Map
Intuitive Explanation of the Sequential
Monte Carlo Algorithm
   FootSLAM lets particles, or hypotheses, explore the state
   space of odometry errors, like evolution of drift
   In this way, every particle is trying a slightly “differently bent
   piece of wire”
   Particles are weighted by their “compatibility” with
          their individual map
          optional sensor readings, such as GPS,
          magnetometer

   We can show that this is optimal in the Bayesian sense!
Experiments and Results

  Measurement data taken from a pedestrian wearing
  a foot mounted IMU



  Two scenarios:
       Indoor only
       Outdoor – indoor - outdoor sequence
Video



   See

   http://www.kn-s.dlr.de/indoornav
Resulting Maps
Resulting Maps
Relative Position Accuracy - Indoors
No Scale Adaptation was Performed
Outdoor-Indoor-Outdoor
Concluding Notes
 FootSLAM effectively bounds the otherwise unbounded error growth
 without the need for pre-existing maps!

 FootSLAM (like all forms of SLAM) is inherently invariant to rotation,
 translation and scale

 In mixed scenarios, the resulting maps are globally and precisely anchored
 using GPS

 Our future work:
       Map building with multiple users;
       “crowdsourcing” collaborative mapping

 Movies: http://www.kn-s.dlr.de/indoornav/
Thank you!

Movies: http://www.kn-s.dlr.de/indoornav/

Weitere ähnliche Inhalte

Was ist angesagt?

Remote Sensing error sources
Remote Sensing error sourcesRemote Sensing error sources
Remote Sensing error sources
Gilbert Okoth
 

Was ist angesagt? (20)

Mapping Water features from SAR Imagery
Mapping Water features from SAR ImageryMapping Water features from SAR Imagery
Mapping Water features from SAR Imagery
 
Facing the archaeological looting in Peru by local spatial autocorrelation st...
Facing the archaeological looting in Peru by local spatial autocorrelation st...Facing the archaeological looting in Peru by local spatial autocorrelation st...
Facing the archaeological looting in Peru by local spatial autocorrelation st...
 
Simultaneous Localization and Mapping for Pedestrians using Distortions of th...
Simultaneous Localization and Mapping for Pedestrians using Distortions of th...Simultaneous Localization and Mapping for Pedestrians using Distortions of th...
Simultaneous Localization and Mapping for Pedestrians using Distortions of th...
 
Global Navigations Satellite System (GNSS) Indonesia
Global Navigations Satellite System (GNSS) IndonesiaGlobal Navigations Satellite System (GNSS) Indonesia
Global Navigations Satellite System (GNSS) Indonesia
 
Remote Sensing error sources
Remote Sensing error sourcesRemote Sensing error sources
Remote Sensing error sources
 
Gps and its application
Gps and its applicationGps and its application
Gps and its application
 
SfM Research Applications Presentation
SfM Research Applications PresentationSfM Research Applications Presentation
SfM Research Applications Presentation
 
Gps
GpsGps
Gps
 
Practical Applications of GPS Technology
Practical Applications of GPS TechnologyPractical Applications of GPS Technology
Practical Applications of GPS Technology
 
Global positioning system (GPS)
Global positioning system (GPS)Global positioning system (GPS)
Global positioning system (GPS)
 
GPS and its Application
GPS and its ApplicationGPS and its Application
GPS and its Application
 
Global positioning system (gps)
Global positioning  system (gps)Global positioning  system (gps)
Global positioning system (gps)
 
How to use GPS and GIS in Surveying - Report
How to use GPS and GIS in Surveying - ReportHow to use GPS and GIS in Surveying - Report
How to use GPS and GIS in Surveying - Report
 
gps
gpsgps
gps
 
User–Centered Map Design
User–Centered Map DesignUser–Centered Map Design
User–Centered Map Design
 
Global positioning system(GPS)
Global positioning system(GPS)Global positioning system(GPS)
Global positioning system(GPS)
 
GPS application soil survey
GPS application soil surveyGPS application soil survey
GPS application soil survey
 
Remote sensing and gps
Remote sensing and gpsRemote sensing and gps
Remote sensing and gps
 
Mobile mapping system
Mobile mapping systemMobile mapping system
Mobile mapping system
 
Introduction of photogrammetry
Introduction of photogrammetryIntroduction of photogrammetry
Introduction of photogrammetry
 

Andere mochten auch

Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for...
Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for...Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for...
Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for...
Shanshan Chen
 
Arindam batabyal literature reviewpresentation
Arindam batabyal literature reviewpresentationArindam batabyal literature reviewpresentation
Arindam batabyal literature reviewpresentation
Arindam Batabyal
 
Artificial Intelligence Presentation
Artificial Intelligence PresentationArtificial Intelligence Presentation
Artificial Intelligence Presentation
lpaviglianiti
 

Andere mochten auch (11)

WiSlam presentation
WiSlam presentationWiSlam presentation
WiSlam presentation
 
Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for...
Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for...Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for...
Extracting Spatio-Temporal Information from Inertial Body Sensor Networks for...
 
Gait analysis in elderly population and rehabilitation
Gait analysis in elderly population and rehabilitationGait analysis in elderly population and rehabilitation
Gait analysis in elderly population and rehabilitation
 
IPIN2011 Angular PDF
IPIN2011 Angular PDFIPIN2011 Angular PDF
IPIN2011 Angular PDF
 
Plans2012 Presentation: Angular PDFs and FootSLAM
Plans2012 Presentation: Angular PDFs and FootSLAMPlans2012 Presentation: Angular PDFs and FootSLAM
Plans2012 Presentation: Angular PDFs and FootSLAM
 
Autonomous Indoor Mapping Using The Microsoft Kinect Sensor
Autonomous Indoor Mapping Using The Microsoft Kinect SensorAutonomous Indoor Mapping Using The Microsoft Kinect Sensor
Autonomous Indoor Mapping Using The Microsoft Kinect Sensor
 
Tecnologías Aumentaty RV
Tecnologías Aumentaty RVTecnologías Aumentaty RV
Tecnologías Aumentaty RV
 
Arindam batabyal literature reviewpresentation
Arindam batabyal literature reviewpresentationArindam batabyal literature reviewpresentation
Arindam batabyal literature reviewpresentation
 
Mapping mobile robotics
Mapping mobile roboticsMapping mobile robotics
Mapping mobile robotics
 
Inertial navigaton systems11
Inertial navigaton systems11Inertial navigaton systems11
Inertial navigaton systems11
 
Artificial Intelligence Presentation
Artificial Intelligence PresentationArtificial Intelligence Presentation
Artificial Intelligence Presentation
 

Ähnlich wie Simultaneous Localization and Mapping for Pedestrians using only Foot-Mounted Inertial Sensors

A general survey of previous works on action recognition
A general survey of previous works on action recognitionA general survey of previous works on action recognition
A general survey of previous works on action recognition
zukun
 
Paper id 25201492
Paper id 25201492Paper id 25201492
Paper id 25201492
IJRAT
 
NIPS2009: Understand Visual Scenes - Part 2
NIPS2009: Understand Visual Scenes - Part 2NIPS2009: Understand Visual Scenes - Part 2
NIPS2009: Understand Visual Scenes - Part 2
zukun
 
sign language recognition using HMM
sign language recognition using HMMsign language recognition using HMM
sign language recognition using HMM
veegrrl
 
Apresentacao BioInformatica
Apresentacao BioInformaticaApresentacao BioInformatica
Apresentacao BioInformatica
kibe123
 
Self-Flying Drones: On a Mission to Navigate Dark, Dangerous and Unknown Worlds
Self-Flying Drones: On a Mission to Navigate Dark, Dangerous and Unknown WorldsSelf-Flying Drones: On a Mission to Navigate Dark, Dangerous and Unknown Worlds
Self-Flying Drones: On a Mission to Navigate Dark, Dangerous and Unknown Worlds
Tahoe Silicon Mountain
 

Ähnlich wie Simultaneous Localization and Mapping for Pedestrians using only Foot-Mounted Inertial Sensors (20)

WeARHand
WeARHandWeARHand
WeARHand
 
9410-2.doc
9410-2.doc9410-2.doc
9410-2.doc
 
A general survey of previous works on action recognition
A general survey of previous works on action recognitionA general survey of previous works on action recognition
A general survey of previous works on action recognition
 
Mc Lendon Using Eye Tracking To Investigate Important Cues For Representative...
Mc Lendon Using Eye Tracking To Investigate Important Cues For Representative...Mc Lendon Using Eye Tracking To Investigate Important Cues For Representative...
Mc Lendon Using Eye Tracking To Investigate Important Cues For Representative...
 
[Mmlab seminar 2016] deep learning for human pose estimation
[Mmlab seminar 2016] deep learning for human pose estimation[Mmlab seminar 2016] deep learning for human pose estimation
[Mmlab seminar 2016] deep learning for human pose estimation
 
Visualizing the Viewer (Clare Davies)
Visualizing the Viewer (Clare Davies)Visualizing the Viewer (Clare Davies)
Visualizing the Viewer (Clare Davies)
 
Playful Explorations of Public and Personal Data - OSCON Data 2011
Playful Explorations of Public and Personal Data - OSCON Data 2011Playful Explorations of Public and Personal Data - OSCON Data 2011
Playful Explorations of Public and Personal Data - OSCON Data 2011
 
Daugherty Measuring Vergence Over Stereoscopic Video With A Remote Eye Tracker
Daugherty Measuring Vergence Over Stereoscopic Video With A Remote Eye TrackerDaugherty Measuring Vergence Over Stereoscopic Video With A Remote Eye Tracker
Daugherty Measuring Vergence Over Stereoscopic Video With A Remote Eye Tracker
 
Paper id 25201492
Paper id 25201492Paper id 25201492
Paper id 25201492
 
NIPS2009: Understand Visual Scenes - Part 2
NIPS2009: Understand Visual Scenes - Part 2NIPS2009: Understand Visual Scenes - Part 2
NIPS2009: Understand Visual Scenes - Part 2
 
Alvaro Cassinelli / Meta Perception Group leader
Alvaro Cassinelli / Meta Perception Group leaderAlvaro Cassinelli / Meta Perception Group leader
Alvaro Cassinelli / Meta Perception Group leader
 
The Mobile Virtual Cane
The Mobile Virtual CaneThe Mobile Virtual Cane
The Mobile Virtual Cane
 
Seminar
SeminarSeminar
Seminar
 
3AMIGAS - Paper5: Feifei Huo
3AMIGAS - Paper5: Feifei Huo3AMIGAS - Paper5: Feifei Huo
3AMIGAS - Paper5: Feifei Huo
 
Detection Tracking and Recognition of Human Poses for a Real Time Spatial Game
Detection Tracking and Recognition of Human Poses for a Real Time Spatial GameDetection Tracking and Recognition of Human Poses for a Real Time Spatial Game
Detection Tracking and Recognition of Human Poses for a Real Time Spatial Game
 
Augmented reality in spine surgery
Augmented reality in spine surgeryAugmented reality in spine surgery
Augmented reality in spine surgery
 
sign language recognition using HMM
sign language recognition using HMMsign language recognition using HMM
sign language recognition using HMM
 
Apresentacao BioInformatica
Apresentacao BioInformaticaApresentacao BioInformatica
Apresentacao BioInformatica
 
Augmented reality in spine surgery
Augmented reality in spine surgeryAugmented reality in spine surgery
Augmented reality in spine surgery
 
Self-Flying Drones: On a Mission to Navigate Dark, Dangerous and Unknown Worlds
Self-Flying Drones: On a Mission to Navigate Dark, Dangerous and Unknown WorldsSelf-Flying Drones: On a Mission to Navigate Dark, Dangerous and Unknown Worlds
Self-Flying Drones: On a Mission to Navigate Dark, Dangerous and Unknown Worlds
 

Kürzlich hochgeladen

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Kürzlich hochgeladen (20)

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 

Simultaneous Localization and Mapping for Pedestrians using only Foot-Mounted Inertial Sensors

  • 1. Simultaneous Localization and Mapping for Pedestrians using only Foot-Mounted Inertial Sensors Patrick Robertson, Michael Angermann, Bernhard Krach German Aerospace Center (DLR) B. Krach is now with EADS Germany
  • 2. Raw NavShoe Odometry Results Algorithm: Extended Kalman Filter with Zero Velcocity Updates (Foxlin) NavShoe INS produced reasonable results NavShoe INS had larger heading slips; stand alone, but still unbounded error growth unbounded error begins to rise earlier
  • 3. State of the Art: Use Maps Inertial sensors used indoors achieve accurate positioning when used in conjunction with maps Krach, Robertson: WPNC 08, PLANS 08+ Widyawan, Klepal, Beauregard: WPNC 08 Woodman, Harle: UbiComp 2008 But what if the map is unknown?
  • 4. So, could we derive a map from this? Naïve approach: “Transfer the raw odometry trace to a piece of wire and bend it bit by bit so that similar areas overlap”
  • 5. SLAM in Robotics Simultaneous Localization and Mapping - identified by robotics community in mid ‘80s! Premise: Localization using odometry and sensing of known landmarks is easy! Mapping of landmarks given known location and orientation (pose) is easy! Simultaneous Localization and Mapping is hard!
  • 6. What about SLAM for Humans? Human pedestrians are not robots but share some similarities with them Visual sensors (eyes) 'Odometry' (in humans: sensed by proprioception) Path and planning and execution In humans, we usually have little or no direct 'access' to most of these senses and functions Our central assumption: The pedestrian is able to actively control motion without violating physical constraints (i.e. walls, etc)
  • 7. A Person Processes Numerous Visual Inputs
  • 8. Bayesian Formulation: DBN Time k-1 Time k Time k+1 Pose P P P U: Actual step taken (pose change vector) Measured U U U Step Error states of Zu the odometry Zu E Zu E Zu E Int Int Int Intention „what the person wants to do“ Vis Vis Vis Visual information „what the person sees“ “Environment” = Map … constant over time Map
  • 9. Intuitive Explanation of the Sequential Monte Carlo Algorithm FootSLAM lets particles, or hypotheses, explore the state space of odometry errors, like evolution of drift In this way, every particle is trying a slightly “differently bent piece of wire” Particles are weighted by their “compatibility” with their individual map optional sensor readings, such as GPS, magnetometer We can show that this is optimal in the Bayesian sense!
  • 10. Experiments and Results Measurement data taken from a pedestrian wearing a foot mounted IMU Two scenarios: Indoor only Outdoor – indoor - outdoor sequence
  • 11. Video See http://www.kn-s.dlr.de/indoornav
  • 14. Relative Position Accuracy - Indoors No Scale Adaptation was Performed
  • 16. Concluding Notes FootSLAM effectively bounds the otherwise unbounded error growth without the need for pre-existing maps! FootSLAM (like all forms of SLAM) is inherently invariant to rotation, translation and scale In mixed scenarios, the resulting maps are globally and precisely anchored using GPS Our future work: Map building with multiple users; “crowdsourcing” collaborative mapping Movies: http://www.kn-s.dlr.de/indoornav/