SlideShare ist ein Scribd-Unternehmen logo
1 von 36
Downloaden Sie, um offline zu lesen
RF-Compass:
Robot Object Manipulation Using RFIDs
Fadel Adib, Ross Knepper, Dina Katabi, Daniela Rus
Jue Wang
Limitation of Today’s Robotic Automation
Fixed-position, single-task robot
• Limited to large-volume production line
• Inability to change manufacturing process
Toyota has been slowly backing away from heavy automation.
The labor saved by robots was wasted most of all by
reprogramming robots.
This is the future. A new wave of robots, far more adept
than those now commonly used by automakers and other
heavy manufacturers.
The potential for much broader industrial acceptance is tied to
the development of robots that can absorb data, recognize
objects, and respond to information and objects in
their environment with greater accuracy.
Mobile Manipulation
Fetching, grasping, and manipulating objects
• Extend automation to small/medium factories
• Easy to reconfigure manufacturing process
• Centimeter-scale localization, e.g., 2cm
• Minimal instrumentation  portable
Requirements for Mobile Manipulation
Current Approaches
• Motion capture system, e.g., VICON
– Sub-centimeter accuracy
– Heavy instrumentation & Expensive
Current Approaches
• Motion capture system, e.g., VICON
– Sub-centimeter accuracy
– Heavy instrumentation & Expensive
• Imaging (e.g., optical camera, Kinect, LIDAR)
– Needs prior training
or ?
Current Approaches
• Motion capture system, e.g., VICON
– Sub-centimeter accuracy
– Heavy instrumentation & Expensive
• Imaging (e.g., optical camera, Kinect, LIDAR)
– Needs prior training
or ?
Can RF localization help?
Current RF localization schemes are too coarse
• State-of-the-art WiFi localization: 23cm
[ArrayTrack]
• State-of-the-art RFID localization: 11cm [PinIt]
BUT requires a dense grid of reference tags
How to get a few cm accuracy without
environment instrumentation?
RF-Compass
• Place RFID tags on both robot and objects
• No reference tags in the environment
Identifying the Object
• RFID: a passive sticker – no battery, low cost
• Reader shines RF signal on tags
 Each tag replies with its unique ID
 Works for up to 10 meters
How to get centimeter-scale accuracy?
• Compare distances between RFIDs
Which blue tag is closer to the red tag?
Tag 3
Tag 1
Tag 2
Distance ordering based on signal similarity
[SIGCOMM’13]
Building block: RF pairwise comparison
Basic building block 2cm accuracy

Basic Idea: Localization by Partitioning
Is the red tag closer to Tag 1 or Tag 2?
Basic Idea: Localization by Partitioning
Tag 1 is closer than Tag 2
Basic Idea: Localization by Partitioning
Tag 3 is closer than Tag 4
Basic Idea: Localization by Partitioning
Tag 4 is closer than Tag 1
Basic Idea: Localization by Partitioning
But not yet centimeter accuracy
Basic Idea: Localization by Partitioning
• Partitions can be iteratively refined
Iterative Refining via Robot Navigation
• Leveraging robot’s consecutive moves
Iterative Refining via Robot Navigation
• Every robot move gives a new set of partitions
Iterative Refining via Robot Navigation
• Lay new partitions over old partitions to refine
• Keep refining until reaching centimeter accuracy
Iterative Refining via Robot Navigation
• Keep refining until reaching centimeter accuracy
Iterative Refining via Robot Navigation
Formulation as an Optimization
2 𝑥2 − 𝑥1 2 𝑦2 − 𝑦1
𝑥0
𝑦0
≤ 𝑥2
2
+ 𝑦2
2
− 𝑥1
2
− 𝑦1
2
(𝑥1, 𝑦1)
(𝑥2, 𝑦2)
(𝑥0, 𝑦0)
Formulation as an Optimization
2(𝑥2 − 𝑥1) 2(𝑦2 − 𝑦1)
⋮ ⋮
𝑥0
𝑦0
≤ 𝑥2
2
+ 𝑦2
2
− 𝑥1
2
− 𝑦1
2
⋮
(𝑥0, 𝑦0)
Formulation as an Optimization
𝑨
𝑥0
𝑦0
≤ 𝒃
Works correctly even if randomly flipping 10% of
pairwise comparisons, shown in paper
(𝑥0, 𝑦0)
• A feasibility problem with
linear constraints
• Efficiently solved via convex
optimization
• Over-constrained system
↓
Robustness to errors & outliers
Problem: also need orientation for grasping
Solution:
• Multiple RFIDs on object
• Naïve approach: localize each RFID
independently and find orientation
• Our approach: joint optimization using
knowledge of their relative location
Orientation
Evaluation
• Used a robot to fetch IKEA furniture parts
• 9 tags on robot, 1 – 4 tags on object
Baseline
• VICON motion capture system
• Sub-centimeter accuracy
• Infrared cameras + infrared-reflective markers
VICON
Markers
Navigation Performance
CDF
CDF
Ratio to Optimal Path in LOS Ratio to Optimal Path in NLOS
Direct line-of-sight
RF-Compass enables effective navigation in NLOS
VICON does NOT
work in NLOS
Occlusion and NLOS
Only 6% longer than
optimal on average
Center Position Accuracy
4 cm
2.8 cm
1.9 cm
1.3 cm
0
1
2
3
4
5
6
1 Tag 2 Tags 3 Tags 4 Tags
Number of Tags on Furniture Part
ErrorinPositionEstimate(cm)
Number of Tags on Furniture Part
ErrorinOrientation(degree)
5.8˚
3.6˚ 3.3˚
0
1
2
3
4
5
6
7
2 Tags 3 Tags 4 Tags
Orientation Accuracy
Conclusion
• RF-Compass: accuracy of a few cm and degrees
• Iterative refining by leveraging robot’s navigation
• Opens up opportunities for bridging robot object
manipulation with RF localization

Weitere ähnliche Inhalte

Ähnlich wie Rf compass

An Intelligent Mobile Robot Navigation Technique Using RFID Technology
An Intelligent Mobile Robot Navigation Technique Using RFID TechnologyAn Intelligent Mobile Robot Navigation Technique Using RFID Technology
An Intelligent Mobile Robot Navigation Technique Using RFID Technology
wacerone
 
Cahall Final Intern Presentation
Cahall Final Intern PresentationCahall Final Intern Presentation
Cahall Final Intern Presentation
Daniel Cahall
 

Ähnlich wie Rf compass (20)

corporate-Robotics-training
corporate-Robotics-trainingcorporate-Robotics-training
corporate-Robotics-training
 
208114036 l aser guided robo
208114036 l aser guided robo208114036 l aser guided robo
208114036 l aser guided robo
 
Robotics (1)
Robotics (1)Robotics (1)
Robotics (1)
 
TARDEC Presentation 2
TARDEC Presentation 2TARDEC Presentation 2
TARDEC Presentation 2
 
An Intelligent Mobile Robot Navigation Technique Using RFID Technology
An Intelligent Mobile Robot Navigation Technique Using RFID TechnologyAn Intelligent Mobile Robot Navigation Technique Using RFID Technology
An Intelligent Mobile Robot Navigation Technique Using RFID Technology
 
fusion of Camera and lidar for autonomous driving I
fusion of Camera and lidar for autonomous driving Ifusion of Camera and lidar for autonomous driving I
fusion of Camera and lidar for autonomous driving I
 
Automatic Book Picking Robot For Libraries
Automatic Book Picking Robot For LibrariesAutomatic Book Picking Robot For Libraries
Automatic Book Picking Robot For Libraries
 
Elevation mapping using stereo vision enabled heterogeneous multi-agent robot...
Elevation mapping using stereo vision enabled heterogeneous multi-agent robot...Elevation mapping using stereo vision enabled heterogeneous multi-agent robot...
Elevation mapping using stereo vision enabled heterogeneous multi-agent robot...
 
Rfig Sig04 Presentation
Rfig Sig04 PresentationRfig Sig04 Presentation
Rfig Sig04 Presentation
 
Efficient architecture to condensate visual information driven by attention ...
Efficient architecture to condensate visual information driven by attention ...Efficient architecture to condensate visual information driven by attention ...
Efficient architecture to condensate visual information driven by attention ...
 
LiDAR-based Autonomous Driving III (by Deep Learning)
LiDAR-based Autonomous Driving III (by Deep Learning)LiDAR-based Autonomous Driving III (by Deep Learning)
LiDAR-based Autonomous Driving III (by Deep Learning)
 
Robotics
RoboticsRobotics
Robotics
 
Robotics
RoboticsRobotics
Robotics
 
Robotics.ppt
Robotics.pptRobotics.ppt
Robotics.ppt
 
Robotics.ppt
Robotics.pptRobotics.ppt
Robotics.ppt
 
Robotics.ppt
Robotics.pptRobotics.ppt
Robotics.ppt
 
Robotics
RoboticsRobotics
Robotics
 
Robotics lover
Robotics loverRobotics lover
Robotics lover
 
OpenLMD, Multimodal Monitoring and Control of LMD processing
OpenLMD, Multimodal Monitoring and Control of LMD processingOpenLMD, Multimodal Monitoring and Control of LMD processing
OpenLMD, Multimodal Monitoring and Control of LMD processing
 
Cahall Final Intern Presentation
Cahall Final Intern PresentationCahall Final Intern Presentation
Cahall Final Intern Presentation
 

Kürzlich hochgeladen

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Kürzlich hochgeladen (20)

FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 

Rf compass

  • 1. RF-Compass: Robot Object Manipulation Using RFIDs Fadel Adib, Ross Knepper, Dina Katabi, Daniela Rus Jue Wang
  • 2. Limitation of Today’s Robotic Automation Fixed-position, single-task robot • Limited to large-volume production line • Inability to change manufacturing process
  • 3. Toyota has been slowly backing away from heavy automation. The labor saved by robots was wasted most of all by reprogramming robots. This is the future. A new wave of robots, far more adept than those now commonly used by automakers and other heavy manufacturers. The potential for much broader industrial acceptance is tied to the development of robots that can absorb data, recognize objects, and respond to information and objects in their environment with greater accuracy.
  • 4. Mobile Manipulation Fetching, grasping, and manipulating objects • Extend automation to small/medium factories • Easy to reconfigure manufacturing process
  • 5. • Centimeter-scale localization, e.g., 2cm • Minimal instrumentation  portable Requirements for Mobile Manipulation
  • 6. Current Approaches • Motion capture system, e.g., VICON – Sub-centimeter accuracy – Heavy instrumentation & Expensive
  • 7. Current Approaches • Motion capture system, e.g., VICON – Sub-centimeter accuracy – Heavy instrumentation & Expensive • Imaging (e.g., optical camera, Kinect, LIDAR) – Needs prior training or ?
  • 8. Current Approaches • Motion capture system, e.g., VICON – Sub-centimeter accuracy – Heavy instrumentation & Expensive • Imaging (e.g., optical camera, Kinect, LIDAR) – Needs prior training or ?
  • 10. Current RF localization schemes are too coarse • State-of-the-art WiFi localization: 23cm [ArrayTrack] • State-of-the-art RFID localization: 11cm [PinIt] BUT requires a dense grid of reference tags How to get a few cm accuracy without environment instrumentation?
  • 11. RF-Compass • Place RFID tags on both robot and objects • No reference tags in the environment
  • 12. Identifying the Object • RFID: a passive sticker – no battery, low cost • Reader shines RF signal on tags  Each tag replies with its unique ID  Works for up to 10 meters
  • 13. How to get centimeter-scale accuracy?
  • 14. • Compare distances between RFIDs Which blue tag is closer to the red tag? Tag 3 Tag 1 Tag 2 Distance ordering based on signal similarity [SIGCOMM’13] Building block: RF pairwise comparison
  • 15. Basic building block 2cm accuracy 
  • 16. Basic Idea: Localization by Partitioning Is the red tag closer to Tag 1 or Tag 2?
  • 17. Basic Idea: Localization by Partitioning Tag 1 is closer than Tag 2
  • 18. Basic Idea: Localization by Partitioning Tag 3 is closer than Tag 4
  • 19. Basic Idea: Localization by Partitioning Tag 4 is closer than Tag 1
  • 20. Basic Idea: Localization by Partitioning But not yet centimeter accuracy
  • 21. Basic Idea: Localization by Partitioning • Partitions can be iteratively refined
  • 22. Iterative Refining via Robot Navigation • Leveraging robot’s consecutive moves
  • 23. Iterative Refining via Robot Navigation • Every robot move gives a new set of partitions
  • 24. Iterative Refining via Robot Navigation • Lay new partitions over old partitions to refine
  • 25. • Keep refining until reaching centimeter accuracy Iterative Refining via Robot Navigation
  • 26. • Keep refining until reaching centimeter accuracy Iterative Refining via Robot Navigation
  • 27. Formulation as an Optimization 2 𝑥2 − 𝑥1 2 𝑦2 − 𝑦1 𝑥0 𝑦0 ≤ 𝑥2 2 + 𝑦2 2 − 𝑥1 2 − 𝑦1 2 (𝑥1, 𝑦1) (𝑥2, 𝑦2) (𝑥0, 𝑦0)
  • 28. Formulation as an Optimization 2(𝑥2 − 𝑥1) 2(𝑦2 − 𝑦1) ⋮ ⋮ 𝑥0 𝑦0 ≤ 𝑥2 2 + 𝑦2 2 − 𝑥1 2 − 𝑦1 2 ⋮ (𝑥0, 𝑦0)
  • 29. Formulation as an Optimization 𝑨 𝑥0 𝑦0 ≤ 𝒃 Works correctly even if randomly flipping 10% of pairwise comparisons, shown in paper (𝑥0, 𝑦0) • A feasibility problem with linear constraints • Efficiently solved via convex optimization • Over-constrained system ↓ Robustness to errors & outliers
  • 30. Problem: also need orientation for grasping Solution: • Multiple RFIDs on object • Naïve approach: localize each RFID independently and find orientation • Our approach: joint optimization using knowledge of their relative location Orientation
  • 31. Evaluation • Used a robot to fetch IKEA furniture parts • 9 tags on robot, 1 – 4 tags on object
  • 32. Baseline • VICON motion capture system • Sub-centimeter accuracy • Infrared cameras + infrared-reflective markers VICON Markers
  • 33. Navigation Performance CDF CDF Ratio to Optimal Path in LOS Ratio to Optimal Path in NLOS Direct line-of-sight RF-Compass enables effective navigation in NLOS VICON does NOT work in NLOS Occlusion and NLOS Only 6% longer than optimal on average
  • 34. Center Position Accuracy 4 cm 2.8 cm 1.9 cm 1.3 cm 0 1 2 3 4 5 6 1 Tag 2 Tags 3 Tags 4 Tags Number of Tags on Furniture Part ErrorinPositionEstimate(cm)
  • 35. Number of Tags on Furniture Part ErrorinOrientation(degree) 5.8˚ 3.6˚ 3.3˚ 0 1 2 3 4 5 6 7 2 Tags 3 Tags 4 Tags Orientation Accuracy
  • 36. Conclusion • RF-Compass: accuracy of a few cm and degrees • Iterative refining by leveraging robot’s navigation • Opens up opportunities for bridging robot object manipulation with RF localization