SlideShare ist ein Scribd-Unternehmen logo
1 von 14
Downloaden Sie, um offline zu lesen
Jürgen ’Juxi’ Leitner
          S. Harding, M. Frank, A. Förster, J. Schmidhuber

          istituto dalle molle di studi sull’intelligenza artificiale
                                 università della svizzera italiana
                                                   idsia / usi / supsi




              transferring
        spatial perception
between robots operating
   in a shared workspace
                                                         #iros 2012
our iCub
 setup is for
manipulation
visual perception




Harding et al., GPTP 2012, Leitner et al., ICDL 2012   IROS 2012
current
localisation approaches
learning
    approach


+
transferring
spatial perception
COLLISIONS ARE
         BAD
MoBeE
framework
            Frank et al., ICINCO, 2012.
MoBeE
framework
            Frank et al., ICINCO, 2012.
9DOF              bounding box
                                  iCub               6 per eye
                                                        .
                                                        .
                                                        .




                                         fully connected
                                              .
                                              .
                                              .




                                         fully connected




                                           Cartesian
                                          Coordinates
            spatial perception
neural network
600                                                       400                                                        -200
             550                                                       300                                                        -300

             500                                                       200                                                        -400

             450                                                       100                                                        -500
                                                                         0                                                        -600
             400




                                                              Y (mm)
    X (mm)




                                                                                                                         Z (mm)
                                                                       -100                                                       -700
             350
                                                                       -200                                                       -800
             300
                                                                       -300                                                       -900
             250
                                                                       -400                                                  -1000
             200
                                                                       -500                                                  -1100
             150                                                       -600                               Predicted          -1200
                                                                                                          Expected
             100                                                       -700                                                  -1300
                   0   200    400      600      800    1000                   0   200   400       600    800      1000                   0
                                Sample Index                                              Sample Index
         -200
         -300
         -400
         -500
         -600
Z (mm)




         -700
         -800


    -1000
         -900
                                                                                                   results
                                                                                                     ANN
    -1100
    -1200
    -1300
                   0   200   400      600      800    1000
                               Sample Index
spatial perception
neural network
future
 work

 unsupervised learning
 different spatial representations
 “intrinsic motivation” learning
 online, continuous learning
 eye-hand coordination
thanks
                                           for listening
       juxi@idsia.ch   http://Juxi.net/projects
video at http://Juxi.net/projects/im-clever/year3.html

Weitere ähnliche Inhalte

Ähnlich wie Transferring Spatial Perception Between Robots Operating In A Shared Workspace

Data generation for Waterfall Diagram
Data generation for Waterfall DiagramData generation for Waterfall Diagram
Data generation for Waterfall DiagramDick Lam
 
Sl&Et Automation Eng
Sl&Et Automation EngSl&Et Automation Eng
Sl&Et Automation Engtseener
 
10,00 Modelling and analysis of geophysical data using geostatistics and mach...
10,00 Modelling and analysis of geophysical data using geostatistics and mach...10,00 Modelling and analysis of geophysical data using geostatistics and mach...
10,00 Modelling and analysis of geophysical data using geostatistics and mach...Beniamino Murgante
 
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...Objective Capital Conferences
 
Canopy management tree training & crop loading – opportunities to learn fro...
Canopy management   tree training & crop loading – opportunities to learn fro...Canopy management   tree training & crop loading – opportunities to learn fro...
Canopy management tree training & crop loading – opportunities to learn fro...MacadamiaSociety
 
L&t%20 investor%20presentation%20 %20feb%202013
L&t%20 investor%20presentation%20 %20feb%202013L&t%20 investor%20presentation%20 %20feb%202013
L&t%20 investor%20presentation%20 %20feb%202013Vikram Pushparaj
 

Ähnlich wie Transferring Spatial Perception Between Robots Operating In A Shared Workspace (14)

Data generation for Waterfall Diagram
Data generation for Waterfall DiagramData generation for Waterfall Diagram
Data generation for Waterfall Diagram
 
Sl&Et Automation Eng
Sl&Et Automation EngSl&Et Automation Eng
Sl&Et Automation Eng
 
10,00 Modelling and analysis of geophysical data using geostatistics and mach...
10,00 Modelling and analysis of geophysical data using geostatistics and mach...10,00 Modelling and analysis of geophysical data using geostatistics and mach...
10,00 Modelling and analysis of geophysical data using geostatistics and mach...
 
Sabrina Skinner
Sabrina SkinnerSabrina Skinner
Sabrina Skinner
 
Kjøkken 4
Kjøkken 4Kjøkken 4
Kjøkken 4
 
Kjøkken 4
Kjøkken 4Kjøkken 4
Kjøkken 4
 
Kjøkken 3
Kjøkken 3Kjøkken 3
Kjøkken 3
 
Kjøkken 2
Kjøkken 2Kjøkken 2
Kjøkken 2
 
Kjøkken 2
Kjøkken 2Kjøkken 2
Kjøkken 2
 
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...
 
Canopy management tree training & crop loading – opportunities to learn fro...
Canopy management   tree training & crop loading – opportunities to learn fro...Canopy management   tree training & crop loading – opportunities to learn fro...
Canopy management tree training & crop loading – opportunities to learn fro...
 
L&t%20 investor%20presentation%20 %20feb%202013
L&t%20 investor%20presentation%20 %20feb%202013L&t%20 investor%20presentation%20 %20feb%202013
L&t%20 investor%20presentation%20 %20feb%202013
 
Mathur
MathurMathur
Mathur
 
Towards a Sustainable Cocoa Economy:Rural transformation of West African coco...
Towards a Sustainable Cocoa Economy:Rural transformation of West African coco...Towards a Sustainable Cocoa Economy:Rural transformation of West African coco...
Towards a Sustainable Cocoa Economy:Rural transformation of West African coco...
 

Mehr von Juxi Leitner

The Need For Robots To Grasp the World
The Need For Robots To Grasp the WorldThe Need For Robots To Grasp the World
The Need For Robots To Grasp the WorldJuxi Leitner
 
Robots that Grasp the World
Robots that Grasp the WorldRobots that Grasp the World
Robots that Grasp the WorldJuxi Leitner
 
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre BerlinImproving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre BerlinJuxi Leitner
 
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Cartman, how to win the amazon robotics challenge with robotic vision and dee...Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Cartman, how to win the amazon robotics challenge with robotic vision and dee...Juxi Leitner
 
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...Juxi Leitner
 
ACRV Picking Benchmark: how to benchmark pick and place robotics research
ACRV Picking Benchmark: how to benchmark pick and place robotics researchACRV Picking Benchmark: how to benchmark pick and place robotics research
ACRV Picking Benchmark: how to benchmark pick and place robotics researchJuxi Leitner
 
Team ACRV's experience at #AmazonPickingChallenge 2016
Team ACRV's experience at #AmazonPickingChallenge 2016Team ACRV's experience at #AmazonPickingChallenge 2016
Team ACRV's experience at #AmazonPickingChallenge 2016Juxi Leitner
 
(deep) reinforcement learning - CAB420
(deep) reinforcement learning - CAB420(deep) reinforcement learning - CAB420
(deep) reinforcement learning - CAB420Juxi Leitner
 
ACRV : Robotic Vision presentation in Lisbon at IST
ACRV : Robotic Vision presentation in Lisbon at ISTACRV : Robotic Vision presentation in Lisbon at IST
ACRV : Robotic Vision presentation in Lisbon at ISTJuxi Leitner
 
The Australian Centre for Robotic Vision (ACRV)
The Australian Centre for Robotic Vision (ACRV)The Australian Centre for Robotic Vision (ACRV)
The Australian Centre for Robotic Vision (ACRV)Juxi Leitner
 
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)Juxi Leitner
 
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
LunaRoo: Designing a Hopping Lunar Science Payload #space #explorationLunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
LunaRoo: Designing a Hopping Lunar Science Payload #space #explorationJuxi Leitner
 
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #ColloquiumRobotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #ColloquiumJuxi Leitner
 
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRVROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRVJuxi Leitner
 
ACRV Research Fellow Intro/Tutorial [Vision and Action]
ACRV Research Fellow Intro/Tutorial [Vision and Action]ACRV Research Fellow Intro/Tutorial [Vision and Action]
ACRV Research Fellow Intro/Tutorial [Vision and Action]Juxi Leitner
 
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...Juxi Leitner
 
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...Juxi Leitner
 
Tele-operation of a Humanoid Robot, Using Operator Bio-data
Tele-operation of a Humanoid Robot, Using Operator Bio-dataTele-operation of a Humanoid Robot, Using Operator Bio-data
Tele-operation of a Humanoid Robot, Using Operator Bio-dataJuxi Leitner
 
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...Juxi Leitner
 
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]Juxi Leitner
 

Mehr von Juxi Leitner (20)

The Need For Robots To Grasp the World
The Need For Robots To Grasp the WorldThe Need For Robots To Grasp the World
The Need For Robots To Grasp the World
 
Robots that Grasp the World
Robots that Grasp the WorldRobots that Grasp the World
Robots that Grasp the World
 
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre BerlinImproving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
 
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Cartman, how to win the amazon robotics challenge with robotic vision and dee...Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
 
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
 
ACRV Picking Benchmark: how to benchmark pick and place robotics research
ACRV Picking Benchmark: how to benchmark pick and place robotics researchACRV Picking Benchmark: how to benchmark pick and place robotics research
ACRV Picking Benchmark: how to benchmark pick and place robotics research
 
Team ACRV's experience at #AmazonPickingChallenge 2016
Team ACRV's experience at #AmazonPickingChallenge 2016Team ACRV's experience at #AmazonPickingChallenge 2016
Team ACRV's experience at #AmazonPickingChallenge 2016
 
(deep) reinforcement learning - CAB420
(deep) reinforcement learning - CAB420(deep) reinforcement learning - CAB420
(deep) reinforcement learning - CAB420
 
ACRV : Robotic Vision presentation in Lisbon at IST
ACRV : Robotic Vision presentation in Lisbon at ISTACRV : Robotic Vision presentation in Lisbon at IST
ACRV : Robotic Vision presentation in Lisbon at IST
 
The Australian Centre for Robotic Vision (ACRV)
The Australian Centre for Robotic Vision (ACRV)The Australian Centre for Robotic Vision (ACRV)
The Australian Centre for Robotic Vision (ACRV)
 
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
 
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
LunaRoo: Designing a Hopping Lunar Science Payload #space #explorationLunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
 
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #ColloquiumRobotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
 
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRVROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
 
ACRV Research Fellow Intro/Tutorial [Vision and Action]
ACRV Research Fellow Intro/Tutorial [Vision and Action]ACRV Research Fellow Intro/Tutorial [Vision and Action]
ACRV Research Fellow Intro/Tutorial [Vision and Action]
 
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
 
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
 
Tele-operation of a Humanoid Robot, Using Operator Bio-data
Tele-operation of a Humanoid Robot, Using Operator Bio-dataTele-operation of a Humanoid Robot, Using Operator Bio-data
Tele-operation of a Humanoid Robot, Using Operator Bio-data
 
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
 
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
 

Kürzlich hochgeladen

UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Manual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditManual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditSkynet Technologies
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...panagenda
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...AliaaTarek5
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 

Kürzlich hochgeladen (20)

UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Manual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditManual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance Audit
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 

Transferring Spatial Perception Between Robots Operating In A Shared Workspace

  • 1. Jürgen ’Juxi’ Leitner S. Harding, M. Frank, A. Förster, J. Schmidhuber istituto dalle molle di studi sull’intelligenza artificiale università della svizzera italiana idsia / usi / supsi transferring spatial perception between robots operating in a shared workspace #iros 2012
  • 2. our iCub setup is for manipulation
  • 3. visual perception Harding et al., GPTP 2012, Leitner et al., ICDL 2012 IROS 2012
  • 5. learning approach +
  • 8. MoBeE framework Frank et al., ICINCO, 2012.
  • 9. MoBeE framework Frank et al., ICINCO, 2012.
  • 10. 9DOF bounding box iCub 6 per eye . . . fully connected . . . fully connected Cartesian Coordinates spatial perception neural network
  • 11. 600 400 -200 550 300 -300 500 200 -400 450 100 -500 0 -600 400 Y (mm) X (mm) Z (mm) -100 -700 350 -200 -800 300 -300 -900 250 -400 -1000 200 -500 -1100 150 -600 Predicted -1200 Expected 100 -700 -1300 0 200 400 600 800 1000 0 200 400 600 800 1000 0 Sample Index Sample Index -200 -300 -400 -500 -600 Z (mm) -700 -800 -1000 -900 results ANN -1100 -1200 -1300 0 200 400 600 800 1000 Sample Index
  • 13. future work unsupervised learning different spatial representations “intrinsic motivation” learning online, continuous learning eye-hand coordination
  • 14. thanks for listening juxi@idsia.ch http://Juxi.net/projects video at http://Juxi.net/projects/im-clever/year3.html