SlideShare ist ein Scribd-Unternehmen logo
1 von 9
C-Lab
Cognitive Vision, Robotics and Autonomy
Monday, 20 January 2020 1
Prof R Bowden
Centre for Vision Speech and Signal Processing
CVSSP Centre for Vision, Speech and Signal Processing
Creating machines that can see, hear and
understand the world around them
Surrey Autonomous Testbed
DAVe:
Deep
Autonomous
Vehcile
Surrey Autonomous Testbed
• The testbed is very similar to the street drone, using the same Twizy vehicle,
sensors and processing platform
• Twizy Cargo
• Nvidia PX2 Drive
• 6 Sekonix cameras (street drone as 8 but same coverage, less overlap)
• Ouster 64 beam lidar
• Wheel odometry, not available on street drone
• Supports wider research and collaborative
projects with Parkopedia, JLR, McLarren,
FLIR amongst others
• Provides Surrey with a data
capture and demonstration platform
Surrey Autonomous Testbed
• Two phase build:
• Phase 1 – sensor recording and onboard processing
• Phase 2 – actuators to provide full control
• Entire build opensource:
http://autonomous.home.blog
How to build an autonomous vehicle for
< £15K
SAE
International
Society of
Automotive
Engineers
Classification
System
Demonstration scenario
1. Parking process is
started via
smartphone
2. Vehicle enters a car
park, localises itself
using indoor maps
and navigates to a
space
3. Driver summons
parked vehicle back
via smartphone
4. Vehicle exits a car
park and is picked by
a driver in a pick up
zone
Work related to Autonomous Driving
• Automatic extrinsic calibration of car
mounted sensors
• Reinforcement Learning for vehicle
control and safety verification
• Feature Learning
across lighting and
weather
• Vehicle state estimation,
sensor fusion and side slip
estimation
• Semantic Segmentation
• Monoscopic depth estimation and
scene estimation
DARPA 3 Waves of AI
• Wave 1 – Handcrafted Knowledge
• e.g. classical AI, chess computers
• Engineers create sets of rules to represent knowledge in well‐defined domains
• The structure of the knowledge is defined by humans
• The specifics are explored by the machine
• Enables reasoning over narrowly defined problems
• No learning capability and poor handling of uncertainty
• Wave 2 – Statistical Learning
• e.g. machine and deep learning, alpha go
• Engineers create statistical models for specific
problem domains and train them on big data
• Nuanced classification and prediction capabilities
• No contextual capability and minimal reasoning ability
• Statistically impressive, but individually unreliable
• Wave 3 - Contextual adaptation
• Systems construct contextual explanatory models for classes of real world phenomena

Weitere ähnliche Inhalte

Ähnlich wie Panel 4-Cognitive vision, robotics and autonomy

Artificial intelligence (AI) + Sensors + Aeronautics
Artificial intelligence (AI) + Sensors + AeronauticsArtificial intelligence (AI) + Sensors + Aeronautics
Artificial intelligence (AI) + Sensors + Aeronauticswaleed zahid kayani
 
Intelligente visie maakt drones autonoom
Intelligente visie maakt drones autonoomIntelligente visie maakt drones autonoom
Intelligente visie maakt drones autonoomEUKA
 
automation.pptx
automation.pptxautomation.pptx
automation.pptxSabarDasal
 
Autonomous Driving- TU Chemnitz
Autonomous Driving- TU ChemnitzAutonomous Driving- TU Chemnitz
Autonomous Driving- TU ChemnitzVivek Bakul Maru
 
“Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
“Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...“Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
“Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...Edge AI and Vision Alliance
 
The Importance of Timing to Autonomous Vehicle Navigation
The Importance of Timing to Autonomous Vehicle NavigationThe Importance of Timing to Autonomous Vehicle Navigation
The Importance of Timing to Autonomous Vehicle NavigationTim Klimasewski
 
About RumiCar project
About RumiCar projectAbout RumiCar project
About RumiCar projectRumika Chiba
 
pick and place robotic arm
pick and place robotic armpick and place robotic arm
pick and place robotic armANJANA ANILKUMAR
 
Mainprojpresentation 150617092611-lva1-app6892
Mainprojpresentation 150617092611-lva1-app6892Mainprojpresentation 150617092611-lva1-app6892
Mainprojpresentation 150617092611-lva1-app6892ANJANA ANILKUMAR
 
autonomous vehicles org ppt.pptx
autonomous vehicles org ppt.pptxautonomous vehicles org ppt.pptx
autonomous vehicles org ppt.pptxADISHPRAMOD
 
Machine learning and Autonomous System
Machine learning and Autonomous SystemMachine learning and Autonomous System
Machine learning and Autonomous SystemAnshul Saxena
 
GANS Artifical Intelligence Assigmentt 7.pptx
GANS Artifical Intelligence Assigmentt 7.pptxGANS Artifical Intelligence Assigmentt 7.pptx
GANS Artifical Intelligence Assigmentt 7.pptxamazingsun810
 
Jatin sharma (42162)
Jatin sharma (42162)Jatin sharma (42162)
Jatin sharma (42162)Jatin Sharma
 
Real Time Object Dectection using machine learning
Real Time Object Dectection using machine learningReal Time Object Dectection using machine learning
Real Time Object Dectection using machine learningpratik pratyay
 
EDGE CASE TESTING IN A SENSOR-REALISTIC SIMULATION ENVIRONMENT
EDGE CASE TESTING IN A SENSOR-REALISTIC SIMULATION ENVIRONMENTEDGE CASE TESTING IN A SENSOR-REALISTIC SIMULATION ENVIRONMENT
EDGE CASE TESTING IN A SENSOR-REALISTIC SIMULATION ENVIRONMENTiQHub
 

Ähnlich wie Panel 4-Cognitive vision, robotics and autonomy (20)

Automated vehicle
Automated vehicleAutomated vehicle
Automated vehicle
 
Artificial intelligence (AI) + Sensors + Aeronautics
Artificial intelligence (AI) + Sensors + AeronauticsArtificial intelligence (AI) + Sensors + Aeronautics
Artificial intelligence (AI) + Sensors + Aeronautics
 
Intelligente visie maakt drones autonoom
Intelligente visie maakt drones autonoomIntelligente visie maakt drones autonoom
Intelligente visie maakt drones autonoom
 
automation.pptx
automation.pptxautomation.pptx
automation.pptx
 
Autonomous Driving- TU Chemnitz
Autonomous Driving- TU ChemnitzAutonomous Driving- TU Chemnitz
Autonomous Driving- TU Chemnitz
 
Self driving car
Self driving carSelf driving car
Self driving car
 
“Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
“Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...“Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
“Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
 
The Importance of Timing to Autonomous Vehicle Navigation
The Importance of Timing to Autonomous Vehicle NavigationThe Importance of Timing to Autonomous Vehicle Navigation
The Importance of Timing to Autonomous Vehicle Navigation
 
About RumiCar project
About RumiCar projectAbout RumiCar project
About RumiCar project
 
AV Latency Measurement
AV Latency MeasurementAV Latency Measurement
AV Latency Measurement
 
pick and place robotic arm
pick and place robotic armpick and place robotic arm
pick and place robotic arm
 
Mainprojpresentation 150617092611-lva1-app6892
Mainprojpresentation 150617092611-lva1-app6892Mainprojpresentation 150617092611-lva1-app6892
Mainprojpresentation 150617092611-lva1-app6892
 
autonomous vehicles org ppt.pptx
autonomous vehicles org ppt.pptxautonomous vehicles org ppt.pptx
autonomous vehicles org ppt.pptx
 
Machine learning and Autonomous System
Machine learning and Autonomous SystemMachine learning and Autonomous System
Machine learning and Autonomous System
 
GANS Artifical Intelligence Assigmentt 7.pptx
GANS Artifical Intelligence Assigmentt 7.pptxGANS Artifical Intelligence Assigmentt 7.pptx
GANS Artifical Intelligence Assigmentt 7.pptx
 
slide-171212080528.pptx
slide-171212080528.pptxslide-171212080528.pptx
slide-171212080528.pptx
 
Autonomous Car
Autonomous CarAutonomous Car
Autonomous Car
 
Jatin sharma (42162)
Jatin sharma (42162)Jatin sharma (42162)
Jatin sharma (42162)
 
Real Time Object Dectection using machine learning
Real Time Object Dectection using machine learningReal Time Object Dectection using machine learning
Real Time Object Dectection using machine learning
 
EDGE CASE TESTING IN A SENSOR-REALISTIC SIMULATION ENVIRONMENT
EDGE CASE TESTING IN A SENSOR-REALISTIC SIMULATION ENVIRONMENTEDGE CASE TESTING IN A SENSOR-REALISTIC SIMULATION ENVIRONMENT
EDGE CASE TESTING IN A SENSOR-REALISTIC SIMULATION ENVIRONMENT
 

Kürzlich hochgeladen

The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 

Kürzlich hochgeladen (20)

The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 

Panel 4-Cognitive vision, robotics and autonomy

  • 1. C-Lab Cognitive Vision, Robotics and Autonomy Monday, 20 January 2020 1 Prof R Bowden Centre for Vision Speech and Signal Processing
  • 2. CVSSP Centre for Vision, Speech and Signal Processing Creating machines that can see, hear and understand the world around them
  • 4. Surrey Autonomous Testbed • The testbed is very similar to the street drone, using the same Twizy vehicle, sensors and processing platform • Twizy Cargo • Nvidia PX2 Drive • 6 Sekonix cameras (street drone as 8 but same coverage, less overlap) • Ouster 64 beam lidar • Wheel odometry, not available on street drone • Supports wider research and collaborative projects with Parkopedia, JLR, McLarren, FLIR amongst others • Provides Surrey with a data capture and demonstration platform
  • 5. Surrey Autonomous Testbed • Two phase build: • Phase 1 – sensor recording and onboard processing • Phase 2 – actuators to provide full control • Entire build opensource: http://autonomous.home.blog How to build an autonomous vehicle for < £15K
  • 7. Demonstration scenario 1. Parking process is started via smartphone 2. Vehicle enters a car park, localises itself using indoor maps and navigates to a space 3. Driver summons parked vehicle back via smartphone 4. Vehicle exits a car park and is picked by a driver in a pick up zone
  • 8. Work related to Autonomous Driving • Automatic extrinsic calibration of car mounted sensors • Reinforcement Learning for vehicle control and safety verification • Feature Learning across lighting and weather • Vehicle state estimation, sensor fusion and side slip estimation • Semantic Segmentation • Monoscopic depth estimation and scene estimation
  • 9. DARPA 3 Waves of AI • Wave 1 – Handcrafted Knowledge • e.g. classical AI, chess computers • Engineers create sets of rules to represent knowledge in well‐defined domains • The structure of the knowledge is defined by humans • The specifics are explored by the machine • Enables reasoning over narrowly defined problems • No learning capability and poor handling of uncertainty • Wave 2 – Statistical Learning • e.g. machine and deep learning, alpha go • Engineers create statistical models for specific problem domains and train them on big data • Nuanced classification and prediction capabilities • No contextual capability and minimal reasoning ability • Statistically impressive, but individually unreliable • Wave 3 - Contextual adaptation • Systems construct contextual explanatory models for classes of real world phenomena