SlideShare ist ein Scribd-Unternehmen logo
1 von 28
ACME Robotics
We do robot stuff
A Presentation for Nevada
County Tech Connection
2017 - 2018 Team
FIRST: For Inspiration and Recognition of Science
and Technology
FTC: First Tech Challenge
What is Computer Vision?
● “Gaining high-level understanding from digital images or videos”
● Includes video tracking, object recognition, 3D pose estimation, motion
estimation, and image restoration.
● We’re mainly concerned with object recognition
Acquire ActThink
Computer Vision
Motivation
● Robot localization (estimating the robot’s
position on the field) is very useful in
autonomous
○ Dead reckoning approaches are only accurate
for short movements
○ Other advanced sensing techniques are not
feasible (e.g., lidar is illegal)
● Major field elements are composed of
simple shapes with solid, saturated
colors
○ This makes simple image processing feasible
(i.e., no CNNs needed)
Image Representation
● Computers use matrices to
represent image data
● Grayscale images are stored as a
2D matrix with each cell storing the
intensity of the corresponding pixel
● Color images have multiple
channels (e.g., RGB) with a separate
matrix for each channel
● For example, the red channel matrix
stores the intensity of red in each
pixel
0
255
8-bit
gray
palette
RGB channels
OpenCV
● An open source computer vision (CV) and
machine learning software library
● Very common in industry
● Provides implementations of many CV algorithms
and supporting data structures
● These operations can be assembled and
composed together to form pipelines
Basic Example: Jewel Vision
● Jewel detection is a useful task in
this year’s game
● Although a color sensor can be used,
they are somewhat unreliable and
difficult to position
● Since the position of the jewels is
fixed, we know beforehand where the
jewels will be located
● With this insight, jewel detection is as
simple as comparing the sum of the
red/blue pixels in these regions
Blurring
● A pretty common operation
outside of computer vision
for editing images in general
● Blurring is also common in
image processing to smooth
out images and remove noise
Thresholding
● Thresholding turns a grayscale image into a binary one
● Simple procedure: pixels below the threshold become black, pixels above the
threshold become white
● RGB thresholding applies the operation to each channel separately
Alternative Color Space: HSV
● Alternate way to represent color
● Three channels/dimensions:
○ Hue
○ Saturation
○ Value
● Often used instead of RGB for
color thresholding
Binary Morphology
Dilate
Erode Close (Dilate ⇒ Erode)
Open (Erode ⇒ Dilate)
Contours
● Basically boundary curves
● OpenCV can find the
contours that enclose
regions in a binary image
● Allows for the pipeline to
extract useful information
from the image data
Example: Basic Cryptobox Vision
Original Blur HSV Threshold
ContoursFinal Binary Morphology
Motion Control
● Speed + Accuracy
● Lots of subsystems
need motion control
○ Drive base
○ Jewel arm
○ Dump bed
○ Dump lift
○ Relic claw
Acquire ActThink
Control Systems
● Get from state A to B
● Maintain a setpoint
● Various applications
○ Motion
○ Temperature
○ Chemical processes
○ Power supply
Basic Example
Bang-Bang control
Target: 72℉
If temp is under target, heat
Otherwise, do nothing
Overshoot
Oscillation
PID
Account for current error
● Slow down as it nears the target
Account for past error
● Compensate for constant forces
● Gravity, Friction, Heat loss
Account for future error
● Dampening
● Prevents overshoot
Motion Profiling
● Observe constraints
○ Max Velocity
○ Max Acceleration
● Time optimal
● Feedforward vs Feedback
Simple Algorithm
● Acceleration limited
● 3 segments
○ Acceleration
○ Cruise
○ Deceleration
Calculate
max
Velocity
Determine
Accel/Decel
Distance
Calculate
Cruise
Distance
Calculate
duration for
segments
Jerk Control
● Jerk - the derivative of acceleration
○ The rate at which
acceleration is changing
● Acceleration Control necessitates
infinite jerk
● 7 segments with constant jerk
Putting it all together
● Feed forward control - applies
control in a pre-defined way
● Feedback control - applies
control in response to the state
of a system
● V and A terms - relate desired
motor performance to voltage
applied
● Lower PID gains - feed forward
ensures that there is relatively
low error
Follow Our Progress
● Website: goacmerobotics.com
● Facebook: fb.com/acmeroboticsinc
● Instagram: @acmerobotics
Contact Us
● Email: goacmerobotics@gmail.com
Learn More About FIRST
● Website: firstinspires.org
Robot Code
● GitHub: https://github.com/acmerobotics/relic-recovery
Program Future

Weitere Àhnliche Inhalte

Ähnlich wie Robotics: Vision-Aided Navigation and Motion Path Planning on Low-End Android Hardware

SSCCIP Final Presentation (The Spartans)
SSCCIP Final Presentation (The Spartans) SSCCIP Final Presentation (The Spartans)
SSCCIP Final Presentation (The Spartans)
Derek J. Russell
 
3 CG_U1_P2_PPT_3 OpenGL.pptx
3 CG_U1_P2_PPT_3 OpenGL.pptx3 CG_U1_P2_PPT_3 OpenGL.pptx
3 CG_U1_P2_PPT_3 OpenGL.pptx
ssuser255bf1
 
PhD_ppt_2012
PhD_ppt_2012PhD_ppt_2012
PhD_ppt_2012
Diego Cheda
 

Ähnlich wie Robotics: Vision-Aided Navigation and Motion Path Planning on Low-End Android Hardware (20)

Charmi chokshi ppt
Charmi chokshi pptCharmi chokshi ppt
Charmi chokshi ppt
 
Dexterous In-hand Manipulation by OpenAI
Dexterous In-hand Manipulation by OpenAIDexterous In-hand Manipulation by OpenAI
Dexterous In-hand Manipulation by OpenAI
 
OpenCV.pdf
OpenCV.pdfOpenCV.pdf
OpenCV.pdf
 
ç‰©ä»¶ć”æžŹèˆ‡èŸšè­˜æŠ€èĄ“
ç‰©ä»¶ć”æžŹèˆ‡èŸšè­˜æŠ€èĄ“ç‰©ä»¶ć”æžŹèˆ‡èŸšè­˜æŠ€èĄ“
ç‰©ä»¶ć”æžŹèˆ‡èŸšè­˜æŠ€èĄ“
 
Presentation shortstory
Presentation shortstoryPresentation shortstory
Presentation shortstory
 
Jpeg compression
Jpeg compressionJpeg compression
Jpeg compression
 
HiPEAC 2019 Workshop - Use Cases
HiPEAC 2019 Workshop - Use CasesHiPEAC 2019 Workshop - Use Cases
HiPEAC 2019 Workshop - Use Cases
 
image processing for jpeg presentati.ppt
image processing for jpeg presentati.pptimage processing for jpeg presentati.ppt
image processing for jpeg presentati.ppt
 
Computer graphics - Nitish Nagar
Computer graphics - Nitish NagarComputer graphics - Nitish Nagar
Computer graphics - Nitish Nagar
 
SSCCIP Final Presentation (The Spartans)
SSCCIP Final Presentation (The Spartans) SSCCIP Final Presentation (The Spartans)
SSCCIP Final Presentation (The Spartans)
 
Photo echance. Problems. Solutions. Ideas
Photo echance. Problems. Solutions. Ideas Photo echance. Problems. Solutions. Ideas
Photo echance. Problems. Solutions. Ideas
 
Dimensionality Reduction | Machine Learning | CloudxLab
Dimensionality Reduction | Machine Learning | CloudxLabDimensionality Reduction | Machine Learning | CloudxLab
Dimensionality Reduction | Machine Learning | CloudxLab
 
Introduction to 3D Computer Vision and Differentiable Rendering
Introduction to 3D Computer Vision and Differentiable RenderingIntroduction to 3D Computer Vision and Differentiable Rendering
Introduction to 3D Computer Vision and Differentiable Rendering
 
3 CG_U1_P2_PPT_3 OpenGL.pptx
3 CG_U1_P2_PPT_3 OpenGL.pptx3 CG_U1_P2_PPT_3 OpenGL.pptx
3 CG_U1_P2_PPT_3 OpenGL.pptx
 
Computer Vision
Computer VisionComputer Vision
Computer Vision
 
Semantic Segmentation on Satellite Imagery
Semantic Segmentation on Satellite ImagerySemantic Segmentation on Satellite Imagery
Semantic Segmentation on Satellite Imagery
 
PhD_ppt_2012
PhD_ppt_2012PhD_ppt_2012
PhD_ppt_2012
 
Screen space reflections on Epsilon Engine
Screen space reflections on Epsilon EngineScreen space reflections on Epsilon Engine
Screen space reflections on Epsilon Engine
 
COSCUP 2023 - Make Your Own Ray Tracing GPU with FPGA
COSCUP 2023 - Make Your Own Ray Tracing GPU with FPGACOSCUP 2023 - Make Your Own Ray Tracing GPU with FPGA
COSCUP 2023 - Make Your Own Ray Tracing GPU with FPGA
 
A parallel gpu version of the traveling salesman problem slides
A parallel gpu version of the traveling salesman problem slidesA parallel gpu version of the traveling salesman problem slides
A parallel gpu version of the traveling salesman problem slides
 

Mehr von Nevada County Tech Connection

Mehr von Nevada County Tech Connection (11)

John Selep: Resources available to the AgTech industry
John Selep: Resources available to the AgTech industryJohn Selep: Resources available to the AgTech industry
John Selep: Resources available to the AgTech industry
 
Willa Leong: Farm Date Ownership
Willa Leong: Farm Date OwnershipWilla Leong: Farm Date Ownership
Willa Leong: Farm Date Ownership
 
Robert Tse: Broadband and the Future of Agriculture
Robert Tse: Broadband and the Future of AgricultureRobert Tse: Broadband and the Future of Agriculture
Robert Tse: Broadband and the Future of Agriculture
 
Gabriel Youtsey: AgTech18 Conference, Nevada County, CA February, 18
Gabriel Youtsey: AgTech18 Conference, Nevada County, CA February, 18Gabriel Youtsey: AgTech18 Conference, Nevada County, CA February, 18
Gabriel Youtsey: AgTech18 Conference, Nevada County, CA February, 18
 
Mobile Apps - From Ideas to Excecution
Mobile Apps - From Ideas to ExcecutionMobile Apps - From Ideas to Excecution
Mobile Apps - From Ideas to Excecution
 
Evolving Cybersecurity Threats
Evolving Cybersecurity Threats  Evolving Cybersecurity Threats
Evolving Cybersecurity Threats
 
Artificial Intelligence for Start-Up Funding Success
Artificial Intelligence for Start-Up Funding SuccessArtificial Intelligence for Start-Up Funding Success
Artificial Intelligence for Start-Up Funding Success
 
Augmented Reality - Today and the Future
Augmented Reality - Today and the FutureAugmented Reality - Today and the Future
Augmented Reality - Today and the Future
 
Rising Above The Noise With Your Tech Brand
Rising Above The Noise With Your Tech BrandRising Above The Noise With Your Tech Brand
Rising Above The Noise With Your Tech Brand
 
How to Shoot your Company in the Foot
How to Shoot your Company in the FootHow to Shoot your Company in the Foot
How to Shoot your Company in the Foot
 
The Promise of BlockChain
The Promise of BlockChainThe Promise of BlockChain
The Promise of BlockChain
 

KĂŒrzlich hochgeladen

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

KĂŒrzlich hochgeladen (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 

Robotics: Vision-Aided Navigation and Motion Path Planning on Low-End Android Hardware

  • 1. ACME Robotics We do robot stuff A Presentation for Nevada County Tech Connection
  • 2. 2017 - 2018 Team
  • 3. FIRST: For Inspiration and Recognition of Science and Technology
  • 4. FTC: First Tech Challenge
  • 5.
  • 6.
  • 7.
  • 8. What is Computer Vision? ● “Gaining high-level understanding from digital images or videos” ● Includes video tracking, object recognition, 3D pose estimation, motion estimation, and image restoration. ● We’re mainly concerned with object recognition Acquire ActThink Computer Vision
  • 9. Motivation ● Robot localization (estimating the robot’s position on the field) is very useful in autonomous ○ Dead reckoning approaches are only accurate for short movements ○ Other advanced sensing techniques are not feasible (e.g., lidar is illegal) ● Major field elements are composed of simple shapes with solid, saturated colors ○ This makes simple image processing feasible (i.e., no CNNs needed)
  • 10. Image Representation ● Computers use matrices to represent image data ● Grayscale images are stored as a 2D matrix with each cell storing the intensity of the corresponding pixel ● Color images have multiple channels (e.g., RGB) with a separate matrix for each channel ● For example, the red channel matrix stores the intensity of red in each pixel 0 255 8-bit gray palette RGB channels
  • 11. OpenCV ● An open source computer vision (CV) and machine learning software library ● Very common in industry ● Provides implementations of many CV algorithms and supporting data structures ● These operations can be assembled and composed together to form pipelines
  • 12. Basic Example: Jewel Vision ● Jewel detection is a useful task in this year’s game ● Although a color sensor can be used, they are somewhat unreliable and difficult to position ● Since the position of the jewels is fixed, we know beforehand where the jewels will be located ● With this insight, jewel detection is as simple as comparing the sum of the red/blue pixels in these regions
  • 13. Blurring ● A pretty common operation outside of computer vision for editing images in general ● Blurring is also common in image processing to smooth out images and remove noise
  • 14. Thresholding ● Thresholding turns a grayscale image into a binary one ● Simple procedure: pixels below the threshold become black, pixels above the threshold become white ● RGB thresholding applies the operation to each channel separately
  • 15. Alternative Color Space: HSV ● Alternate way to represent color ● Three channels/dimensions: ○ Hue ○ Saturation ○ Value ● Often used instead of RGB for color thresholding
  • 16. Binary Morphology Dilate Erode Close (Dilate ⇒ Erode) Open (Erode ⇒ Dilate)
  • 17. Contours ● Basically boundary curves ● OpenCV can find the contours that enclose regions in a binary image ● Allows for the pipeline to extract useful information from the image data
  • 18. Example: Basic Cryptobox Vision Original Blur HSV Threshold ContoursFinal Binary Morphology
  • 19. Motion Control ● Speed + Accuracy ● Lots of subsystems need motion control ○ Drive base ○ Jewel arm ○ Dump bed ○ Dump lift ○ Relic claw Acquire ActThink
  • 20. Control Systems ● Get from state A to B ● Maintain a setpoint ● Various applications ○ Motion ○ Temperature ○ Chemical processes ○ Power supply
  • 21. Basic Example Bang-Bang control Target: 72℉ If temp is under target, heat Otherwise, do nothing Overshoot Oscillation
  • 22. PID Account for current error ● Slow down as it nears the target Account for past error ● Compensate for constant forces ● Gravity, Friction, Heat loss Account for future error ● Dampening ● Prevents overshoot
  • 23. Motion Profiling ● Observe constraints ○ Max Velocity ○ Max Acceleration ● Time optimal ● Feedforward vs Feedback
  • 24. Simple Algorithm ● Acceleration limited ● 3 segments ○ Acceleration ○ Cruise ○ Deceleration Calculate max Velocity Determine Accel/Decel Distance Calculate Cruise Distance Calculate duration for segments
  • 25. Jerk Control ● Jerk - the derivative of acceleration ○ The rate at which acceleration is changing ● Acceleration Control necessitates infinite jerk ● 7 segments with constant jerk
  • 26. Putting it all together ● Feed forward control - applies control in a pre-defined way ● Feedback control - applies control in response to the state of a system ● V and A terms - relate desired motor performance to voltage applied ● Lower PID gains - feed forward ensures that there is relatively low error
  • 27. Follow Our Progress ● Website: goacmerobotics.com ● Facebook: fb.com/acmeroboticsinc ● Instagram: @acmerobotics Contact Us ● Email: goacmerobotics@gmail.com Learn More About FIRST ● Website: firstinspires.org Robot Code ● GitHub: https://github.com/acmerobotics/relic-recovery

Hinweis der Redaktion

  1. Founded 3 years ago by Ryan and Kellen because they wanted to do robotics and there was a lack of STEM activities in the area Grown to 11 team members and 5 mentors (coaches) Only brought the three senior members / team leads Community team (room at NU, but self-funded team)
  2. International competitive robotics organization founded almost 30 years ago by serial entrepreneur Dean Kamen Focused on building skills for future business and technology leaders 4 levels of programs, starting for kids age 6 through high schoolers
  3. Way more fun than the Federal Trade Commission We compete in the third level, First Tech Challenge, for middle schoolers and high schoolers Program is designed so teams run like small tech start-ups Team is responsible for creating and setting the budget and raising money for the year Team is split into multiple sub-teams: hardware, software, and business Documentation: engineering notebook that we present to judges at competitions, documents our team’s journey and design process Scheduling: team must figure out how to get everything designed and built among multiple sub-teams by a deadline Marketing: team branding, website/social media, fundraising Specific examples - like current budget tension between being over budget and wanting to rebuild the robot Community outreach: summer camp, school presentations
  4. Talk about each sub-component of the hardware (and how we do CAD)
  5. High-level overview of robot (how it talks to driver station and is controlled)
  6. Up while Q & A