A beginners guide to computer vision as shared at Prairie Code

1. COMPUTER VISION
A BEGINNERS GUIDE TO

2. A BEGINNERS GUIDE TO COMPUTER VISION
INTRODUCTION: ANDREW RANGEL
▸ Background: Mobile Development
▸ Passion for new and exciting technologies
▸ Working with and learning CV for ~1 year
▸ Wanted to share my experience

3. A BEGINNERS GUIDE TO COMPUTER VISION
INTRODUCTION: COMPUTER VISION
▸ What is it
▸ What is it for
▸ Who uses it
▸ Examples
▸ How can you use it
▸ Misconceptions

4. A BEGINNERS GUIDE TO COMPUTER VISION
WHAT IS IT
▸ Computer Vision is the process of using a computer based
algorithm to identify patterns in the data of images
▸ Basic Steps:
▸ Process the image
▸ Use an algorithm to identify a pattern
▸ Present that pattern in a meaningful way

5. A BEGINNERS GUIDE TO COMPUTER VISION
WHAT IS IT

6. A BEGINNERS GUIDE TO COMPUTER VISION
WHAT IS IT

7. A BEGINNERS GUIDE TO COMPUTER VISION
WHAT IS IT

8. A BEGINNERS GUIDE TO COMPUTER VISION
WHAT IS IT

9. A BEGINNERS GUIDE TO COMPUTER VISION
WHAT IS IT

10. A BEGINNERS GUIDE TO COMPUTER VISION
WHAT IS IT
▸ Matrix math
▸ From basic to
complex
▸ “Seeing” the
matrix

11. A BEGINNERS GUIDE TO COMPUTER VISION
WHAT IS IT FOR
▸ More uses than you may imagine
▸ Sorting fruit
▸ Self driving vehicles
▸ Snapchat filters
▸ Identifying animals
▸ Identifying patterns humans cannot

12. COMPUTER VISION HAS
SURPRISING
APPLICATIONS

15. A BEGINNERS GUIDE TO COMPUTER VISION
WHO USES IT
▸ Companies from farming to Snapchat
▸ Computer Vision allows companies to process unique
input in a way that creates innovation and new industries
▸ Will be integrated more as Augmented Reality grows in
popularity

16. A BEGINNERS GUIDE TO COMPUTER VISION
BAD AI BOT: MY EXCURSION INTO COMPUTER VISION
▸ I wanted to show my family and friends what I meant by
“computer vision”
▸ When I showed them they were rarely impressed “meh”
▸ I noticed how terrible it is to use a “stock” model to try and
identify the world
▸ Got a much bigger result from friends and family when
showing them bad results

17. A BEGINNERS GUIDE TO COMPUTER VISION
BAD AI BOT: MY EXCURSION INTO COMPUTER VISION

18. A BEGINNERS GUIDE TO COMPUTER VISION
BAD AI BOT: MY EXCURSION INTO COMPUTER VISION
▸ Started with Inception3 model (open source)
▸ Apple example code
▸ Created UI wrapper and image picker interface
▸ Business logic when sending / receiving images from
model

19. A BEGINNERS GUIDE TO COMPUTER VISION
BAD AI BOT: MY EXCURSION INTO COMPUTER VISION
CAMERA OPENCV
INCEPTION
V3
RESULTS UI

20. A BEGINNERS GUIDE TO COMPUTER VISION
BAD AI BOT: MY EXCURSION INTO COMPUTER VISION
OPENCV INCEPTION V3 RESULTS
MODELIMAGEIMAGEIMAGE
ERRORADJUST
LABELS

21. A BEGINNERS GUIDE TO COMPUTER VISION
SEE FIRE: A MORE SERIOUS PROJECT
▸ Started with Netflix, naturally
▸ Wildfire epidemic on the west coast
▸ Prevention may be impossible but containment could save
lives / homes / money
▸ What if you distributed a mesh network connected army of
fire spotters?

22. A BEGINNERS GUIDE TO COMPUTER VISION
SEE FIRE: A MORE SERIOUS PROJECT
▸ This project seemed more suited for TensorFlow
▸ How to choose images
▸ Decide on how to train model
▸ Determine how you will test model
▸ Next steps

23. A BEGINNERS GUIDE TO COMPUTER VISION
SEE FIRE: A MORE SERIOUS PROJECT
▸ Sourcing images
▸ Google images (search tools for reuse)
▸ Programming is your friend: Python script
▸ Reviewing images
▸ Content is key

24. A BEGINNERS GUIDE TO COMPUTER VISION
HOW CAN YOU USE IT
▸ Easiest way to try computer vision is OpenCV on the
desktop
▸ Easiest way to use computer vision is a mobile application
▸ 3 easy steps

25. A BEGINNERS GUIDE TO COMPUTER VISION
HOW CAN YOU USE IT: STEP 1
▸ Think of a use for computer vision
▸ Don’t start with the technology
▸ Get creative!
▸ Have a clear vision for what you want to achieve

26. A BEGINNERS GUIDE TO COMPUTER VISION
HOW CAN YOU USE IT: STEP 2
▸ Evaluate training your own model vs. cloud based
▸ Train your model / start working with API
▸ Test using data the model has never seen

27. A BEGINNERS GUIDE TO COMPUTER VISION
HOW CAN YOU USE IT: STEP 2 (DETOUR)
▸ OpenCV
▸ TensorFlow
▸ Google Cloud Vision API
▸ Microsoft Azure Computer Vision
▸ Amazon Rekognition

28. A BEGINNERS GUIDE TO COMPUTER VISION
HOW CAN YOU USE IT: STEP 3
▸ Integrate your model into your program / app
▸ Test. Test. TEST!
▸ Deploy!

29. A BEGINNERS GUIDE TO COMPUTER VISION
HOW CAN YOU USE IT: STEP 3
▸ Integrate your model into your program / app
▸ Test. Test. TEST!
▸ Deploy!
▸ …draw the rest of the owl

30. A BEGINNERS GUIDE TO COMPUTER VISION
MISCONCEPTIONS
▸ Terminator
▸ Self driving cars
▸ Computer Vision vs. Artificial Intelligence
▸ Facial Recognition
▸ Human behind the computer

31. A BEGINNERS GUIDE TO MACHINE LEARNING
THANK YOU!