SALT Software Architecture (at Butterfly)
•
0 likes•407 views
This was a talk that I gave as part of the interview process for a mobile app lead at a medical device startup. I didn't get the job, but the presentation was a lot of fun to put together and it highlights a lot of the crazy stuff involved behind the scenes, working on the mobile apps and computer vision for SALT. You'll see code examples in Python, Kotlin, Rust, and Clojure, all languages which came in handy for developing this app. Talk given November 2, 2015, at Butterfly Network, Inc.
Recommended
Recommended
More Related Content
Recently uploaded
Recently uploaded (20)
Featured
Featured (20)
SALT Software Architecture (at Butterfly)
- 1. SALT Software Architecture David Y. Kay Nov 2, 2015
- 3. “Presentation on a project that is representative of your abilities”
- 6. Bio Lived in China Mobile since 2008 Hated It Entrepreneurship
- 7. Big Names
- 8. Interesting Projects Kenya Shark Tank Defense
- 9. Startups
- 10. Other Works
- 11. Community
- 12. Healthcare Hackathons • MIT Hacking Medicine 2015 - 2x first place • Yale CBIT-Core 2015 - Best Design • NASA Space Apps - Global Finalist, 2012 & 2015 • GHG Healthcare Outcomes 2014 - 3rd Place
- 13. Present Day
- 15. S.A.L.T.
- 17. Hardware Device
- 22. How to read it?
- 24. In other words…
- 26. System Overview
- 27. Polyglot
- 28. Recognition API
- 31. Why Python? • OpenCV Bindings • Highly productive • Easy debugging • Small system
- 32. Computer Vision
- 34. Device • Rotate to a standard orientation • Remove perspective from the image
- 37. Creatinine • Segment the color key • Find the square with the most similar average color
- 39. Chloride • Thermometer-like gauge • Find the red part • Find the yellow part • Count the lines
- 41. Finding The Red • Use green channel • Threshold • Erode • Dilate
- 43. The Filtering Problem • Too sensitive? Over-counting • Too strict? Under-counting
- 45. Computer Vision - Notes • Show line counting issue • Show the calibration issue • Show experimenting with color spaces • Show filtering challenges
- 47. Server Deployment Incredible Free Tier Helpful for wrangling OpenCV
- 48. Android App • Founders on Android • Android is the harder platform of the two • Keep the app small
- 49. Code Sharing
- 50. • Cross-platform app development • Open-core • Use Case • Primarily an Android app, secondarily an iPhone app
- 51. • Functional, safe, and expressive • Minimal overhead compared to Java • EXCELLENT tooling, via IDEA plugin
- 59. Why Rust? • Very strict, strongly-typed, safety-oriented language • Easy C-compatible FFI • Cross-platform, server/client • Modern tools
- 61. Admin Dashboard • Review Results & Troubleshoot • In future: • Mark results valid/invalid • Build a corpus over time
- 63. Why Clojure(script)? • Incredible agility (REPL & Figwheel) • Functional Language • Not mission critical - dynamic types
- 67. Demo
- 69. Recap
- 70. Wrap • Very lighting-dependent • Would love to build a corpus and use ML • Would love to spend more time with a computer vision expert