1. How to detect porn and decide where to live using
MACHINE LEARNING
MICHAEL SHILMAN
michael@shilman.net
1

2. SCI-FI INSPIRES, TECHNOLOGY DELIVERS...
Sci-Fi Technology
2001: A Space Odyssey (1968) Infinity Blade for iPhone (2011)

3. TECHNOLOGY DELIVERS... most of the time
Teleportation
Time Travel Hardware
Telekinesis
Artificial Intelligence (AI) Software
AI is the last big software problem left
...and has been largely a failure so far.

4. 1960-70’s: CONCEPTS
Basic Theory Demos
Viterbi Decoding (1967) Sutherland’s Sketchpad (1968)

5. 1980’s: MODELING THE BRAIN
Neuron Expert
Neural Network Expert System

6. ENTER MACHINE LEARNING
Machine Learning is the study of
computer algorithms that improve
automatically through experience.
Tom Mitchell, Machine Learning (1997)

7. BASIC MACHINE LEARNING
Observations X Learn f(x) = y
Labels Y
Y = gender
Male
Female
X = height

8. REAL-WORLD MACHINE LEARNING
Observations X Y - 100’s of labels
X - 1000’s of features
Labels Y N - Millions of examples
? - Not all data is labeled
? - Some data is mis-labeled
f(x) = y Model spatial context
Model temporal context

9. 1990’s: MACHINE LEARNING BASICS
Speech Handwriting OCR

10. 2000’s: BIG DATA
Web Search Collaborative Filtering Porn Detection

11. 2011: PUTTING IT ALL TOGETHER
Modeling the Brain (1980’s)
+
= Machine Learning Basics (1990’s)
+
Big Data (2000’s)
Apple’s Siri (2011)

12. SIRI TEARDOWN

13. SIRI TEARDOWN f u u d
a
e
i
o
u
“food”
Waveform Input Broken into Each Chunk is Find the most likely
Little Chunks a phoneme paths through the
X(t) Y(t) phonemes that match
a words from the
dictionary

14. SIRI TEARDOWN
“what
would
you like
to eat?”
dialog
“bet me food” “get me food”
Find the most likely Find the most Execute a query Speak the result to
paths through the likely sentences based on the most the user
words that make that match the likely sentence
grammatical sense context

15. SCI-FI INSPIRES, TECHNOLOGY DELIVERS?
Sci-Fi Technology
2001: A Space Odyssey (1968) Apple’s Siri (2011)

16. TECHNOLOGY DELIVERS? TIME WILL TELL
Good Bad Ugly
http://siriouslyweird.tumblr.com/

17. WHAT’S NEXT?
Modeling the Brain (1980’s)
??? ???
+
Machine Learning Basics (1990’s)
???
??? ??? ???
+
Big Data (2000’s)

18. WHAT’S NEXT ... BIG DECISIONS
What to Buy? Where to Live? Who to Marry?

19. WHAT’S NEXT ... HUMAN STEERING

20. WHAT’S NEXT? NEED MORE SCI-FI!
Sci-Fi Technology
??? ???
???
??? ??? ???