Eric Bezzam is Signal Processing Scientist at Snips. Snips is the only private by design Voice platform. They are French and service the world. His presentation is called voice assistants on the edge.
2. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Outline of talk
1. Lead-up to ML / voice assistant craze (tech)
2. What’s in a voice assistant? Wake Word, ASR, NLU
3. Cloud vs. on-device (Snips!)
3. Eric Bezzam | @EricBezzam | @snips @HdwPioneers
But first…
4. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Maker Kit Giveaway!
RT + follow @snips to enter the lottery!
5. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Maker Kit Giveaway!
RT + follow @snips to enter the lottery!
6. Eric Bezzam | @EricBezzam | @snips #OpenVoice
2018: 41% of US consumers (100M) own a smart speaker
(21.5% in 2017 +90%)
source: RBC Capital Markets
10. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Towards voice assistants
Algorithms Hardware
70x speedup when
training with GPUs (’09)
• Perceptron (’58)
• Backprop (60s)
• CNN / LSTM (80s-90s)
11. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Towards voice assistants
Algorithms Hardware Internet
70x speedup when
training with GPUs (’09)
• Access to large
amounts of data
• Easier collaboration
• Perceptron (’58)
• Backprop (60s)
• CNN / LSTM (80s-90s)
12. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Towards voice assistants
Algorithms Hardware Internet
70x speedup when
training with GPUs (’09)
• Access to large
amounts of data
• Easier collaboration
• Perceptron (’58)
• Backprop (60s)
• CNN / LSTM (80s-90s)Deep Learning Revolution (2012)
13. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Towards voice assistants
Source: https://www.smartsheet.com/voice-assistants-artificial-intelligence
14. What’s in a voice assistant?
Eric Bezzam | @EricBezzam | @snips #OpenVoice
15. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Voice assistant pipeline
Wakeword
Detection
Automatic Speech
Recognition (ASR)
Natural Language
Understanding (NLU)
Action / Dialogue
—> writing an algorithm
19. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Cloud based
• Rely on remote computing power for general
voice assistant (more memory and comp. power)
• Always listening, streaming when Wake Word
detected
20. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Cloud based
• Rely on remote computing power for general
voice assistant (more memory and comp. power)
• Always listening, streaming when Wake Word
detected
Source: 2017 Speak Easy Report
21. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Cloud based
• Rely on remote computing power for general
voice assistant (more memory and comp. power)
• Always listening, streaming when Wake Word
detected
Source: 2017 Speak Easy Report
Is it necessary to send voice data?
22. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Your voice is fundamental
to your identity
myactivity.google.com/myactivity
23. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Your data is safe with us
24. Eric Bezzam | @EricBezzam | @snips #OpenVoice
On-device (Snips)
• Rethinking solutions → specialized
models instead of general AI
• Specialized models allow smaller model
and need less data
25. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Cloud-level performance on a
Raspberry Pi 3 (Medium post)
26. Eric Bezzam | @EricBezzam | @snips #OpenVoice
Free as in beer!
Snips Console
console.snips.ai
docs.snips.ai
NLU Training
Maker Kit
hackster.io/contests/building-for-voice
