Quoc Le, Software Engineer, Google at MLconf SF - 11/13/15
•Download as PPTX, PDF•
5 likes•1,850 views
Quoc Le is software engineer at Google and will become an assistant professor at Carnegie Mellon University in Fall 2014. At Google, Quoc works on large scale brain simulation using unsupervised feature learning and deep learning. His work focuses on object recognition, speech recognition and language understanding. Quoc obtained his PhD at Stanford, undergraduate degree with First Class Honours and Distinguished Scholar at the Australian National University, and was a researcher at National ICT Australia, Microsoft Research and Max Planck Institute of Biological Cybernetics. Quoc won best paper award as ECML 2007.
Recommended
Recommended
More Related Content
Viewers also liked
Viewers also liked (13)
More from MLconf
More from MLconf (20)
Recently uploaded
Recently uploaded (20)
Quoc Le, Software Engineer, Google at MLconf SF - 11/13/15
- 1. Quoc V. Le Deep Learning: Overview and Latest Results joint work with many Google & Stanford collaborators
- 3. Coates et al 200
- 4. Quoc V. Le 4 Feature Engineering Handcrafted Features Classifier X X’ “Face” Y
- 5. Quoc V. Le Why Deep Learning? x Corner Detectors … Edge Detectors Raw Image Cat, Face Detectors
- 6. Quoc V. Le Model Partitioning Machine 4 Machine 1 Machine 2 Machine 3
- 7. Quoc V. Le GoogleBrain infrastructure Parameter Server Model Workers Data Shards p’ = p + ∆p ∆p ∆p ∆p Le et al, 2011, Dean et al 2
- 8. Quoc V. Le Why scaling up? Amount of data Accuracy Deep Learning Traditional Machine Learning
- 9. Quoc V. Le GoogleBrain teaches itself Watch YouTube for 3 days (10M frames) Run on 16,000 machines 1 billion synapses Le et al 201
- 10. Quoc V. Le GoogleBrain teaches itself Watch YouTube for 3 days (10M frames) Run on 16,000 machines 1 billion synapses “Cat” Le et al 201
- 11. Quoc V. Le
- 12. Quoc V. Le Applications - Understanding Images - Understanding Speech - Understanding Texts
- 13. Quoc V. Le Image Recognition 28% vs. 5% Error rate: Achieves superhuman performance Now used in Google+ Photosearch and StreetView LeCun et al 1998, Krizhevsky et al 2
- 14. Quoc V. Le Speech Recognition Voice Search 23% vs. 8% Error rate: Hinton et al, 201
- 15. Quoc V. Le Applications - Understanding Images - Understanding Speech - Understanding Texts
- 16. Quoc V. Le Mapping sequence to sequence A W X Y Z <EOS> B C <EOS> W X Y W Z WX XWY YXWZ YXW<EOS>
- 17. Quoc V. Le Sample Conversations Describe your problem: i am having issues accessing vpn Machine: hi Human: hello Machine: could you please let me know what are the operating systems you are using ? Human: i am using linux Machine: ok it was in the ssl vpn on which you stated it was broken Machine: please check if you are logged in to corp network Machine: what is the error that you are running please Human: i am seeing an error related to vpn Machine: what is the error message that you are getting when connecting to vpn using network connect ? Human: connection refused or something like that Machine: may i know the version of network connect you connect ?
- 18. Quoc V. Le Sample Conversations Human: i am not sure i know that Machine: is the network connect prompting for any user certificate Machine: ? Human: yes Machine: are you at home or at work at the moment ? Machine: office ? Human: i am at home Machine: try this Machine: goto <URL> page and enter your name and password Human: done Machine: try logging in with <NAME> and check if its working fine now Human: yes , now it works ! Machine: great Machine: anything else that i can help Human: no , that was very useful Machine: you are other than <NAME> : ) Machine: have a nice night
- 19. Quoc V. Le Sample Conversations Human: what is the purpose of life ? Machine: to serve the greater good . Human: what is the purpose of living ? Machine: to live forever . Human: what is the purpose of existence ? Machine: to find out what happens when we get to the planet earth . Human: where are you now ? Machine: i ’m in the middle of nowhere . Human: what is the purpose of dying ? Machine: to have a life . Human: what is the purpose of being intelligent ? Machine: to find out what it is . Human: what is the purpose of emotions ? Machine: i don ’t know .
- 20. Quoc V. Le Applications - Understanding Images - Understanding Speech - Understanding Texts Image to Texts
- 21. Quoc V. Le Generating captions for images A person riding a motorcycle on a dirt road A group of young people playing a game of frisbee Two dogs play in the grass Vinyals, et al, 201
- 22. Quoc V. Le Deep Learning tutorials & software Deep Learning tutorials are available on my website: Part 1 (Basic): http://ai.stanford.edu/~quocle/tutorial1.pdf Part 2 (Advanced): http://ai.stanford.edu/~quocle/tutorial2.pdf Popular open source software for Deep Learning: CAFFE https://github.com/BLVC/caffe
- 23. Quoc V. Le Thanks Jeff Dean Oriol VinyalsIlya SutskeverGreg Corrado Matthieu Devin Andrew Ng Rajat Monga Navdeep Jaitly +GoogleBrain team, Tomas Mikolov, Thang Luong, William Chan, Wojciech Zaremba