AI is considered the biggest commercial opportunity in the changing economy. It is expected to generate $15.7T by 2030 (according to PwC). In this talk I explained what are some of the top business opportunities for cloud sales professionals in the field of deep learning and artificial intelligence. I addressed the most important principles of deep learning techniques and finally, I studied two deep learning problems (image recognition with CNNs and sentiment analysis with RNNs) with 5 different deep learning frameworks.
3. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: wikipedia
“Our strategy is to
build best-in-class
platforms and services
for an intelligent cloud
and an intelligent
edge infused with
artificial intelligence”
source: annual report 2017
4. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: PwC AI analysis 2017
BIGGEST
OPPORTUNITY$15.7Trillion by 2030 ~ 14% GPD
Productivity gains ($6.6T)
Automation
Increased demand ($9.1T)
Augmentation Higher quality products
5. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: PwC AI analysis 2017
6. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
DNNs (learn complex patterns
on HUGE amounts of data)
Intelligent applications … such as….
Cloud (flexibility, scalability, efficiency)
8. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Speech
recognition
Natural Language
Processing
Computer
Vision
9. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
“The more data,
The better it works*”
* always read the small print
source: https://xkcd.com/1838/
10. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Best bet to solve intelligence
11. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
wait, wait, wait…
What makes deep learning deep?
input hidden output
13. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: http://www.iro.umontreal.ca/~bengioy/yoshua_en/
“Learning multiple levels of
representation to help a learner
accomplish a task of interest,
with higher levels capturing
more abstract concepts
through a deeper composition
of computations”
Yoshua Bengio
14. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
low level features high level featuresmedium level features
Interesting paper about representations: https://arxiv.org/abs/1411.1792
15. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Convolutional Neural Networks
(CNN)
Recurrent Neural Networks
(RNN)
16. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
MNIST with CNNs
(source here)
17. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: https://www.cs.toronto.edu/~kriz/cifar.html
CIFAR with ResNet CNN
(source here)
18. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Object detection with FasterRCNN
(source here)
dog
19. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Transfer Learning with CNNs
(source here)
20. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Video classification with 3D CNNs
(source here)
21. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Text classification with
CNNs (source here)
Input text: “It was a breeze to configure and worked straight away”
Books Electronics
Home &
Kitchen
Clothing Movies Health Sports
22. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Speech recognition
with LSTMs
(source here)
23. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Time series forecasting
with LSTMs (source here)
24. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Autoencoders (source here)
Original Learned
Encoder Decoder
Low dimensional
representation
25. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Reinforcement Learning
tutorial (basic & advanced)
source: wikipedia
26. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Generative Adversarial Networks (GANs)
tutorial (source here)
27. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Diagnosis augmentation for lung cancer detection
3D CNN for nodule segmentation +
CNN for nodule classification (info1, info2)
CT scan: horizontal section of lung
Patient health monitoring with sensors (IoT):
Autoencoder on normal class +
reconstruction error abnormal class (info)
28. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Predictive maintenance with sensors:
LSTM for classification
Visual fault detection in components:
Transfer learning with CNNs
29. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Generative
Asset wealth management and prediction:
Reinforcement Learning for optimal action
policy
Bots for insurance policy management:
LSTM&CNN for speech recognition+
CNN for recommendation system
30. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Route optimization:
Reinforcement Learning
Inventory optimization:
LSTM
32. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Personalized fashion design and
production:
CNNs for image classification +
GANs for image generation
Customer demand forecasting:
LSTM
33. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Demand forecasting:
LSTM
Predictive maintenance:
LSTM
34. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Supply chain defect reduction
based on images:
Transfer learning with CNNs
On-demand production:
LSTM
35. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: https://github.com/Azure/fast_retraining
Degradation of accuracy
with new data
Airline delay prediction
You need to retrain!!!
37. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Learning can be viewed as finding
a and b in:
y = a.x + b
y (outputs)
x (inputs)
a,b (parameters)
38. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
y = a.x + b
1 = a.1 + b
5 = a.5 + b
= a. + b
a=1 b=0
e = ytrue – ypred
ytrue=1
ypred depends on a,b
optimize a,b so e is
minimum
39. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: R. Rojas: Neural Networks, Springer-Verlag, Berlin, 1996
40. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Sharpening filter
Laplacian filter
Sobel x-axis filter
42. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Max pooling with 2x2 kernel and stride of 2x2
1 5 3 2
2 6 0 9
1 5 0 1
5 7 2 4
6 9
7 4
43. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
input hidden output
44. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
SoftmaxReLUtanh
45. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: Introduction to Natural Language Processing with FastText
Mappings of discrete objects to a high
dimensional space
bird: (1.072, 4.245, …)
dove: (1.134, 4.079, …)
woman: (-1.385, -2.104, …)
man: (-2.207, 2.118, …)
46. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
input
hidden
output
hidden
hidden
ti ti+1 ti+2 ti+3
…
…
…
47. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
number of layers
48. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: https://en.wikipedia.org/wiki/Long_short-term_memory
49. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
CNTK
TensorFlow
https://github.com/ilkarman/DeepLearningFrameworks: 5 frameworks, same problem
74. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
GIVE ME DATA!!!!
CONCEPT DRIFT IS YOUR FRIEND
MASTER THE CORE PRINCIPLES
KNOW THE FRAMEWORKS&TOOLS
75. Dr. Miguel Fierro
Data Scientist at Microsoft
@miguelgfierro
https://miguelgfierro.com
Intelligent Cloud GBB Ready | Lisbon Sept 2017
76. Intelligent Cloud GBB Ready Lisbon 2017
The code from these slides is published at:
https://github.com/ilkarman/DeepLearningFrameworks
Attribution of some images:
• http://morguefile.com
• https://unsplash.com
• Ana Corrales Photography
• http://wikipedia.org
Dataset citation:
• CIFAR-10. Learning Multiple Layers of Features from Tiny
Images, Alex Krizhevsky, 2009.
https://www.cs.toronto.edu/~kriz/cifar.html
• IMDB. https://s3.amazonaws.com/text-datasets/imdb.npz