1.
AI / ML Technologies and
Application for Product
Development
Chetan Khatri
FOSSASIA Summit, 2018
@khatri_chetan

2.
Accionlabs Artificial Intelligence | Machine Learning
WHO AM I ?
Lead - Data Science, Technology Evangelist @ Accion labs India Pvt. Ltd.
Committer @ Apache Spark, Apache HBase, Elixir Lang.
Co-Authored University Curriculum @ University of Kachchh.
Software Engineering @: Nazara Games, Eccella Corporation.
M.Sc. - Computer Science from University of Kachchh.

3.
Accionlabs Artificial Intelligence | Machine Learning
What is Artificial Intelligence ?
“Artificial intelligence is intelligence demonstrated by machines, in contrast to the natural intelligence
displayed by humans and other animals”. - Wikipedia
The Original definition of A.I:
“Every aspect of learning or any other feature of intelligence can in principle be so precisely described that a
machine can be made it simulate it. An attempt will be made to find how to make machines use language,
form abstractions and concepts, solve kinds of problems now reserved for humans, and improve
themselves”.
- John McCarthy at Dartmouth Conference. 1955
AI is new electricity!

4.
Accionlabs Artificial Intelligence | Machine Learning
“Software is eating the world, and A.I is eating
software !”
- GPUs / TPUs are eating Linear Algebra.
- Linear Algebra is eating Deep Learning.
- Deep Learning is eating Machine Learning.
- Machine Learning is eating Artificial Intelligence (AI).
- AI is eating Software.
- Software is eating the world.

5.
Accionlabs Artificial Intelligence | Machine Learning
Machine learning
It is a subfield of AI concerned with algorithms that allow computer to learn from examples/data and
experience. Machine
Learning Machine
Learning
Supervised
Learning
Unsupervised
Learning
Reinforcement
Learning
Deep Neural
Network / Deep
learning

6.
Accionlabs Artificial Intelligence | Machine Learning
How deep learning is different ?
Data
Feature
engineering
Statistical
Machine learning
Model
Features
Unseen Sample
Data
Deep Learning kind of
Machine learning
Model
Automatically identifies
features !
Prediction
Prediction
Unseen Sample

7.
Accionlabs Artificial Intelligence | Machine Learning
What is an Artificial Neural Network ?
BEACH
SEA
SKY
...

8.
Accionlabs Artificial Intelligence | Machine Learning
Neural Networks have been around for a while ...

9.
Accionlabs Artificial Intelligence | Machine Learning
… But then this happened
1
WEB-SCALE
DATA
Data volumes double
every year

10.
Accionlabs Artificial Intelligence | Machine Learning
… But then this happened
2
WEB-SCALE
DATA
Massive Adoption of GPU
and TPU.

11.
Accionlabs Artificial Intelligence | Machine Learning
… But then this happened
3
ADVANCED NEURAL
NETWORK DESIGNS

12.
Accionlabs Artificial Intelligence | Machine Learning
Supervised Learning !
A (INPUT) B (RESPONSE)
EMAIL SPAM ? (0/1)
IMAGE
OBJECT(1,...,10
00)
AUDIO TEXT
ENGLISH FRENCH

13.
Accionlabs Artificial Intelligence | Machine Learning
Machine learning / AI: Use Cases
Regression &
Classification
Real-time Data
Analysis
Character
Recognition (OCR)
ML Workload
Automation
Recommendation
& Personalization
Natural Language
Processing
Computer Vision
Data
Visualization
Information
Extraction
Deep Neural
Network
Conversational
Dialog Agent
(Bots)
Speech
Recognition
Forecasting
Predictions
Reinforcement
Learning
Scaling Prediction
services
Federated
Learning

14.
Accionlabs Artificial Intelligence | Machine Learning
TOOLS &
TECHNOLOGIES
Languages
Data Quality

15.
Accionlabs Artificial Intelligence | Machine Learning
Predictive
Modelling
Deep
Learning / AI
TOOLS &
TECHNOLOGIES

16.
Accionlabs Artificial Intelligence | Machine Learning
Data
Visualization
Containerized Scheduling
TOOLS &
TECHNOLOGIES

17.
Accionlabs Artificial Intelligence | Machine Learning
Scheduling
GPU Enabled
TOOLS &
TECHNOLOGIES

18.
Accionlabs Artificial Intelligence | Machine Learning
Artificial Intelligence and Machine learning
Automating the organization
Improving Decision making &
Reducing Inefficiencies

19.
Accionlabs Artificial Intelligence | Machine Learning
Machine learning process
Collect and
prepare
training data
Choose and
optimize your
ML algorithm
Setup and manage
environments for
training
Train and tune model
(trial and error)
Deploy model
in production
Scale and manage the
production environment

20.
Accionlabs Artificial Intelligence | Machine Learning
High level Architecture
BUILD TRAIN
Machine learning as
Service
ALGORITHMS
FRAMEWORKS
K-Means Clustering
Principal Component Analysis
Neural Topic Modelling
Factorization Machines
Linear Learner - Regression
Deep Reinforcement Learner
Convolutional Neural Network
XGBoost
Latent Dirichlet Allocation
Seq2Seq , LSTM
Recurrent Neural Network
Linear Learner - Classification
TensorFlow
PyTorch
Torch
Caffe2
CNTK
Caffe
Apache Spark MLlib
Apache Flink
Setup and manage
environments for
training
Train and tune
model
(trial and error)
Deploy model
in production
Scale & manage
the production
environment

21.
Accionlabs Artificial Intelligence | Machine Learning
Applications of AI : Computer Vision
Self-Driving
Cars
Convolution Neural
Network
Recurrent Neural
network
Vision i.e Camera Object recognition and identification
Real time, Per pixel Object Segmentation
Centimeter-accurate positioning

22.
Accionlabs Artificial Intelligence | Machine Learning
Applications of AI : Computer Vision
Visual Search &
Recommendation
Convolution Neural
Network
Recurrent Neural
network
Camera

23.
Accionlabs Artificial Intelligence | Machine Learning
Applications of AI : Computer Vision

24.
Accionlabs Artificial Intelligence | Machine Learning
Applications of AI : Computer Vision
Ad / User Click ? (0/1) Whether user will click to adv. or not ?
UI Wireframe UI Screen
Possible ???
Screenshot Source Code

25.
Accionlabs Artificial Intelligence | Machine Learning
Applications of AI : Computer Vision
Ad / User Click ? (0/1) Whether user will click to adv. or not ?
UI Wireframe UI Screen
Possible ???
Screenshot Source Code
DEMO

26.
Accionlabs Artificial Intelligence | Machine Learning
Applications of AI : Computer Vision - DEMO
UI Wireframe UI Screen

27.
Accionlabs Artificial Intelligence | Machine Learning
Applications of AI : Computer Vision - DEMO
Screenshot Source Code

28.
Accionlabs Artificial Intelligence | Machine Learning
Natural Language Processing
Entities
Key Phrases
Language
Sentiment
Topics

29.
Accionlabs Artificial Intelligence | Machine Learning
Application of AI: Natural Language Processing
Business Applications
Entity Recognition
Sentiment Analysis
Content Classification
Language Translation, Speech Recognition
Conversational Dialog Agent / Chatbots
Syntax Analysis (Key Phrases, Language
Understanding)
Techniques
Recurrent Neural Network
Latent Dirichlet Allocation (LDA)
Neural Topic Modeling
Neural Recursive Network / Attention Network
Transfer Learning
Seq-to-Seq + LSTM

30.
Accionlabs Artificial Intelligence | Machine Learning
Challenges
- Interoperability of Deep Learning frameworks.
- Scale Inference at Production.
- Distribution and Parallelism of ML / AI Models.
- Build reusable components that work well together (across frameworks) - UNIX Philosophy
- Train at GPU / CPU - Inference @ Mobile, Raspberry PI, Drone, Streaming Application

31.
Accionlabs Artificial Intelligence | Machine Learning
Facial Emotion Recognition: DEMO
1.
Facial
Emotion
Recognition
Convolution Neural
Network
Recurrent Neural
network
Vision i.e Camera

32.
Accionlabs Artificial Intelligence | Machine Learning
Real time object recognition : DEMO
Real time
Object
recognition
Convolution Neural
Network
Recurrent Neural
network
Vision i.e Camera

33.
Everyone has own choice of Deep Learning
Frameworks

34.
Research to Production
Everyone has own choice of Deep Learning
Frameworks
Reimplementation takes
Weeks or months

35.
Accionlabs Artificial Intelligence | Machine Learning
Deep Learning Framework Zoo
...
Framework
backends
Vendor and numeric libraries
...
O (n2
) pairs
Apple CoreML Nvidia TensorRT
Intel/Nervana
ngraph
Qualcomm SNPE

36.
Accionlabs Artificial Intelligence | Machine Learning
Open Neural Network Exchange (ONNX)
...
Framework
backends
Vendor and numeric libraries
...
Apple CoreML Nvidia TensorRT
Intel/Nervana
ngraph
Qualcomm SNPE
Shared model and operator representation
From O(n2
) to O(n) pairs

37.
Accionlabs Artificial Intelligence | Machine Learning
Train at GPU, Inference at Mobile App !
...
Apple CoreML TensorFlow Light

38.
Accionlabs Artificial Intelligence | Machine Learning
Thanks !
@khatri_chetan chetan.khatri@accionlabs.com