SlideShare a Scribd company logo
1 of 29
Bank of America Merrill Lynch
 Who am I?
Sr. SharePoint Architect
16+ years in the IT industry
10+ years in SharePoint
bhakthil@gmail.com
@bhakthil
https://www.linkedin.com/pub/bhakthi-liyanage/14/15/912
https://github.com/bhakthil
Thanks to our sponsors
Platinum
Gold
Bronze
Northern VA CodeCamp Spring 2016
Thanks to host sponsor
Northern VA CodeCamp Spring 2016
• Introducing machine learning
• Introducing Azure Machine Learning
• Machine Learning Lifecycle
• Demo
• Summary
• Q & A
Academic Definition
Machine learning is a subfield of computer science that evolved
from the study of pattern recognition and computational learning
theory in artificial intelligence. Machine learning explores the
study and construction of algorithms that can learn from and
make predictions on data.
Simple Definition
Computing systems that become smarter with learning and
experience
Experience = Past data + human input
• Need to know of the future
• Being able to predict the future with a reasonable accuracy
Reports
Yesterday Today Tomorrow
Business Intelligence
Predictive Analytics
Predictability
Time
A highly educated and skilled person who can solve complex data problems by
employing deep expertise in scientific disciplines (mathematics, statistics or
computer science)
A skilled person who creates or maintains data systems, data solutions, or
implements predictive modelling
Roles: Database Administrator, Database Developer, or BI Developer
A skilled person who designs and develops programming logic, and can apply
machine learning to integrate predictive functionality into applications
 What problems are we
trying to solve?
◦ Anomaly detection
◦ Customer churn
◦ Predictive maintenance
◦ Recommendations system
 What data do we have or
do we have any data at
all?
◦ Data already available via sensory
systems, transactional databases,
customer sales databases, etc.
Predictive
maintenance
Vision
Analytics
Recommenda-
tion engines
Advertising
analysis
Weather
forecasting for
business
planning
Social network
analysis
Legal
discovery and
document
archiving
Pricing analysis
Fraud
detection
Churn
analysis
Equipment
monitoring
Location-
based tracking
and services
Personalized
Insurance
 Data Consist of
◦ Features (aka input parameters) : The data that
is fed in to the model
◦ Identify which features relevant for the problem
◦ Labels : Historical result of each observation
 Training Data
◦ Pairing of features and label
◦ Historical
 Data Validation
◦ Used to verify the trained model
 Supervised
◦ Machine learning task of inferring a function/model from labeled
training data or examples
◦ Training data consist of both features and labels
 Un-supervised
◦ Machine learning task of inferring a function to describe hidden
structure from unlabeled data
◦ Data contains only features
 Enables powerful cloud-based predictive analytics
 Professionals can easily build, deploy and share
advanced analytics solutions
 Browser based, Rapid Deployment
 Connects seamlessly with other Azure data-related services,
including:
 Azure HDInsight (Big Data)
 Azure SQL Database, and
 Virtual Machines
 Models are consumed via ML API service
Machine learning lifecycle
Define
Objective
Collect
Data
Prepare
Data
Train
Models
Evaluate
Models
Deploy
Manage
Integrate
 It is important to start a machine learning project with a
clearly defined objective
I need to predict
customer churn rate
for next 6 months…
Define
Objective
I need to suggest
relevant products to
the customers
I need to know when
my manufacturing
equipment will fail
 Collecting complete data is critical
◦ Garbage in ► Garbage out 
 Datasets can be sourced from:
◦ Internal sources, i.e. operational systems, data warehouse, etc.
◦ External sources
◦ Different formats, i.e. relational, multidimensional, text, map-
reduce
 Combining datasets can enrich data
◦ E.g., integrate internal data to external data like weather, or
market intelligence data
◦ Weather data with flight delay data
◦ Population data with energy consumption data
Collect
Data
 Prepare data for machine learning
◦ Transform to cleanse, reduce or reformat
◦ Isolate and flag abnormal data
◦ Appropriately substitute missing values
◦ Categorize continuous values into ranges
◦ Normalize continuous values between 0 and 1
 Of course, having the required data to begin with is
important
◦ When designing systems, give consideration to attributes that
may be required as inputs for future modeling, e.g.
demographic data: Birth date, gender, etc.
Prepare
Data
 This stage is iterative, and experimentation involves:
◦ Selecting a machine learning algorithm
◦ Defining inputs and outputs
◦ Optimizing by configuring algorithm parameters
 Model evaluation is critical to determine:
◦ Accuracy, Reliability, Usefulness
Train
Models
Evaluate
Models
 First, add a scoring experiment
– Training logic is replaced with a trained model
– Inputs and output end-points are added
– Module properties can be parameterized
 Publish the experiment to the gallery
– Learn from others by discovering experiments
– Contribute and showcase your experiments
Deploy
Integrate
 Integrate the experiment with external applications
– Integration offers REST web service end points
– Each web service offers two methods:
• Request/Response Service (RRS) ► Low latency, highly scalable web
service
• Batch Execution Service (BES) ► High volume, asynchronous scoring of
many records
Stream analytics, blob
storage,
Azure SQL, HDInsight
Azure ML Services
Clients
Azure ML
Studio
ML web service end-
points
Data Model Development Model Deployment Operationalize
Power BI/DashboardsMobile AppsWeb Apps
Azure Portal
Azure Ops Team
ML Studio
Data Scientist
HDInsight
Azure Storage
Desktop Data
Azure Portal &
ML API service
Azure Ops Team
ML API service Developer
ML Studio
and the Data Professional
• Access and prepare data
• Create, test and train models
• Collaborate
• One click to stage for
production via the API service
AzurePortal&MLAPIservice
and the Azure Ops Team
• Create ML Studio workspace
• Assign storage account(s)
• Monitor ML consumption
• See alerts when model is ready
• Deploy models to web service
ML API service and the Application Developer
• Tested models available as a URL that can be called from any endpoint
Business users easily access results
from anywhere, on any device
Quick and easy extensibility with cloud
functions such as
Power BI, Hadoop (Azure HDInsight) and cloud
storage
Machine Learning is a subfield of computer science and
statistics that deals with the construction and study of
systems that can learn from data.
Azure Machine Learning key attributes:
Fully managed ► No hardware or software to buy
Integrated ► Drag, drop, connect and configure
Best-in-class algorithms ► Proven solutions from Xbox and Bing
R built in ► Use over 400 R packages, or bring your own R or Python code
Deploy in minutes ► Operationalize with a click
Flexible consumption ► Any device capable of consuming REST API
Machine Learning is now approachable to developers
Q & A
Getting started with data analytics with azure machine learning

More Related Content

Viewers also liked

Setting up a Machine Learning Platform
Setting up a Machine Learning PlatformSetting up a Machine Learning Platform
Setting up a Machine Learning Platform10x Nation
 
Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...Bruno Paulino
 
The Past, Present, and Future of Machine Learning APIs
The Past, Present, and Future of Machine Learning APIsThe Past, Present, and Future of Machine Learning APIs
The Past, Present, and Future of Machine Learning APIsBigML, Inc
 
Using Azure Machine Learning to Detect Patterns in Data from Devices
Using Azure Machine Learning to Detect Patterns in Data from DevicesUsing Azure Machine Learning to Detect Patterns in Data from Devices
Using Azure Machine Learning to Detect Patterns in Data from DevicesBizTalk360
 
Solving business problems: No-code approach with SharePoint designer workflow...
Solving business problems: No-code approach with SharePoint designer workflow...Solving business problems: No-code approach with SharePoint designer workflow...
Solving business problems: No-code approach with SharePoint designer workflow...Bhakthi Liyanage
 
Introduction to Machine Learning on Apache Spark MLlib by Juliet Hougland, Se...
Introduction to Machine Learning on Apache Spark MLlib by Juliet Hougland, Se...Introduction to Machine Learning on Apache Spark MLlib by Juliet Hougland, Se...
Introduction to Machine Learning on Apache Spark MLlib by Juliet Hougland, Se...Cloudera, Inc.
 
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...Bhakthi Liyanage
 
Amazon Machine Learning Case Study: Predicting Customer Churn
Amazon Machine Learning Case Study: Predicting Customer ChurnAmazon Machine Learning Case Study: Predicting Customer Churn
Amazon Machine Learning Case Study: Predicting Customer ChurnAmazon Web Services
 
Analyzing StackExchange data with Azure Data Lake
Analyzing StackExchange data with Azure Data LakeAnalyzing StackExchange data with Azure Data Lake
Analyzing StackExchange data with Azure Data LakeBizTalk360
 
Transform your Business with AI, Deep Learning and Machine Learning
Transform your Business with AI, Deep Learning and Machine LearningTransform your Business with AI, Deep Learning and Machine Learning
Transform your Business with AI, Deep Learning and Machine LearningSri Ambati
 
Microsoft Azure vs Amazon Web Services (AWS) Services & Feature Mapping
Microsoft Azure vs Amazon Web Services (AWS) Services & Feature MappingMicrosoft Azure vs Amazon Web Services (AWS) Services & Feature Mapping
Microsoft Azure vs Amazon Web Services (AWS) Services & Feature MappingIlyas F ☁☁☁
 
Compare Clouds: Aws vs Azure vs Google vs SoftLayer
Compare Clouds: Aws vs Azure vs Google vs SoftLayerCompare Clouds: Aws vs Azure vs Google vs SoftLayer
Compare Clouds: Aws vs Azure vs Google vs SoftLayerRightScale
 

Viewers also liked (15)

Setting up a Machine Learning Platform
Setting up a Machine Learning PlatformSetting up a Machine Learning Platform
Setting up a Machine Learning Platform
 
Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...
 
The Past, Present, and Future of Machine Learning APIs
The Past, Present, and Future of Machine Learning APIsThe Past, Present, and Future of Machine Learning APIs
The Past, Present, and Future of Machine Learning APIs
 
Using Azure Machine Learning to Detect Patterns in Data from Devices
Using Azure Machine Learning to Detect Patterns in Data from DevicesUsing Azure Machine Learning to Detect Patterns in Data from Devices
Using Azure Machine Learning to Detect Patterns in Data from Devices
 
Solving business problems: No-code approach with SharePoint designer workflow...
Solving business problems: No-code approach with SharePoint designer workflow...Solving business problems: No-code approach with SharePoint designer workflow...
Solving business problems: No-code approach with SharePoint designer workflow...
 
Introduction to Machine Learning on Apache Spark MLlib by Juliet Hougland, Se...
Introduction to Machine Learning on Apache Spark MLlib by Juliet Hougland, Se...Introduction to Machine Learning on Apache Spark MLlib by Juliet Hougland, Se...
Introduction to Machine Learning on Apache Spark MLlib by Juliet Hougland, Se...
 
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
 
Amazon Machine Learning Case Study: Predicting Customer Churn
Amazon Machine Learning Case Study: Predicting Customer ChurnAmazon Machine Learning Case Study: Predicting Customer Churn
Amazon Machine Learning Case Study: Predicting Customer Churn
 
Analyzing StackExchange data with Azure Data Lake
Analyzing StackExchange data with Azure Data LakeAnalyzing StackExchange data with Azure Data Lake
Analyzing StackExchange data with Azure Data Lake
 
Machine Learning with Apache Spark
Machine Learning with Apache SparkMachine Learning with Apache Spark
Machine Learning with Apache Spark
 
Big Data and Analytics on AWS
Big Data and Analytics on AWS Big Data and Analytics on AWS
Big Data and Analytics on AWS
 
AWS vs. Azure
AWS vs. AzureAWS vs. Azure
AWS vs. Azure
 
Transform your Business with AI, Deep Learning and Machine Learning
Transform your Business with AI, Deep Learning and Machine LearningTransform your Business with AI, Deep Learning and Machine Learning
Transform your Business with AI, Deep Learning and Machine Learning
 
Microsoft Azure vs Amazon Web Services (AWS) Services & Feature Mapping
Microsoft Azure vs Amazon Web Services (AWS) Services & Feature MappingMicrosoft Azure vs Amazon Web Services (AWS) Services & Feature Mapping
Microsoft Azure vs Amazon Web Services (AWS) Services & Feature Mapping
 
Compare Clouds: Aws vs Azure vs Google vs SoftLayer
Compare Clouds: Aws vs Azure vs Google vs SoftLayerCompare Clouds: Aws vs Azure vs Google vs SoftLayer
Compare Clouds: Aws vs Azure vs Google vs SoftLayer
 

Recently uploaded

VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiVIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiSuhani Kapoor
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxolyaivanovalion
 
Data-Analysis for Chicago Crime Data 2023
Data-Analysis for Chicago Crime Data  2023Data-Analysis for Chicago Crime Data  2023
Data-Analysis for Chicago Crime Data 2023ymrp368
 
Ukraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICSUkraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICSAishani27
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Callshivangimorya083
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxolyaivanovalion
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxJohnnyPlasten
 
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改atducpo
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysismanisha194592
 
100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptxAnupama Kate
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz1
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfLars Albertsson
 
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiLow Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiSuhani Kapoor
 
Halmar dropshipping via API with DroFx
Halmar  dropshipping  via API with DroFxHalmar  dropshipping  via API with DroFx
Halmar dropshipping via API with DroFxolyaivanovalion
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Delhi Call girls
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxolyaivanovalion
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxolyaivanovalion
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxolyaivanovalion
 

Recently uploaded (20)

VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiVIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
 
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
Data-Analysis for Chicago Crime Data 2023
Data-Analysis for Chicago Crime Data  2023Data-Analysis for Chicago Crime Data  2023
Data-Analysis for Chicago Crime Data 2023
 
Ukraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICSUkraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICS
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
 
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
 
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signals
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdf
 
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiLow Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
 
Halmar dropshipping via API with DroFx
Halmar  dropshipping  via API with DroFxHalmar  dropshipping  via API with DroFx
Halmar dropshipping via API with DroFx
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFx
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptx
 

Getting started with data analytics with azure machine learning

  • 1.
  • 2. Bank of America Merrill Lynch  Who am I? Sr. SharePoint Architect 16+ years in the IT industry 10+ years in SharePoint bhakthil@gmail.com @bhakthil https://www.linkedin.com/pub/bhakthi-liyanage/14/15/912 https://github.com/bhakthil
  • 3. Thanks to our sponsors Platinum Gold Bronze Northern VA CodeCamp Spring 2016
  • 4. Thanks to host sponsor Northern VA CodeCamp Spring 2016
  • 5. • Introducing machine learning • Introducing Azure Machine Learning • Machine Learning Lifecycle • Demo • Summary • Q & A
  • 6.
  • 7. Academic Definition Machine learning is a subfield of computer science that evolved from the study of pattern recognition and computational learning theory in artificial intelligence. Machine learning explores the study and construction of algorithms that can learn from and make predictions on data. Simple Definition Computing systems that become smarter with learning and experience Experience = Past data + human input
  • 8. • Need to know of the future
  • 9. • Being able to predict the future with a reasonable accuracy Reports Yesterday Today Tomorrow Business Intelligence Predictive Analytics Predictability Time
  • 10. A highly educated and skilled person who can solve complex data problems by employing deep expertise in scientific disciplines (mathematics, statistics or computer science) A skilled person who creates or maintains data systems, data solutions, or implements predictive modelling Roles: Database Administrator, Database Developer, or BI Developer A skilled person who designs and develops programming logic, and can apply machine learning to integrate predictive functionality into applications
  • 11.  What problems are we trying to solve? ◦ Anomaly detection ◦ Customer churn ◦ Predictive maintenance ◦ Recommendations system  What data do we have or do we have any data at all? ◦ Data already available via sensory systems, transactional databases, customer sales databases, etc. Predictive maintenance Vision Analytics Recommenda- tion engines Advertising analysis Weather forecasting for business planning Social network analysis Legal discovery and document archiving Pricing analysis Fraud detection Churn analysis Equipment monitoring Location- based tracking and services Personalized Insurance
  • 12.  Data Consist of ◦ Features (aka input parameters) : The data that is fed in to the model ◦ Identify which features relevant for the problem ◦ Labels : Historical result of each observation  Training Data ◦ Pairing of features and label ◦ Historical  Data Validation ◦ Used to verify the trained model
  • 13.  Supervised ◦ Machine learning task of inferring a function/model from labeled training data or examples ◦ Training data consist of both features and labels  Un-supervised ◦ Machine learning task of inferring a function to describe hidden structure from unlabeled data ◦ Data contains only features
  • 14.
  • 15.  Enables powerful cloud-based predictive analytics  Professionals can easily build, deploy and share advanced analytics solutions  Browser based, Rapid Deployment  Connects seamlessly with other Azure data-related services, including:  Azure HDInsight (Big Data)  Azure SQL Database, and  Virtual Machines  Models are consumed via ML API service
  • 17.  It is important to start a machine learning project with a clearly defined objective I need to predict customer churn rate for next 6 months… Define Objective I need to suggest relevant products to the customers I need to know when my manufacturing equipment will fail
  • 18.  Collecting complete data is critical ◦ Garbage in ► Garbage out   Datasets can be sourced from: ◦ Internal sources, i.e. operational systems, data warehouse, etc. ◦ External sources ◦ Different formats, i.e. relational, multidimensional, text, map- reduce  Combining datasets can enrich data ◦ E.g., integrate internal data to external data like weather, or market intelligence data ◦ Weather data with flight delay data ◦ Population data with energy consumption data Collect Data
  • 19.  Prepare data for machine learning ◦ Transform to cleanse, reduce or reformat ◦ Isolate and flag abnormal data ◦ Appropriately substitute missing values ◦ Categorize continuous values into ranges ◦ Normalize continuous values between 0 and 1  Of course, having the required data to begin with is important ◦ When designing systems, give consideration to attributes that may be required as inputs for future modeling, e.g. demographic data: Birth date, gender, etc. Prepare Data
  • 20.  This stage is iterative, and experimentation involves: ◦ Selecting a machine learning algorithm ◦ Defining inputs and outputs ◦ Optimizing by configuring algorithm parameters  Model evaluation is critical to determine: ◦ Accuracy, Reliability, Usefulness Train Models Evaluate Models
  • 21.  First, add a scoring experiment – Training logic is replaced with a trained model – Inputs and output end-points are added – Module properties can be parameterized  Publish the experiment to the gallery – Learn from others by discovering experiments – Contribute and showcase your experiments Deploy
  • 22. Integrate  Integrate the experiment with external applications – Integration offers REST web service end points – Each web service offers two methods: • Request/Response Service (RRS) ► Low latency, highly scalable web service • Batch Execution Service (BES) ► High volume, asynchronous scoring of many records
  • 23. Stream analytics, blob storage, Azure SQL, HDInsight Azure ML Services Clients Azure ML Studio ML web service end- points Data Model Development Model Deployment Operationalize
  • 24. Power BI/DashboardsMobile AppsWeb Apps Azure Portal Azure Ops Team ML Studio Data Scientist HDInsight Azure Storage Desktop Data Azure Portal & ML API service Azure Ops Team ML API service Developer ML Studio and the Data Professional • Access and prepare data • Create, test and train models • Collaborate • One click to stage for production via the API service AzurePortal&MLAPIservice and the Azure Ops Team • Create ML Studio workspace • Assign storage account(s) • Monitor ML consumption • See alerts when model is ready • Deploy models to web service ML API service and the Application Developer • Tested models available as a URL that can be called from any endpoint Business users easily access results from anywhere, on any device
  • 25. Quick and easy extensibility with cloud functions such as Power BI, Hadoop (Azure HDInsight) and cloud storage
  • 26.
  • 27. Machine Learning is a subfield of computer science and statistics that deals with the construction and study of systems that can learn from data. Azure Machine Learning key attributes: Fully managed ► No hardware or software to buy Integrated ► Drag, drop, connect and configure Best-in-class algorithms ► Proven solutions from Xbox and Bing R built in ► Use over 400 R packages, or bring your own R or Python code Deploy in minutes ► Operationalize with a click Flexible consumption ► Any device capable of consuming REST API Machine Learning is now approachable to developers
  • 28. Q & A