SlideShare ist ein Scribd-Unternehmen logo
1 von 32
INDUSTRIALIZE AI WITH ENTERPRISE SCALE
MACHINE LEARNING
Hilary Mason, GM of Machine Learning, Cloudera
2 © Cloudera, Inc. All rights reserved.
Welcome!
3 © Cloudera, Inc. All rights reserved.
LET’S MAKE MACHINE LEARNING BORING.
4 © Cloudera, Inc. All rights reserved.
AI IS CHANGING
THE WORLD
5 © Cloudera, Inc. All rights reserved.
OR IS IT
MUNDANE?
6 © Cloudera, Inc. All rights reserved.
MOVING FROM EXPLORATION TO PRODUCTION OF ML & AI
WE’RE WITNESSING THE INDUSTRIALIZATION OF AI
FROM THE LAB… TO THE FACTORY
7 © Cloudera, Inc. All rights reserved.
WHAT DOES
GREAT AI LOOK
LIKE?
REDUCING CALL CENTER
COSTS
8 © Cloudera, Inc. All rights reserved.
NEW BUSINESS
OPPORTUNITIES
NEW REVENUE AND NEW
PRODUCT OPPORTUNITIES
9 © Cloudera, Inc. All rights reserved.
WORKFLOWS FOR EFFECTIVE ML
DONE WELL, THE VALUE GENERATED BY MACHINE LEARNING GROWS OVER TIME
9
DEVELOPMENT PRODUCTIONSTRATEGY
critical business
infrastructure
research and explorationprioritization and use case
identification
10 © Cloudera, Inc. All rights reserved.
IT’S TIME TO
GROW UP
• Even when companies
are great at this, best
practices are
inconsistent.
• As we mature in
understanding value,
we’re able to address
new opportunities.
• Avoid common failure
modes!
• Optimize for scale.
11 © Cloudera, Inc. All rights reserved.
12 © Cloudera, Inc. All rights reserved.
ENTERPRISE-GRADE SCALE
WHETHER YOU ARE A FORTUNE 100 OR A STARTUP
SECURITY,
GOVERNANCE,
COMPLIANCE
STRATEGY PEOPLE &
ORGANIZATION
TECHNOLOGY
13 © Cloudera, Inc. All rights reserved.
VISION AND STRATEGY SCALE
MOVING FROM SINGLE PROJECTS TO A REPEATABLE MACHINE
• Strategic vision and prioritization
frameworks
• Who is best positioned to identify ML
opportunities?
• It’s not just ROI vs Cost
• These are investments!
© Cloudera, Inc. All rights reserved.
STRATEGIC INVESTMENT FRAMEWORK
•IT’S NOT A SOFTWARE PROJECT, IT’S A PORTFOLIO INVESTMENT MODEL
15 © Cloudera, Inc. All rights reserved.
SECURITY,
GOVERNANCE,
COMPLIANCE
16 © Cloudera, Inc. All rights reserved.
FEDERATED LEARNING
New research from Cloudera Fast Forward Labs
• Train a model on distributed data across
devices or end-points.
• Share models, rather than data, preserving
privacy and reducing communication costs.
• Shift the burden of training out of
datacenter infrastructure and onto edge
devices
• Webinar Nov 15th https://bit.ly/2yZsceH
17 © Cloudera, Inc. All rights reserved.
ETHICS OF
PRACTICE IN
DATA SCIENCE –
FOR
PRACTITIONERS
Available now:
https://amzn.to/2oUsZZ3
18 © Cloudera, Inc. All rights reserved.
SCALING
PEOPLE &
ORGANIZATIONS
19 © Cloudera, Inc. All rights reserved.
MANY FAILURE MODES
What to think about
• Who does data science work?
• How is the org structured?
• How do they work together?
• How is it governed?
• What’s your flavor of the ML lifecycle?
• Do people trust machine learning?
20 © Cloudera, Inc. All rights reserved.
TECHNOLOGY
SCALE
21 © Cloudera, Inc. All rights reserved.
THE VISION: MAKE THIS EASY
Systematic process to
discover and prioritize
opportunities for ML and AI
OPPORTUNITY
DISCOVERY
“AI FACTORY”
Agile platform to build, train,
and deploy ML applications
BUSINESS
TRANSFORMATION
Capability to absorb
business transformation
and discover next
opportunity
22 © Cloudera, Inc. All rights reserved.22
AI
MACHINE
LEARNING
DATA SCIENCE
ANALYTICS
"BIG DATA"
23 © Cloudera, Inc. All rights reserved.
THE FUTURE
24© Cloudera, Inc. All rights reserved.
OUR APPROACH
MODERN ENTERPRISE PLATFORM, TOOLS AND EXPERT GUIDANCE TO HELP YOU
UNLOCK BUSINESS VALUE WITH ML/AI
Agile platform to build,
train, and deploy
scalable ML
applications
Enterprise data science
tools to accelerate
team productivity
Expert guidance,
services & training to
fast track value & scale
25 © Cloudera, Inc. All rights reserved.
AS NEW TECH CAPABILITIES EMERGE, BE READY
THE LATEST RESEARCH
MULTI-TASK LEARNING FROM CLOUDERA FAST FORWARD LABS
26 © Cloudera, Inc. All rights reserved.
EVOLVING OUR DNA
27 © Cloudera, Inc. All rights reserved.27
MARKET DEVELOPMENT & PHASES OF GROWTH
BIG DATA
TECH
DATA
PLATFORM
CIO
& Data Admins
ML, ANALYTICS
& CLOUD
LOB
& Data ScientistsIT early adopters
& Developers
INDUSTRIAL AI
C-suite &
Boards
28 © Cloudera, Inc. All rights reserved. 28
enable the modern machine learning lifecycle
for thousands of applications with an open enterprise platform
across petabytes of data and heterogeneous compute
Rapid provisioning and
experimentation
DevOps mindset
From development to
production
Team
collaboration
and shared
context
Any
framework,
your data, your
models
Secure by default
CPUs, GPUS, TPUs,
and beyond
Massive, diverse
data
Automation Runs anywhere
29 © Cloudera, Inc. All rights reserved.
HOW CAN CLOUDERA HELP CUSTOMERS INDUSTRIALIZE AI?
Manage pipelines + models
Deploy models
Automate pipelines
Monitor performance
DEPLOYDEVELOP
Make teams more productive
Explore data
Develop reports, pipelines, models
Collaborate with peers
TRAIN
Scale resources efficiently
Train models
Tune parameters
Track performance
DELIVER THE PLATFORM TO ACCELERATE AI DEVELOPMENT AT SCALE, ANYWHERE
MANAGE
Run anywhere with a common architecture
Manage access and resources
Scale cost with usage
30 © Cloudera, Inc. All rights reserved.
PLATFORM FOR ENTERPRISE AI, OPTIMIZED FOR THE CLOUD
NEW CONTAINERIZED MACHINE LEARNING PRODUCTS WITH A COMMON RUNTIME
CLOUDERA
DATA WAREHOUSE
Kubernetes
S3 ADLSDBMS
HDFS KUDU
Spark-on-YARN
CLOUDERA MACHINE LEARNING
DATA SCIENCE DATA ENGINEERING MODEL MANAGEMENT
CLOUDERA AI RUNTIME (CPU/GPU-optimized Python/R, Spark, …)
SHARED WORKSPACES FEATURE + MODEL CATALOG
31 © Cloudera, Inc. All rights reserved.
[future]
THANK YOU

Weitere ähnliche Inhalte

Mehr von Cloudera, Inc.

Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19
Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19
Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19Cloudera, Inc.
 
Leveraging the cloud for analytics and machine learning 1.29.19
Leveraging the cloud for analytics and machine learning 1.29.19Leveraging the cloud for analytics and machine learning 1.29.19
Leveraging the cloud for analytics and machine learning 1.29.19Cloudera, Inc.
 
Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19
Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19
Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19Cloudera, Inc.
 
Leveraging the Cloud for Big Data Analytics 12.11.18
Leveraging the Cloud for Big Data Analytics 12.11.18Leveraging the Cloud for Big Data Analytics 12.11.18
Leveraging the Cloud for Big Data Analytics 12.11.18Cloudera, Inc.
 
Modern Data Warehouse Fundamentals Part 3
Modern Data Warehouse Fundamentals Part 3Modern Data Warehouse Fundamentals Part 3
Modern Data Warehouse Fundamentals Part 3Cloudera, Inc.
 
Modern Data Warehouse Fundamentals Part 2
Modern Data Warehouse Fundamentals Part 2Modern Data Warehouse Fundamentals Part 2
Modern Data Warehouse Fundamentals Part 2Cloudera, Inc.
 
Modern Data Warehouse Fundamentals Part 1
Modern Data Warehouse Fundamentals Part 1Modern Data Warehouse Fundamentals Part 1
Modern Data Warehouse Fundamentals Part 1Cloudera, Inc.
 
Extending Cloudera SDX beyond the Platform
Extending Cloudera SDX beyond the PlatformExtending Cloudera SDX beyond the Platform
Extending Cloudera SDX beyond the PlatformCloudera, Inc.
 
Federated Learning: ML with Privacy on the Edge 11.15.18
Federated Learning: ML with Privacy on the Edge 11.15.18Federated Learning: ML with Privacy on the Edge 11.15.18
Federated Learning: ML with Privacy on the Edge 11.15.18Cloudera, Inc.
 
Analyst Webinar: Doing a 180 on Customer 360
Analyst Webinar: Doing a 180 on Customer 360Analyst Webinar: Doing a 180 on Customer 360
Analyst Webinar: Doing a 180 on Customer 360Cloudera, Inc.
 
Build a modern platform for anti-money laundering 9.19.18
Build a modern platform for anti-money laundering 9.19.18Build a modern platform for anti-money laundering 9.19.18
Build a modern platform for anti-money laundering 9.19.18Cloudera, Inc.
 
Introducing the data science sandbox as a service 8.30.18
Introducing the data science sandbox as a service 8.30.18Introducing the data science sandbox as a service 8.30.18
Introducing the data science sandbox as a service 8.30.18Cloudera, Inc.
 
Introducing Workload XM 8.7.18
Introducing Workload XM 8.7.18Introducing Workload XM 8.7.18
Introducing Workload XM 8.7.18Cloudera, Inc.
 
Get started with Cloudera's cyber solution
Get started with Cloudera's cyber solutionGet started with Cloudera's cyber solution
Get started with Cloudera's cyber solutionCloudera, Inc.
 
Spark and Deep Learning Frameworks at Scale 7.19.18
Spark and Deep Learning Frameworks at Scale 7.19.18Spark and Deep Learning Frameworks at Scale 7.19.18
Spark and Deep Learning Frameworks at Scale 7.19.18Cloudera, Inc.
 
Cloud Data Warehousing with Cloudera Altus 7.24.18
Cloud Data Warehousing with Cloudera Altus 7.24.18Cloud Data Warehousing with Cloudera Altus 7.24.18
Cloud Data Warehousing with Cloudera Altus 7.24.18Cloudera, Inc.
 
How Cloudera SDX can aid GDPR compliance
How Cloudera SDX can aid GDPR complianceHow Cloudera SDX can aid GDPR compliance
How Cloudera SDX can aid GDPR complianceCloudera, Inc.
 
When SAP alone is not enough
When SAP alone is not enoughWhen SAP alone is not enough
When SAP alone is not enoughCloudera, Inc.
 
Multi task learning stepping away from narrow expert models 7.11.18
Multi task learning stepping away from narrow expert models 7.11.18Multi task learning stepping away from narrow expert models 7.11.18
Multi task learning stepping away from narrow expert models 7.11.18Cloudera, Inc.
 

Mehr von Cloudera, Inc. (20)

Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19
Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19
Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19
 
Leveraging the cloud for analytics and machine learning 1.29.19
Leveraging the cloud for analytics and machine learning 1.29.19Leveraging the cloud for analytics and machine learning 1.29.19
Leveraging the cloud for analytics and machine learning 1.29.19
 
Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19
Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19
Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19
 
Leveraging the Cloud for Big Data Analytics 12.11.18
Leveraging the Cloud for Big Data Analytics 12.11.18Leveraging the Cloud for Big Data Analytics 12.11.18
Leveraging the Cloud for Big Data Analytics 12.11.18
 
Modern Data Warehouse Fundamentals Part 3
Modern Data Warehouse Fundamentals Part 3Modern Data Warehouse Fundamentals Part 3
Modern Data Warehouse Fundamentals Part 3
 
Modern Data Warehouse Fundamentals Part 2
Modern Data Warehouse Fundamentals Part 2Modern Data Warehouse Fundamentals Part 2
Modern Data Warehouse Fundamentals Part 2
 
Modern Data Warehouse Fundamentals Part 1
Modern Data Warehouse Fundamentals Part 1Modern Data Warehouse Fundamentals Part 1
Modern Data Warehouse Fundamentals Part 1
 
Extending Cloudera SDX beyond the Platform
Extending Cloudera SDX beyond the PlatformExtending Cloudera SDX beyond the Platform
Extending Cloudera SDX beyond the Platform
 
Federated Learning: ML with Privacy on the Edge 11.15.18
Federated Learning: ML with Privacy on the Edge 11.15.18Federated Learning: ML with Privacy on the Edge 11.15.18
Federated Learning: ML with Privacy on the Edge 11.15.18
 
Analyst Webinar: Doing a 180 on Customer 360
Analyst Webinar: Doing a 180 on Customer 360Analyst Webinar: Doing a 180 on Customer 360
Analyst Webinar: Doing a 180 on Customer 360
 
Build a modern platform for anti-money laundering 9.19.18
Build a modern platform for anti-money laundering 9.19.18Build a modern platform for anti-money laundering 9.19.18
Build a modern platform for anti-money laundering 9.19.18
 
Introducing the data science sandbox as a service 8.30.18
Introducing the data science sandbox as a service 8.30.18Introducing the data science sandbox as a service 8.30.18
Introducing the data science sandbox as a service 8.30.18
 
Cloudera SDX
Cloudera SDXCloudera SDX
Cloudera SDX
 
Introducing Workload XM 8.7.18
Introducing Workload XM 8.7.18Introducing Workload XM 8.7.18
Introducing Workload XM 8.7.18
 
Get started with Cloudera's cyber solution
Get started with Cloudera's cyber solutionGet started with Cloudera's cyber solution
Get started with Cloudera's cyber solution
 
Spark and Deep Learning Frameworks at Scale 7.19.18
Spark and Deep Learning Frameworks at Scale 7.19.18Spark and Deep Learning Frameworks at Scale 7.19.18
Spark and Deep Learning Frameworks at Scale 7.19.18
 
Cloud Data Warehousing with Cloudera Altus 7.24.18
Cloud Data Warehousing with Cloudera Altus 7.24.18Cloud Data Warehousing with Cloudera Altus 7.24.18
Cloud Data Warehousing with Cloudera Altus 7.24.18
 
How Cloudera SDX can aid GDPR compliance
How Cloudera SDX can aid GDPR complianceHow Cloudera SDX can aid GDPR compliance
How Cloudera SDX can aid GDPR compliance
 
When SAP alone is not enough
When SAP alone is not enoughWhen SAP alone is not enough
When SAP alone is not enough
 
Multi task learning stepping away from narrow expert models 7.11.18
Multi task learning stepping away from narrow expert models 7.11.18Multi task learning stepping away from narrow expert models 7.11.18
Multi task learning stepping away from narrow expert models 7.11.18
 

Kürzlich hochgeladen

CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 

Kürzlich hochgeladen (20)

CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 

Industrialize AI with Enterprise Scale Machine Learning 11.7.18

  • 1. INDUSTRIALIZE AI WITH ENTERPRISE SCALE MACHINE LEARNING Hilary Mason, GM of Machine Learning, Cloudera
  • 2. 2 © Cloudera, Inc. All rights reserved. Welcome!
  • 3. 3 © Cloudera, Inc. All rights reserved. LET’S MAKE MACHINE LEARNING BORING.
  • 4. 4 © Cloudera, Inc. All rights reserved. AI IS CHANGING THE WORLD
  • 5. 5 © Cloudera, Inc. All rights reserved. OR IS IT MUNDANE?
  • 6. 6 © Cloudera, Inc. All rights reserved. MOVING FROM EXPLORATION TO PRODUCTION OF ML & AI WE’RE WITNESSING THE INDUSTRIALIZATION OF AI FROM THE LAB… TO THE FACTORY
  • 7. 7 © Cloudera, Inc. All rights reserved. WHAT DOES GREAT AI LOOK LIKE? REDUCING CALL CENTER COSTS
  • 8. 8 © Cloudera, Inc. All rights reserved. NEW BUSINESS OPPORTUNITIES NEW REVENUE AND NEW PRODUCT OPPORTUNITIES
  • 9. 9 © Cloudera, Inc. All rights reserved. WORKFLOWS FOR EFFECTIVE ML DONE WELL, THE VALUE GENERATED BY MACHINE LEARNING GROWS OVER TIME 9 DEVELOPMENT PRODUCTIONSTRATEGY critical business infrastructure research and explorationprioritization and use case identification
  • 10. 10 © Cloudera, Inc. All rights reserved. IT’S TIME TO GROW UP • Even when companies are great at this, best practices are inconsistent. • As we mature in understanding value, we’re able to address new opportunities. • Avoid common failure modes! • Optimize for scale.
  • 11. 11 © Cloudera, Inc. All rights reserved.
  • 12. 12 © Cloudera, Inc. All rights reserved. ENTERPRISE-GRADE SCALE WHETHER YOU ARE A FORTUNE 100 OR A STARTUP SECURITY, GOVERNANCE, COMPLIANCE STRATEGY PEOPLE & ORGANIZATION TECHNOLOGY
  • 13. 13 © Cloudera, Inc. All rights reserved. VISION AND STRATEGY SCALE MOVING FROM SINGLE PROJECTS TO A REPEATABLE MACHINE • Strategic vision and prioritization frameworks • Who is best positioned to identify ML opportunities? • It’s not just ROI vs Cost • These are investments!
  • 14. © Cloudera, Inc. All rights reserved. STRATEGIC INVESTMENT FRAMEWORK •IT’S NOT A SOFTWARE PROJECT, IT’S A PORTFOLIO INVESTMENT MODEL
  • 15. 15 © Cloudera, Inc. All rights reserved. SECURITY, GOVERNANCE, COMPLIANCE
  • 16. 16 © Cloudera, Inc. All rights reserved. FEDERATED LEARNING New research from Cloudera Fast Forward Labs • Train a model on distributed data across devices or end-points. • Share models, rather than data, preserving privacy and reducing communication costs. • Shift the burden of training out of datacenter infrastructure and onto edge devices • Webinar Nov 15th https://bit.ly/2yZsceH
  • 17. 17 © Cloudera, Inc. All rights reserved. ETHICS OF PRACTICE IN DATA SCIENCE – FOR PRACTITIONERS Available now: https://amzn.to/2oUsZZ3
  • 18. 18 © Cloudera, Inc. All rights reserved. SCALING PEOPLE & ORGANIZATIONS
  • 19. 19 © Cloudera, Inc. All rights reserved. MANY FAILURE MODES What to think about • Who does data science work? • How is the org structured? • How do they work together? • How is it governed? • What’s your flavor of the ML lifecycle? • Do people trust machine learning?
  • 20. 20 © Cloudera, Inc. All rights reserved. TECHNOLOGY SCALE
  • 21. 21 © Cloudera, Inc. All rights reserved. THE VISION: MAKE THIS EASY Systematic process to discover and prioritize opportunities for ML and AI OPPORTUNITY DISCOVERY “AI FACTORY” Agile platform to build, train, and deploy ML applications BUSINESS TRANSFORMATION Capability to absorb business transformation and discover next opportunity
  • 22. 22 © Cloudera, Inc. All rights reserved.22 AI MACHINE LEARNING DATA SCIENCE ANALYTICS "BIG DATA"
  • 23. 23 © Cloudera, Inc. All rights reserved. THE FUTURE
  • 24. 24© Cloudera, Inc. All rights reserved. OUR APPROACH MODERN ENTERPRISE PLATFORM, TOOLS AND EXPERT GUIDANCE TO HELP YOU UNLOCK BUSINESS VALUE WITH ML/AI Agile platform to build, train, and deploy scalable ML applications Enterprise data science tools to accelerate team productivity Expert guidance, services & training to fast track value & scale
  • 25. 25 © Cloudera, Inc. All rights reserved. AS NEW TECH CAPABILITIES EMERGE, BE READY THE LATEST RESEARCH MULTI-TASK LEARNING FROM CLOUDERA FAST FORWARD LABS
  • 26. 26 © Cloudera, Inc. All rights reserved. EVOLVING OUR DNA
  • 27. 27 © Cloudera, Inc. All rights reserved.27 MARKET DEVELOPMENT & PHASES OF GROWTH BIG DATA TECH DATA PLATFORM CIO & Data Admins ML, ANALYTICS & CLOUD LOB & Data ScientistsIT early adopters & Developers INDUSTRIAL AI C-suite & Boards
  • 28. 28 © Cloudera, Inc. All rights reserved. 28 enable the modern machine learning lifecycle for thousands of applications with an open enterprise platform across petabytes of data and heterogeneous compute Rapid provisioning and experimentation DevOps mindset From development to production Team collaboration and shared context Any framework, your data, your models Secure by default CPUs, GPUS, TPUs, and beyond Massive, diverse data Automation Runs anywhere
  • 29. 29 © Cloudera, Inc. All rights reserved. HOW CAN CLOUDERA HELP CUSTOMERS INDUSTRIALIZE AI? Manage pipelines + models Deploy models Automate pipelines Monitor performance DEPLOYDEVELOP Make teams more productive Explore data Develop reports, pipelines, models Collaborate with peers TRAIN Scale resources efficiently Train models Tune parameters Track performance DELIVER THE PLATFORM TO ACCELERATE AI DEVELOPMENT AT SCALE, ANYWHERE MANAGE Run anywhere with a common architecture Manage access and resources Scale cost with usage
  • 30. 30 © Cloudera, Inc. All rights reserved. PLATFORM FOR ENTERPRISE AI, OPTIMIZED FOR THE CLOUD NEW CONTAINERIZED MACHINE LEARNING PRODUCTS WITH A COMMON RUNTIME CLOUDERA DATA WAREHOUSE Kubernetes S3 ADLSDBMS HDFS KUDU Spark-on-YARN CLOUDERA MACHINE LEARNING DATA SCIENCE DATA ENGINEERING MODEL MANAGEMENT CLOUDERA AI RUNTIME (CPU/GPU-optimized Python/R, Spark, …) SHARED WORKSPACES FEATURE + MODEL CATALOG
  • 31. 31 © Cloudera, Inc. All rights reserved. [future]