SlideShare ist ein Scribd-Unternehmen logo
1 von 29
Principles of Artificial Intelligence
& Machine Learning
September 2017
Today’s Objectives
2
▪ Define Artificial Intelligence (AI) and describe its applications in business
▪ Discuss major drivers and influencers that are shaping the future of AI / ML
▪ Dive into Machine Learning (ML) and decode buzzwords such as “deep learning” and
“cognitive computing”
▪ Highlight analytical techniques and best practices used in AI / ML
▪ Share opportunities for students to get involved in Penn’s data science community
Introduction to
Artificial Intelligence
Defining Artificial Intelligence (AI)
Artificial Intelligence is the automation of activities we normally attribute to human thinking and
rationality, such as problem-solving, decision-making, and learning
4
Neuroscience: How do our brains process information?
Philosophy: Where does knowledge come from?
Linguistics: How does language relate to thought?
Behavioral Economics: How do you make decisions to maximize utility?
Mathematics: What can be computed?
Computer Science: How can we build an efficient computer?
ARTIFICIAL
INTELLIGENCE
Source: Artificial Intelligence: A Modern Approach (2nd Edition) by Stuart J. Russell, Peter Norvig, and Ernest Davis
Motivations for Artificial Intelligence in Business
Artificial Intelligence is sure to impact your professional career path, regardless of your role within the
business community
5Sources: McKinsey Global Institute, Executive Office Report on AI, IBM Analytics Report, Venture Scanner
Executives
▪ Proactive AI adopters have 3% to 15% higher self-reported margins
▪ 75% of executives said that AI would be “actively implemented” within 3 years
▪ Early adopters are expected to grow operating margins by >5% over three years
▪ Demand for data scientists is expected to grow by 28% between now and 2020
▪ 47% of jobs are at risk of becoming irrelevant due to AI automation
▪ 40%+ of activities are automatable in 51% of occupations
Practitioners
▪ $27B+ was spent on AI in 2016, with ~$9B coming from VC / PE
▪ 300% increase in AI-related private investments from 2013 to 2016
▪ Machine learning startups accounted for 44% of all venture funding in 2016
Investors
Societal Implications of Artificial Intelligence
Outside of the workplace, AI will also have far-reaching impact on our personal lives
6
Autonomous
Weapons
Autonomous
Industry
Autonomous
Decision-Making
Artificial
Superintelligence
Save lives and create a military
advantage in the short term
Universal Basic Income could free
people to pursue their passions
Better, faster decisions that
underweight human biases
Ability to solve a wide range of
mysteries and maladies
High potential for misuse by
rogue or artificial agents
Rampant unemployment,
inequality, and societal unrest
Introduction of artificial biases in
infrastructure, recruiting, etc.
The destruction of civilization
as we know it
Time to Impact
+
−
Modern Applications of AI Research
AI can be broken down into roughly five distinct research areas originating from the Total Turing test
7
FarmTech
Prospera
Artificial Intelligence
Machine
Vision
Therapist Chatbots
Woebot
Natural Language
Processing
Robot Bankers
Commonwealth Bank
of Australia
Robotics
Warehouse Ops
Amazon
Expert
Systems
Pro Gaming
OpenAI
Machine
Learning
Machine Vision – How Robots See
Onboard automotive sensors are pushing the boundaries of perception, and doing so cheaper than ever
8
Autonomous Truck on Top GearScanse’s 3D Environment Phoenix Aerial Systems Mapping Drone
Applications
▪ Geological mapping / imaging to monitor erosion or other
changes
▪ Doing survey work for construction projects
▪ Making accurate volumetric estimates of landfills
Companies
▪ Velodyne - Combines up to 64 emitter/receiver pairs in a
single sensor that can provide 360 degree horizontal view
▪ Scanse - Inexpensive scanning Lidar a la Velodyne
▪ Quanergy - Inexpensive solid-state Lidar. Uses non-
mechanical “phased array optics” to move laser
Natural Language Processing – How Robots Hear
In our quest to optimize for speed, efficiency and convenience, we are moving to a world where we
primarily speak to machines before reading and listening to their responses
9
Adaptive Beamforming
Enables noise reduction,
automatic speech recognition,
and speaker separation
Voice Print Identification
Enables personalization, user
identification, and biometric
authentication
Speech Synthesis
Enables mimicry of any person's
voice with predefined emotion
or intonation
“If I were to guess what our biggest
existential threat is, it’s probably
[AI]… With artificial intelligence, we
are summoning the demon.”
- Elon Musk
“AI is the new electricity. Just as
100 years ago electricity
transformed industry after
industry, AI will now do the same.”
- Andrew Ng
Artificial Intelligence
Drivers & Influencers
Rise of Big Data
Though “big data” is everyone’s least favorite buzzword, AI and ML have both benefited significantly
from the world’s ever-increasing volume, variety, and velocity of data
12
Volume: Quantity of data available for analysis
▪ Gigabytes
▪ Terabytes
▪ Petabytes
Variety: Types of data available for analysis
▪ Structured (financial metrics, demographic data, etc.)
▪ Unstructured (conversational transcripts, social media, etc.)
Velocity: How quickly data is available for analysis
▪ Real Time
▪ Near-Real Time
▪ Batch
Improvements in Software & Hardware
Both software and hardware have made significant improvements over the past several years, enabling
data scientists to develop increasingly-complex neural architectures
13
Advancements in the way data is processed… … continue to shape the future of hardware
Distributed
Processing1
Splitting workloads between
computers (nodes) in a network
Parallel
Processing2
Sharing individual jobs between
nodes within a network
In-Memory
Processing3
Processing data using RAM
instead of disk storage
Google’s Tensor
Processing Unit
Evolution of Analytical Techniques
Though today’s ML techniques are much more advanced than those used in the past, the data science
community has built a number of sophisticated tools and resources to guide the next generation
14
Input Layer Output LayerHidden Layers
x1
x2
x3
ො𝑦
ML has become both increasingly more complicated… … and significantly more accessible
Building to General Intelligence
While artificial agents have historically been limited to ‘narrow intelligence’, recent advancements in
cognitive computing are leading some to speculate that we’ll reach the Singularity within our lifetime
15
Machine
Vision
Pattern Recognition
Image Processing
3D Modeling
Augmented Reality
Virtual Reality
Machine
Learning
Supervised
Semi-Supervised
Unsupervised
Reinforcement
Robotics
Humanoid
Mobile
Manipulators
As we blend these five capabilities together to enable increasingly complex
use cases, we inch closer to the Holy Grail of AI: artificial general intelligence
Expert
Systems
Process Control
Monitoring
Diagnoses
Design
Planning
Natural Language
Processing
Translation
Topic Modeling
Sentiment Analysis
Speech to Text
Text to Speech
The Singularity
A hypothesis stating that the invention of
artificial general intelligence will
abruptly trigger runaway technological
growth, resulting in unfathomable
changes to human civilization.
Diving into
Machine Learning
Introduction to Machine Learning
Whether you realize it or not, you are impacted by machine learning every single day
18
3
Contrary to popular belief, not all ML algorithms are obscure and
overly-complex
Linear Regression
1
Machine learning algorithms are responsible for many scientific
and business model innovations
Discovery of Higgs boson
2
Deep learning architectures (e.g., recurrent, convolutional neural
networks) are to thank for a variety of modern technologies
Siri, Alexa, and Cortana
Generate predictions by
training on labeled datasets
Expose and visualize hidden
relationships and anomalies
in unlabeled datasets
Generate predictions using
a small amount of labeled
data within a larger pool of
unlabeled data
Create an agent capable of
taking environmental actions
to maximize utility over time
Four Types of Machine Learning
There are four types of problems that we aim to solve with ML, and each requires a different approach
to learning and deployment
19
Machine Learning
Supervised Unsupervised Semi-Supervised Reinforcement
Geospatial Market
Segmentation
Self-Driving
Vehicles
Handwriting
Recognition
Interactive
Recommendations
Principles of
Machine Learning
Principle #1: Generalization
When we train a machine to think, we are mostly concerned with how well it can predict the future. This
often means that we need to restrain the complexity of our model to improve its ability to generalize
21
Training Data Predictions
Time
Y
Strong Fit Overfitting (High Variance)
Training Data Predictions
Time
Y
Underfitting (High Bias)
Training Data Predictions
Time
Y
Principle #2: No Free Lunch
Unfortunately, there is no ‘magical’ algorithm that will solve all of our problems. Generating accurate
predictions requires a thorough understanding of the underlying behaviors at play within our data
22
For a given problem, pick the right algorithms… … to optimize the bias-variance trade-off
Graphic Source: Scott Fortmann-Roe
Random Forests PCA
Gradient Boosted Machines LLE
Support Vector Machines t-SNE
Multi-Layer Neural Networks LDA
Recurrent Neural Networks DBSCAN
Linear Regression K-Nearest NeighborsLogistic Regression
Multivariate Linear Reg. HCAMultinomial Logistic Reg.
Regression Classification Clustering
Convolutional Neural Networks Autoencoders
Supervised Semi-Supervised
… ….
Principle #3: Occam’s Razor
When two algorithms present similar results, there are many reasons why we should prefer the simpler
of the two
23
Significantly less costly to compute
due to their relatively simple cost
functions, accelerating insight to action
1
Less likely to encounter optimization
issues when working in lower-
dimensional spaces
2
Final solutions are generally easier to
interpret, visualize, and understand3
Gradient Descent 101 Advantages of Simplicity
Graphic Source: Sebastian Raschka
Principle #4: More Data > More Complex Algorithms
Using fancy algorithms is just one piece of the data science puzzle. Including new features or increasing
the volume of data available for training will substantially improve your results.
24
“The Unreasonable Effectiveness of Data”“We don't have better
algorithms than anyone else; we
just have more data”
- Peter Norvig, Google
Principle #5: Cross-Validation
In the same way that we cannot determine a drug’s effectiveness by only testing it on a single patient,
we need to examine our model using multiple data samples (called ‘folds’) to evaluate performance
25Graphic Source: Karl Rosaen
k-fold Cross-Validation Error
Used to evaluate how well each model
generalizes an independent data set
Cross-Validation 101
Principle #6: Algorithmic Diversity
Algorithmic diversity is key to predictive success; the combination of many simple models (“weak
learners”) can outperform much more complex algorithms (“strong learners”)
26
Model 1
CV predictions are
7% too high
Model 3
CV predictions are
5% too low
Model 2
CV predictions are
2% too low
Ensembling
Ensembled
Model
CV predictions are
0% off. Success!
Initial models are
developed independently
Model predictions are compiled
together using majority voting
Biases cancel out, giving us a much
more accurate final model
+
−
−
Ensembling 101
1 2 3
Wrapping-Up
Key Take-Aways
28
▪ We, as future business leaders, must be able to decipher the signal from
the noise with regards to AI / ML
▪ AI will have profound practical and ethical implications for our society
▪ Getting started is not as difficult as you might think
Thank you for your time
Contact Information
Nick Lind (nthorlind@gmail.com)
Jerry Lu (jylu88@gmail.com)

Weitere ähnliche Inhalte

Was ist angesagt?

ARTIFICIAL INTELLIGENCE
ARTIFICIAL INTELLIGENCEARTIFICIAL INTELLIGENCE
ARTIFICIAL INTELLIGENCEMidhuti
 
HISTORY OF ARTIFICIAL INTELLIGENCE
HISTORY OF ARTIFICIAL INTELLIGENCEHISTORY OF ARTIFICIAL INTELLIGENCE
HISTORY OF ARTIFICIAL INTELLIGENCESohiniGuha7
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial IntelligenceGirish Naik
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligencesaloni sharma
 
Artifical intelligence
Artifical intelligenceArtifical intelligence
Artifical intelligenceRizwan Afzal
 
Introduction To Artificial Intelligence Powerpoint Presentation Slides
Introduction To Artificial Intelligence Powerpoint Presentation SlidesIntroduction To Artificial Intelligence Powerpoint Presentation Slides
Introduction To Artificial Intelligence Powerpoint Presentation SlidesSlideTeam
 
Artifical Intelligence
Artifical IntelligenceArtifical Intelligence
Artifical IntelligenceHarsha Varyani
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligenceSai Nath
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligenceu053675
 
Introduction To Artificial Intelligence PowerPoint Presentation Slides
Introduction To Artificial Intelligence PowerPoint Presentation SlidesIntroduction To Artificial Intelligence PowerPoint Presentation Slides
Introduction To Artificial Intelligence PowerPoint Presentation SlidesSlideTeam
 
Artificial Intelligence Overview Powerpoint Presentation Slides
Artificial Intelligence Overview Powerpoint Presentation SlidesArtificial Intelligence Overview Powerpoint Presentation Slides
Artificial Intelligence Overview Powerpoint Presentation SlidesSlideTeam
 
9 Examples of Artificial Intelligence in Use Today
9 Examples of Artificial Intelligence in Use Today9 Examples of Artificial Intelligence in Use Today
9 Examples of Artificial Intelligence in Use TodayIQVIS
 

Was ist angesagt? (20)

ARTIFICIAL INTELLIGENCE
ARTIFICIAL INTELLIGENCEARTIFICIAL INTELLIGENCE
ARTIFICIAL INTELLIGENCE
 
HISTORY OF ARTIFICIAL INTELLIGENCE
HISTORY OF ARTIFICIAL INTELLIGENCEHISTORY OF ARTIFICIAL INTELLIGENCE
HISTORY OF ARTIFICIAL INTELLIGENCE
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
Artifical intelligence
Artifical intelligenceArtifical intelligence
Artifical intelligence
 
Ai presentation
Ai presentationAi presentation
Ai presentation
 
ARTIFICIAL INTELLIGENCE
ARTIFICIAL INTELLIGENCEARTIFICIAL INTELLIGENCE
ARTIFICIAL INTELLIGENCE
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
 
Presentation on ai
Presentation on aiPresentation on ai
Presentation on ai
 
Introduction To Artificial Intelligence Powerpoint Presentation Slides
Introduction To Artificial Intelligence Powerpoint Presentation SlidesIntroduction To Artificial Intelligence Powerpoint Presentation Slides
Introduction To Artificial Intelligence Powerpoint Presentation Slides
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
 
Artificial inteligence
Artificial inteligenceArtificial inteligence
Artificial inteligence
 
Artifical Intelligence
Artifical IntelligenceArtifical Intelligence
Artifical Intelligence
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
 
Introduction To Artificial Intelligence PowerPoint Presentation Slides
Introduction To Artificial Intelligence PowerPoint Presentation SlidesIntroduction To Artificial Intelligence PowerPoint Presentation Slides
Introduction To Artificial Intelligence PowerPoint Presentation Slides
 
Aippt
AipptAippt
Aippt
 
Artificial Intelligence Overview Powerpoint Presentation Slides
Artificial Intelligence Overview Powerpoint Presentation SlidesArtificial Intelligence Overview Powerpoint Presentation Slides
Artificial Intelligence Overview Powerpoint Presentation Slides
 
9 Examples of Artificial Intelligence in Use Today
9 Examples of Artificial Intelligence in Use Today9 Examples of Artificial Intelligence in Use Today
9 Examples of Artificial Intelligence in Use Today
 

Ähnlich wie Principles of Artificial Intelligence & Machine Learning

What is Artificial Intelligence.docx
What is Artificial Intelligence.docxWhat is Artificial Intelligence.docx
What is Artificial Intelligence.docxAliParsa22
 
Artificial Intelligence (2016) - AMP New Ventures
Artificial Intelligence (2016) - AMP New VenturesArtificial Intelligence (2016) - AMP New Ventures
Artificial Intelligence (2016) - AMP New VenturesAMP New Ventures
 
Technologies Demystified: Artificial Intelligence
Technologies Demystified: Artificial IntelligenceTechnologies Demystified: Artificial Intelligence
Technologies Demystified: Artificial IntelligencePioneers.io
 
Top And Best Digital Marketing Agency With AI
Top And Best Digital Marketing Agency With AITop And Best Digital Marketing Agency With AI
Top And Best Digital Marketing Agency With AIamdigitalmark15
 
IBM Watson & Cognitive Computing - Tech In Asia 2016
IBM Watson & Cognitive Computing - Tech In Asia 2016IBM Watson & Cognitive Computing - Tech In Asia 2016
IBM Watson & Cognitive Computing - Tech In Asia 2016Nugroho Gito
 
Introduction to Artificial Intelligence.pptx
Introduction to Artificial Intelligence.pptxIntroduction to Artificial Intelligence.pptx
Introduction to Artificial Intelligence.pptxRSAISHANKAR
 
AI EXPLAINED Non-Technical Guide for Policymakers
AI EXPLAINED Non-Technical Guide for PolicymakersAI EXPLAINED Non-Technical Guide for Policymakers
AI EXPLAINED Non-Technical Guide for PolicymakersBranka Panic
 
Area's of Artificial Inteligence .pptx
Area's of Artificial Inteligence .pptxArea's of Artificial Inteligence .pptx
Area's of Artificial Inteligence .pptxJIMSVKII
 
Fontys Eric van Tol
Fontys Eric van TolFontys Eric van Tol
Fontys Eric van TolTalentEvent
 
Artificial IntelligenceNavya Reddy Karnati (556139)Ven.docx
Artificial IntelligenceNavya Reddy Karnati (556139)Ven.docxArtificial IntelligenceNavya Reddy Karnati (556139)Ven.docx
Artificial IntelligenceNavya Reddy Karnati (556139)Ven.docxtarifarmarie
 
Artificial intelligence: PwC Top Issues
Artificial intelligence: PwC Top IssuesArtificial intelligence: PwC Top Issues
Artificial intelligence: PwC Top IssuesPwC
 
Introduction to artificial intelligence
Introduction to artificial intelligenceIntroduction to artificial intelligence
Introduction to artificial intelligenceSindhuVelmukull
 
Addis abeb university ..Artificial intelligence .pptx
Addis abeb university ..Artificial intelligence .pptxAddis abeb university ..Artificial intelligence .pptx
Addis abeb university ..Artificial intelligence .pptxethiouniverse
 
AI vs ML-converted-converted.pptx
AI vs ML-converted-converted.pptxAI vs ML-converted-converted.pptx
AI vs ML-converted-converted.pptxsphinx Worldbiz
 
ARTIFICIAL INTELLIGENT ( ITS / TASK 6 ) done by Wael Saad Hameedi / P71062
ARTIFICIAL INTELLIGENT ( ITS / TASK 6 ) done by Wael Saad Hameedi / P71062ARTIFICIAL INTELLIGENT ( ITS / TASK 6 ) done by Wael Saad Hameedi / P71062
ARTIFICIAL INTELLIGENT ( ITS / TASK 6 ) done by Wael Saad Hameedi / P71062Wael Alawsey
 
Artificial intelligence in practice- part-1
Artificial intelligence in practice- part-1Artificial intelligence in practice- part-1
Artificial intelligence in practice- part-1GMR Group
 
Artificial Intelligence Vs Machine Learning Vs Deep Learning
Artificial Intelligence Vs Machine Learning Vs Deep LearningArtificial Intelligence Vs Machine Learning Vs Deep Learning
Artificial Intelligence Vs Machine Learning Vs Deep Learningvenkatvajradhar1
 

Ähnlich wie Principles of Artificial Intelligence & Machine Learning (20)

What is Artificial Intelligence.docx
What is Artificial Intelligence.docxWhat is Artificial Intelligence.docx
What is Artificial Intelligence.docx
 
Artificial Intelligence (2016) - AMP New Ventures
Artificial Intelligence (2016) - AMP New VenturesArtificial Intelligence (2016) - AMP New Ventures
Artificial Intelligence (2016) - AMP New Ventures
 
Technologies Demystified: Artificial Intelligence
Technologies Demystified: Artificial IntelligenceTechnologies Demystified: Artificial Intelligence
Technologies Demystified: Artificial Intelligence
 
Top And Best Digital Marketing Agency With AI
Top And Best Digital Marketing Agency With AITop And Best Digital Marketing Agency With AI
Top And Best Digital Marketing Agency With AI
 
IBM Watson & Cognitive Computing - Tech In Asia 2016
IBM Watson & Cognitive Computing - Tech In Asia 2016IBM Watson & Cognitive Computing - Tech In Asia 2016
IBM Watson & Cognitive Computing - Tech In Asia 2016
 
Introduction to Artificial Intelligence.pptx
Introduction to Artificial Intelligence.pptxIntroduction to Artificial Intelligence.pptx
Introduction to Artificial Intelligence.pptx
 
AI EXPLAINED Non-Technical Guide for Policymakers
AI EXPLAINED Non-Technical Guide for PolicymakersAI EXPLAINED Non-Technical Guide for Policymakers
AI EXPLAINED Non-Technical Guide for Policymakers
 
Area's of Artificial Inteligence .pptx
Area's of Artificial Inteligence .pptxArea's of Artificial Inteligence .pptx
Area's of Artificial Inteligence .pptx
 
Fontys Eric van Tol
Fontys Eric van TolFontys Eric van Tol
Fontys Eric van Tol
 
Artificial IntelligenceNavya Reddy Karnati (556139)Ven.docx
Artificial IntelligenceNavya Reddy Karnati (556139)Ven.docxArtificial IntelligenceNavya Reddy Karnati (556139)Ven.docx
Artificial IntelligenceNavya Reddy Karnati (556139)Ven.docx
 
Artificial intelligence: PwC Top Issues
Artificial intelligence: PwC Top IssuesArtificial intelligence: PwC Top Issues
Artificial intelligence: PwC Top Issues
 
inte
inteinte
inte
 
Introduction to artificial intelligence
Introduction to artificial intelligenceIntroduction to artificial intelligence
Introduction to artificial intelligence
 
Addis abeb university ..Artificial intelligence .pptx
Addis abeb university ..Artificial intelligence .pptxAddis abeb university ..Artificial intelligence .pptx
Addis abeb university ..Artificial intelligence .pptx
 
Salesforce - AI for CRM
Salesforce - AI for CRMSalesforce - AI for CRM
Salesforce - AI for CRM
 
AI for CRM e-book
AI for CRM e-bookAI for CRM e-book
AI for CRM e-book
 
AI vs ML-converted-converted.pptx
AI vs ML-converted-converted.pptxAI vs ML-converted-converted.pptx
AI vs ML-converted-converted.pptx
 
ARTIFICIAL INTELLIGENT ( ITS / TASK 6 ) done by Wael Saad Hameedi / P71062
ARTIFICIAL INTELLIGENT ( ITS / TASK 6 ) done by Wael Saad Hameedi / P71062ARTIFICIAL INTELLIGENT ( ITS / TASK 6 ) done by Wael Saad Hameedi / P71062
ARTIFICIAL INTELLIGENT ( ITS / TASK 6 ) done by Wael Saad Hameedi / P71062
 
Artificial intelligence in practice- part-1
Artificial intelligence in practice- part-1Artificial intelligence in practice- part-1
Artificial intelligence in practice- part-1
 
Artificial Intelligence Vs Machine Learning Vs Deep Learning
Artificial Intelligence Vs Machine Learning Vs Deep LearningArtificial Intelligence Vs Machine Learning Vs Deep Learning
Artificial Intelligence Vs Machine Learning Vs Deep Learning
 

Kürzlich hochgeladen

The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 

Kürzlich hochgeladen (20)

The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 

Principles of Artificial Intelligence & Machine Learning

  • 1. Principles of Artificial Intelligence & Machine Learning September 2017
  • 2. Today’s Objectives 2 ▪ Define Artificial Intelligence (AI) and describe its applications in business ▪ Discuss major drivers and influencers that are shaping the future of AI / ML ▪ Dive into Machine Learning (ML) and decode buzzwords such as “deep learning” and “cognitive computing” ▪ Highlight analytical techniques and best practices used in AI / ML ▪ Share opportunities for students to get involved in Penn’s data science community
  • 4. Defining Artificial Intelligence (AI) Artificial Intelligence is the automation of activities we normally attribute to human thinking and rationality, such as problem-solving, decision-making, and learning 4 Neuroscience: How do our brains process information? Philosophy: Where does knowledge come from? Linguistics: How does language relate to thought? Behavioral Economics: How do you make decisions to maximize utility? Mathematics: What can be computed? Computer Science: How can we build an efficient computer? ARTIFICIAL INTELLIGENCE Source: Artificial Intelligence: A Modern Approach (2nd Edition) by Stuart J. Russell, Peter Norvig, and Ernest Davis
  • 5. Motivations for Artificial Intelligence in Business Artificial Intelligence is sure to impact your professional career path, regardless of your role within the business community 5Sources: McKinsey Global Institute, Executive Office Report on AI, IBM Analytics Report, Venture Scanner Executives ▪ Proactive AI adopters have 3% to 15% higher self-reported margins ▪ 75% of executives said that AI would be “actively implemented” within 3 years ▪ Early adopters are expected to grow operating margins by >5% over three years ▪ Demand for data scientists is expected to grow by 28% between now and 2020 ▪ 47% of jobs are at risk of becoming irrelevant due to AI automation ▪ 40%+ of activities are automatable in 51% of occupations Practitioners ▪ $27B+ was spent on AI in 2016, with ~$9B coming from VC / PE ▪ 300% increase in AI-related private investments from 2013 to 2016 ▪ Machine learning startups accounted for 44% of all venture funding in 2016 Investors
  • 6. Societal Implications of Artificial Intelligence Outside of the workplace, AI will also have far-reaching impact on our personal lives 6 Autonomous Weapons Autonomous Industry Autonomous Decision-Making Artificial Superintelligence Save lives and create a military advantage in the short term Universal Basic Income could free people to pursue their passions Better, faster decisions that underweight human biases Ability to solve a wide range of mysteries and maladies High potential for misuse by rogue or artificial agents Rampant unemployment, inequality, and societal unrest Introduction of artificial biases in infrastructure, recruiting, etc. The destruction of civilization as we know it Time to Impact + −
  • 7. Modern Applications of AI Research AI can be broken down into roughly five distinct research areas originating from the Total Turing test 7 FarmTech Prospera Artificial Intelligence Machine Vision Therapist Chatbots Woebot Natural Language Processing Robot Bankers Commonwealth Bank of Australia Robotics Warehouse Ops Amazon Expert Systems Pro Gaming OpenAI Machine Learning
  • 8. Machine Vision – How Robots See Onboard automotive sensors are pushing the boundaries of perception, and doing so cheaper than ever 8 Autonomous Truck on Top GearScanse’s 3D Environment Phoenix Aerial Systems Mapping Drone Applications ▪ Geological mapping / imaging to monitor erosion or other changes ▪ Doing survey work for construction projects ▪ Making accurate volumetric estimates of landfills Companies ▪ Velodyne - Combines up to 64 emitter/receiver pairs in a single sensor that can provide 360 degree horizontal view ▪ Scanse - Inexpensive scanning Lidar a la Velodyne ▪ Quanergy - Inexpensive solid-state Lidar. Uses non- mechanical “phased array optics” to move laser
  • 9. Natural Language Processing – How Robots Hear In our quest to optimize for speed, efficiency and convenience, we are moving to a world where we primarily speak to machines before reading and listening to their responses 9 Adaptive Beamforming Enables noise reduction, automatic speech recognition, and speaker separation Voice Print Identification Enables personalization, user identification, and biometric authentication Speech Synthesis Enables mimicry of any person's voice with predefined emotion or intonation
  • 10. “If I were to guess what our biggest existential threat is, it’s probably [AI]… With artificial intelligence, we are summoning the demon.” - Elon Musk “AI is the new electricity. Just as 100 years ago electricity transformed industry after industry, AI will now do the same.” - Andrew Ng
  • 12. Rise of Big Data Though “big data” is everyone’s least favorite buzzword, AI and ML have both benefited significantly from the world’s ever-increasing volume, variety, and velocity of data 12 Volume: Quantity of data available for analysis ▪ Gigabytes ▪ Terabytes ▪ Petabytes Variety: Types of data available for analysis ▪ Structured (financial metrics, demographic data, etc.) ▪ Unstructured (conversational transcripts, social media, etc.) Velocity: How quickly data is available for analysis ▪ Real Time ▪ Near-Real Time ▪ Batch
  • 13. Improvements in Software & Hardware Both software and hardware have made significant improvements over the past several years, enabling data scientists to develop increasingly-complex neural architectures 13 Advancements in the way data is processed… … continue to shape the future of hardware Distributed Processing1 Splitting workloads between computers (nodes) in a network Parallel Processing2 Sharing individual jobs between nodes within a network In-Memory Processing3 Processing data using RAM instead of disk storage Google’s Tensor Processing Unit
  • 14. Evolution of Analytical Techniques Though today’s ML techniques are much more advanced than those used in the past, the data science community has built a number of sophisticated tools and resources to guide the next generation 14 Input Layer Output LayerHidden Layers x1 x2 x3 ො𝑦 ML has become both increasingly more complicated… … and significantly more accessible
  • 15. Building to General Intelligence While artificial agents have historically been limited to ‘narrow intelligence’, recent advancements in cognitive computing are leading some to speculate that we’ll reach the Singularity within our lifetime 15 Machine Vision Pattern Recognition Image Processing 3D Modeling Augmented Reality Virtual Reality Machine Learning Supervised Semi-Supervised Unsupervised Reinforcement Robotics Humanoid Mobile Manipulators As we blend these five capabilities together to enable increasingly complex use cases, we inch closer to the Holy Grail of AI: artificial general intelligence Expert Systems Process Control Monitoring Diagnoses Design Planning Natural Language Processing Translation Topic Modeling Sentiment Analysis Speech to Text Text to Speech
  • 16. The Singularity A hypothesis stating that the invention of artificial general intelligence will abruptly trigger runaway technological growth, resulting in unfathomable changes to human civilization.
  • 18. Introduction to Machine Learning Whether you realize it or not, you are impacted by machine learning every single day 18 3 Contrary to popular belief, not all ML algorithms are obscure and overly-complex Linear Regression 1 Machine learning algorithms are responsible for many scientific and business model innovations Discovery of Higgs boson 2 Deep learning architectures (e.g., recurrent, convolutional neural networks) are to thank for a variety of modern technologies Siri, Alexa, and Cortana
  • 19. Generate predictions by training on labeled datasets Expose and visualize hidden relationships and anomalies in unlabeled datasets Generate predictions using a small amount of labeled data within a larger pool of unlabeled data Create an agent capable of taking environmental actions to maximize utility over time Four Types of Machine Learning There are four types of problems that we aim to solve with ML, and each requires a different approach to learning and deployment 19 Machine Learning Supervised Unsupervised Semi-Supervised Reinforcement Geospatial Market Segmentation Self-Driving Vehicles Handwriting Recognition Interactive Recommendations
  • 21. Principle #1: Generalization When we train a machine to think, we are mostly concerned with how well it can predict the future. This often means that we need to restrain the complexity of our model to improve its ability to generalize 21 Training Data Predictions Time Y Strong Fit Overfitting (High Variance) Training Data Predictions Time Y Underfitting (High Bias) Training Data Predictions Time Y
  • 22. Principle #2: No Free Lunch Unfortunately, there is no ‘magical’ algorithm that will solve all of our problems. Generating accurate predictions requires a thorough understanding of the underlying behaviors at play within our data 22 For a given problem, pick the right algorithms… … to optimize the bias-variance trade-off Graphic Source: Scott Fortmann-Roe Random Forests PCA Gradient Boosted Machines LLE Support Vector Machines t-SNE Multi-Layer Neural Networks LDA Recurrent Neural Networks DBSCAN Linear Regression K-Nearest NeighborsLogistic Regression Multivariate Linear Reg. HCAMultinomial Logistic Reg. Regression Classification Clustering Convolutional Neural Networks Autoencoders Supervised Semi-Supervised … ….
  • 23. Principle #3: Occam’s Razor When two algorithms present similar results, there are many reasons why we should prefer the simpler of the two 23 Significantly less costly to compute due to their relatively simple cost functions, accelerating insight to action 1 Less likely to encounter optimization issues when working in lower- dimensional spaces 2 Final solutions are generally easier to interpret, visualize, and understand3 Gradient Descent 101 Advantages of Simplicity Graphic Source: Sebastian Raschka
  • 24. Principle #4: More Data > More Complex Algorithms Using fancy algorithms is just one piece of the data science puzzle. Including new features or increasing the volume of data available for training will substantially improve your results. 24 “The Unreasonable Effectiveness of Data”“We don't have better algorithms than anyone else; we just have more data” - Peter Norvig, Google
  • 25. Principle #5: Cross-Validation In the same way that we cannot determine a drug’s effectiveness by only testing it on a single patient, we need to examine our model using multiple data samples (called ‘folds’) to evaluate performance 25Graphic Source: Karl Rosaen k-fold Cross-Validation Error Used to evaluate how well each model generalizes an independent data set Cross-Validation 101
  • 26. Principle #6: Algorithmic Diversity Algorithmic diversity is key to predictive success; the combination of many simple models (“weak learners”) can outperform much more complex algorithms (“strong learners”) 26 Model 1 CV predictions are 7% too high Model 3 CV predictions are 5% too low Model 2 CV predictions are 2% too low Ensembling Ensembled Model CV predictions are 0% off. Success! Initial models are developed independently Model predictions are compiled together using majority voting Biases cancel out, giving us a much more accurate final model + − − Ensembling 101 1 2 3
  • 28. Key Take-Aways 28 ▪ We, as future business leaders, must be able to decipher the signal from the noise with regards to AI / ML ▪ AI will have profound practical and ethical implications for our society ▪ Getting started is not as difficult as you might think
  • 29. Thank you for your time Contact Information Nick Lind (nthorlind@gmail.com) Jerry Lu (jylu88@gmail.com)