With the growing number of business cases for artificial intelligence (AI), machine learning (ML) and deep learning (DL) continue to drive the development of cutting edge technology solutions. We see this manifested in computer vision, predictive modeling, natural language understanding, and recommendation engines. During this full afternoon of sessions and workshops, learn how you can develop your own applications to leverage the benefits of these services. Join this State of the Union presentation to hear more about ML and DL at AWS and see how Motorola Solutions is leveraging these state-of-the-art technologies to solve public safety challenges, and how Ohio Health intends to inject AI into the medical system.

1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Swami Sivasubramanian
GM, Amazon AI
November 30, 2016
MAC206
AI and Deep Learning
at Amazon

2. A Flywheel For Data
More Data Better Analytics

3. A Flywheel For Data
More Data Better Analytics
Better Products

4. A Flywheel For Data
More Users
More Data Better Analytics
Better Products

5. A Flywheel For Data
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
More Users
More Data Better Analytics
Better Products

6. A Flywheel For Data
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
More Users
More Data Better Analytics
Better Products

7. A Flywheel For Data
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Artificial
Intelligence
More Users
More Data Better Analytics
Better Products

8. A Flywheel For Data
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Artificial
Intelligence
More Users
More Data Better Analytics
Better Products

9. Artificial Intelligence
At Amazon

10. Artificial Intelligence At Amazon
Thousands Of Employees Across The Company Focused on AI
Discovery &
Search
Fulfillment &
Logistics
Enhance
Existing Products
Define New
Categories Of
Products
Bring Machine
Learning To All

11. AI on AWS Today
• Zillow
–Zestimate (using Apache Spark)
• Howard Hughes Corp
–Lead scoring for luxury real estate purchase predictions
• FINRA
–Anomaly detection, sequence matching, regression
analysis, network/tribe analysis
• Netflix
–Recommendation engine
• Pinterest
–Image recognition search
• Fraud.net
–Detect online payment fraud
• DataXu
–Leverage automated & unattended ML at
large scale (Amazon EMR + Spark)
• Mapillary
–Computer vision for crowd sourced maps
• Hudl
–Predictive analytics on sports plays
• Upserve
–Restaurant table mgmt & POS for
forecasting customer traffic
• TuSimple
–Computer Vision for Autonomous Driving
• Clarifai
– Computer Vision APIs

12. The Advent Of
Deep Learning
Algorithms

13. The Advent Of
Deep Learning
Data
Algorithms

14. The Advent Of
Deep Learning
Data
GPUs
& Acceleration
Algorithms

15. The Advent Of
Deep Learning
Data
GPUs
& Acceleration
Programming
models
Algorithms

16. One-Click GPU
Deep Learning
AWS Deep Learning AMI
Up to~40k CUDA cores
MXNet
TensorFlow
Theano
Caffe
Torch
Pre-configured CUDA drivers
Anaconda, Python3
+ CloudFormation template
+ Container Image

17. MXNet: Scalable Deep Learning Framework

18. Can We Help Customers
Put Intelligence At The Heart Of
Every Application & Business?

19. Amazon AI
Intelligent Services Powered By Deep Learning

20. Amazon AI: Three New Deep Learning Services
Amazon Polly
Life-like Speech

21. Amazon AI: Three New Deep Learning Services
Amazon Rekognition
Life-like Speech Image Analysis
Amazon Polly

22. Amazon AI: Three New Deep Learning Services
Amazon Rekognition Amazon Lex
Life-like Speech Image Analysis Conversational
Engine
Amazon Polly

23. Amazon AI: Three New Deep Learning Services
Polly Rekognition Lex
Life-like Speech Image Analysis Conversational
Engine

24. The Advent Of Conversational Interactions
1st Gen: Machine-oriented
interactions

25. The Advent Of Conversational Interactions
1st Gen: Machine-oriented
interactions
2nd Gen: Control-oriented
& translated

26. The Advent Of Conversational Interactions
1st Gen: Machine-oriented
interactions
2nd Gen: Control-oriented
& translated
3rd Gen:
Intent-oriented

27. Lex: Build Natural, Conversational Interactions In Voice & Text
Voice & Text
“Chatbots”
Powers
Amazon Alexa
Voice interactions
on mobile, web
& devices
Text interaction
with Facebook Messenger
Enterprise
Connectors
(with more coming) Salesforce
Microsoft Dynamics
Marketo
Zendesk
Quickbooks
Hubspot

28. Origin
Destination
Departure Date
Flight Booking

29. Origin
Destination
Departure Date
Flight Booking
“Book a flight to
London”

30. Origin
Destination
Departure Date
Flight Booking
“Book a flight to
London”
Automatic
Speech Recognition
Book Flight
London

31. Origin
Destination
Departure Date
Flight Booking
“Book a flight to
London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight booking
London Heathrow
Intent /
Slot model

32. Origin
Destination London Heathrow
Departure Date
Flight Booking
“Book a flight to
London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight booking
London Heathrow
Intent /
Slot model

33. Origin Seattle
Destination London Heathrow
Departure Date
Flight Booking
“Book a flight to
London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight booking
London Heathrow
LocationLocation
Intent /
Slot model

34. Origin Seattle
Destination London Heathrow
Departure Date
Flight Booking
“Book a flight to
London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight booking
London Heathrow
Prompt
LocationLocation
“When would you like to fly?”
Intent /
Slot model

35. Origin Seattle
Destination London Heathrow
Departure Date
Flight Booking
“Book a flight to
London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight booking
London Heathrow
Prompt
LocationLocation
“When would you like to fly?”
“When would you like to
fly?”
Polly
Intent /
Slot model

36. Origin Seattle
Destination London Heathrow
Departure Date
Flight Booking
“Next Friday”
“When would you like to
fly?”

37. Origin Seattle
Destination London Heathrow
Departure Date
Flight Booking
“Next Friday”
Automatic
Speech Recognition
Next Friday

38. Origin Seattle
Destination London Heathrow
Departure Date 11/18/2016
Flight Booking
“Next Friday”
Automatic
Speech Recognition
Natural Language
Understanding
Next Friday
Utterances
Flight booking
11/18/2016
Intent /
Slot model

39. Origin Seattle
Destination London Heathrow
Departure Date 11/18/2016
Flight Booking
“Next Friday”
Automatic
Speech Recognition
Natural Language
Understanding
Next Friday
Utterances
Flight booking
11/18/2016
Intent /
Slot model

40. Origin Seattle
Destination London Heathrow
Departure Date 11/18/2016
Flight Booking
“Next Friday”
Automatic
Speech Recognition
Natural Language
Understanding
Next Friday
Utterances
Flight booking
11/18/2016
Confirmation
“Your flight is booked for next Friday”
Intent /
Slot model

41. Origin Seattle
Destination London Heathrow
Departure Date 11/18/2016
Flight Booking
“Next Friday”
Automatic
Speech Recognition
Natural Language
Understanding
Next Friday
Intent /
Slot model
Utterances
Flight booking
11/18/2016
“Your flight is booked for
next Friday”
Confirmation
“Your flight is booked for next Friday”
Polly

42. Origin Seattle
Destination London Heathrow
Departure Date 11/18/2016
Flight Booking
“Next Friday”
Automatic
Speech Recognition
Natural Language
Understanding
Next Friday
Grammar
Graph
Utterances
Flight booking
11/18/2016
Hotel Booking

43. High quality,
through
best-in-class
deep learning
Deep
functionality
Easy to use
& thoughtfully integrated
Built for
production
Low
cost
Lex: Build Natural, Conversational Interfaces In Voice & Text

44. Amazon AI: Three New Deep Learning Services
Polly Rekognition Lex
Life-like Speech Image Analysis Conversational
Engine

45. Polly: Life-like Speech Service
Converts text
to life-like speech
47 voices 24 languages Low latency,
real time
Fully managed

46. Let’s hear from Polly..

47. “Today in Seattle, WA, it’s 11°F”
‘"We live for the music" live from the Madison Square Garden.’
1. Automatic, Accurate Text Processing
Polly: A Focus On Voice Quality & Pronunciation

48. Polly: A Focus On Voice Quality & Pronunciation
2. Intelligible and Easy to Understand
1. Automatic, Accurate Text Processing

49. 2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
Richard’s number without semantic meaning
Richard’s number with semantic meaning
Telephone Number
Polly: A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing

50. 2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
4. Customized Pronunciation
“My last name is Nguyen.”
Polly: A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
“My last name is Nguyen.”

51. Polly: Life-like Speech Service
High quality,
through
best-in-class
deep learning
Deep
functionality
Easy to use
& thoughtfully integrated
Built for
production
Low
cost

52. Amazon AI: Three New Deep Learning Services
Polly Rekognition Lex
Life-like Speech Image Analysis Conversational
Engine

53. Rekognition: Search & Understand Visual Content
Real-time &
batch image
analysis
Object & Scene
Detection
Facial Detection Face SearchFacial Analysis

54. Object and Scene Detection
Maple
Villa
Plant
Garden
Water
Swimming Pool
Tree
Potted Plant
Backyard

55. Demographic Data
Facial Landmarks
Sentiment Expressed
Image Quality
Facial Analysis
Brightness: 25.84
Sharpness: 160
General Attributes

56. Face Comparison

57. Face Recognition

58. High quality,
through
best-in-class
deep learning
Deep
functionality
Easy to use
& thoughtfully integrated
Built for
production
Low
cost
Rekognition: Search & Understand Visual Content

59. Amazon AI: New Deep Learning Services
Polly Rekognition Lex
Life-like Speech Image Analysis Conversational
Engine
Deep Learning
Frameworks
MxNet, TensorFlow,
Theano, Caffe, Torch

60. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dan Law, Wei Lin, Steve Varner
November 30, 2016
AI for Public Safety
Leveraging Amazon Rekognition, Amazon Lex,
and Amazon Polly to Find Missing Persons

61. Learn about:
• A difficult public safety challenge
• How we currently address it
• How Amazon AI can help (with video
and live demo)
• How we apply Amazon Rekognition,
Amazon Lex, and Amazon Polly
What to expect from the session

62. A public safety challenge: Finding
missing persons
~ 100,000 active missing persons cases in U.S. at any given time
~ 60% are adults, ~40% are children
The National Missing and Unidentified Persons System (NamUs)
currently has:
~ 13,000 open missing persons cases
~ 11,000 open unidentified remains cases

63. How can AI apply?
Image analytics and facial
recognition can continually monitor
for missing persons
Tools that understand natural
language can enable officers to
keep eyes up and hands free
Amazon Rekognition, Amazon Lex, and Amazon Polly Can Support This

65. COMMANDCENTRAL
INGEST, MANAGEMENT, SEARCH
INTELLIGENT MIDDLEWARE
How do we employ Amazon AI tools?
BIO
MONITORWEAPONVEHICLE OFFICER
SMART DEVICE
& BODYCAM
Amazon
Rekognition
Amazon S3 Amazon Lex
Amazon
Polly
AWS (GovCloud)
EDGE
AWS Lambda
FACE
DETECTOR
COUCH
(Amazon EC2)
MICROSERVICES
(Amazon EC2)
FACE PATH
VOICE PATH

66. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Salil Verma, Senior Director, IT
OhioHealth

69. Thank you!
swami@amazon.com
THANK YOU!