Amazon brings computer vision, natural language processing, speech recognition, text-to-speech, and machine translation within the reach of every developer. API-driven application services enable developers to easily plug in pre-built AI functionality into their applications and automate manual workflows. Join us to learn more about new language capabilities and text-in-image extraction. We also share how others are building the next generation of intelligent apps that can see, hear, speak, understand, and interact with the world around us.

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
David Pearson
Business Development, ML Application Services
BDA202
Introduction to AWS
ML Application Services

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Machine Learning at Amazon: A long heritage
Voice-driven
interactions
Fulfillment automation
& inventory management
Personalized
recommendations
Drones
Inventing entirely new
customer experiences

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML @ AWS
OUR MISSION
Put machine learning in the
hands of every developer and
data scientist

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The AWS Machine Learning Stack
FRAMEWORKS KERAS
EC2 GPUs
P3
Machine Learning
AMIs
INFRASTRUCTURE
&
EC2 CPUs EDGEIOT
C5

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The AWS Machine Learning Stack
PLATFORMS Amazon SageMaker Amazon Mechanical Turk AWS DeepLens
FRAMEWORKS KERAS
EC2 GPUs
P3
Machine Learning
AMIs
INFRASTRUCTURE
&
EC2 CPUs EDGEIOT
C5

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The AWS Machine Learning Stack
FRAMEWORKS KERAS
EC2 GPUs
P3
Machine Learning
AMIs
INFRASTRUCTURE
&
EC2 CPUs EDGEIOT
C5
PLATFORMS Amazon SageMaker Amazon Mechanical Turk AWS DeepLens
APPLICATION SERVICES
A M A Z O N
R E K O G N I T I O N
A M A Z O N
R E K O G N I T I O N
V I D E O
A M A Z O N
P O L L Y
A M A Z O N
T R A N S C R I B E
A M A Z O N
T R A N S L A T E
A M A Z O N
C O M P R E H E N D
A M A Z O N
L E X

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DeepLens architecture
Video out
Data out
I N F E R E N C E
D E P L O Y P R O J E C T S
Manage device
Security
Console Project
Management
AWS Cloud
Intel: Model Optimizer
cIDNN and Driver

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Fast ML
Build machine learning-based applications
and features in less than a day

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Building blocks of fast ML
APPLICATION SERVICES
A M A Z O N
R E K O G N I T I O N
A M A Z O N
R E K O G N I T I O N
V I D E O
A M A Z O N
P O L L Y
A M A Z O N
T R A N S C R I B E
A M A Z O N
T R A N S L A T E
A M A Z O N
C O M P R E H E N D
A M A Z O N
L E X

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Deep learning-based image and video analysis service
Extract metadata from rich media
Used by customers in multiple industries:
o Media & entertainment, security & safety, travel & hospitality
o Digital advertising & marketing, social media, online dating
o Education, automotive, financial services, facilities mgt ++
Fast ML: Build applications that see
Amazon
Rekognition
APPLICATION SERVICES
A M A Z O N
R E K O G N I T I O N
A M A Z O N
R E K O G N I T I O N
V I D E O
A M A Z O N
P O L L Y
A M A Z O N
T R A N S C R I B E
A M A Z O N
T R A N S L A T E
A M A Z O N
C O M P R E H E N D
A M A Z O N
L E X

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Rekognition Image
Unsafe image detection Text in imageCelebrity recognition
Facial analysis Face matchObject detection

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Rekognition Video
Facial analysis Live stream face matchObject & activity detection
Unsafe image detectionCelebrity recognition Motion path detection

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Celebrity guests at the Royal Wedding
• “Who’s Who Live”
function
• Celebrity guests
identified in live stream
• On-screen captions of
attendee names on
arrival

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Rekognition and sports media tagging
• Player recognition
• Motion path tracking
• Objects, activities, and event detection

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Turn text into lifelike speech
• 53 voices, 26 languages, 16 AWS regions
• Lip-syncing & text highlighting
• Fine-grained voice control
• Custom vocabularies
• Education, publishing, IoT, telephony, gaming ++
Fast ML: Build applications that speak
Amazon
Polly
APPLICATION SERVICES
A M A Z O N
R E K O G N I T I O N
A M A Z O N
R E K O G N I T I O N
V I D E O
A M A Z O N
P O L L Y
A M A Z O N
T R A N S C R I B E
A M A Z O N
T R A N S L A T E
A M A Z O N
C O M P R E H E N D
A M A Z O N
L E X

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Polly – use cases
Voiced
notifications
Special needs
AI assistant
AI radio
announcer
Video
creation
Navigation
Podcasting
Amazon Polly

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Read me the news
A massive 8.2 magnitude earthquake struck in
the middle of the Pacific Ocean, roughly 200
miles off Fiji and almost the same distance from
Tonga, according to the preliminary report from
the US Geological Survey. The earthquake
struck just after midday Sunday and was almost
560 kilometers deep, the USGS said. The Pacific
Tsunami Warning Center said based on the data
available, a destructive Pacific-wide tsunami
was not expected, and there was no threat to
Hawaii. There were no immediate reports of
damage or injuries.

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multilingual personalized greetings
<speak><prosody rate="fast">
Thank you for calling the Island Air rebooking hotline.
नम्स्कार्। Island Air में आप का ्वागत है।
मैं अदितत, आप कक ककस प्रकार सहाय्ता कर सकती हूँ?
</prosody></speak>
user_loc=india; user_lang=hindi
user_loc=us; user_lang=english

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Automated speech recognition service
• Support for both regular and telephony audio
• Time stamps, confidence scores, and punctuation
• Support for English and Spanish, and more to come!
• Multiple speaker detection and custom vocabulary
• Media, contact centers, security & safety, education ++
Fast ML: Build applications that listen
APPLICATION SERVICES
A M A Z O N
R E K O G N I T I O N
A M A Z O N
R E K O G N I T I O N
V I D E O
A M A Z O N
P O L L Y
A M A Z O N
T R A N S C R I B E
A M A Z O N
T R A N S L A T E
A M A Z O N
C O M P R E H E N D
A M A Z O N
L E X
Amazon
Transcribe

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AMAZON TRANSCRIBE
JSON
INPUT
VIDEO / AUDIO
CONTENT
OUTPUT
METADATA
• START / END TIME
• SPOKEN TEXT
• CONFIDENCE
• PUNCTUATION
• SPEAKER ID
• CHANNEL ID

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AMAZON TRANSCRIBE
A man down and unwilling
to play on without a first five
coach hansen brings in lima.
Sapporo wanna to fill the
void left by baron, leaving
dag spot on the wing empty.
I just had to do my job. I just
had to direct the traffic, get
us in the right part of field,
and our team will do the rest.

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AMAZON TRANSCRIBE
five-eighth
Hansen
Lima-Sopoaga
Barrett
Dagg
AllOrNothing.txt
Custom
vocabulary
A man down and unwilling
to play on without a first five-
eighth coach Hansen brings in
Lima-Sopoaga to fill the void
left by Barrett, leaving
Dagg spot on the wing empty.
I just had to do my job. I just
had to direct the traffic, get
us in the right part of field,
and our team will do the rest.

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Neural machine translation – fast, affordable, & accurate
• 12 languages supported, with more to come
• Real-time translation with language detection (via Amazon
Comprehend)
• Messaging & communications, education, website and content
publishing, public safety & security ++
Fast ML: Build multilingual applications
Amazon
Translate
APPLICATION SERVICES
A M A Z O N
R E K O G N I T I O N
A M A Z O N
R E K O G N I T I O N
V I D E O
A M A Z O N
P O L L Y
A M A Z O N
T R A N S C R I B E
A M A Z O N
T R A N S L A T E
A M A Z O N
C O M P R E H E N D
A M A Z O N
L E X

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Translate – supported languages
Japanese
Traditional Chinese
Italian
Russian
Turkish
Czech
Arabic
Simplified Chinese
French
German
Spanish
Portuguese
Danish
Dutch
Finnish
Hebrew
Polish
Swedish

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use for high-volume and time-sensitive information
Share of worldwide digital content
Machine translation
• User-authored content
• Text analytics
• Real-time communication
• Content discovery
Post-edited
machine
translation
• Legal documents
• Healthcare documents
• Advertising materials

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Real-time translation in chat
Amazon Translate

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Natural language processing (NLP) service that finds insights and
relationships in text
• Detect sentiment & language, model documents by topic
• Identify entities, key phrases, and syntax
• Financial services, healthcare, insurance, government, document
classification & search, customer analytics ++
Fast ML: Build applications that understand text
APPLICATION SERVICES
A M A Z O N
R E K O G N I T I O N
A M A Z O N
R E K O G N I T I O N
V I D E O
A M A Z O N
P O L L Y
A M A Z O N
T R A N S C R I B E
A M A Z O N
T R A N S L A T E
A M A Z O N
C O M P R E H E N D
A M A Z O N
L E X
Amazon
Comprehend

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon.com, Inc. is located in
Seattle, WA and was founded
July 5th, 1994 by Jeff Bezos.
Our customers love buying
everything from books to
blenders at great prices
Named entities
- Amazon.com: Organization
- Seattle, WA: Location
- July 5th,1994: Date
- Jeff Bezos: Person
Key phrases
- Our customers
- books
- blenders
- great prices
Sentiment
Positive
Language
English
Amazon Comprehend – extract insights from text

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Comprehend – Syntax API
Our customers love
buying everything
from books to
blenders at great
prices
Token (word) Part of speech
customers Noun
love Verb
books Noun
great Adjective
prices Noun

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Supported parts of speech
NUM – Numeral
O – Other
PART – Particle
PRON – Pronoun
PROPN – Proper noun
PUNCT – Punctuation
SCONJ – Subordinating
conjunction
SYM – Symbol
VERB – Verb
ADJ – Adjective
ADP – Ad position
ADV – Adverb
AUX – Auxiliary
CCONJ – Coordinating
conjunction
DET – Determiner
INTJ – Interjection
NOUN – Noun

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Popular text analytics use cases
Content Personalization: Understand related documents based on entities,
phrases, or even topic similarities for trends analysis, to drive content personalization and
recommendations
Semantic Search: Index entities for boosting and ranking search results
Intelligent Data Warehouse: Query unstructured data in relational databases and
data lakes and insert the enriched output into a data warehouse
Social Analytics: Ingest, process, and analyze trends from entities and sentiment from
social media posts across Twitter and Facebook

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Create conversational interfaces using voice and text
• Embedded ASR and NLU, and works with Alexa
• Integrated with messaging applications and call centers
• Real-time sentiment detection (via Amazon Comprehend)
• Contact centers, enterprise assistants, education, gaming ++
Fast ML: Build applications that communicate
Amazon Lex
APPLICATION SERVICES
A M A Z O N
R E K O G N I T I O N
A M A Z O N
R E K O G N I T I O N
V I D E O
A M A Z O N
P O L L Y
A M A Z O N
T R A N S C R I B E
A M A Z O N
T R A N S L A T E
A M A Z O N
C O M P R E H E N D
A M A Z O N
L E X

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex
Scale
Business Logic
SecurityAnalytics
Text to Speech
Speech to Intent
End to
End
Native support &
maintains context
One-click deployment
Completely managed
service
Native integration with
AWS Lambda
Encrypted data
in transit & at
rest
Monitor and
improve
Amazon Polly
integrated into API
ASR + NLU integrated
into one API
Dialog Management Deployment

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex
Social Intelligence
Personality
Modality
Dynamic Conversation • Built-in error handling allows you to manage unexpected scenarios
• Intent chaining can build a conversation flow based on user input
• Rich formatting capabilities can provide more engaging experiences
• Create conversation combining speech and text in the same session
• Select from multiple prompts to give your bot a personality
• Choose from a range of Amazon Polly voices to suit your audience
• Use AWS Lambda to personalize the conversation based on each user’s social
profile
• Context is maintained allowing you to build intelligent conversations

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex – use cases
Informational Bots
Chatbots for everyday consumer requests
Application Bots
Build powerful interfaces to mobile applications
• News updates
• Weather information
• Game scores ….
• Book tickets
• Order food
• Manage bank accounts ….
Enterprise Productivity Bots
Streamline enterprise work activities and improve efficiencies
• Check sales numbers
• Marketing performance
• Inventory status ….
Internet of Things (IoT) Bots
Enable conversational interfaces for device interactions
• Wearables
• Appliances
• Auto ….
Contact Center Bots
Chatbots for customer service IVR
• Account inquiries
• Bill payment
• Service update ….

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Patrick Tedjamulia, Co-founder & CEO
Ben Cobb, Co-founder & CTO
Using AI to Gather Customer Insights

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VideoPeel automates the collection of video testimonials to drive business results
and better understand your customer.

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VideoPeel edits each video for use in websites, emails, Facebook & Instagram
ads, Amazon, Indiegogo, SEO, etc.

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VideoPeel’s key
challenge was to
process and analyze
thousands of videos to
provide clients with
actionable insights on
who to target and
what to message in
their campaigns.

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VideoPeel AI and Machine
Learning technologies
integrate with Amazon
Transcribe, Amazon
Comprehend, & Amazon
Rekognition to quickly
transcribe each video and
audio to create rich profiles
we can cluster to generate
dynamic consumer
personas and insights.

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VideoPeel architecture ‒ integration with Amazon Transcribe, Amazon
Comprehend, and Amazon Rekognition

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Getting Started
Tools to help you build fast ML applications
and features in minutes

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-language product analytics
Twitter Stream
API
Amazon
S3
Amazon
Athena
Amazon Kinesis Amazon
Translate
AWS Lambda
Amazon
Comprehend
Amazon
Transcribe
Amazon
S3
Product
Reviews

46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Text analytics workloads
Amazon Kinesis
Amazon ES
Amazon Redshift
Amazon EMR
• Semantic
• Rich filtering
• Grouping, trends
• Joining, correlating
• Clustering
• Graph, search
• Near real-time
• Alerts
Amazon S3
Social media, support
Amazon Aurora
Articles, documents

47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Searchable media metadata index
aws.amazon.com/answers/media-entertainment/media-analysis-solution
Downloadable
media analysis
solution
Tagged videos
accessible in less
than 30 mins

48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Supported media use cases
Media Asset
Management System
(Web App) (Media Content Store)
• NEWS SEARCH & DISCOVERY
• CELEBRITY RECOGNITION
• CONTEXT AD INSERTION
• COMPLIANCE MARKING
• SPORTS ACTIVITIES & EVENTS
• CLOSED CAPTIONING METADATA
DAM / MAM
extensible

49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Machine Learning Blog
aws.amazon.com/blogs/
machine-learning
Contributions from AWS experts,
customers, & partners
• Code samples
• Specific use cases
• Architecture diagrams
• Real-world deployments

50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Answers
aws.amazon.com/answers
Includes:
Serverless Bot Framework for
multi-language chatbots
Media Analysis Solution for media
metadata indexing

51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Submit session feedback
1. Tap the Schedule icon.
2. Select the session you attended.
3. Tap Session Evaluation to submit your
feedback.

52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ml.aws