Slides from my talk at the Serverless Meetup in Helsinki (May 10th)

1. Adrian Hornsby | Technical Evangelist | AWS
May 2017
Building AI-powered apps on AWS
<demo>
Polly, Reko & more
</demo>
@adhorn

2. What’s coming
1. A little bit history never kills
2. AI in AWS
1. Polly
2. Reko
3. Building Mobile apps
1. Cognito
2. CodeStar
4. Putting it all together

3. Artificial Intelligence
At Amazon

4. Artificial Intelligence
At Amazon

6. The (60 years) rise of Artificial Intelligence

7. https://en.wikipedia.org/wiki/Artificial_neural_network

8. The Curse of Dimensionality

9. The Advent Of Deep
Learning
Algorithms

10. Data
Algorithms
The Advent Of Deep
Learning

11. Data
GPUs
& Acceleration
Algorithms
The Advent Of Deep
Learning

12. Data
GPUs
& Acceleration
Cloud
Computing
Algorithms
The Advent Of Deep
Learning

13. Data
GPUs
& Acceleration
Cloud
Computing
Algorithms
AWS
The Advent Of Deep
Learning

14. Artificial Intelligence on AWS
Polly
Text-to-Speech
Rekognition Lex
Image Analysis ASR & NLU
Deep Learning AMI
Popular Frameworks

15. Artificial Intelligence on AWS
Polly
Text-to-Speech
Rekognition
Image Analysis

16. Artificial Intelligence on AWS
Polly
Text-to-Speech

17. Text In, Life-like Speech Out
Amazon Polly
“Today in Seattle, WA
it’s 11°F”
“Today in Seattle Washington
it’s 11 degrees Fahrenheit”
47 lifelike voices spread across 24 languages

18. “Today in Seattle, WA, it’s 11°F”
‘"We live for the music" live from the Madison Square Garden.’
1. Automatic, Accurate Text Processing
A Focus On Voice Quality & Pronunciation

19. 2. Intelligible and Easy to Understand
1. Automatic, Accurate Text Processing
A Focus On Voice Quality & Pronunciation

20. 2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
“Richard’s number is 2122341237“
“Richard’s number is 2122341237“
Telephone Number
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing

21. 2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
4. Customized Pronunciation
“My daughter’s name is Kaja.”
“My daughter’s name is Kaja.”
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing

22. A Focus On Voice Quality & Pronunciation
https://www.w3.org/TR/speech-synthesis/<speak>
The spelling of my last name is
<prosody rate='x-slow'>
<say-as interpret-as="characters">Adrian</say-as>
</prosody></speak>

23. Duolingo voices its language learning service Using Polly
Duolingo is a free language learning service where
users help translate the web and rate translations.
With Amazon Polly our users
benefit from the most lifelike
Text-to-Speech voices
available on the market.
Severin Hacker
CTO, Duolingo
”
“
• Spoken language crucial for
language learning
• Accurate pronunciation matters
• Faster iteration thanks to TTS
• As good as natural human speech

24. <demo>
Amazon Polly API
</demo>

25. PollyCast

26. <demo>
Amazon PollyCast
</demo>
James Siri
Piotr Lewalskihttps://github.com/adhorn/amazon-polly-sample

27. Artificial Intelligence on AWS
Rekognition
Image Analysis

28. Amazon Rekognition
Deep learning-based image recognition service
Search, verify, and organize millions of images
Object and Scene
Detection
Facial
Analysis
Face
Comparison
Facial
Recognition

29. Object & Scene Detection

30. Object & Scene Detection

31. Facial Analysis

32. Facial Analysis

33. Facial Search

34. Facial Search

35. Collections

36. Bynder allows you to easily create, find and use
content for branding automation and marketing
solutions.
With our new AI capabilities,
Bynder’s software… now allows
users to save hours of admin
labor when uploading and
organizing their files, adding
exponentially more value.
Chris Hall
CEO, Bynder
”
“
With Rekognition, Bynder revolutionizes marketing admin tasks with AI capabilities

37. <demo>
Amazon Rekognition API
</demo>

38. Cognito support for Identity

39. How it works
Username
Password
Sign In
SAML
Identity Provider
Amazon Cognito
2. Get AWS credentials
API Gateway
Your APIs
DynamoDB S3
Lambda
Cognito User Pools

40. AWS.config.region = 'us-east-1'; // Region
AWS.config.credentials = new AWS.CognitoIdentityCredentials(
{
IdentityPoolId: 'us-east-1:873891a7-92b8-45c2-9c25-212bb7555bc1',
});
Simple to use with the SDK

41. curl -X POST -H "Authorization: $(aws cognito-idp admin-initiate-auth
--user-pool-id us-east-1_1ZkFb79PI
--client-id 5q4eiv7mmb59lpg6jf9ei82r2j
--cli-input-json file:///tmp/authflow.json
--query AuthenticationResult.IdToken
--output text --region us-east-1)"
-H "search-key: building" -H "Cache-Control: no-cache"
"https://xxx.amazonaws.com/prod/picture/search/"
| native2ascii -encoding UTF-8 -reverse
Simple to use with the CLI

42. AWS CodeStar
New integrated
AWS console UI for
developers
Start developing
on AWS in minutes
Manage software
delivery in one
place
Work across your
team, securely

43. Start projects quickly
with templates

44. Set up secure
team access

45. Configure projects with
continuous delivery
toolchain

46. Connect your IDE &
Start Coding

47. Manage delivery pipeline
and track issues

48. <demo>
Poliko
powered by Amazon Polly & Rekognition
</demo>

49. C o o r d i n a t e t h e c o m p o n e n t s o f d i s t r i b u t e d a p p l i c a t i o n s
u s i n g v i s u a l w o r k f l o w s
A W S S t e p F u n c t i o n s

50. Start
Sequential Steps
U p l o a d R AW f i l e
D e l e t e R AW f i l e
End
A W S S t e p F u n c t i o n s

51. S e l e c t i m a g e
c o n v e rt e r
RA W t o J P E G RA W t o P NGRA W t o TI FF
L o a d i n Da t a b a se
Start
End
Un s u p p or te d i m a g e
t yp eParallel Steps
A W S S t e p F u n c t i o n s

52. P r o c e s s p h o t o
Re s i ze i m a g e
Start
End
E xt r a c t m e t a d a ta Fa c i a l r e c o g n ition
L o a d i n Da t a b a se
Branching Steps
A W S S t e p F u n c t i o n s

53. https://github.com/awslabs/lambda-refarch-imagerecognition

54. <demo>
Image Recognition and Processing Backend
Step Functions
</demo>
https://github.com/awslabs/lambda-refarch-imagerecognition

56. Thank You!