SlideShare ist ein Scribd-Unternehmen logo
1 von 28
Downloaden Sie, um offline zu lesen
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Donnie Prakoso, MSc
AWS Technology Evangelist, ASEAN
Text Analytics Workload with
Amazon Comprehend
AWS User Group Meetup
@donnieprakoso
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Hello, World.
Donnie Prakoso, MSc
AWS Technology Evangelist, ASEAN
@donnieprakoso
donnieprakoso
• Speak in Go and Python
• Machine Learning and Serverless
• I AWS User Groups
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Let’s Discuss Something
• Why do we need text analytics?
• What are the examples of the use cases?
• How Amazon Comprehend can help
you?
• Demo + API and architecture diagram
example
https://bit.ly/aws-donnie-serverless-text-analytics
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why do we need text
analytics?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enabling The Possibility for These Use Cases
• News Media
• Brand trends, correlating events
• Customer engagement
• Call center, issue triage, social media analytics
• Records and research
• Actionable document-centric processes, understand patterns
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Machine Learning Services
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
FRAMEWORKS AND INTERFACES
AI for data scientists
KERAS
Frameworks Interfaces
APPLICATION SERVICES
AI for everyone
P O L L Y R E K O G N I T I O N C O M P R E H E N DL E X R E K O G N I T I O N
V I D E O
T R A N S C R I B E T R A N S L A T E
PLATFORM SERVICES
AI for engineers
AMAZON
SAGEMAKER
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
G e t S t a r t e d w i t h
A W S M L A p p l i c a t i o n S e r v i c e s
POLLY REKOGNITION COMPREHENDLEX REKOGNITION
VIDEO
TRANSCRIBE TRANSLATE
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Sentiment Entities Languages Key phrases Topic modeling
POWERED BY DEEP
LEARNING
Amazon Comprehend
Discover insights and relationships in text
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Entities
Key Phrases
Language
Sentiment
Amazon
Comprehend
Amazon Comprehend
Discover insights and relationships in text
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A m a z o n . c o m , I n c . i s l o c a t e d
i n S e a t t l e , W A a n d w a s
f o u n d e d J u l y 5 t h , 1 9 9 4 b y
J e f f B e z o s . O u r c u s t o m e r s
l o v e b u y i n g e v e r y t h i n g f r o m
b o o k s t o b l e n d e r s a t g r e a t
p r i c e s
N a m e d E n t i t i e s
• A m a z o n . c o m : O r g a n i z a t i o n
• S e a t t l e , W A : L o c a t i o n
• J u l y 5 t h , 1 9 9 4 : D a t e
• J e f f B e z o s : P e r s o n
K e y p h r a s e s
• O u r c u s t o m e r s
• b o o k s
• b l e n d e r s
• g r e a t p r i c e s
S e n t i m e n t
• P o s i t i v e
L a n g u a g e
• E n g l i s h
Text Analysis
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Synchronous
• DetectDominantLanguage and BatchDetectDominantLanguage – to detect
the dominant language in a document. We can detect up to 100 languages.
• DetectEntities and Batch DetectEntities – to detect the entities, such as persons
or places, in the document.
• DetectKeyPhrases and Batch DetectKeyPhrases – to detect key noun phrases
that are most indicative of the content.
• DetectSentiment and Batch DetectSentiment – to detect the emotional
sentiment, positive, negative, mixed, or neutral, of a document.
API Summary - Synchronous
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo
Twitter Sentiment Analysis w/
Amazon Comprehend
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Twitter
Search API
Analyze social media postings and comments
AWS
Lambda
Amazon
S3
AWS IoT
Amazon
DynamoDB
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Twitter
Stream API
Organize and classify customer feedback and look for common patterns.
Visualize results in Amazon QuickSight
Amazon
Kinesis
Amazon
Athena
Amazon
S3
AWS
Lambda
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
Customer Feedback Analytics
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
STORM
WORLD SERIES
STOCK MARKET
WASHINGTON
LIBRARY OF
NEWS ARTICLES
Amazon
Comprehend
Topic Modelling
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Topic Modeling
Document Topic Proportion
Doc.txt 0 .89
Doc.txt 1 .67
Doc.txt 2 .91
Topic Term Weight
0 Washington .89
1 Silicon Valley .67
2 Roasting .91
Keywords Topic Groups Document Relationship to Topics
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Asynchronous
• StartTopicDetection – to start a topic modeling job
• ListTopicDetection – to list all your submitted jobs
• DescribeTopicDetection –to get progress status and
information about each submitted job
API Summary - Asynchronous
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo
Classifying Customer
Feedback
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend + AWS = Scale Text Analytics
Amazon Kinesis
Amazon EMR
Amazon Redshift
Amazon EMR
• Semantic
• Rich Filtering
• Grouping, Trends
• Joining, Correlating
• Clustering
• Graph, Search
• Near real-time
• Alerts
Amazon S3
Articles, Documents
Social Media, Support
Amazon Aurora
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
Knowledge Management and Discovery
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Ideas Are Welcome
Content Personalization: Customers are using Comprehend NLP output to understand related documents
based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and
recommendations
Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking
search results.
Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in
relational databases, processing data within the data lake (S3) and then inserting it back into the data
warehouse
Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from
entities and sentiment from social media posts across Twitter and Facebook.
Information management: Customers are using Amazon Comprehend for indexing and finding related
content for enterprise information management and various internal business processes including
compliance and IT.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
Scale
Business Logic
SecurityAnalytics
Text to Speech
Speech to Intent
End to
End
Native support &
maintains context
One-click
deployment
Completely managed
service
Native integration
with AWS Lambda
Encrypted
data in transit
& at rest
Monitor and
improve
Amazon Polly
integrated into API
ASR + NLU integrated
into one API
Dialog Management Deployment
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
Informational
Bots
Chatbots for
everyday consumer
requests
Application
Bots
Build powerful
interfaces to mobile
applications
News updates
Weather information
Game scores ….
Book tickets
Order food
Manage bank accounts ….
Enterprise Productivity
Bots
Streamline enterprise
work activities and
improve efficiencies
Check sales numbers
Marketing performance
Inventory status ….
Internet of Things
(IoT) Bots
Enable conversational
interfaces for device
interactions
Wearables
Appliances
Auto ….
Contact Center
Bots
Chatbots for
customer service IVR
Account inquiries
Bill payment
Service update ….
Use cases
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Intents
A particular goal that the
user wants to achieve
Utterances
Spoken or typed phrases
that invoke your intent
Slots
Data the user must provide to fulfill the
intent
Prompts
Questions that ask the user to input
data
Fulfillment
The business logic required to fulfill the
user’s intent
BookHotel
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex Customers
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Build On!
Donnie Prakoso
@donnieprakoso

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
 
Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend & Amazon TranslateBuild Text Analytics Solutions with Amazon Comprehend & Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate
 
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
 
STG302_Best Practices for Amazon S3
STG302_Best Practices for Amazon S3STG302_Best Practices for Amazon S3
STG302_Best Practices for Amazon S3
 
NEW LAUNCH! Introducing Amazon Translate – Now in Preview - MCL209 - re:Inven...
NEW LAUNCH! Introducing Amazon Translate – Now in Preview - MCL209 - re:Inven...NEW LAUNCH! Introducing Amazon Translate – Now in Preview - MCL209 - re:Inven...
NEW LAUNCH! Introducing Amazon Translate – Now in Preview - MCL209 - re:Inven...
 
Working with Amazon Lex Chatbots in Amazon Connect - AWS Online Tech Talks
Working with Amazon Lex Chatbots in Amazon Connect - AWS Online Tech TalksWorking with Amazon Lex Chatbots in Amazon Connect - AWS Online Tech Talks
Working with Amazon Lex Chatbots in Amazon Connect - AWS Online Tech Talks
 
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
 
GAM311-How Linden Lab Built a Virtual World on the AWS Cloud.pdf
GAM311-How Linden Lab Built a Virtual World on the AWS Cloud.pdfGAM311-How Linden Lab Built a Virtual World on the AWS Cloud.pdf
GAM311-How Linden Lab Built a Virtual World on the AWS Cloud.pdf
 
FSV307-Capital Markets Discovery How FINRA Runs Trade Analytics and Surveilla...
FSV307-Capital Markets Discovery How FINRA Runs Trade Analytics and Surveilla...FSV307-Capital Markets Discovery How FINRA Runs Trade Analytics and Surveilla...
FSV307-Capital Markets Discovery How FINRA Runs Trade Analytics and Surveilla...
 
BAP202_Amazon Connect Delivers Personalized Customer Experiences for Your Clo...
BAP202_Amazon Connect Delivers Personalized Customer Experiences for Your Clo...BAP202_Amazon Connect Delivers Personalized Customer Experiences for Your Clo...
BAP202_Amazon Connect Delivers Personalized Customer Experiences for Your Clo...
 
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDBSRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
 
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
 
Developing Sophisticated Serverless Applications with AI
Developing Sophisticated Serverless Applications with AIDeveloping Sophisticated Serverless Applications with AI
Developing Sophisticated Serverless Applications with AI
 
ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores...
ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores...ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores...
ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores...
 
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
 
Women in Big Data
Women in Big DataWomen in Big Data
Women in Big Data
 
Supercharge your Machine Learning Solutions with Amazon SageMaker
Supercharge your Machine Learning Solutions with Amazon SageMakerSupercharge your Machine Learning Solutions with Amazon SageMaker
Supercharge your Machine Learning Solutions with Amazon SageMaker
 
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdfGAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
 
ALX315_Test Automation for Alexa Skills
ALX315_Test Automation for Alexa SkillsALX315_Test Automation for Alexa Skills
ALX315_Test Automation for Alexa Skills
 
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
 

Ähnlich wie Serverless Text Analytics with Amazon Comprehend

AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
Amazon Web Services Korea
 

Ähnlich wie Serverless Text Analytics with Amazon Comprehend (20)

Sviluppare applicazioni voice-first con AWS e Amazon Alexa
Sviluppare applicazioni voice-first con AWS e Amazon AlexaSviluppare applicazioni voice-first con AWS e Amazon Alexa
Sviluppare applicazioni voice-first con AWS e Amazon Alexa
 
BDA302 Building Intelligent Apps with AWS Machine Learning Language Services
BDA302 Building Intelligent Apps with AWS Machine Learning Language ServicesBDA302 Building Intelligent Apps with AWS Machine Learning Language Services
BDA302 Building Intelligent Apps with AWS Machine Learning Language Services
 
Building Text Analytics Solutions with AWS ML Services
Building Text Analytics Solutions with AWS ML ServicesBuilding Text Analytics Solutions with AWS ML Services
Building Text Analytics Solutions with AWS ML Services
 
Build Intelligent Apps with Amazon ML
Build Intelligent Apps with Amazon ML Build Intelligent Apps with Amazon ML
Build Intelligent Apps with Amazon ML
 
Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...
Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...
Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...
 
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
 
Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...
Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...
Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...
 
Add Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML ServicesAdd Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML Services
 
AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...
AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...
AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...
 
Add Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML ServicesAdd Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML Services
 
Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...
Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...
Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...
 
Improving Customer Experience: Enhanced Customer Insights Using Natural Langu...
Improving Customer Experience: Enhanced Customer Insights Using Natural Langu...Improving Customer Experience: Enhanced Customer Insights Using Natural Langu...
Improving Customer Experience: Enhanced Customer Insights Using Natural Langu...
 
AI and Machine Learning - AWS Public Sector Summit Singapore 2017
AI and Machine Learning - AWS Public Sector Summit Singapore 2017AI and Machine Learning - AWS Public Sector Summit Singapore 2017
AI and Machine Learning - AWS Public Sector Summit Singapore 2017
 
Mike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdf
Mike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdfMike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdf
Mike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdf
 
Add Intelligence to Applications with AWS ML: Machine Learning Workshops SF
Add Intelligence to Applications with AWS ML: Machine Learning Workshops SFAdd Intelligence to Applications with AWS ML: Machine Learning Workshops SF
Add Intelligence to Applications with AWS ML: Machine Learning Workshops SF
 
Darin_Briskman_AWS_Machine_Learning_Beyond_the_Hype
Darin_Briskman_AWS_Machine_Learning_Beyond_the_HypeDarin_Briskman_AWS_Machine_Learning_Beyond_the_Hype
Darin_Briskman_AWS_Machine_Learning_Beyond_the_Hype
 
Natural Language Processing for Data Analytics - Tel Aviv Summit 2018
Natural Language Processing for Data Analytics - Tel Aviv Summit 2018Natural Language Processing for Data Analytics - Tel Aviv Summit 2018
Natural Language Processing for Data Analytics - Tel Aviv Summit 2018
 
AI and Machine Learning Services
AI and Machine Learning ServicesAI and Machine Learning Services
AI and Machine Learning Services
 
AWS 機器學習 I ─ 人工智慧 AI
AWS 機器學習 I ─ 人工智慧 AIAWS 機器學習 I ─ 人工智慧 AI
AWS 機器學習 I ─ 人工智慧 AI
 
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex PollexyMCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
 

Mehr von Donnie Prakoso

Mehr von Donnie Prakoso (6)

Programming Infrastructure with AWS CDK
Programming Infrastructure with AWS CDKProgramming Infrastructure with AWS CDK
Programming Infrastructure with AWS CDK
 
Modern Application Development for Startups
Modern Application Development for StartupsModern Application Development for Startups
Modern Application Development for Startups
 
Operating Microservices at Hyperscale — Tech in Asia PDC 2019
Operating Microservices at Hyperscale — Tech in Asia PDC 2019Operating Microservices at Hyperscale — Tech in Asia PDC 2019
Operating Microservices at Hyperscale — Tech in Asia PDC 2019
 
How to Use AWS Lambda Layers and Lambda Runtime
How to Use AWS Lambda Layers and Lambda RuntimeHow to Use AWS Lambda Layers and Lambda Runtime
How to Use AWS Lambda Layers and Lambda Runtime
 
More Containers Less Operations
More Containers Less OperationsMore Containers Less Operations
More Containers Less Operations
 
Building Serverless Microservices with AWS
Building Serverless Microservices with AWSBuilding Serverless Microservices with AWS
Building Serverless Microservices with AWS
 

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 

Serverless Text Analytics with Amazon Comprehend

  • 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Donnie Prakoso, MSc AWS Technology Evangelist, ASEAN Text Analytics Workload with Amazon Comprehend AWS User Group Meetup @donnieprakoso
  • 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hello, World. Donnie Prakoso, MSc AWS Technology Evangelist, ASEAN @donnieprakoso donnieprakoso • Speak in Go and Python • Machine Learning and Serverless • I AWS User Groups
  • 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Let’s Discuss Something • Why do we need text analytics? • What are the examples of the use cases? • How Amazon Comprehend can help you? • Demo + API and architecture diagram example https://bit.ly/aws-donnie-serverless-text-analytics
  • 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why do we need text analytics?
  • 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Enabling The Possibility for These Use Cases • News Media • Brand trends, correlating events • Customer engagement • Call center, issue triage, social media analytics • Records and research • Actionable document-centric processes, understand patterns
  • 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Machine Learning Services
  • 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. FRAMEWORKS AND INTERFACES AI for data scientists KERAS Frameworks Interfaces APPLICATION SERVICES AI for everyone P O L L Y R E K O G N I T I O N C O M P R E H E N DL E X R E K O G N I T I O N V I D E O T R A N S C R I B E T R A N S L A T E PLATFORM SERVICES AI for engineers AMAZON SAGEMAKER
  • 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. G e t S t a r t e d w i t h A W S M L A p p l i c a t i o n S e r v i c e s POLLY REKOGNITION COMPREHENDLEX REKOGNITION VIDEO TRANSCRIBE TRANSLATE
  • 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Sentiment Entities Languages Key phrases Topic modeling POWERED BY DEEP LEARNING Amazon Comprehend Discover insights and relationships in text
  • 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Entities Key Phrases Language Sentiment Amazon Comprehend Amazon Comprehend Discover insights and relationships in text
  • 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. A m a z o n . c o m , I n c . i s l o c a t e d i n S e a t t l e , W A a n d w a s f o u n d e d J u l y 5 t h , 1 9 9 4 b y J e f f B e z o s . O u r c u s t o m e r s l o v e b u y i n g e v e r y t h i n g f r o m b o o k s t o b l e n d e r s a t g r e a t p r i c e s N a m e d E n t i t i e s • A m a z o n . c o m : O r g a n i z a t i o n • S e a t t l e , W A : L o c a t i o n • J u l y 5 t h , 1 9 9 4 : D a t e • J e f f B e z o s : P e r s o n K e y p h r a s e s • O u r c u s t o m e r s • b o o k s • b l e n d e r s • g r e a t p r i c e s S e n t i m e n t • P o s i t i v e L a n g u a g e • E n g l i s h Text Analysis
  • 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Synchronous • DetectDominantLanguage and BatchDetectDominantLanguage – to detect the dominant language in a document. We can detect up to 100 languages. • DetectEntities and Batch DetectEntities – to detect the entities, such as persons or places, in the document. • DetectKeyPhrases and Batch DetectKeyPhrases – to detect key noun phrases that are most indicative of the content. • DetectSentiment and Batch DetectSentiment – to detect the emotional sentiment, positive, negative, mixed, or neutral, of a document. API Summary - Synchronous
  • 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Demo Twitter Sentiment Analysis w/ Amazon Comprehend
  • 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Twitter Search API Analyze social media postings and comments AWS Lambda Amazon S3 AWS IoT Amazon DynamoDB
  • 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Twitter Stream API Organize and classify customer feedback and look for common patterns. Visualize results in Amazon QuickSight Amazon Kinesis Amazon Athena Amazon S3 AWS Lambda
  • 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend Customer Feedback Analytics
  • 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend STORM WORLD SERIES STOCK MARKET WASHINGTON LIBRARY OF NEWS ARTICLES Amazon Comprehend Topic Modelling
  • 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Topic Modeling Document Topic Proportion Doc.txt 0 .89 Doc.txt 1 .67 Doc.txt 2 .91 Topic Term Weight 0 Washington .89 1 Silicon Valley .67 2 Roasting .91 Keywords Topic Groups Document Relationship to Topics
  • 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Asynchronous • StartTopicDetection – to start a topic modeling job • ListTopicDetection – to list all your submitted jobs • DescribeTopicDetection –to get progress status and information about each submitted job API Summary - Asynchronous
  • 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Demo Classifying Customer Feedback
  • 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Comprehend + AWS = Scale Text Analytics Amazon Kinesis Amazon EMR Amazon Redshift Amazon EMR • Semantic • Rich Filtering • Grouping, Trends • Joining, Correlating • Clustering • Graph, Search • Near real-time • Alerts Amazon S3 Articles, Documents Social Media, Support Amazon Aurora
  • 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend Knowledge Management and Discovery
  • 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Ideas Are Welcome Content Personalization: Customers are using Comprehend NLP output to understand related documents based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and recommendations Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking search results. Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in relational databases, processing data within the data lake (S3) and then inserting it back into the data warehouse Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from entities and sentiment from social media posts across Twitter and Facebook. Information management: Customers are using Amazon Comprehend for indexing and finding related content for enterprise information management and various internal business processes including compliance and IT.
  • 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Scale Business Logic SecurityAnalytics Text to Speech Speech to Intent End to End Native support & maintains context One-click deployment Completely managed service Native integration with AWS Lambda Encrypted data in transit & at rest Monitor and improve Amazon Polly integrated into API ASR + NLU integrated into one API Dialog Management Deployment
  • 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Informational Bots Chatbots for everyday consumer requests Application Bots Build powerful interfaces to mobile applications News updates Weather information Game scores …. Book tickets Order food Manage bank accounts …. Enterprise Productivity Bots Streamline enterprise work activities and improve efficiencies Check sales numbers Marketing performance Inventory status …. Internet of Things (IoT) Bots Enable conversational interfaces for device interactions Wearables Appliances Auto …. Contact Center Bots Chatbots for customer service IVR Account inquiries Bill payment Service update …. Use cases
  • 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Intents A particular goal that the user wants to achieve Utterances Spoken or typed phrases that invoke your intent Slots Data the user must provide to fulfill the intent Prompts Questions that ask the user to input data Fulfillment The business logic required to fulfill the user’s intent BookHotel
  • 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Customers
  • 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Build On! Donnie Prakoso @donnieprakoso