SlideShare ist ein Scribd-Unternehmen logo
1 von 35
How to build voice
interfaces professionally
Fabian Dill, DieProduktMacher
Grand Event about Chatbots and Voice Interfaces
June 23rd
Agenda
When to consider voice user interfaces (VUIs)
How to design great experiences for VUIs
How to develop VUIs
2
1
2
3
When to consider VUIs?
3
Conversational is the new normal
MESSAGING APPS HAVE SURPASSED
SOCIAL NETWORKS (Monthly active users for top 4 social networks and messaging apps)
Big 4 Social
Network Apps
Big 4 Messaging Apps
4
Why now? Because we can
0
5
10
15
20
25
30
2010 2011 2012 2013 2014 2015
Error rate
0
2
4
6
8
10
12
14
16
Error rate
1. Deep Learning
Algorithm
5
ERROR RATE IN IMAGE RECOGNITION
(ILSVRC RESULTS)
ERROR RATE IN SPEECH RECOGNITION
Two types of conversational interfaces are on the rise.
6
What kind of conversational interfaces?
TEXT | Chatbots VOICE | existing platforms custom build
7
• Siri (Apple)
• Google Assistent (Google)
• Google Home (Google)
• Cortana (Microsoft)
• Alexa (Amazon)
• Bragi
Voice interfaces are not restricted to Alexa skills
In addition to these voice interface
platforms custom build solutions
are possible:
• Matrix Labs
• Google Speech API
• Alexa Services / Amazon Lex
8
You can also built your custom voice interfaces
9
Half of the Germans already used a voice interface
10
Before Alexa VUIs were tied to Smartphones
11
As you can see in the typical applications
12
In the following I will focus on Alexa skills
OPERATORS &
EXECUTORS
• Commerce
(fashion, flowers,
food delivery)
• Booking
(Tickets, Travel, …)
• Banking
DOMAIN
KNOWLEDGE EXPERTS
• Customer Support
• Advice and
Recommendations
• Domain-specific
knowledge:
• Sports
• News
• Travel
• Insurance
13
Three types of Conversational UIs (Chatbots)
PERSONAL
ASSISTANT
• Google Assistant
• Facebook M
• Apple Siri
• Microsoft Cortana
• Amazon Alexa
14
(SHORT)
INFORMATION
Types of Voice Interfaces
TV program, weather,
news, knowledge,
status information
ENTERTAINMENT
Jokes, Games,
…
ADVICE AND
RECOMMENDATION
Fashion,
Travel, ...
TRANSACTIONAL
Shopping,
Booking
CUSTOMER CARE?
15
Smart Home
Physical Device
Game
Complex Interaction
Handsfree environment (e.g. car, climbing, assembly, …)
Your user experience can significantly improve
When to consider Voice Interfaces?
16
How to design great
experiences for VUIs
17
PRODUCT
ATTRIBUTES
• Goal
• Target Group
• Core Value
PERSONALITY
• Age and gender
• Adjective
• Name
EXAMPLE
DIALOG
• Text
• Talk
• Record
Our current best practices
18
ASK
TELL
REMEMBER
… keeps the dialog going, listens to further user input
… use it for questions, reprompts, error messages
Endpoint of the dialog, shuts down the session
Use it for results, stop and goodbye
Creating a DynamoDB storage is just one line of code!
Create dialogs
19
How to develop VUIs
20
The usual Alexa skill environment 
21
• Use your favorite IDE (code completions, shortcuts, etc.)
• Realise parallel development (>1 developer)
• Extend live product with new features
• Be able to rollback (in the unlikely case someone messed it up)
Why professional development?
22
Serverless to the rescue
23
Deploying with Serverless
Our road to a professional development
enviroment for VUIs (Alexa)
AUTOM.
TESTING
How to create
unit
and integration
tests
MULTI-
LANGUAGE
SUPPORT
Separate
language from
functionality
STAGING
Create stages
for interaction
model and
backend
lambdas
LOCAL
DEVELOPMENT
Set up a local
development
environment
25
• Develop a skill in several languages (English, German)
• Separate utterances from functionality
• Require the correct language file at runtime
Multi-language Support Preparation
26
Multi-language Support
Input / Output
language based on
user settings in Alexa
App
locale: 'de-DE'
handler.js
i18n/de-DE.js
i18n/en-US.js
i18n/en-UK.js
locale: 'de-DE'
// require specific language file
const languages =
require(`./locales/${lang}.js`)
// get text message according to locale
const getText = (alexa, message,
attributes, index) => {
return Language.getText(
alexa.event.request.locale,
message,
attributes,
index)
}
ALEXA
AWS
lambda
27
Separate language from functionality (DEMO)
SERVERLESS
INDIVIDUAL DEVELOPMENT INTEGRATION PRODUCTION
INTERACTION
MODEL / SKILL
BACKEND /
LAMBDA
GIT REPO /
GITFLOW
static arn
28
Parallel Development,
Staging and releases with Alexa
manual copy manual copy manual copy
FEATURE
DEVELOP
MASTER
RELEASE
29
Copying interaction models =
manual 5-step process 
30
• Error prone  developer has to be on the correct branch
• Next step: automate or use continuous integration system
31
We use Serverless to connect correct branch with
referring stage
• Install as a serverless plugin
• Start a local server
• Share localhost with the internet
• Configure Alexa skill to use your HTTPS
endpoint
32
We are working on a serverless plugin to allow for
local development
33
Develop and test locally until commit
• Several use cases applicable for voice interfaces
• Design dialogs by prototyping them extensively
• Alexa infrastructure is not yet ready for a professional setup
• There are several ways to optimize your development process (we shared one of them)
• We are on our journey to continuously improve this process
• We are looking for input, comments, other experiences and new team members 
34
Conclusion
Contact:
35
Fabian Dill
CEO
Email: fabian.dill@produktmacher.com
Telefon: 089 / 189 46 54

Weitere ähnliche Inhalte

Ähnlich wie How to build voice interfaces in a professional way

Presentation final
Presentation finalPresentation final
Presentation finalRoy Hibbert
 
Как да станем софтуерни инженери и да стартираме ИТ бизнес?
Как да станем софтуерни инженери и да стартираме ИТ бизнес?Как да станем софтуерни инженери и да стартираме ИТ бизнес?
Как да станем софтуерни инженери и да стартираме ИТ бизнес?Svetlin Nakov
 
Flutter vs. MAUI - Techorama BE 2022
Flutter vs. MAUI - Techorama BE 2022Flutter vs. MAUI - Techorama BE 2022
Flutter vs. MAUI - Techorama BE 2022Tobias Hoppenthaler
 
Flutter vs. MAUI - what should you pick and why?
Flutter vs. MAUI - what should you pick and why?Flutter vs. MAUI - what should you pick and why?
Flutter vs. MAUI - what should you pick and why?Tobias Hoppenthaler
 
Multi-platform Mobile apps with Phonegap
Multi-platform Mobile apps with PhonegapMulti-platform Mobile apps with Phonegap
Multi-platform Mobile apps with PhonegapGautam Chaudhary
 
OpenNTF Updates 03/05/13
OpenNTF Updates 03/05/13OpenNTF Updates 03/05/13
OpenNTF Updates 03/05/13Niklas Heidloff
 
White paper native, web or hybrid mobile app development
White paper  native, web or hybrid mobile app developmentWhite paper  native, web or hybrid mobile app development
White paper native, web or hybrid mobile app developmentIBM Software India
 
Маргарита Остапчук (Microsoft Украина) «Разработка на универсальной платформе...
Маргарита Остапчук (Microsoft Украина) «Разработка на универсальной платформе...Маргарита Остапчук (Microsoft Украина) «Разработка на универсальной платформе...
Маргарита Остапчук (Microsoft Украина) «Разработка на универсальной платформе...DataArt
 
Абрамович Максим, "Rad studio xe4"
Абрамович Максим, "Rad studio xe4"Абрамович Максим, "Rad studio xe4"
Абрамович Максим, "Rad studio xe4"EPAM Systems
 
The Great Mobile Debate: Native vs. Hybrid App Development
The Great Mobile Debate: Native vs. Hybrid App DevelopmentThe Great Mobile Debate: Native vs. Hybrid App Development
The Great Mobile Debate: Native vs. Hybrid App DevelopmentNick Landry
 
AI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using PythonAI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using Pythonamyiris
 
AppStudio for ArcGIS: The Basics - Esri FedGIS 2016
AppStudio for ArcGIS: The Basics - Esri FedGIS 2016AppStudio for ArcGIS: The Basics - Esri FedGIS 2016
AppStudio for ArcGIS: The Basics - Esri FedGIS 2016Blue Raster
 
Guest Lecture _ Python Basics _ Alexa Skill Dev _ by Shivam Dutt Sharma
Guest Lecture _ Python Basics _ Alexa Skill Dev _ by Shivam Dutt SharmaGuest Lecture _ Python Basics _ Alexa Skill Dev _ by Shivam Dutt Sharma
Guest Lecture _ Python Basics _ Alexa Skill Dev _ by Shivam Dutt SharmaShivamDuttSharma
 
Info Session GDSC USICT
Info Session GDSC USICTInfo Session GDSC USICT
Info Session GDSC USICTDSCUSICT
 
Stronger than Chuck Norris: SharePoint in clouds, on earth, in subway and in ...
Stronger than Chuck Norris: SharePoint in clouds, on earth, in subway and in ...Stronger than Chuck Norris: SharePoint in clouds, on earth, in subway and in ...
Stronger than Chuck Norris: SharePoint in clouds, on earth, in subway and in ...Adis Jugo
 
Mobile App Landscape for the Non-Technical
Mobile App Landscape for the Non-TechnicalMobile App Landscape for the Non-Technical
Mobile App Landscape for the Non-TechnicalJames Quick
 
Embarcadero's Connected Development
Embarcadero's Connected DevelopmentEmbarcadero's Connected Development
Embarcadero's Connected DevelopmentJim McKeeth
 
Mobile App Development by Will Yeo
Mobile App Development by Will YeoMobile App Development by Will Yeo
Mobile App Development by Will Yeo"Il "Will"​" Yeo
 

Ähnlich wie How to build voice interfaces in a professional way (20)

Build Alexa Skills for Hindi - Workshop
Build Alexa Skills for Hindi - WorkshopBuild Alexa Skills for Hindi - Workshop
Build Alexa Skills for Hindi - Workshop
 
Presentation final
Presentation finalPresentation final
Presentation final
 
Как да станем софтуерни инженери и да стартираме ИТ бизнес?
Как да станем софтуерни инженери и да стартираме ИТ бизнес?Как да станем софтуерни инженери и да стартираме ИТ бизнес?
Как да станем софтуерни инженери и да стартираме ИТ бизнес?
 
Flutter vs. MAUI - Techorama BE 2022
Flutter vs. MAUI - Techorama BE 2022Flutter vs. MAUI - Techorama BE 2022
Flutter vs. MAUI - Techorama BE 2022
 
Flutter vs. MAUI - what should you pick and why?
Flutter vs. MAUI - what should you pick and why?Flutter vs. MAUI - what should you pick and why?
Flutter vs. MAUI - what should you pick and why?
 
Multi-platform Mobile apps with Phonegap
Multi-platform Mobile apps with PhonegapMulti-platform Mobile apps with Phonegap
Multi-platform Mobile apps with Phonegap
 
OpenNTF Updates 03/05/13
OpenNTF Updates 03/05/13OpenNTF Updates 03/05/13
OpenNTF Updates 03/05/13
 
White paper native, web or hybrid mobile app development
White paper  native, web or hybrid mobile app developmentWhite paper  native, web or hybrid mobile app development
White paper native, web or hybrid mobile app development
 
Маргарита Остапчук (Microsoft Украина) «Разработка на универсальной платформе...
Маргарита Остапчук (Microsoft Украина) «Разработка на универсальной платформе...Маргарита Остапчук (Microsoft Украина) «Разработка на универсальной платформе...
Маргарита Остапчук (Microsoft Украина) «Разработка на универсальной платформе...
 
Абрамович Максим, "Rad studio xe4"
Абрамович Максим, "Rad studio xe4"Абрамович Максим, "Rad studio xe4"
Абрамович Максим, "Rad studio xe4"
 
The Great Mobile Debate: Native vs. Hybrid App Development
The Great Mobile Debate: Native vs. Hybrid App DevelopmentThe Great Mobile Debate: Native vs. Hybrid App Development
The Great Mobile Debate: Native vs. Hybrid App Development
 
Xamarin the good, the bad and the ugly
Xamarin  the good, the bad and the uglyXamarin  the good, the bad and the ugly
Xamarin the good, the bad and the ugly
 
AI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using PythonAI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using Python
 
AppStudio for ArcGIS: The Basics - Esri FedGIS 2016
AppStudio for ArcGIS: The Basics - Esri FedGIS 2016AppStudio for ArcGIS: The Basics - Esri FedGIS 2016
AppStudio for ArcGIS: The Basics - Esri FedGIS 2016
 
Guest Lecture _ Python Basics _ Alexa Skill Dev _ by Shivam Dutt Sharma
Guest Lecture _ Python Basics _ Alexa Skill Dev _ by Shivam Dutt SharmaGuest Lecture _ Python Basics _ Alexa Skill Dev _ by Shivam Dutt Sharma
Guest Lecture _ Python Basics _ Alexa Skill Dev _ by Shivam Dutt Sharma
 
Info Session GDSC USICT
Info Session GDSC USICTInfo Session GDSC USICT
Info Session GDSC USICT
 
Stronger than Chuck Norris: SharePoint in clouds, on earth, in subway and in ...
Stronger than Chuck Norris: SharePoint in clouds, on earth, in subway and in ...Stronger than Chuck Norris: SharePoint in clouds, on earth, in subway and in ...
Stronger than Chuck Norris: SharePoint in clouds, on earth, in subway and in ...
 
Mobile App Landscape for the Non-Technical
Mobile App Landscape for the Non-TechnicalMobile App Landscape for the Non-Technical
Mobile App Landscape for the Non-Technical
 
Embarcadero's Connected Development
Embarcadero's Connected DevelopmentEmbarcadero's Connected Development
Embarcadero's Connected Development
 
Mobile App Development by Will Yeo
Mobile App Development by Will YeoMobile App Development by Will Yeo
Mobile App Development by Will Yeo
 

Kürzlich hochgeladen

Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 

Kürzlich hochgeladen (20)

Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 

How to build voice interfaces in a professional way

  • 1. How to build voice interfaces professionally Fabian Dill, DieProduktMacher Grand Event about Chatbots and Voice Interfaces June 23rd
  • 2. Agenda When to consider voice user interfaces (VUIs) How to design great experiences for VUIs How to develop VUIs 2 1 2 3
  • 4. Conversational is the new normal MESSAGING APPS HAVE SURPASSED SOCIAL NETWORKS (Monthly active users for top 4 social networks and messaging apps) Big 4 Social Network Apps Big 4 Messaging Apps 4
  • 5. Why now? Because we can 0 5 10 15 20 25 30 2010 2011 2012 2013 2014 2015 Error rate 0 2 4 6 8 10 12 14 16 Error rate 1. Deep Learning Algorithm 5 ERROR RATE IN IMAGE RECOGNITION (ILSVRC RESULTS) ERROR RATE IN SPEECH RECOGNITION
  • 6. Two types of conversational interfaces are on the rise. 6 What kind of conversational interfaces? TEXT | Chatbots VOICE | existing platforms custom build
  • 7. 7 • Siri (Apple) • Google Assistent (Google) • Google Home (Google) • Cortana (Microsoft) • Alexa (Amazon) • Bragi Voice interfaces are not restricted to Alexa skills
  • 8. In addition to these voice interface platforms custom build solutions are possible: • Matrix Labs • Google Speech API • Alexa Services / Amazon Lex 8 You can also built your custom voice interfaces
  • 9. 9 Half of the Germans already used a voice interface
  • 10. 10 Before Alexa VUIs were tied to Smartphones
  • 11. 11 As you can see in the typical applications
  • 12. 12 In the following I will focus on Alexa skills
  • 13. OPERATORS & EXECUTORS • Commerce (fashion, flowers, food delivery) • Booking (Tickets, Travel, …) • Banking DOMAIN KNOWLEDGE EXPERTS • Customer Support • Advice and Recommendations • Domain-specific knowledge: • Sports • News • Travel • Insurance 13 Three types of Conversational UIs (Chatbots) PERSONAL ASSISTANT • Google Assistant • Facebook M • Apple Siri • Microsoft Cortana • Amazon Alexa
  • 14. 14 (SHORT) INFORMATION Types of Voice Interfaces TV program, weather, news, knowledge, status information ENTERTAINMENT Jokes, Games, … ADVICE AND RECOMMENDATION Fashion, Travel, ... TRANSACTIONAL Shopping, Booking CUSTOMER CARE?
  • 15. 15 Smart Home Physical Device Game Complex Interaction Handsfree environment (e.g. car, climbing, assembly, …) Your user experience can significantly improve When to consider Voice Interfaces?
  • 16. 16 How to design great experiences for VUIs
  • 17. 17 PRODUCT ATTRIBUTES • Goal • Target Group • Core Value PERSONALITY • Age and gender • Adjective • Name EXAMPLE DIALOG • Text • Talk • Record Our current best practices
  • 18. 18 ASK TELL REMEMBER … keeps the dialog going, listens to further user input … use it for questions, reprompts, error messages Endpoint of the dialog, shuts down the session Use it for results, stop and goodbye Creating a DynamoDB storage is just one line of code! Create dialogs
  • 20. 20 The usual Alexa skill environment 
  • 21. 21 • Use your favorite IDE (code completions, shortcuts, etc.) • Realise parallel development (>1 developer) • Extend live product with new features • Be able to rollback (in the unlikely case someone messed it up) Why professional development?
  • 24. Our road to a professional development enviroment for VUIs (Alexa) AUTOM. TESTING How to create unit and integration tests MULTI- LANGUAGE SUPPORT Separate language from functionality STAGING Create stages for interaction model and backend lambdas LOCAL DEVELOPMENT Set up a local development environment
  • 25. 25 • Develop a skill in several languages (English, German) • Separate utterances from functionality • Require the correct language file at runtime Multi-language Support Preparation
  • 26. 26 Multi-language Support Input / Output language based on user settings in Alexa App locale: 'de-DE' handler.js i18n/de-DE.js i18n/en-US.js i18n/en-UK.js locale: 'de-DE' // require specific language file const languages = require(`./locales/${lang}.js`) // get text message according to locale const getText = (alexa, message, attributes, index) => { return Language.getText( alexa.event.request.locale, message, attributes, index) } ALEXA AWS lambda
  • 27. 27 Separate language from functionality (DEMO)
  • 28. SERVERLESS INDIVIDUAL DEVELOPMENT INTEGRATION PRODUCTION INTERACTION MODEL / SKILL BACKEND / LAMBDA GIT REPO / GITFLOW static arn 28 Parallel Development, Staging and releases with Alexa manual copy manual copy manual copy FEATURE DEVELOP MASTER RELEASE
  • 29. 29 Copying interaction models = manual 5-step process 
  • 30. 30
  • 31. • Error prone  developer has to be on the correct branch • Next step: automate or use continuous integration system 31 We use Serverless to connect correct branch with referring stage
  • 32. • Install as a serverless plugin • Start a local server • Share localhost with the internet • Configure Alexa skill to use your HTTPS endpoint 32 We are working on a serverless plugin to allow for local development
  • 33. 33 Develop and test locally until commit
  • 34. • Several use cases applicable for voice interfaces • Design dialogs by prototyping them extensively • Alexa infrastructure is not yet ready for a professional setup • There are several ways to optimize your development process (we shared one of them) • We are on our journey to continuously improve this process • We are looking for input, comments, other experiences and new team members  34 Conclusion