Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.

Building High-Quality Apps for Google Assistant

497 Aufrufe

Veröffentlicht am

In this session, I will show you how to build great apps for the assistant using Dialogflow and Actions on Google. Building Actions with Dialogflow is deceptively easy, but building great apps that meet the quality bar requires in-depth knowledge of the design guidelines we defined. In this talk, I'm going to walk you through the best practices for VUI design and will show you how to apply these to your Assistant apps. We’ll cover topics such as handling new and returning users, robust error handling for no-input and no-match situations, and being able to repeat information for the user. We will also look at strategies for implementing multi-lingual apps and how to design for multiple surfaces at the same time.

Veröffentlicht in: Technologie
  • Als Erste(r) kommentieren

Building High-Quality Apps for Google Assistant

  1. 1. Building High-Quality Apps for Google Assistant Peter Friese Developer Advocate, Google @peterfriese
  2. 2. Building High-Quality Apps for Google Assistant Hello and welcome to this session on "Building high quality apps for the Google Assistant"!
  3. 3. Building High-Quality Apps for Google Assistant Hello and welcome to this session on "Building high quality apps for the Google Assistant"! I am the Google Assistant, and I could not be more excited to be here with you today to tell you everything about Actions on Google and Dialogflow.
  4. 4. Building High-Quality Apps for Google Assistant I am the Google Assistant, and I could not be more excited to be here with you today to tell you everything about Actions on Google and Dialogflow. But first, let me introduce my assistant: Peter Friese!
  5. 5. Peter, why don't you introduce yourself? Building High-Quality Apps for Google Assistant But first, let me introduce my assistant: Peter Friese! Let’s give him a warm round of applause!
  6. 6. Peter, why don't you introduce yourself? Building High-Quality Apps for Google Assistant …
  7. 7. Peter, why don't you introduce yourself? Building High-Quality Apps for Google Assistant … Ich spreche viele verschiedene Sprachen!
  8. 8. Meet the Assistant Ask it questions. Tell it to do things. It’s your own personal Google, always ready to help
  9. 9. Ready to help across 400M+ devices
  10. 10. Built on cutting edge Google tech Payments Location & Context awareness Knowledge Graph Identity Structured Data Markup Natural Language Understanding Machine Learning Individual speech recognition
  11. 11. Voice Typing Tap Google Lens
  12. 12. A growing audience: Devices
  13. 13. A growing audience: Languages JapaneseGerman FR French CA French Korean UK English AU English CA English US English Italian Spanish BR Portuguese LATAM Spanish IN English Russian Hindi Thai Indonesian Danish Norwegian Swedish Dutch
  14. 14. UI options enable new use cases
  15. 15. Building for the Google Assistant Building an app in less than 5 minutes
  16. 16. Demo!
  17. 17. How does it work?
  18. 18. Step 1: Create a new project
  19. 19. Step 1: Create a new project
  20. 20. Step 1: Create a new project
  21. 21. Step 2: Define Intents
  22. 22. Step 2: Define Intents
  23. 23. Step 2: Define Intents
  24. 24. Step 2: Define Intents
  25. 25. Step 3: Test in simulator
  26. 26. Step 3: Test in Dialogflow simulator
  27. 27. Step 4: Set up Actions on Google Integration
  28. 28. Step 4: Set up Actions on Google Integration
  29. 29. Step 5: Test in Actions on Google Simulator
  30. 30. Step 5: Test on Device
  31. 31. Demo!
  32. 32. • New Intent: “I am hungry” • Return predefined answers • Add Entities for kinds of food Demo!
  33. 33. Antipatterns
  34. 34. How can we avoid antipatterns?
  35. 35. ^ KEEP CALM AND READ THE FANTASTIC MANUAL
  36. 36. Design Resources: g.co/dev/ActionsDesign
  37. 37. Focus on the user and all else will follow. Ten Things https://www.google.com/about/philosophy.html
  38. 38. Think outside the box
  39. 39. ✘ ✔ Think outside the box … literally
  40. 40. Best Practices
  41. 41. Best Practices for Google Assistant apps Must-do Recommended Additional
  42. 42. • Invocation Name • Greeting / Exit • Error Handling • Repeating • The open mic issue Best Practices - Must Do
  43. 43. Invocation Name OK Google, talk to … OK Google, speak to … OK Google, ask … to … Explicit triggers OK Google, order a … Implicit triggers
  44. 44. Invocation Name - Explicit triggers Invocation name At least two words
  45. 45. Invocation Name - Implicit triggers Choose intents
  46. 46. Greetings - Don’t be a bore! Hello, and welcome to … Hello! This is … ! Glad to see you. Welcome to … These will be cycled
  47. 47. Greetings - Return Visitors Hello, and welcome to Do It Already. I can tell you about your due tasks or add a new task to the list. What would you like to do? Welcome back to Do It Already! You’ve got three due tasks today. Here is the first one:
 “Deliver a kick-ass talk at MobileTechCon.”
 Now get cracking!
  48. 48. Greetings - Return Visitors function welcome(app: DialogflowApp) { if (app.getLastSeen()) { app.ask("Welcome back to Do It Already!") } else { app.ask(strings.welcome()) } }
  49. 49. Exit / Farewell Goodbye! Goodbye, come back soon! actions_intent_CANCEL
  50. 50. Error Handling What’s the priority for this task? … ⚡ No input What’s the priority for this task? Gobbledygook ⚡ No match
  51. 51. Error Handling What’s the priority for this task? … What’s the priority for this task? Gobbledygook • Always be helpful • Try to get the conversation back on track • Be progressively more helpful and provide more detail / hints • Give up after 3 attempts
  52. 52. Error Handling - Strategies Rapid reprompt • “What was that?” • “Say that again?” Reframe the question • “What time is this for” —> “Sorry, what time?” • “For when?” —> “What time would you like to book this for? Ask another way • “If it helps, we can do this one piece at a time.” Be ready for questions about the question • “I have your name and email from your account, so now all I need is your phone number.” Be proactive • I could put you down for 6 for now, does that work? • Do you want to finish this later?
  53. 53. Replay information at the user’s request It seems like the flight to San Francisco is the 7:05am flight via London Heathrow. Would you like to book it now? Sorry, can you say that again?
  54. 54. Replay information It seems like the flight to San Francisco is the 7:05am flight via London Heathrow. Would you like to book it now? Sorry, can you say that again? • Keep track of the last messages the app sent • Implement a repeat intent • Prefix the last message with a randomised repeat string
  55. 55. Replay information const REPEAT_PREFIX: [ “Sorry, I said “, “Let me repeat that.” ]; function repeat (app) { let repeatPrefix = promptFetch.getRepeatPrefix(); app.ask(repeatPrefix + app.data.lastPrompt, app.data.lastNoInputPrompts); }
  56. 56. The open microphone issue
  57. 57. The open microphone issue function areWeThereYet(app) { const response = “We will arrive very soon. Promised.”
 app.ask(response); } function quit(app) { const response = “It has been nice talking with you.”
 app.tell(response); } Microphone closed Microphone open No prompt 😱
  58. 58. The open microphone issue app.ask(); app.tell(); The conversation will go on, and your message needs to end with a prompt The conversation will end after this turn. Don’t include a prompt.
  59. 59. • Support multiple languages • Use Rich Responses Best practices - Recommended
  60. 60. Support multiple languages
  61. 61. Use Rich Responses Speech bubble
  62. 62. Use Rich Responses Suggestion chips
  63. 63. Use Rich Responses Basic cards
  64. 64. Use Rich Responses Carousel
  65. 65. Use Rich Responses List
  66. 66. • Use follow-up intents • Check out the sample agents Dialogflow-specific
  67. 67. Title TextDo not misuse Entities ✘ ✘
  68. 68. Title TextUse Follow-up Intents instead ✔
  69. 69. Title TextRe-use ready solutions
  70. 70. Key take-aways Google Assistant is more than just smart speakers Building Assistant Actions is really easy with Dialogflow Close the mic, Dude! Read the docs and follow our guidelines
  71. 71. Thank you! Peter Friese Developer Advocate, Google @peterfriese
  72. 72. How to stay in touch dialogflow.com/ github.com/dialogflow tag: dialogflow Actions on Google actions.google.com github.com/actions-on-google tag: actions-on-google Peter Friese Developer Advocate, Google @peterfriese
  73. 73. The End.

×