Diese Präsentation wurde erfolgreich gemeldet.
Die SlideShare-Präsentation wird heruntergeladen. ×

Google Assistant - Why? How?

Google Assistant - Why? How?

Herunterladen, um offline zu lesen

At Google, we believe the future is AI first, and we’re investing heavily in the fields of machine learning, speech recognition and language understanding. These technologies come together in the Google Assistant, which allows you to have a conversation with Google that helps you get things done.

Developers can build apps for the Google Assistant using Actions on Google and in these slides we will show you how you can do it and why you wish to be in this new platform.

At Google, we believe the future is AI first, and we’re investing heavily in the fields of machine learning, speech recognition and language understanding. These technologies come together in the Google Assistant, which allows you to have a conversation with Google that helps you get things done.

Developers can build apps for the Google Assistant using Actions on Google and in these slides we will show you how you can do it and why you wish to be in this new platform.

Weitere Verwandte Inhalte

Ähnliche Bücher

Kostenlos mit einer 30-tägigen Testversion von Scribd

Alle anzeigen

Ähnliche Hörbücher

Kostenlos mit einer 30-tägigen Testversion von Scribd

Alle anzeigen

Google Assistant - Why? How?

  1. 1. Google Assistant! Why? How? UX Next Palo Alto 2017 +GreenIdo @GreenIdo
  2. 2. On your watch On your phone At home In your car
  3. 3. Ready to help across 100M+ devices
  4. 4. Location & Context awareness Knowledge Graph Identity Payments Structured Data Markup Natural Language Understanding Machine Learning Individual speech recognition Built on cutting edge Google tech
  5. 5. Voice Typing Tap Google Lens Coming soon
  6. 6. A growing audience: devices
  7. 7. Google Home / Mobile device — The surface to interact with the Assistant. The Google Assistant — A conversation between you and Google that helps you get things done in your world. Actions on Google — How developers can extend the assistant (via Assistant apps)
  8. 8. “OK Google, talk to...”
  9. 9. Ok Google, talk to Personal Chef Sure, here’s Personal Chef What are you in the mood for? What protein would you like to use? Speech to Text NLP Knowledge Graph ML Ranking User Profile Text to Speech Speech to Text Text to Speech ... Invoke Personal Chef action Parse query and generate response Well, it’s kind of cold outside, so I’d like...
  10. 10. Well, it’s kind of cold outside, so I'd like something to warm me up, like a hot soup, and I want it fast. I have some chicken, and also canned tomatoes
  11. 11. Assistant app { conversation api request } { conversation api response } user input app response
  12. 12. “ Intent Matching — Match and categorize user utterances to an intent. Entity Extraction — Identify key words and phrases spoken by the user.@
  13. 13. Ok Google, talk to Personal Chef Sure, here’s Personal Chef What are you in the mood for? What protein would you like to use? Speech to Text NLP Knowledge Graph ML Ranking User Profile Speech to Text Text to Speech ... ... ... Trigger WELCOME event ... NLP: Intent Matching Entity Extraction Well, it’s kind of cold outside, so I’d like...
  14. 14. “Find me a recipe for homemade cannoli” User Says Response “Here’s the best one I can find” Webhook Entities: homemade cannoli “Find me a recipe for homemade cannoli”
  15. 15. A magical experience
  16. 16. g.co/dev/ActionsDesign
  17. 17. Support different surface capabilities https://developers.google.com/actions/assistant/surface-capabilities AUDIO_OUTPUT SCREEN_OUTPUT
  18. 18. function simpleResponse (app) { app.ask({ speech: 'Howdy! I can tell you fun facts about ' + 'almost any number, like 42. What do you have in mind?', displayText: 'Howdy! I can tell you fun facts about ' + 'almost any number. What do you have in mind?' }); } Support speech and display text https://developers.google.com/actions/assistant/responses Chat text should be a subset of audio
  19. 19. function suggestionChips (app) { app.ask(app.buildRichResponse() .addSimpleResponse({ speech: 'Howdy! I can tell you fun facts about ' + 'almost any number like 0, 42, or 100. What number do you have ' + 'in mind?', displayText: 'Howdy! I can tell you fun facts about almost any ' + 'number. What number do you have in mind?' }) .addSuggestions(['0', '42', '100', 'Never mind']) ); } Guide the user (suggestion chips) https://developers.google.com/actions/assistant/responses “OK Google, Talk to Bitcoin Info”
  20. 20. function basicCard (app) { app.ask(app.buildRichResponse() .addSimpleResponse('Math and prime numbers it is!') .addBasicCard( app.buildBasicCard(`42 is an even composite number. It ` + `is composed of three distinct prime numbers multiplied together. It ` + `has a total of eight divisors. 42 is an abunt number, because the ` + `sum of its proper divisors 54 is greater than itself. To count from ` + `1 to 42 would take you about twenty-one…`) .setTitle('Math & prime numbers') .addButton('Read more') .setImage('https://example.google.com/42.png', 'Image alternate text') ) ); } Display basic cards https://developers.google.com/actions/assistant/responses “OK Google, Talk to Marathon List And Tips”
  21. 21. Lists and carousels for selection https://developers.google.com/actions/assistant/responses Used for easy selection <10 items Used for comparison <30 items “OK Google, Talk to Marathon List And Tips”
  22. 22. Google Home Mobile Device NAME Registered device user’s full name Registered device user’s full name DEVICE_COARSE_LOCATION Zip code and city N/A DEVICE_PRECISE_LOCATION Coordinates and street address Coordinates let permission = app.SupportedPermissions.DEVICE_COARSE_LOCATION; app.askForPermission('To find bookstores near you', permission); Q: "Recommend me a local bookstore" A: "To find bookstores near you, I'll just need to get your zip code from Google. Is that okay?" Ask for information https://developers.google.com/actions/assistant/helpers#user_information
  23. 23. Link an account to your OAuth2 server https://developers.google.com/actions/identity/ Seamless account linking with Google Sign-in
  24. 24. Transact with the user https://developers.google.com/actions/identity/ Build orders Use Google provided payment instrument Use your payment processor (Stripe, Braintree, Vantiv, more coming) Update order status
  25. 25. Smart Home developers.google.com/actions/smarthome/ What is the temperature inside? Turn off all the lights. Dim the lights in the living room a little bit. What lights are on in the living room? Make it warmer. How many lights are on?
  26. 26. Google Assistant SDK developers.google.com/assistant/sdk
  27. 27. Reach users
  28. 28. In Dialogue Discovery: Explicit Triggering Ok Google, ask Personal Chef for a hot soup recipe Trigger Phrase App Name Developer Specified Action Preposition Action Phrase Developer Specified Working Examples: Let’s speak to Domino’s Ask Dr. Doggy if dogs can eat chocolate Ok Google, let’s talk to Personal Chef Trigger Phrase App Name Developer Specified
  29. 29. Hey Google, I want to play a game. Hey Google, tell me a joke. In Dialogue Discovery: Implicit Triggering Hey Google, I want to work out. Hey Google, what’s the surf report
  30. 30. Discovery in the Google Assistant Directory
  31. 31. Link to your Assistant App From anywhere Examples: ido-green.appspot.com/bots.html
  32. 32. Where do I start?
  33. 33. developers.google.com/actions
  34. 34. codelabs.developers.google.com
  35. 35. Actions on Google Developer Community https://g.co/actionsdev Actions on Google Developers https://developers.google.com/actions Actions on Google Twitter https://twitter.com/actionsongoogle bit.ly/aog-tips
  36. 36. +GreenIdo @GreenIdo Thank you!
  37. 37. 87% of B2C marketers in the US believe chatbots and digital assistants will play a significant role in marketing before 2021. —eMarketer

×