getting started with google actions

1. Confidential + Proprietary
Hands-on Workshop
Okay Google! How do I build actions for assistant?
Getting started with Google
Actions
Oct 09, 2020
8:00 –9:30 PM IST

3. Building for Google Assistant

4. Be the Best Way to Get Things
Done

6. Google Home — voice-activated speaker powered
The Google Assistant — A conversation between you
and Google that helps you get more done in your world.
Actions on Google — How developers can extend
the assistant (via Conversation Actions)

13. When do we use voice search?

15. Actions on Google
developers.google.com/actions

16. Your content, discoverable

17. If you are a...
Web content owner
Content Actions: recipes, how-tos,
podcasts, news, and more
Android app developer App Actions
Innovator in the
conversational space
Conversational Actions with
Interactive Canvas
Hardware developer Smart home SDK

18. Content Actions
Make your existing content awesome on the Assistant

19. Content Actions
News Recipes
FAQs How-to
Podcast

20. App Actions
Voice enabled triggering for your Android Apps

21. Apps re-engagement challenge

22. Apps re-engagement challenge
Drop off rate of usage
3 day post install (ref)
Average cost to
drive install (ref)
↓77%
$4.13

23. Connects with users on nearly 1B Android Phones
Uses Google’s Natural Language Understanding
Fast-Forward into your App
App Actions

24. Step 1: Find the SmoreSmores app in a sea of icons
Today: Long Intent to Fulfillment

25. Today: Long Intent to Fulfillment
Step 1: Find the SmoreSmores app in a sea of icons
Step 2: Select the Cracker

26. Today: Long Intent to Fulfillment
Step 1: Find the SmoreSmores app in a sea of icons
Step 2: Select the Cracker
Step 3: Choose the Marshmallow

27. Today: Long Intent to Fulfillment
Step 1: Find the SmoreSmores app in a sea of icons
Step 2: Select the Cracker
Step 3: Choose the Marshmallow
Step 4: Pick the Chocolate

28. Today: Long Intent to Fulfillment
Step 1: Find the SmoreSmores app in a sea of icons
Step 2: Select the Cracker
Step 3: Choose the Marshmallow
Step 4: Pick the Chocolate
Step 5: Indicate a Toast Level

29. Today: Long Intent to Fulfillment
Step 1: Find the SmoreSmores app in a sea of icons
Step 2: Select the Cracker
Step 3: Choose the Marshmallow
Step 4: Pick the Chocolate
Step 5: Indicate a Toast Level
Step 6: Define how many

30. Today: Long Intent to Fulfillment
Step 1: Find the SmoreSmores app in a sea of icons
Step 2: Select the Cracker
Step 3: Choose the Marshmallow
Step 4: Pick the Chocolate
Step 5: Indicate a Toast Level
Step 6: Define how many
Step 7: Review your order

31. Today: Long Intent to Fulfillment
Step 1: Find the SmoreSmores app in a sea of icons
Step 2: Select the Cracker
Step 3: Choose the Marshmallow
Step 4: Pick the Chocolate
Step 5: Indicate a Toast Level
Step 6: Define how many
Step 7: Review your order
Step 8: Order Complete

32. App Actions:
Direct Intent to Fulfillment

33. Step 1: Naturally invoke with voice
App Actions:
Direct Intent to Fulfillment

34. Step 1: Naturally invoke with voice
Step 2: Confirm order
App Actions:
Direct Intent to Fulfillment

35. Step 1: Naturally invoke with voice
Step 2: Confirm order
Step 3: Enjoy!
App Actions:
Direct Intent to Fulfillment

36. Smart Home
Control Hardware with your voice

37. Smart Home Device Integration
Device Types
What is the device?
Device Traits
How does the device
function?
Home Graph
Stores contextual
data about the home,
users, and devices

38. Dim the lights in the living
room a little bit.
Is the front door locked?
Set the oven to 325 ℉.
Turn off all of the lights.
What is the temperature
inside?
How many lights are on?

39. Smart Home Integration
Assistant
Hey Google,
turn on the lights

40. Conversational
Build new, rich experiences for the Assistant

41. User query
User
Assistant Conversational Action
User input
Deliver prompt Response

42. “Yes”

43. “Yes”
“Of course”
“I do”
“Let’s do it!” “Sure”
“ok”
“Why not”
“That
works”

44. ● Identify intents
● Provide training phrases
● Extend the Assistant's understanding
Natural Language Understanding (NLU)
Intent
Intent
Intent
Intent
Intent
Intent

45. User Assistant Conversational Action
User Assistant Conversational Action
Who does what

46. User input
User Assistant Conversational Action
User Assistant Conversational Action
Who does what

47. User input
NLU
User Assistant Conversational Action
User Assistant Conversational Action
Who does what

48. User input
Generate prompt
NLU
User Assistant Conversational Action
User Assistant Conversational Action
Who does what

49. User input
Deliver prompt
Generate prompt
NLU
User Assistant Conversational Action
User Assistant Conversational Action
Who does what

50. Building for Google Assistant
Demonstration and Hands-on Workshop
Kindly join in with your laptop/desktop for the workshop

51. Today’s Google Action Trainer:
Ajay Singh
Web Developer
Developer Student Club’s Lead,
Google Cloud Facilitator
at BIST, Bhopal

53. Extend Google Assistant
Actions on Google
A developer platform that lets you build
Actions that users can invoke.

54. https://console.actions.google.com/

55. http://bit.ly/google-assistant-quick-start
Code Labs : Learn More About Google Assistant Action
https://developers.google.com/assistant/codelabs
http://bit.ly/google-assistant-qwik-start-dialogflow

56. Thank You!
Suhani Sinha
DSC Lead at OIST, Bhopal
https://www.linkedin.com/in/suhani-sinha/
Abhishek Srivastava
DSC Lead at VIT Bhopal University
https://www.linkedin.com/in/abhishek-srivastava-4
9482a190/
Shivam Soni
DSC Lead at SISTec, Gandhi Nagar, Bhopal
https://www.linkedin.com/in/i-shivamsoni
Yukti Rapartiwar
DSC Lead at LNCT, Bhopal
https://www.linkedin.com/in/yuktirapartiwar/
Ajay Singh
DSC Lead at BIST, Bhopal
https://www.linkedin.com/in/hello-ajay-singh/