My presentation slides from SMX East on future search interfaces on a conceptual level, and how spoken, visual, and even parameterless searches may impact seo and online marketing.

1. Meet Siri: Apple’s Google
Killer? (#smx #11C)
Google Will not go Gentle into That Good
Night: Project Glass
Bill Slawski
Webimax
@bill_slawski

2. Siri is smarter than what we’ve seen on iPhones
so far…
It has a…
•Short Term Memory
•Long Term Memory
And uses an
•Active Ontology
Intelligent Automated Assistant - http://appft.uspto.gov/netacgi/nph-
Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-
adv.html&r=1&p=1&f=G&l=50&d=PG01&S1=20120016678.PGNR.&OS=dn/20120016678&RS=DN/20120016678
Intelligent Automated Assistant - http://appft.uspto.gov/netacgi/nph-
Parser?Sect1=PTO1&Sect2=HITOFF&d=PG01&p=1&u=%2Fnetahtml%2FPTO%2Fsrchnum.html&r=1&f=G&l=50&s1=%2
220120245944%22.PGNR.&OS=DN/20120245944&RS=DN/20120245944

3. Siri – The Intelligent Automated
Assistant
Siri doesn’t just understand your voice
commands, but it also can elicit conversation
from you.
Siri can do your online shopping for you, or
book you a hotel room without your
participation.
Siri can turn on your home security or
temperature control, or set your DVR while
you’re at work.
At its heart, Siri has a learning ontology that
understands your intent

4. Siri’s Active Ontology
Siri uses statistical language models from:
Domain Models (e.g., phrases relating to restaurant and meal events),
Task Flow Models (e.g., phrases relating to planning an event),
Dialog Flow Models (e.g., phrases related to constraints needed to gather
inputs for a restaurant reservation),
Domain Entity Databases (e.g., names of restaurants),
Vocabulary Databases (e.g., names of cuisines),
Service Models (e.g., names of service providers such as OpenTable),
and/or any words, names, or phrases associated with any node of active
ontology.

6. Google Now
Uses Predictive Models to Deliver
Information before you know you want or
need it based on:
– User Behavior
– Location Information
– Contextual Information
Google Now - http://www.google.com/landing/now/

7. Google Field Trip
• Referred to as “Google Here”
• Knowledge Base Information
• Provides Alerts based upon Location
Google Field Trip - http://www.fieldtripper.com/

8. Siri vs. Google Now
Both Google Now and Siri will recognize that
you like to go to Yankees games at the nearby
stadium, and will start showing you scores.
Siri will show you scores for Yankees games
Google Now will notice that you only go to
games when the Yankees play the Orioles,
and show you Orioles scores.
http://www.webimax.com/blog/mobile-applications/googles-predictive-personal-assistant-better-
than-siri
Providing digital content based on expected user behavior -
http://patft1.uspto.gov/netacgi/nph-Parser?patentnumber=08271413

9. The Swimming Goggles Patent
http://www.seobythesea.com/2011/04/google-acquires-swimming-goggle-patent/
Sergey
Likes
Swimming?

10. Google Goggles Visual Queries
• Facial recognition
• OCR search for text in images
• Product to recognition search (book covers. CDs,
3D objects
• Bar codes recognition search
• Named entity recognition
• Landmark recognition
• Place recognition (+GPS)
• Color recognition
• Similar image search
User Interface for Presenting Search Results for Multiple Regions of a Visual Query -
http://appft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-
adv.html&r=1&p=1&f=G&l=50&d=PG01&S1=20110035406.PGNR.&OS=dn/20110035406&RS=DN/20110035406

11. Terahop Indoor Mapping
• Terahop Patents
• Google Offering Free
Wifi
• Indoor Maps
http://www.seobythesea.com/2012/04/google-acquires-indooroutdoor-wireless-location-patents/

12. Templated Maps
Dynamic Exploration of Electronic Maps - http://appft1.uspto.gov/netacgi/nph-
Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-
adv.html&r=1&p=1&f=G&l=50&d=PG01&S1=20080059205.PGNR.&OS=dn/20080059205&RS=DN/20080059205
PlaceBase vs. Google

13. Telcontar Location-Based Services
• Method for providing matching and introduction services to proximate mobile users and
service providers (US Patent 6,819,919)
• Method and system for selectively connecting mobile users based on physical proximity (US
Patent 6,542,750)
• System and method for initiating responses to location-based events (US Patent 7,813,741)
• Method and system for automatically initiating a telecommunications connection based on
distance (US Patent 6,542,748)
• Method and system for connecting mobile users based on degree of separation (US Patent
6,539,232)
• Method and system for connecting proximately located mobile users based on compatible
attributes (US Patent 6,542,749)
• Method and system for analyzing advertisements delivered to a mobile unit (US Patent
6,647,269)

14. Project Glass Touch Interface
Use of potential-touch detection to improve responsiveness of devices - http://patft.uspto.gov/netacgi/nph-
Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-
adv.htm&r=1&f=G&l=50&d=PALL&S1=08199126&OS=PN/08199126&RS=PN/08199126

15. Glass Adjustable User Interface
Method and system for selecting a user interface for a wearable computing device -
http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-
adv.htm&r=1&f=G&l=50&d=PALL&S1=08184070&OS=PN/08184070&RS=PN/08184070

16. Google Glass Wearable Markers
Wearable marker for passive interaction - http://patft.uspto.gov/netacgi/nph-
Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-
adv.htm&r=1&f=G&l=50&d=PALL&S1=08179604&OS=PN/08179604&RS=PN/08179604

17. Glass Predictive Applications
Launches
For example, input 110 may be GPS data
obtained from a sensor and relating to the
location of the user when a folder is selected.
In embodiments, input 115 may be biometric
data such as, for example, an iris scan that
may be used to identify the user selecting a
folder. Input 120 may be, for example, data
analytics such as the frequency in which a
first application in the selected folder is
selected over a second, third, or fourth
application in the selected folder. Additional
analytics may include, for example, what a
user typically does when entering a given
folder, what resources the applications in the
folder use, etc.
Responsiveness for application launch - http://patft.uspto.gov/netacgi/nph-
Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-
adv.htm&r=1&f=G&l=50&d=PALL&S1=08176437&OS=PN/08176437&RS=PN/08176437

18. Outland Research Patents
http://www.seobythesea.com/2011/09/google-picks-up-hardware-and-media-patents-from-outland-research/

19. Ralph Osterhout Heads Up Displays

20. Thanks!
Bill Slawski
Senior SEO Consultant
Webimax
bslawski@seobythesea.com
https://twitter.com/bill_slawski
http://www.linkedin.com/in/slawski
https://plus.google.com/u/0/106515636986325493284/posts