Making the Web Searchable Peter Mika Researcher, Data Architect Yahoo! Research

Yahoo! Research (research.yahoo.com)

Metadata in HTML

SHOE system

SHOE Text-based query interface

SHOE Graphical Query Interface

Example: microformats <cite class=&quot; vcard &quot;> <a class=&quot; fn url &quot; rel=&quot;friend colleague met&quot; href=&quot;http://meyerweb.com/&quot;> Eric Meyer </a> </cite> wrote a post ( <cite> <a href=&quot;http://meyerweb.com/eric/thoughts/2005/12/16/tax-relief/&quot;> Tax Relief </a></cite> ) about an unintentionally humorous letter he received from the <span class=&quot; vcard &quot;> <a class=&quot; fn org url &quot; href=&quot;http://irs.gov/&quot;> Internal Revenue Service </a> </span>. <div class=&quot; vcard &quot;> <a class=&quot; email fn &quot; href=&quot;mailto:jfriday@host.com&quot;> Joe Friday </a> <div class=&quot; tel &quot;> +1-919-555-7878 </div> <div class=&quot; title &quot;> Area Administrator, Assistant </div> </div>

RDFa in a slide <p xmlns:rdfs=&quot;http://www.w3.org/2000/01/rdf-schema#&quot; xmlns:foaf=&quot;http://xmlns.com/foaf/0.1/” typeof=”foaf:Person &quot; about=&quot;http://example.org/staff/jo&quot; > <span property= &quot; rdfs:label foaf:name &quot;> Jo Smith </span>. <span property= &quot; foaf:title &quot;> Web hacker </span> at <a rel=”vcard:org&quot; property= &quot; foaf:name &quot; href=&quot;http://example.org&quot;> Acme Corp </a>. You can contact me <a rel= &quot; foaf:mbox&quot; href=&quot;mailto:jo@example.org&quot;> via email </a>. </p> ... Assign the prefixes rdfs and foaf to the RDFS and FOAF namespaces (as in XML, RDF/XML etc.) Create a new resource of type foaf:Person Assign a value to a property Give it a URI Link to another resource and assign a name to it

Microdata example <div item=“http://www.yahoo.com/resource/person”> <p>My name is <span itemprop=&quot; name &quot;> Neil </span>.</p> <p>My band is called <span itemprop=&quot; band &quot;> Four Parts Water </span>. I was born on <time itemprop=&quot; birthday &quot; datetime=&quot; 2009-05-10 &quot;>May 10th 2009</time>. <img itemprop=&quot; image &quot; src=” me.png &quot; alt=”me”> </p> </div

Semantic Search

Not just search

Semantics at every step of the IR process bla bla bla? q=“bla” * 3 Document processing bla bla bla Ranking Query processing Search interface The IR engine The Web The Semantic Web bla bla bla bla bla bla “ bla” θ (q,d)

Demo

image deep links name/value pairs or abstract Enhanced Result

SearchMonkey Acme.com’s database Index RDF/Microformat Markup site owners/publishers share structured data with Yahoo!. 1 consumers customize their search experience with Enhanced Results or Infobars 3 site owners & third-party developers build SearchMonkey apps. 2 DataRSS feed Web Services Page Extraction Acme.com’s Web Pages

Demo

YQL example ( source )

the monkey is out!