Peter Mika's Presentation at SSSW 2011

Semantic Search Peter Mika Yahoo! Research

Yahoo! serves over 680 million users in 25 countries

Yahoo! Research: visit us at research.yahoo.com

Yahoo! Research Barcelona ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Search is really fast, without necessarily being intelligent

Why Semantic Search? Part I ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Poorly solved information needs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Many of these queries would not be asked by users, who learned over time what search technology can and can not do.

Dealing with sparse collections Note: don’t solve the sparsity problem where it doesn’t exist

Contextual Search: content-based recommendations Hovering over an underlined phrase triggers a search for related news items.

Contextual Search: personalization Machine Learning based ‘search’ algorithm selects the main story and the three alternate stories based on the users demographics (age, gender etc.) and previous behavior. Display advertizing is a similar top-1 search problem on the collection of advertisements.

Contextual Search: new devices Show related content Connect to friends watching the same

Aggregation across different dimensions Hyperlocal: showing content from across Yahoo that is relevant to a particular neighbourhood.

Why Semantic Search? Part II ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Direct answers in search Information box with content from and links to Yahoo! Travel Points of interest in Vienna, Austria Since Aug, 2010, ‘regular’ search results are ‘Powered by Bing’ Products from Yahoo! Shopping

Novel search tasks ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why Semantic Search? Part III ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

This is not a business model http://en.wikipedia.org/wiki/Underpants_Gnomes

Example: rNews ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Example: Facebook’s Like and the Open Graph Protocol ,[object Object],[object Object],[object Object],[object Object],[object Object]

Example: Facebook’s Open Graph Protocol ,[object Object],[object Object],[object Object],[object Object],[object Object],<html xmlns:og="http://opengraphprotocol.org/schema/" > <head> <title>The Rock (1996)</title> <meta property="og:title" content="The Rock" /> <meta property="og:type" content="movie" /> <meta property="og:url" content="http://www.imdb.com/title/tt0117500/" /> <meta property="og:image" content="http://ia.media-imdb.com/images/rock.jpg" /> … </head> ...

Semantic Search: a definition ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Semantics at every step of the IR process bla bla bla? q=“bla” * 3 Document processing bla bla bla Indexing Ranking Query interpretation Result presentation The IR engine The Web bla bla bla bla bla bla “ bla” θ (q,d)

Data on the Web ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Information Extraction methods ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Semantic Web ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Resource Description Framework (RDF) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],example:roi “ Roi Blanco” name type foaf:Person RDF document

Linked Data: interlinked RDF documents example:roi “ Roi Blanco” name foaf:Person sameAs example:roi2 worksWith example:peter “ pmika@yahoo-inc.com” email type type Roi’s homepage Yahoo Friend-of-a-Friend ontology

RDFa: metadata embedded in HTML … <p typeof=”foaf:Person" about="http://example.org/roi"> <span property=”foaf:name” >Roi Blanco</span>. <a rel=”owl:sameAs" href="http://research.yahoo.com/roi"> Roi Blanco </a>. You can contact him at <a rel=”foaf:mbox" href="mailto:roi@yahoo-inc.com"> via email </ a>. </p> ... Roi’s homepage

Crawling the Semantic Web ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data fusion ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data quality ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The role of ontologies in semantic search ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Query Interpretation in Information Retrieval ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Query interpretation in Semantic Search ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Indexing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

DB-style indexing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

IR-style indexing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Horizontal index structure ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Vertical index structure ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Ranking methods ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Semantic Search evaluation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hosted by Yahoo! Labs at semsearch.yahoo.com

Assessment with Amazon Mechanical Turk ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Number of tasks completed per worker (2010)

Catching the bad guys ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Worker Known bad Real Known Good Total N Time to complete (sec) N Mean N Mean N Mean badguy 20 2.556 200 2.738 20 2.684 240 29.6 goodguy 13 1 130 2.038 13 3 156 95 whoknows 1 1 21 1.571 2 3 24 83.5

Lessons learned ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Related work ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Search Interface ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Snippet generation using metadata ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Example: Yahoo! Enhanced Results Enhanced result with deep links, rating, address.

Example: Yahoo! Vertical Intent Search Related actors and movies

Example: Sig.ma Semantic Information Mashup (DERI)

Future work in Semantic Web Search ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The End ,[object Object],[object Object],[object Object],[object Object]

Peter Mika's Presentation at SSSW 2011

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (6)

Ähnlich wie Peter Mika's Presentation at SSSW 2011

Ähnlich wie Peter Mika's Presentation at SSSW 2011 (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Peter Mika's Presentation at SSSW 2011

Hinweis der Redaktion