SlideShare a Scribd company logo
1 of 18
HACKING WITH YAHOO!
BOSS
Rahul Hampole
Sr Product Manager Yahoo! BOSS
rhampole@yahoo-inc.com
@ysearchboss
WHAT DOES BOSS GIVE YOU?
 Search Data and Infrastructure
 Monetization (We give you Ads!!)
 Support and Tools
BOSS is a service that provides you (the
developer) flexible access to different types of
data from Yahoo and allows you to build
powerful commercial applications with that
data.
BOSS provides you Search Advertising
and simple terms so that you can
monetize that innovative product and
continue to invest your personal time in
it.
BOSS also gives you Support and Tools to
get your product working.
Restful XML and JSON API
Search Data - Web, Image, Spelling, News, Also Try, Blogs and Search Ads
Geo Services – Placefinder & PlaceSpotter
Flexibility to Blend and Re-rank Results
 Create your own look and feel
Change ranking
Mix it with other API’s
oAuth based Authentication
WHAT DOES THAT MEAN?
WHAT ELSE DO YOU GET
Web and Limited Web results (smaller subset)
 Complex query combinations and filters
 Searches for content on multiple markets
Image attributes like height, width, etc
Time span filtering for News Search
Extended abstracts
Recognizes most search filters from Yahoo! and Google (backdoor hacks)
YAHOO! BOSS GEO SERVICS
Placefinder
1. Geocoding – Give it an
address and get back a
Lat/Lon
2. Address normalization
3. Reverse Geocoding – Give
it a lat/long and get an
address
PlaceSpotter
1. Recognize geographical
entities available in textual
content
2. Understand the meaning
of those entities
3. Couple with Geoplanet to
understand geographical
meaning
6
Learn more at http://developer.yahoo.com/boss/geo/
HOW DO I HACK WITH IT?
THE QUERY
Tells you what the user is looking for
Powers secondary APIs
Can be generated by a search box, URL,
tags or keyword extraction from the page.
Generates related topics
The Query is your BFF!
e.g. http://yboss.yahooapis.com/ysearch/web?q=“Dark Knight”&format=xml
SAMPLE CALLS
Getting multiple data sets
 /ysearch/web,images,news?q=obama
 /ysearch/web,images,news?web.q=obama&images.q=flower&news.q=egypt
Searching through sites
 A Simple Movie Search
 /ysearch/web?q=“Dark Knight”&
sites=movies.yahoo.com,netflix.com,imdb.com
AND/OR operators
 /ysearch/web?q="steve
jobs"AND((ipad)OR(iphone))&sites=bestbuy.com,newegg.com
UNARY OPERATORS
Search for Batman but not “Dark Knight”
 q=(batman -“Dark Knight")
Find pages with “Heath Ledger” but not “Dark
Knight”
 q=+”heath ledger”–”Dark
Knight”&sites=movies.yahoo.com
OUTPUT
IMAGE SEARCH PARAMETERS
Search for images that are not offensive
 /ysearch/images?q=“san francisco”&filter=yes
Search for images that are wallpaper size
 /ysearch/images?q=“san francisco”&dimensions=wallpaper
Search for a image at a certain refer URL
 /ysearch/images?q=yahoo&refererurl=http://www.flickr.com
Interesting Output Fields
 format, file size, height, width, title, total result count
NEWS SEARCH PARAMETERS
Search news that is less than 7 days old
/ysearch/news? q=osama&age=7d
Search news that is between 20hrs and 2 days old
/ysearch/news?q=osama&age=20h2d
Re-rank news results by date
/ysearch/news?q=osama&ranking=true
Interesting Output Fields
Source, Date, Source URL
BOSS + YQL
Table Name: boss.search
e.g. select * from boss.search where ck=… and
secret=… and q=„yahoo‟ and service=„news‟
Parameters Example
Consumer Key ck -
Consumer Secret secret -
Query Term q ‘yahoo’
Service service ‘news’
UNDERSTAND OAUTH
Identification
Consumer Key – Used to make a call to the API
Consumer Secret – Used for 3 legged oAuth (not used for BOSS)
Making a call
(www.oauth.net/code)
-Consumer Key
-Nonce – Random string generated by oAuth (prevents replay attacks)
-Signature – Generated by library
-Signature Method – Various types of methods supported (e.g. HMAC-SHA1)
-oAuth Timestamp –Unix time (valid for 5 minutes only)
-oAuth version – 1.0
We have code samples in most languages on BOSS Site
HACK IDEAS AND USEFUL API’S
RealTime
 Twitter/Facebook API
Mobile Applications
Video
 YouTube data API
Vertical search engines
 Programmable web has interesting API‟s
Local + Search
 Pull entities using Placespotter and
recognize relationships between content
Chrome extensions
HACK AWAY
1. We have BOSS Keys available for you
 Find me if you don’t have them
2. Code samples in the BOSS Docs
3. In depth demo later today
 Build a location aware news service
17
HACK AWAY!!
Rahul Hampole
Sr Product Manager Yahoo! BOSS
rhampole@yahoo-inc.com
@ysearchboss

More Related Content

Viewers also liked

November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...
November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...
November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...Yahoo Developer Network
 
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them all
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them allYahoo! Hack India: Hyderabad 2013 | YQL - One API to query them all
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them allYahoo Developer Network
 
April 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant clusterApril 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant clusterYahoo Developer Network
 
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)Yahoo Developer Network
 
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...Yahoo Developer Network
 
Feb 2013 HUG: Large Scale Data Ingest Using Apache Flume
Feb 2013 HUG: Large Scale Data Ingest Using Apache FlumeFeb 2013 HUG: Large Scale Data Ingest Using Apache Flume
Feb 2013 HUG: Large Scale Data Ingest Using Apache FlumeYahoo Developer Network
 
Accenture Technology Vision 2014—Every Business is a Digital Business
Accenture Technology Vision 2014—Every Business is a Digital BusinessAccenture Technology Vision 2014—Every Business is a Digital Business
Accenture Technology Vision 2014—Every Business is a Digital Businessaccenture
 

Viewers also liked (7)

November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...
November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...
November 2014 HUG: Apache Tez - A Performance View into Large Scale Data-proc...
 
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them all
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them allYahoo! Hack India: Hyderabad 2013 | YQL - One API to query them all
Yahoo! Hack India: Hyderabad 2013 | YQL - One API to query them all
 
April 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant clusterApril 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant cluster
 
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
 
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...
October 2016 HUG: Pulsar,  a highly scalable, low latency pub-sub messaging s...
 
Feb 2013 HUG: Large Scale Data Ingest Using Apache Flume
Feb 2013 HUG: Large Scale Data Ingest Using Apache FlumeFeb 2013 HUG: Large Scale Data Ingest Using Apache Flume
Feb 2013 HUG: Large Scale Data Ingest Using Apache Flume
 
Accenture Technology Vision 2014—Every Business is a Digital Business
Accenture Technology Vision 2014—Every Business is a Digital BusinessAccenture Technology Vision 2014—Every Business is a Digital Business
Accenture Technology Vision 2014—Every Business is a Digital Business
 

Similar to BOSS

Open hack 2011-ppt-draft-final
Open hack 2011-ppt-draft-finalOpen hack 2011-ppt-draft-final
Open hack 2011-ppt-draft-finalRahul Hampole
 
Yahoo BOSS Presentation London Open Hack Day Talk Boss
Yahoo BOSS Presentation London Open Hack Day Talk   BossYahoo BOSS Presentation London Open Hack Day Talk   Boss
Yahoo BOSS Presentation London Open Hack Day Talk BossKorben00
 
Hack the BOSS at Open Hack Day - London
Hack the BOSS at Open Hack Day - LondonHack the BOSS at Open Hack Day - London
Hack the BOSS at Open Hack Day - LondonTed Drake
 
Gianluca fiorelli Search Marketing Connect - Visual Search 2020
Gianluca fiorelli   Search Marketing Connect - Visual Search 2020Gianluca fiorelli   Search Marketing Connect - Visual Search 2020
Gianluca fiorelli Search Marketing Connect - Visual Search 2020Gianluca Fiorelli
 
Everything You Didn't Know About Entity SEO
Everything You Didn't Know About Entity SEO Everything You Didn't Know About Entity SEO
Everything You Didn't Know About Entity SEO Sara Taher
 
Finding things on the web with BOSS
Finding things on the web with BOSSFinding things on the web with BOSS
Finding things on the web with BOSSChristian Heilmann
 
Yahoo! BOSS API external 20091001
Yahoo! BOSS API external 20091001Yahoo! BOSS API external 20091001
Yahoo! BOSS API external 20091001Fred Meng
 
Y Boss External 20091017
Y Boss External 20091017Y Boss External 20091017
Y Boss External 20091017JH Lee
 
Yahoo! BOSS in Bucharest
Yahoo! BOSS in BucharestYahoo! BOSS in Bucharest
Yahoo! BOSS in BucharestTed Drake
 
Future of Search | Yury Lifshits, Yahoo! Research
Future of Search | Yury Lifshits, Yahoo! ResearchFuture of Search | Yury Lifshits, Yahoo! Research
Future of Search | Yury Lifshits, Yahoo! ResearchYury Lifshits
 
<ellis>presentation
<ellis>presentation<ellis>presentation
<ellis>presentationajellis01
 
Smx Milano 2014 Semantic SEO with Schema.org
Smx Milano 2014 Semantic SEO with Schema.orgSmx Milano 2014 Semantic SEO with Schema.org
Smx Milano 2014 Semantic SEO with Schema.orgSante J. Achille
 
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup Sante J. Achille
 
Advanced operator-cheat-sheet
Advanced operator-cheat-sheetAdvanced operator-cheat-sheet
Advanced operator-cheat-sheetTanveer Razwan
 
Featured Snippets - How to Get Position Zero
Featured Snippets - How to Get Position ZeroFeatured Snippets - How to Get Position Zero
Featured Snippets - How to Get Position ZeroMichael Marsh
 
Boss hack u-iit-madras-2012
Boss hack u-iit-madras-2012Boss hack u-iit-madras-2012
Boss hack u-iit-madras-2012discoversudhir
 
Yahoo! BOSS and trainspotting
Yahoo! BOSS and trainspottingYahoo! BOSS and trainspotting
Yahoo! BOSS and trainspottingTed Drake
 
Google search - Tips and Tricks
Google search - Tips and TricksGoogle search - Tips and Tricks
Google search - Tips and TricksNaji El Kotob
 

Similar to BOSS (20)

Open hack 2011-ppt-draft-final
Open hack 2011-ppt-draft-finalOpen hack 2011-ppt-draft-final
Open hack 2011-ppt-draft-final
 
Yahoo BOSS Presentation London Open Hack Day Talk Boss
Yahoo BOSS Presentation London Open Hack Day Talk   BossYahoo BOSS Presentation London Open Hack Day Talk   Boss
Yahoo BOSS Presentation London Open Hack Day Talk Boss
 
Hack the BOSS at Open Hack Day - London
Hack the BOSS at Open Hack Day - LondonHack the BOSS at Open Hack Day - London
Hack the BOSS at Open Hack Day - London
 
BOSS HackU IITD
BOSS HackU IITDBOSS HackU IITD
BOSS HackU IITD
 
Gianluca fiorelli Search Marketing Connect - Visual Search 2020
Gianluca fiorelli   Search Marketing Connect - Visual Search 2020Gianluca fiorelli   Search Marketing Connect - Visual Search 2020
Gianluca fiorelli Search Marketing Connect - Visual Search 2020
 
Everything You Didn't Know About Entity SEO
Everything You Didn't Know About Entity SEO Everything You Didn't Know About Entity SEO
Everything You Didn't Know About Entity SEO
 
Finding things on the web with BOSS
Finding things on the web with BOSSFinding things on the web with BOSS
Finding things on the web with BOSS
 
Yahoo! BOSS API external 20091001
Yahoo! BOSS API external 20091001Yahoo! BOSS API external 20091001
Yahoo! BOSS API external 20091001
 
Y Boss External 20091017
Y Boss External 20091017Y Boss External 20091017
Y Boss External 20091017
 
Yahoo! BOSS in Bucharest
Yahoo! BOSS in BucharestYahoo! BOSS in Bucharest
Yahoo! BOSS in Bucharest
 
Future of Search | Yury Lifshits, Yahoo! Research
Future of Search | Yury Lifshits, Yahoo! ResearchFuture of Search | Yury Lifshits, Yahoo! Research
Future of Search | Yury Lifshits, Yahoo! Research
 
<ellis>presentation
<ellis>presentation<ellis>presentation
<ellis>presentation
 
Smx Milano 2014 Semantic SEO with Schema.org
Smx Milano 2014 Semantic SEO with Schema.orgSmx Milano 2014 Semantic SEO with Schema.org
Smx Milano 2014 Semantic SEO with Schema.org
 
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup
Schemas >> Schema.org >> Take Your Website to a New Level with Schema Markup
 
Advanced operator-cheat-sheet
Advanced operator-cheat-sheetAdvanced operator-cheat-sheet
Advanced operator-cheat-sheet
 
Featured Snippets - How to Get Position Zero
Featured Snippets - How to Get Position ZeroFeatured Snippets - How to Get Position Zero
Featured Snippets - How to Get Position Zero
 
Boss hack u-iit-madras-2012
Boss hack u-iit-madras-2012Boss hack u-iit-madras-2012
Boss hack u-iit-madras-2012
 
Bridging The Google Gap
Bridging The Google GapBridging The Google Gap
Bridging The Google Gap
 
Yahoo! BOSS and trainspotting
Yahoo! BOSS and trainspottingYahoo! BOSS and trainspotting
Yahoo! BOSS and trainspotting
 
Google search - Tips and Tricks
Google search - Tips and TricksGoogle search - Tips and Tricks
Google search - Tips and Tricks
 

More from Yahoo Developer Network

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media
Developing Mobile Apps for Performance - Swapnil Patel, Verizon MediaDeveloping Mobile Apps for Performance - Swapnil Patel, Verizon Media
Developing Mobile Apps for Performance - Swapnil Patel, Verizon MediaYahoo Developer Network
 
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...Yahoo Developer Network
 
Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan
Athenz & SPIFFE, Tatsuya Yano, Yahoo JapanAthenz & SPIFFE, Tatsuya Yano, Yahoo Japan
Athenz & SPIFFE, Tatsuya Yano, Yahoo JapanYahoo Developer Network
 
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...Yahoo Developer Network
 
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, OathBig Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, OathYahoo Developer Network
 
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenuHow @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenuYahoo Developer Network
 
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, AmpoolThe Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, AmpoolYahoo Developer Network
 
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...Yahoo Developer Network
 
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...Yahoo Developer Network
 
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, OathHDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, OathYahoo Developer Network
 
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...Yahoo Developer Network
 
Moving the Oath Grid to Docker, Eric Badger, Oath
Moving the Oath Grid to Docker, Eric Badger, OathMoving the Oath Grid to Docker, Eric Badger, Oath
Moving the Oath Grid to Docker, Eric Badger, OathYahoo Developer Network
 
Architecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI ApplicationsArchitecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI ApplicationsYahoo Developer Network
 
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...Yahoo Developer Network
 
Jun 2017 HUG: YARN Scheduling – A Step Beyond
Jun 2017 HUG: YARN Scheduling – A Step BeyondJun 2017 HUG: YARN Scheduling – A Step Beyond
Jun 2017 HUG: YARN Scheduling – A Step BeyondYahoo Developer Network
 
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies Yahoo Developer Network
 
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...Yahoo Developer Network
 
February 2017 HUG: Exactly-once end-to-end processing with Apache Apex
February 2017 HUG: Exactly-once end-to-end processing with Apache ApexFebruary 2017 HUG: Exactly-once end-to-end processing with Apache Apex
February 2017 HUG: Exactly-once end-to-end processing with Apache ApexYahoo Developer Network
 
February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics
February 2017 HUG: Data Sketches: A required toolkit for Big Data AnalyticsFebruary 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics
February 2017 HUG: Data Sketches: A required toolkit for Big Data AnalyticsYahoo Developer Network
 

More from Yahoo Developer Network (20)

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media
Developing Mobile Apps for Performance - Swapnil Patel, Verizon MediaDeveloping Mobile Apps for Performance - Swapnil Patel, Verizon Media
Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media
 
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...
Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...
 
Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan
Athenz & SPIFFE, Tatsuya Yano, Yahoo JapanAthenz & SPIFFE, Tatsuya Yano, Yahoo Japan
Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan
 
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...
Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...
 
CICD at Oath using Screwdriver
CICD at Oath using ScrewdriverCICD at Oath using Screwdriver
CICD at Oath using Screwdriver
 
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, OathBig Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath
Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath
 
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenuHow @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu
How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu
 
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, AmpoolThe Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool
The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool
 
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...
Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...
 
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...
Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...
 
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, OathHDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath
HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath
 
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...
Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...
 
Moving the Oath Grid to Docker, Eric Badger, Oath
Moving the Oath Grid to Docker, Eric Badger, OathMoving the Oath Grid to Docker, Eric Badger, Oath
Moving the Oath Grid to Docker, Eric Badger, Oath
 
Architecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI ApplicationsArchitecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI Applications
 
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...
Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...
 
Jun 2017 HUG: YARN Scheduling – A Step Beyond
Jun 2017 HUG: YARN Scheduling – A Step BeyondJun 2017 HUG: YARN Scheduling – A Step Beyond
Jun 2017 HUG: YARN Scheduling – A Step Beyond
 
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies
Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies
 
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...
February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...
 
February 2017 HUG: Exactly-once end-to-end processing with Apache Apex
February 2017 HUG: Exactly-once end-to-end processing with Apache ApexFebruary 2017 HUG: Exactly-once end-to-end processing with Apache Apex
February 2017 HUG: Exactly-once end-to-end processing with Apache Apex
 
February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics
February 2017 HUG: Data Sketches: A required toolkit for Big Data AnalyticsFebruary 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics
February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics
 

Recently uploaded

The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 

Recently uploaded (20)

The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 

BOSS

  • 1.
  • 2. HACKING WITH YAHOO! BOSS Rahul Hampole Sr Product Manager Yahoo! BOSS rhampole@yahoo-inc.com @ysearchboss
  • 3. WHAT DOES BOSS GIVE YOU?  Search Data and Infrastructure  Monetization (We give you Ads!!)  Support and Tools BOSS is a service that provides you (the developer) flexible access to different types of data from Yahoo and allows you to build powerful commercial applications with that data. BOSS provides you Search Advertising and simple terms so that you can monetize that innovative product and continue to invest your personal time in it. BOSS also gives you Support and Tools to get your product working.
  • 4. Restful XML and JSON API Search Data - Web, Image, Spelling, News, Also Try, Blogs and Search Ads Geo Services – Placefinder & PlaceSpotter Flexibility to Blend and Re-rank Results  Create your own look and feel Change ranking Mix it with other API’s oAuth based Authentication WHAT DOES THAT MEAN?
  • 5. WHAT ELSE DO YOU GET Web and Limited Web results (smaller subset)  Complex query combinations and filters  Searches for content on multiple markets Image attributes like height, width, etc Time span filtering for News Search Extended abstracts Recognizes most search filters from Yahoo! and Google (backdoor hacks)
  • 6. YAHOO! BOSS GEO SERVICS Placefinder 1. Geocoding – Give it an address and get back a Lat/Lon 2. Address normalization 3. Reverse Geocoding – Give it a lat/long and get an address PlaceSpotter 1. Recognize geographical entities available in textual content 2. Understand the meaning of those entities 3. Couple with Geoplanet to understand geographical meaning 6 Learn more at http://developer.yahoo.com/boss/geo/
  • 7. HOW DO I HACK WITH IT?
  • 8. THE QUERY Tells you what the user is looking for Powers secondary APIs Can be generated by a search box, URL, tags or keyword extraction from the page. Generates related topics The Query is your BFF! e.g. http://yboss.yahooapis.com/ysearch/web?q=“Dark Knight”&format=xml
  • 9. SAMPLE CALLS Getting multiple data sets  /ysearch/web,images,news?q=obama  /ysearch/web,images,news?web.q=obama&images.q=flower&news.q=egypt Searching through sites  A Simple Movie Search  /ysearch/web?q=“Dark Knight”& sites=movies.yahoo.com,netflix.com,imdb.com AND/OR operators  /ysearch/web?q="steve jobs"AND((ipad)OR(iphone))&sites=bestbuy.com,newegg.com
  • 10. UNARY OPERATORS Search for Batman but not “Dark Knight”  q=(batman -“Dark Knight") Find pages with “Heath Ledger” but not “Dark Knight”  q=+”heath ledger”–”Dark Knight”&sites=movies.yahoo.com
  • 12. IMAGE SEARCH PARAMETERS Search for images that are not offensive  /ysearch/images?q=“san francisco”&filter=yes Search for images that are wallpaper size  /ysearch/images?q=“san francisco”&dimensions=wallpaper Search for a image at a certain refer URL  /ysearch/images?q=yahoo&refererurl=http://www.flickr.com Interesting Output Fields  format, file size, height, width, title, total result count
  • 13. NEWS SEARCH PARAMETERS Search news that is less than 7 days old /ysearch/news? q=osama&age=7d Search news that is between 20hrs and 2 days old /ysearch/news?q=osama&age=20h2d Re-rank news results by date /ysearch/news?q=osama&ranking=true Interesting Output Fields Source, Date, Source URL
  • 14. BOSS + YQL Table Name: boss.search e.g. select * from boss.search where ck=… and secret=… and q=„yahoo‟ and service=„news‟ Parameters Example Consumer Key ck - Consumer Secret secret - Query Term q ‘yahoo’ Service service ‘news’
  • 15. UNDERSTAND OAUTH Identification Consumer Key – Used to make a call to the API Consumer Secret – Used for 3 legged oAuth (not used for BOSS) Making a call (www.oauth.net/code) -Consumer Key -Nonce – Random string generated by oAuth (prevents replay attacks) -Signature – Generated by library -Signature Method – Various types of methods supported (e.g. HMAC-SHA1) -oAuth Timestamp –Unix time (valid for 5 minutes only) -oAuth version – 1.0 We have code samples in most languages on BOSS Site
  • 16. HACK IDEAS AND USEFUL API’S RealTime  Twitter/Facebook API Mobile Applications Video  YouTube data API Vertical search engines  Programmable web has interesting API‟s Local + Search  Pull entities using Placespotter and recognize relationships between content Chrome extensions
  • 17. HACK AWAY 1. We have BOSS Keys available for you  Find me if you don’t have them 2. Code samples in the BOSS Docs 3. In depth demo later today  Build a location aware news service 17
  • 18. HACK AWAY!! Rahul Hampole Sr Product Manager Yahoo! BOSS rhampole@yahoo-inc.com @ysearchboss

Editor's Notes

  1. Add Images here
  2. Choose a funny image here