SlideShare a Scribd company logo
1 of 14
SEO at MSN Dan Cohen Global SEO Engineering Lead dan.cohen@microsoft.com | http://dancohen.info/
SEO at scale MSN covers 47 countries, 21 languages, 465Mil Users, Hotmail and Messenger Selling SEO: Prioritization, Proof, Progress Search marketing mix: PPC vs. SEO? Automation: crawler + analysis engine Engagement and Education Crawlers are users too
Relevance  User vs. Machine
SEO Workflow Engineering Editorial
Crawlability: Server Optimization HTTP Compression Having a large website and millions of pages or URLs means a crawler takes a long time to crawl and index your entire site XML Sitemaps and proper link strategy aren’t always enough HTTP Compression works like a .zip file Reduces download time for users and crawlers Conditional GET Do your pages change often?  Why waste time having crawlers re-spider your site? Tell browsers and crawlers that your pages haven’t changed Improves index coverage quickly
IIS 7.0 SEO Toolkit
IIS SEO Toolkit ,[object Object]
Full and deep SEO analysis
Rich dashboard and Query Builder
Detailed path-mapping analysis
IISBot – a fully-featured crawler engine
Full politeness features: analysis boundaries, number of URLs, max Kbs per URL
Support for Sitemaps, Robots.txt and “NOINDEX, NOFOLLOW”
Robots Exclusion

More Related Content

Viewers also liked

[Michael r. genesereth,__nils_j._nilsson__(auth.),(book_zz.org)
[Michael r. genesereth,__nils_j._nilsson__(auth.),(book_zz.org)[Michael r. genesereth,__nils_j._nilsson__(auth.),(book_zz.org)
[Michael r. genesereth,__nils_j._nilsson__(auth.),(book_zz.org)Andreea Ion
 
BITKOM_Präsentation Data Intelligence Hub -Schwarz-Kouril
BITKOM_Präsentation Data Intelligence Hub -Schwarz-KourilBITKOM_Präsentation Data Intelligence Hub -Schwarz-Kouril
BITKOM_Präsentation Data Intelligence Hub -Schwarz-KourilStefan Schwarz
 
Workshop Part 1b: Excursus on digital materiality (arts & aesthetic education)
Workshop Part 1b: Excursus on digital materiality (arts & aesthetic education)Workshop Part 1b: Excursus on digital materiality (arts & aesthetic education)
Workshop Part 1b: Excursus on digital materiality (arts & aesthetic education)Benjamin Jörissen
 
Workshop Part 3: Excursus - What is it all about? Arts, Aesthetic and Cultura...
Workshop Part 3: Excursus - What is it all about? Arts, Aesthetic and Cultura...Workshop Part 3: Excursus - What is it all about? Arts, Aesthetic and Cultura...
Workshop Part 3: Excursus - What is it all about? Arts, Aesthetic and Cultura...Benjamin Jörissen
 
Ästhetische Bildung 
in der postdigitalen Kultur
Ästhetische Bildung 
in der postdigitalen KulturÄsthetische Bildung 
in der postdigitalen Kultur
Ästhetische Bildung 
in der postdigitalen KulturBenjamin Jörissen
 
Workshop Part 2: Postdigitality (arts & aesthetic education)
Workshop Part 2: Postdigitality (arts & aesthetic education)Workshop Part 2: Postdigitality (arts & aesthetic education)
Workshop Part 2: Postdigitality (arts & aesthetic education)Benjamin Jörissen
 
Digital and Post-digital Conditions: Challenges for Nexts Arts Educations
Digital and Post-digital Conditions: Challenges for Nexts Arts EducationsDigital and Post-digital Conditions: Challenges for Nexts Arts Educations
Digital and Post-digital Conditions: Challenges for Nexts Arts EducationsBenjamin Jörissen
 
Workshop Part 1: Digitality (arts & aesthetic education)
Workshop Part 1: Digitality (arts & aesthetic education)Workshop Part 1: Digitality (arts & aesthetic education)
Workshop Part 1: Digitality (arts & aesthetic education)Benjamin Jörissen
 
Avatare - Bildungsaspekte digitaler Körperlichkeit
Avatare - Bildungsaspekte digitaler KörperlichkeitAvatare - Bildungsaspekte digitaler Körperlichkeit
Avatare - Bildungsaspekte digitaler KörperlichkeitBenjamin Jörissen
 
“21st Century Skills” und “digital literacy”: Globale Herausforderungen für d...
“21st Century Skills” und “digital literacy”: Globale Herausforderungen für d...“21st Century Skills” und “digital literacy”: Globale Herausforderungen für d...
“21st Century Skills” und “digital literacy”: Globale Herausforderungen für d...Benjamin Jörissen
 
„Bildung“ im Zeitalter vernetzten Wissens, Denkens, Handelns
„Bildung“ im Zeitalter vernetzten Wissens, Denkens, Handelns„Bildung“ im Zeitalter vernetzten Wissens, Denkens, Handelns
„Bildung“ im Zeitalter vernetzten Wissens, Denkens, HandelnsBenjamin Jörissen
 
Strukturale (Medien-) Bildung - Was Medienpädagogik in der aktuellen Medienw...
Strukturale (Medien-) Bildung -  Was Medienpädagogik in der aktuellen Medienw...Strukturale (Medien-) Bildung -  Was Medienpädagogik in der aktuellen Medienw...
Strukturale (Medien-) Bildung - Was Medienpädagogik in der aktuellen Medienw...Benjamin Jörissen
 
Twitter: Ritualisierte Ästhetisierungen des Alltags
Twitter: Ritualisierte Ästhetisierungen des AlltagsTwitter: Ritualisierte Ästhetisierungen des Alltags
Twitter: Ritualisierte Ästhetisierungen des AlltagsBenjamin Jörissen
 
Artikulation und "Gouvernementalität": Identität im Social Web
Artikulation und "Gouvernementalität": Identität im Social WebArtikulation und "Gouvernementalität": Identität im Social Web
Artikulation und "Gouvernementalität": Identität im Social WebBenjamin Jörissen
 
Digitale Medien und digitale Netzwerke: Herausforderungen für die Kulturelle ...
Digitale Medien und digitale Netzwerke: Herausforderungen für die Kulturelle ...Digitale Medien und digitale Netzwerke: Herausforderungen für die Kulturelle ...
Digitale Medien und digitale Netzwerke: Herausforderungen für die Kulturelle ...Benjamin Jörissen
 

Viewers also liked (18)

[Michael r. genesereth,__nils_j._nilsson__(auth.),(book_zz.org)
[Michael r. genesereth,__nils_j._nilsson__(auth.),(book_zz.org)[Michael r. genesereth,__nils_j._nilsson__(auth.),(book_zz.org)
[Michael r. genesereth,__nils_j._nilsson__(auth.),(book_zz.org)
 
BITKOM_Präsentation Data Intelligence Hub -Schwarz-Kouril
BITKOM_Präsentation Data Intelligence Hub -Schwarz-KourilBITKOM_Präsentation Data Intelligence Hub -Schwarz-Kouril
BITKOM_Präsentation Data Intelligence Hub -Schwarz-Kouril
 
Blue Ocean Strategy
Blue Ocean StrategyBlue Ocean Strategy
Blue Ocean Strategy
 
Workshop Part 1b: Excursus on digital materiality (arts & aesthetic education)
Workshop Part 1b: Excursus on digital materiality (arts & aesthetic education)Workshop Part 1b: Excursus on digital materiality (arts & aesthetic education)
Workshop Part 1b: Excursus on digital materiality (arts & aesthetic education)
 
Workshop Part 3: Excursus - What is it all about? Arts, Aesthetic and Cultura...
Workshop Part 3: Excursus - What is it all about? Arts, Aesthetic and Cultura...Workshop Part 3: Excursus - What is it all about? Arts, Aesthetic and Cultura...
Workshop Part 3: Excursus - What is it all about? Arts, Aesthetic and Cultura...
 
Ästhetische Bildung 
in der postdigitalen Kultur
Ästhetische Bildung 
in der postdigitalen KulturÄsthetische Bildung 
in der postdigitalen Kultur
Ästhetische Bildung 
in der postdigitalen Kultur
 
Workshop Part 2: Postdigitality (arts & aesthetic education)
Workshop Part 2: Postdigitality (arts & aesthetic education)Workshop Part 2: Postdigitality (arts & aesthetic education)
Workshop Part 2: Postdigitality (arts & aesthetic education)
 
Digital and Post-digital Conditions: Challenges for Nexts Arts Educations
Digital and Post-digital Conditions: Challenges for Nexts Arts EducationsDigital and Post-digital Conditions: Challenges for Nexts Arts Educations
Digital and Post-digital Conditions: Challenges for Nexts Arts Educations
 
Workshop Part 1: Digitality (arts & aesthetic education)
Workshop Part 1: Digitality (arts & aesthetic education)Workshop Part 1: Digitality (arts & aesthetic education)
Workshop Part 1: Digitality (arts & aesthetic education)
 
Krisenkommunikation
KrisenkommunikationKrisenkommunikation
Krisenkommunikation
 
Web 3.0
Web 3.0Web 3.0
Web 3.0
 
Avatare - Bildungsaspekte digitaler Körperlichkeit
Avatare - Bildungsaspekte digitaler KörperlichkeitAvatare - Bildungsaspekte digitaler Körperlichkeit
Avatare - Bildungsaspekte digitaler Körperlichkeit
 
“21st Century Skills” und “digital literacy”: Globale Herausforderungen für d...
“21st Century Skills” und “digital literacy”: Globale Herausforderungen für d...“21st Century Skills” und “digital literacy”: Globale Herausforderungen für d...
“21st Century Skills” und “digital literacy”: Globale Herausforderungen für d...
 
„Bildung“ im Zeitalter vernetzten Wissens, Denkens, Handelns
„Bildung“ im Zeitalter vernetzten Wissens, Denkens, Handelns„Bildung“ im Zeitalter vernetzten Wissens, Denkens, Handelns
„Bildung“ im Zeitalter vernetzten Wissens, Denkens, Handelns
 
Strukturale (Medien-) Bildung - Was Medienpädagogik in der aktuellen Medienw...
Strukturale (Medien-) Bildung -  Was Medienpädagogik in der aktuellen Medienw...Strukturale (Medien-) Bildung -  Was Medienpädagogik in der aktuellen Medienw...
Strukturale (Medien-) Bildung - Was Medienpädagogik in der aktuellen Medienw...
 
Twitter: Ritualisierte Ästhetisierungen des Alltags
Twitter: Ritualisierte Ästhetisierungen des AlltagsTwitter: Ritualisierte Ästhetisierungen des Alltags
Twitter: Ritualisierte Ästhetisierungen des Alltags
 
Artikulation und "Gouvernementalität": Identität im Social Web
Artikulation und "Gouvernementalität": Identität im Social WebArtikulation und "Gouvernementalität": Identität im Social Web
Artikulation und "Gouvernementalität": Identität im Social Web
 
Digitale Medien und digitale Netzwerke: Herausforderungen für die Kulturelle ...
Digitale Medien und digitale Netzwerke: Herausforderungen für die Kulturelle ...Digitale Medien und digitale Netzwerke: Herausforderungen für die Kulturelle ...
Digitale Medien und digitale Netzwerke: Herausforderungen für die Kulturelle ...
 

Recently uploaded

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesZilliz
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 

Recently uploaded (20)

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector Databases
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 

Dan Cohen Seo At Scale from A4UExpo London 2009

  • 1. SEO at MSN Dan Cohen Global SEO Engineering Lead dan.cohen@microsoft.com | http://dancohen.info/
  • 2. SEO at scale MSN covers 47 countries, 21 languages, 465Mil Users, Hotmail and Messenger Selling SEO: Prioritization, Proof, Progress Search marketing mix: PPC vs. SEO? Automation: crawler + analysis engine Engagement and Education Crawlers are users too
  • 3. Relevance  User vs. Machine
  • 5. Crawlability: Server Optimization HTTP Compression Having a large website and millions of pages or URLs means a crawler takes a long time to crawl and index your entire site XML Sitemaps and proper link strategy aren’t always enough HTTP Compression works like a .zip file Reduces download time for users and crawlers Conditional GET Do your pages change often? Why waste time having crawlers re-spider your site? Tell browsers and crawlers that your pages haven’t changed Improves index coverage quickly
  • 6. IIS 7.0 SEO Toolkit
  • 7.
  • 8. Full and deep SEO analysis
  • 9. Rich dashboard and Query Builder
  • 11. IISBot – a fully-featured crawler engine
  • 12. Full politeness features: analysis boundaries, number of URLs, max Kbs per URL
  • 13. Support for Sitemaps, Robots.txt and “NOINDEX, NOFOLLOW”
  • 15. Full graphical user interface, support for filtering, sorting and grouping
  • 16. Control sitemap locations and “disallow” by path, URL, parameters
  • 17. “Physical” or “logical” view of your website
  • 19. Full control over sitemaps and sitemap index files
  • 21. Tests for broken linkshttp://www.iis.net/extensions/SEOToolkit
  • 22. IIS SEO Toolkit http://www.iis.net/extensions/SEOToolkit
  • 23. Case Study SEO for MSN Video
  • 24. Case Study: MSN Video http://video.msn.com/video.aspx?mkt=en-gb Flash Video in Flash Flash and AJAX AJAX
  • 25. Case Study: MSN Video http://video.msn.com/video.aspx?mkt=en-gb
  • 26. Case Study: MSN Video http://video.msn.com/video.aspx?mkt=en-gb
  • 27. Case Study: MSN Video Real URLs – One page per video http://video.msn.com/?mkt=en-gb&vid=b098ff42-994c-4ebd-8741-1c34737318b7&playlist=search:q:plane:mk:en-gb:sf:ActiveStartDate:vs:1:cs:ENGB_Stupid%20Videos&tab=s1204718424896&from=video_module ...becomes http://uk.video.msn.com/videos/woman-in-airport-strop/ Build links to the Video pages Empower users to share via Social Media and blogging with a single click Achieve scale by using the inline player on MSN content pages Show related videos Make the pages Crawlable Get rid of the AJAX Correct down-level experience Build topic relevance Expose user generated content such as ratings, comments, submitted videos Display relevant content from around the network in an automated fashion Full index coverage Geo-target individual countries’ Video destination site with Webmaster Tools validation, META tagging and domain XML Sitemaps and Robots.txt for each market
  • 28. Thank you  Dan Cohen Global SEO Engineering Lead dan.cohen@microsoft.com | http://dancohen.info/

Editor's Notes

  1. Breakdown of SEO factors and assignment within internal groups
  2. Just one
  3. Just one