18. It’s Too Late When…
#SEJSummit
#Searchmetrics @AJMihalic
19. The Disaster Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
Googlebot
activity drops
due to errors
Rankings drop
for large volume
of longtail terms
Traffic drops
across the board
SEO alerted to
the problem
#SEJSummit
#Searchmetrics @AJMihalic
20. The Disaster Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
Googlebot
activity drops
due to errors
Rankings drop
for large volume
of longtail terms
Traffic drops
across the board
SEO alerted to
the problem
#SEJSummit
#Searchmetrics @AJMihalic
21. The Disaster Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
Googlebot
activity drops
due to errors
Rankings drop
for large volume
of longtail terms
Traffic drops
across the board
SEO alerted to
the problem
#SEJSummit
#Searchmetrics @AJMihalic
22. The Disaster Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
Googlebot
activity drops
due to errors
Rankings drop
for large volume
of longtail terms
Traffic drops
across the board
SEO alerted to
the problem
#SEJSummit
#Searchmetrics @AJMihalic
23. The Disaster Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
Googlebot
activity drops
due to errors
Rankings drop
for large volume
of longtail terms
Traffic drops
across the board
SEO alerted to
the problem
#SEJSummit
#Searchmetrics @AJMihalic
24. The Disaster Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
Googlebot
activity drops
due to errors
Rankings drop
for large volume
of longtail terms
Traffic drops
across the board
SEO alerted to
the problem
Warnings in Webmaster Tools
or emails only seen here
#SEJSummit
#Searchmetrics @AJMihalic
25. What are the Key Metrics?
• Count of each status code type
• Count of status codes with user-agent = Googlebot
• Log of URLs crawled by Googlebot
• Ideally 2x daily email of counts for earliest warning
#SEJSummit
#Searchmetrics @AJMihalic
26. The EKG inAction
Status code 410 served to remove
thin, duplicated URLs from the index
#SEJSummit
#Searchmetrics @AJMihalic
27. How is the Data Actionable?
• Add robots.txt fixes to production (patching)
• Fix code generating errors or remove links to pages
serving errors (patching)
• Reduce crawl rates in Google Webmaster Tools
• If problems are very serious, roll back to previous stable
releases
#SEJSummit
#Searchmetrics @AJMihalic
28. The New Preventative Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
SEO alerted
thanks to our
friends in IT
Implement fixes
to production
Rankings &
Traffic are
maintained
#SEJSummit
#Searchmetrics @AJMihalic
29. The New Preventative Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
SEO alerted
thanks to our
friends in IT
Implement fixes
to production
Rankings &
Traffic are
maintained
#SEJSummit
#Searchmetrics @AJMihalic
30. The New Preventative Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
SEO alerted
thanks to our
friends in IT
Implement fixes
to production
Rankings &
Traffic are
maintained
#SEJSummit
#Searchmetrics @AJMihalic
31. The New Preventative Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
SEO alerted
thanks to our
friends in IT
Implement fixes
to production
Rankings &
Traffic are
maintained
#SEJSummit
#Searchmetrics @AJMihalic
32. The New Preventative Timeline
Googlebot
crawls new,
concatenated
URLs
Errors generated
on the server
SEO alerted
thanks to our
friends in IT
Implement fixes
to production
Rankings &
Traffic are
maintained
#SEJSummit
#Searchmetrics @AJMihalic