The slides of my talk at the seokomm in Salzburg, Austria (November 2015).
It covers the basics of web crawling, with focus of search engine bots. It can be settled in the SEO space aswell as in the general webmaster world. Besides quotes of important influencers of Bing, Yandex and Google, it gives actionable advices on how you can influence the Crawl Budget allocation of search engine spiders.
The talk closes on some insights on how we wrote our own CMS in order to cover all the SEO needs we are facing (multilanguage, multi-template, caching, if-modified-since, etc.).
If you like this talk, please follow me on twitter:
And to miss to sign up for the Free Account of OnPage.org:
Last but not least -> visit the seokomm next year if you are around - its worth it :)