Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.
@FaisalAnderson
Spying on Google
How to Use Log File Analysis to Reveal
Invaluable SEO Insights
@FaisalAnderson
Imagine if you could
Spy on Google...
@FaisalAnderson
Understand how your
Site is Crawled
@FaisalAnderson
Quickly find why
content isn’t ranking
@FaisalAnderson
Find Quick Tech SEO Wins
@FaisalAnderson
See if fresh content being
discovered
@FaisalAnderson
LOG FILE ANALYSIS
@FaisalAnderson
@FaisalAnderson
Log Files
You Say?
@FaisalAnderson
WTF really is
Log File Analysis?
@FaisalAnderson
@FaisalAnderson
Log File
@FaisalAnderson
HUGE POTENTIAL
@FaisalAnderson
SEARCH CONSOLE IS…
____________________________
@FaisalAnderson
SEARCH CONSOLE IS…
____________________________
KINDA SHIT
- FAISAL ANDERSON 2K19
@FaisalAnderson
1) Data accuracy is NOT guaranteed
@FaisalAnderson
1) Data accuracy is NOT guaranteed
2) Only 1000 rows available in the GUI
@FaisalAnderson
1) Data Accuracy Is NOT Guaranteed
2) Only 1000 rows available in the GUI
3) Google owns it
@FaisalAnderson
4) Fresh AF
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
CONVINCED?
LET’S DIVE IN
@FaisalAnderson
3 THINGS
@FaisalAnderson
1) Getting the Log Files
@FaisalAnderson
1) Getting the Log Files
2) Choosing the best Tool
@FaisalAnderson
1) Getting the Log Files
2) Choosing the best Tool
3) Do Our Analysis
@FaisalAnderson
GETTING THE LOG
FILES
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
1) Ask about Host Setup
@FaisalAnderson
COMMON
HOSTING SCENARIOS
@FaisalAnderson
Load Balancing
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
CDNs
@FaisalAnderson
1) Ask about Server setup
2) Ask about the hostname
@FaisalAnderson
faisalfuntime.com
@FaisalAnderson
https://
@FaisalAnderson
@FaisalAnderson
/faisal/loves/bananas
@FaisalAnderson
@FaisalAnderson
1) Ask about Server setup
2) Ask about the hostname
3) Get 6 months of Data
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
copy *.log mylogfile.csv
bash$ cat file*.txt > mergedfile.csv
@FaisalAnderson
2.
Choosing the
Right Tool
@FaisalAnderson
@FaisalAnderson
Tools
@FaisalAnderson
Excel
@FaisalAnderson
Easy to use
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
Log File Analyser
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
Easy to use and quick
@FaisalAnderson
Can’t create custom reports
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
HUGE FILES
@FaisalAnderson
Larger Learning Curve
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
3.
Do Some Analysis
@FaisalAnderson
3
CATEGORIES
@FaisalAnderson
CRAWL BEHAVIOUR
@FaisalAnderson
CRAWL BUDGET WASTE
@FaisalAnderson
SITE HEALTH
@FaisalAnderson
@FaisalAnderson
CRAWL BEHAVIOUR
@FaisalAnderson
CASE STUDY
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
MOST AND LEAST
CRAWLED URLS
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
CRAWL FREQUENCY
BY DEPTH AND
INTERNAL LINKS
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
CRAWL BUDGET
WASTE
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
CASE STUDY #2
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
E > NACHOS > CHEESE
@FaisalAnderson
CHEESE
@FaisalAnderson
CHEESE
CHEESE
@FaisalAnderson
CHEESE
CHEESE
CHEESE
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
2 CHECKS
@FaisalAnderson
Find Low
Value-Add URLs
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
Crawl Frequency
by Subdirectory
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
SITE HEALTH
@FaisalAnderson
CASE STUDY #3
@FaisalAnderson
LARGE
NEWS SITE
@FaisalAnderson
SMARTPHONE
DESKTOP
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
LET’S ANALYSE...
@FaisalAnderson
INCONSISTENT
SERVER RESPONSES
@FaisalAnderson
200
@FaisalAnderson
@FaisalAnderson
500
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
Errors by Subdirectory
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
@FaisalAnderson
Finito!
@FaisalAnderson
Download the Scripts
@FaisalAnderson
bit.ly/log-file-scripts
@FaisalAnderson
WE’RE HIRING!
Nächste SlideShare
Wird geladen in …5
×

SearchLoveLondon 2019 - Faisal Anderson - Spying on Google: Using Log File Analysis to Reveal Invaluable SEO Insights

Log File Analysis is rarely touched on by the average SEO... but you're missing out on data that is pure gold. Imagine not "guesstimating" how Googlebot and other crawlers behave on a website with traditional crawling tools and actually knowing how Google is crawling a client's site? Imagine not having to play by the 1000 row limit in search console (without delving into the coding or the API) and having limitless data? All of this and more can be done with Log File Analysis.

Learn how to actually get log files from clients (without making their brain hurt from excessive SEO jargon) and handle different Log File Types & how to diagnose any crawling issue by analysing crawling rates by sub-folder or by crawl depth, seeing behaviours on low value add URLs, reviewing how Googlebot behaves based on page speed and much, much more!

This talk is for any level of SEO, and starts from the absolute basics to more advanced checks that can be performed quickly to bring massive value to clients and reveal big wins for any website.

  • Als Erste(r) kommentieren

SearchLoveLondon 2019 - Faisal Anderson - Spying on Google: Using Log File Analysis to Reveal Invaluable SEO Insights

  1. 1. @FaisalAnderson Spying on Google How to Use Log File Analysis to Reveal Invaluable SEO Insights
  2. 2. @FaisalAnderson Imagine if you could Spy on Google...
  3. 3. @FaisalAnderson Understand how your Site is Crawled
  4. 4. @FaisalAnderson Quickly find why content isn’t ranking
  5. 5. @FaisalAnderson Find Quick Tech SEO Wins
  6. 6. @FaisalAnderson See if fresh content being discovered
  7. 7. @FaisalAnderson LOG FILE ANALYSIS
  8. 8. @FaisalAnderson
  9. 9. @FaisalAnderson Log Files You Say?
  10. 10. @FaisalAnderson WTF really is Log File Analysis?
  11. 11. @FaisalAnderson
  12. 12. @FaisalAnderson Log File
  13. 13. @FaisalAnderson HUGE POTENTIAL
  14. 14. @FaisalAnderson SEARCH CONSOLE IS… ____________________________
  15. 15. @FaisalAnderson SEARCH CONSOLE IS… ____________________________ KINDA SHIT - FAISAL ANDERSON 2K19
  16. 16. @FaisalAnderson 1) Data accuracy is NOT guaranteed
  17. 17. @FaisalAnderson 1) Data accuracy is NOT guaranteed 2) Only 1000 rows available in the GUI
  18. 18. @FaisalAnderson 1) Data Accuracy Is NOT Guaranteed 2) Only 1000 rows available in the GUI 3) Google owns it
  19. 19. @FaisalAnderson 4) Fresh AF
  20. 20. @FaisalAnderson
  21. 21. @FaisalAnderson
  22. 22. @FaisalAnderson
  23. 23. @FaisalAnderson
  24. 24. @FaisalAnderson CONVINCED? LET’S DIVE IN
  25. 25. @FaisalAnderson 3 THINGS
  26. 26. @FaisalAnderson 1) Getting the Log Files
  27. 27. @FaisalAnderson 1) Getting the Log Files 2) Choosing the best Tool
  28. 28. @FaisalAnderson 1) Getting the Log Files 2) Choosing the best Tool 3) Do Our Analysis
  29. 29. @FaisalAnderson GETTING THE LOG FILES
  30. 30. @FaisalAnderson
  31. 31. @FaisalAnderson
  32. 32. @FaisalAnderson
  33. 33. @FaisalAnderson 1) Ask about Host Setup
  34. 34. @FaisalAnderson COMMON HOSTING SCENARIOS
  35. 35. @FaisalAnderson Load Balancing
  36. 36. @FaisalAnderson
  37. 37. @FaisalAnderson
  38. 38. @FaisalAnderson CDNs
  39. 39. @FaisalAnderson 1) Ask about Server setup 2) Ask about the hostname
  40. 40. @FaisalAnderson faisalfuntime.com
  41. 41. @FaisalAnderson https://
  42. 42. @FaisalAnderson
  43. 43. @FaisalAnderson /faisal/loves/bananas
  44. 44. @FaisalAnderson
  45. 45. @FaisalAnderson 1) Ask about Server setup 2) Ask about the hostname 3) Get 6 months of Data
  46. 46. @FaisalAnderson
  47. 47. @FaisalAnderson
  48. 48. @FaisalAnderson
  49. 49. @FaisalAnderson
  50. 50. @FaisalAnderson
  51. 51. @FaisalAnderson copy *.log mylogfile.csv bash$ cat file*.txt > mergedfile.csv
  52. 52. @FaisalAnderson 2. Choosing the Right Tool
  53. 53. @FaisalAnderson
  54. 54. @FaisalAnderson Tools
  55. 55. @FaisalAnderson Excel
  56. 56. @FaisalAnderson Easy to use
  57. 57. @FaisalAnderson
  58. 58. @FaisalAnderson
  59. 59. @FaisalAnderson Log File Analyser
  60. 60. @FaisalAnderson
  61. 61. @FaisalAnderson
  62. 62. @FaisalAnderson
  63. 63. @FaisalAnderson Easy to use and quick
  64. 64. @FaisalAnderson Can’t create custom reports
  65. 65. @FaisalAnderson
  66. 66. @FaisalAnderson
  67. 67. @FaisalAnderson
  68. 68. @FaisalAnderson HUGE FILES
  69. 69. @FaisalAnderson Larger Learning Curve
  70. 70. @FaisalAnderson
  71. 71. @FaisalAnderson
  72. 72. @FaisalAnderson
  73. 73. @FaisalAnderson 3. Do Some Analysis
  74. 74. @FaisalAnderson 3 CATEGORIES
  75. 75. @FaisalAnderson CRAWL BEHAVIOUR
  76. 76. @FaisalAnderson CRAWL BUDGET WASTE
  77. 77. @FaisalAnderson SITE HEALTH
  78. 78. @FaisalAnderson
  79. 79. @FaisalAnderson CRAWL BEHAVIOUR
  80. 80. @FaisalAnderson CASE STUDY
  81. 81. @FaisalAnderson
  82. 82. @FaisalAnderson
  83. 83. @FaisalAnderson
  84. 84. @FaisalAnderson
  85. 85. @FaisalAnderson
  86. 86. @FaisalAnderson
  87. 87. @FaisalAnderson
  88. 88. @FaisalAnderson
  89. 89. @FaisalAnderson
  90. 90. @FaisalAnderson MOST AND LEAST CRAWLED URLS
  91. 91. @FaisalAnderson
  92. 92. @FaisalAnderson
  93. 93. @FaisalAnderson
  94. 94. @FaisalAnderson
  95. 95. @FaisalAnderson CRAWL FREQUENCY BY DEPTH AND INTERNAL LINKS
  96. 96. @FaisalAnderson
  97. 97. @FaisalAnderson
  98. 98. @FaisalAnderson
  99. 99. @FaisalAnderson
  100. 100. @FaisalAnderson
  101. 101. @FaisalAnderson
  102. 102. @FaisalAnderson
  103. 103. @FaisalAnderson
  104. 104. @FaisalAnderson
  105. 105. @FaisalAnderson
  106. 106. @FaisalAnderson
  107. 107. @FaisalAnderson
  108. 108. @FaisalAnderson CRAWL BUDGET WASTE
  109. 109. @FaisalAnderson
  110. 110. @FaisalAnderson
  111. 111. @FaisalAnderson CASE STUDY #2
  112. 112. @FaisalAnderson
  113. 113. @FaisalAnderson
  114. 114. @FaisalAnderson E > NACHOS > CHEESE
  115. 115. @FaisalAnderson CHEESE
  116. 116. @FaisalAnderson CHEESE CHEESE
  117. 117. @FaisalAnderson CHEESE CHEESE CHEESE
  118. 118. @FaisalAnderson
  119. 119. @FaisalAnderson
  120. 120. @FaisalAnderson 2 CHECKS
  121. 121. @FaisalAnderson Find Low Value-Add URLs
  122. 122. @FaisalAnderson
  123. 123. @FaisalAnderson
  124. 124. @FaisalAnderson
  125. 125. @FaisalAnderson
  126. 126. @FaisalAnderson Crawl Frequency by Subdirectory
  127. 127. @FaisalAnderson
  128. 128. @FaisalAnderson
  129. 129. @FaisalAnderson
  130. 130. @FaisalAnderson
  131. 131. @FaisalAnderson SITE HEALTH
  132. 132. @FaisalAnderson CASE STUDY #3
  133. 133. @FaisalAnderson LARGE NEWS SITE
  134. 134. @FaisalAnderson SMARTPHONE DESKTOP
  135. 135. @FaisalAnderson
  136. 136. @FaisalAnderson
  137. 137. @FaisalAnderson
  138. 138. @FaisalAnderson
  139. 139. @FaisalAnderson
  140. 140. @FaisalAnderson LET’S ANALYSE...
  141. 141. @FaisalAnderson INCONSISTENT SERVER RESPONSES
  142. 142. @FaisalAnderson 200
  143. 143. @FaisalAnderson
  144. 144. @FaisalAnderson 500
  145. 145. @FaisalAnderson
  146. 146. @FaisalAnderson
  147. 147. @FaisalAnderson
  148. 148. @FaisalAnderson
  149. 149. @FaisalAnderson
  150. 150. @FaisalAnderson
  151. 151. @FaisalAnderson
  152. 152. @FaisalAnderson
  153. 153. @FaisalAnderson Errors by Subdirectory
  154. 154. @FaisalAnderson
  155. 155. @FaisalAnderson
  156. 156. @FaisalAnderson
  157. 157. @FaisalAnderson
  158. 158. @FaisalAnderson Finito!
  159. 159. @FaisalAnderson Download the Scripts
  160. 160. @FaisalAnderson bit.ly/log-file-scripts
  161. 161. @FaisalAnderson WE’RE HIRING!

    Als Erste(r) kommentieren

    Loggen Sie sich ein, um Kommentare anzuzeigen.

  • SarahGill3

    Oct. 15, 2019
  • DylanBrooks

    Oct. 24, 2019

Log File Analysis is rarely touched on by the average SEO... but you're missing out on data that is pure gold. Imagine not "guesstimating" how Googlebot and other crawlers behave on a website with traditional crawling tools and actually knowing how Google is crawling a client's site? Imagine not having to play by the 1000 row limit in search console (without delving into the coding or the API) and having limitless data? All of this and more can be done with Log File Analysis. Learn how to actually get log files from clients (without making their brain hurt from excessive SEO jargon) and handle different Log File Types & how to diagnose any crawling issue by analysing crawling rates by sub-folder or by crawl depth, seeing behaviours on low value add URLs, reviewing how Googlebot behaves based on page speed and much, much more! This talk is for any level of SEO, and starts from the absolute basics to more advanced checks that can be performed quickly to bring massive value to clients and reveal big wins for any website.

Aufrufe

Aufrufe insgesamt

5.211

Auf Slideshare

0

Aus Einbettungen

0

Anzahl der Einbettungen

3.551

Befehle

Downloads

54

Geteilt

0

Kommentare

0

Likes

2

×