Get Free Site Assessment with EBriks Get Free Site Assessment with EBriks Get Free Site Assessment with EBriks

Google Webmaster Tools Revamps Crawl Errors, But Is It For The Better

Posted by : Jitendra Singh, March 21st, 2012

Refurbishing search tools for webmasters

Refurbishing the entire crawl tools is what Google has done recently. Issues encountered by GoogleBot while crawling are known as crawl errors.

So the changes are

Website and URL based errors

The crawl errors have been categorized into 2, namelywebsite errors and URL based errors. Website based errors occur over the entire site, unlike being specific to the URL.

Website errors have been classified into:

Errors based on DNS – DNS lookup, DNS domain and DNS errors. (Though these do not exist specifically as explained below)

Connectivity of Server – Network unreachable, no response, connection timed out are the common errors associated with this.

Fetching Robots.txt–This is a Robots.txt file specific error. Googlebot has no way of knowing if that file exists or what sites it blocks and thus terminates the crawling until it’s found, when encountered with this error.

URL errors are based on individual pages.

URL errors have been classified into:

Error in server –5xx errors, such as 503 errors for server maintenance is a typical example

Error Soft404 – These errors return an erroneous value, but they don’t conform to the usual 404 standard. This makes the Googlebot to crawl unnecessary pages which contain no data and thus the efficiency of the crawling reduces greatly. Additionally, appearance of these pages in the search results can hamper smooth user experience.

Access denial error–The URLs returning 401 errors are classified as access denied errors. Often this translates to request for permission rather than actual error. However blocking these sites from being crawled will improve efficiency.

Not found error –URLs returning 404 and 410 belong to this category.

Not being followed error –301 and 302 status codes are part of this usually. This error report lists URLs that can’t be followed because of too many redirects or redirecting loops . ’Not followed’ should not be the tag for 301 as it is being followed properly.

Other errors – Catch-all errors that is inclusive of all 403s

Evolution over time

Trends for the errors over the past 90 days are being showed by Google now. The aggregation of the URLs that Google knows about is listed here, not the crawled pages that Google has accomplished that day. Re-crawling of the same page with no error, removes the URL from the list and also it’s count decremented

Additionally, Google still listing the date the first error in URL was encountered and also the last time the URL was visited.

Fixing the status and Priorities

URL is listing in Sitemap, lots traffic data, and the number of links it has, are the ways by which Google are now listing URLs in priority order. A URL can be marked fixed and removed from the list. But if Google visits the page again and finds errors, it then adds it to the list again.

Fetch as Googlebot feature is recommended by Google to test the fixes. In fact the right side has a button to accomplish this, but the limiting factor is only 500 fetches per account, not per site per se. So this feature should be used judiciously.

 

Conclusion

There is a feeling that the majority of the updates have been done keeping in mind the small site developers and not the big enterprise-level (agency level) sites which handle large and diverse data. More data is better for these latter levels as they have the systems to parse and crunch data.

It’s a bit sad to see the features that have been worked hard during the initial launch stages of the webmaster tools have been dismantled or reduced in functionality. But then as a frequent user may want user functionality, this is more like a trade- off rather than serious handicap.

 

VN:F [1.9.22_1171]
Rating: 10.0/10 (1 vote cast)
VN:F [1.9.22_1171]
Rating: +1 (from 1 vote)
Google Webmaster Tools Revamps Crawl Errors, But Is It For The Better, 10.0 out of 10 based on 1 rating

48 Responses to “Google Webmaster Tools Revamps Crawl Errors, But Is It For The Better”

  1. Alaina Daring says:

    I’m amazed, I must say. Rarely do I come across a blog that’s equally educative and fascinating, and without a skepticism, you’ve hit the nail on the head. The come forth is an come forth that not enough those are speaking intelligently about. I’m very pleased that I came across this in my hunt for a upset concerning this.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  2. Aurore Cowett says:

    Its really nice and interesting..

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  3. netmark says:

    Nice site with good article information. Keep the good information coming.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  4. Webmaster says:

    Wow, marvelous blog format! How long have you ever been running a blog for? you made running a blog look easy. The full look of your site is excellent, as neatly as the content!

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  5. Main Line Homes for Sale says:

    I do agree with all the ideas you have presented in your post. They are very convincing and can certainly work. Nonetheless, the posts are too brief for novices. May you please prolong them a bit from next time? Thanks for the post.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  6. Training says:

    I’ve been exploring for a bit for any high quality articles or blog posts on this sort of house . Exploring in Yahoo I finally stumbled upon this site. Reading this information So i’m glad to exhibit that I’ve an incredibly excellent uncanny feeling I found out just what I needed. I so much for sure will make sure to do not fail to remember this website and give it a look on a relentless basis.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  7. Arhitect says:

    Happy to say, You made me so happy today

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  8. rai rai ken says:

    Thanks , I have recently been looking for information approximately this subject for a long time and yours is the best I’ve found out so far. But, what about the bottom line? Are you positive concerning the source?|What i do not realize is actually how you’re no longer actually a lot more neatly-liked than you might be right now. You are very intelligent.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  9. tasty says:

    hello there and thank you in your information ? I’ve certainly picked up something new from proper here. I did on the other hand expertise several technical points the usage of this web site, since I skilled to reload the website a lot of instances prior to I may get it to load correctly. I were thinking about in case your hosting is OK? No longer that I’m complaining, however sluggish loading circumstances instances will very frequently affect your placement in google and can injury your quality rating if advertising and marketing with Adwords. Well I’m including this RSS to my email and could glance out for much extra of your respective interesting content. Make sure you update this once more very soon..

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  10. HP says:

    Excellent blog here! Also your website lots up fast! What web host are you using? Can I am getting your associate link in your host? I desire my site loaded up as fast as yours lol

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  11. Shane says:

    Hello, i think that i saw you visited my blog thus i came to go back the prefer?.I’m attempting to find issues to enhance my site!I suppose its adequate to make use of a few of your ideas!!

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  12. unold brotbackautomat says:

    Hey there, You have performed an incredible job. I will certainly digg it and for my part recommend to my friends. I am confident they’ll be benefited from this website.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  13. cupcakes says:

    Hello there, You have performed a great job. I will definitely digg it and individually suggest to my friends. I’m confident they will be benefited from this website.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  14. acuphysio says:

    Great post. I used to be checking constantly this blog and I’m impressed! Very useful information particularly the remaining phase :) I take care of such info a lot. I used to be looking for this particular info for a long time. Thank you and best of luck.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  15. agile project manager says:

    We are a gaggle of volunteers and starting a new scheme in our community. Your web site offered us with valuable info to paintings on. You’ve performed an impressive activity and our whole group shall be grateful to you.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  16. management plan says:

    Valuable information. Lucky me I discovered your web site by chance, and I’m shocked why this accident didn’t took place in advance! I bookmarked it.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  17. cuong hoa gunny says:

    Hello There. I discovered your blog the usage of msn. That is a very smartly written article. I’ll be sure to bookmark it and come back to read more of your useful information. Thanks for the post. I will definitely return.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  18. masini avariate says:

    Wonderful goods from you, man. I have have in mind your stuff previous to and you’re simply extremely fantastic. I actually like what you have received here, really like what you’re saying and the best way wherein you assert it. You’re making it entertaining and you continue to take care of to stay it sensible. I can not wait to learn much more from you. This is really a great site.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  19. piese alfa says:

    I will immediately take hold of your rss feed as I can not find your e-mail subscription hyperlink or newsletter service. Do you’ve any? Please permit me realize in order that I could subscribe. Thanks.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  20. Shera says:

    Thank you a lot for sharing this with all of us you really recognise what you’re talking approximately! Bookmarked. Kindly additionally seek advice from my website =). We may have a link change arrangement among us

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  21. piese auto ieftine says:

    Thanks for every other fantastic post. Where else may anybody get that type of info in such a perfect way of writing? I’ve a presentation subsequent week, and I am on the look for such info.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  22. Mac Iphone says:

    Fantastic Sites…

    [...]this is absolutely fantastic, added your site to my list[...]…

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  23. Global forum says:

    Get Free Senuke x…

    Hope to see more good work from you soon. Get your Favorite stuff…..

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  24. Beetta says:

    Nice weblog right here! Additionally your site a lot up very fast! What host are you the use of? Can I am getting your associate hyperlink in your host? I want my web site loaded up as fast as yours lol

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  25. Free ofshore hosting says:

    Facebook Accounts…

    I saw this really great post today. Get your wanted stuff….

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  26. Slots says:

    Woah this blog is excellent i really like studying your articles. Stay up the good paintings! You recognize, a lot of individuals are searching around for this info, you can aid them greatly.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  27. riester sparen says:

    I believe this is one of the most significant information for me. And i’m glad reading your article. However should remark on few basic things, The site style is wonderful, the articles is truly great : D. Good activity, cheers

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  28. Refilo marze says:

    I do believe all of the concepts you have offered in your post. They’re really convincing and can certainly work. Still, the posts are very short for novices. May you please prolong them a bit from next time? Thank you for the post.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  29. nivaagilymn says:

    Now i really like the particular design of your site,

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  30. chetan says:

    its really strong stuff…..

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  31. pooja singh says:

    awesome sharing.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  32. johnny says:

    johnny…

    This blog is amazing. I realy love it!…

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  33. Google says:

    The details mentioned inside the report are some of the best offered

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  34. Markopolo says:

    http://www.ebriks.com owner you are awsome writer

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  35. lallan says:

    SEO is Best for new Project……

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  36. Rex says:

    Hi to every body, it’s my first go to see of this web site; this weblog consists of remarkable and really good material for visitors.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  37. Russell says:

    It is vital that you constantly work and improve….

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  38. Gabrielle says:

    Awesome, this was an extremely good post. Finding the time and actual
    effort to make a really good article…
    can I say… I procrastinate a whole lot and never seem to get anything done.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  39. Johnette says:

    Great website and I look forward to seeing it grow over time.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  40. Quincy says:

    Like this..Please continue your writing.. i am your reader ever.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  41. The way of information is really appreciable.
    As i read and found you doing heard work in your write up.
    Thanks Buddy.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  42. Brooks says:

    Unique information & commendable thoughts.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  43. Lizette says:

    Best of luck and always shine.
    My best wishes with you , you doing really good job here.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  44. Christine says:

    Good Writing and appreciable information..
    Thanks

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  45. Dear..i m very happy after reading..sharing this thanks.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  46. Harriet says:

    This page definitely has all of the information and facts. Good one.

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  47. Jeannine says:

    Incredible, amazing, superb, commendable, appreciable, good one, great,
    These all words for your website blog.
    Thanks a lot. EBriks

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)
  48. Lashawn says:

    Hey would you mind letting me know which hosting company you’re utilizing?
    I’ve loaded your blog in 3 completely different webb browsers and I
    mustt sayy this blog loads a lot faster then most.
    Can you rrecommend a good web hosting provider at a
    honest price? Kudos, I appreciate it!

    Take a look at my web page – Advanced Spanish Grammar Books

    VA:F [1.9.22_1171]
    Rating: 0.0/5 (0 votes cast)
    VA:F [1.9.22_1171]
    Rating: 0 (from 0 votes)

Leave a Reply

(will not be published)

Ask Your Queries

 
Ebriks@ Quick Contact Bar