Crawl Rate is the New Google Page Rank – Use These Great Tools
February 28, 2008 - Written by Gyutae Park
What do the search engines think about your site? In SEO, it’s important to gauge the importance and authority of your site and of others in order to build quality links and to move up in the search engine rankings. PageRank is often used as a general meter but with sporadic updates and random fluctuations and penalties, it’s an unreliable tool at best.
So what can we use to better assess the importance and authority of a site?
Enter the crawl rate. How frequently Google crawls a website is usually indication of how much they value the site. In fact, Aaron Wall of SEO Book goes as far as to say that “what Google frequently visits (and spends significant resources to keep updated) is what they consider important.”
Throw away the green pixels on your Google toolbar and start looking at the Google cache date. When was the last time Google accessed your site and updated their index?
Google last accessed Winning the Web on Feb 21, nearly 7 days ago. The crawl rate depends on the kind of site that you have, but the more often Google crawls your site the better. For example, blogs will usually have a higher crawl rate than a static html page.
A great way to determine the crawl rate of your site and of your competitors is to use a site called SEO Meter. SEO Meter offers a free web-based tool that tracks the rate in which Google crawls your website. You can then monitor the crawling and see how it changes with the different stages of your SEO campaign.
Below is a screen shot of Winning the Web’s Google crawl rate in the month of February.
I recommend you submit your site to SEO Meter in order to monitor your site’s Google crawl rate. Top-level domains are free to add but internal URL submissions cost $20 per year because they offer a much more detailed view of your entire site’s crawl rate.
SEO Meter reports the top 20 Internet marketing sites based on Google crawl rate. Not surprisingly, the overall popularity of the site is negatively correlated with the crawl rate.
If you’re using WordPress, another tool that you can use to measure your site’s crawl rate is the crawl rate tracker plugin. It’s free to download and offers crawl rates for all of your blog’s pages in Google, Yahoo, and MSN. It’s a pretty nifty tool that I recommend you download and use.
SEO Meter is still great for comparing your site’s crawl rate to those of competitors in your niche via graphing.If you like this post, subscribe to the RSS feed. Get the latest updates delivered straight to your email or news reader.