Does it matter? Yes.

Google crawls millions of websites roughly once a month in what is known as the “Deep Crawl”. Deep Crawling enables Google to update its index and the search result it gives back to its users. If, however, Google relies entirely on the deep crawl, its index would quickly become outdated in the rapidly changing web. To stay updated, Google launches various supplemental fresh crawls that skim the web more shallowly and frequently than the deep crawl. These supplementary crawls freshens the index by updating the content of some sites.

Getting fresh crawls from Google, therefore, improves your website’s traffic from Google. Moreover, websites frequently crawled are much more credible and trusted by search engines. The higher the frequency search engines crawl your website, the more trusted it is. Also, a website frequently crawled by search engines has a better ranking in the Search Engine Result Page. The problem is, we can’t see Google robots crawling our websites. How do we know the frequency of Google crawling our websites?

SEOmeter.com

If you are curious about the frequency of Google robots crawling your website, SEOmeter.com can provide you the answer.

SEOmeter.com offers a convenient online tool that allows webmasters to monitor search engine’s crawling activities on their website. SEOmeter.com provides a record of search engine’s cache update events and a user-friendly graph that displays the history of cache updates. All you need to do is add your website to their database for FREE! Here’s an example of a graph that displays  the Google Crawl Cycle (CC) of BlogCatalog. Crawl Cycle is the time between two consecutive crawls (i.e., cache updates) done by search engine robots.

seometer.com of blogcatalog

The graph shows that BlogCatalog is crawled by Google at an average of 0.6 day. This simply means that that it takes roughly 0.6 day for Google bot to crawl back BlogCatalog after the latest crawling. A more detailed statistics can be found just below the crawling cycle graph. Here’s how it looks like.

detailed crawling rate

SEOmeter.com also gives you the option to easly track your website’s Crawl Cycle through a widget that you can copy and paste on your website. The widget comes in different sizes (80X15, 120X60, 120X90 and 125X125) to fit your space. Here’s a screen shot of SEOmeter stat buttons available.

seometer button crawling cycle

For more information, refer to SEOmeter’s FAQs or read SEOmeter’s Blog. I personally recommend you to try SEOmeter.com. Their service is free so you’ve got nothing to lose. Would it not be great to know how often Google crawls your website and about what time Google crawls it? I just submitted Blogging Mix to SEOmeter’s database and I’m excited to know the results.

Thank you for your time. :)

If you enjoyed this post, make sure you subscribe to my RSS feed.!