View Single Post
Old 01 Apr 2008, 06:48
MikeHolohan's Avatar
MikeHolohan MikeHolohan is offline
Join Date: Mar 2007
My question really is why do the spiders need to crawl it so often, of course we all want to be found in the search engines but really 50-60 spiders every hour is a bit strange, is it normal, am I have less or more than others?

I have a small non profit site that I am trying to grow and I don't want all my sql queries being used by spiders and yet I still want to be found by the search engines, i would love a vps but couldn't afford to sustain one... I have reseller hosting with Hostgator...
Reply With Quote