Spider Control

Google Webmaster Tools has stepped it up again by offering more features and controls over how Google bots view your site. One of the most noteworthy of options is the ability to control how often your site gets spidered, rather how much bandwidth is used during the indexing process.

In addition, a key statistic tool added is the ability to see how many urls your sitemap submitted. This is especially important to insure that your site is being crawled as deeply as possible.

Check it out and more at the Google Webmaster Blog.

October 19, 2006 · Filed Under Web Development

Comments

Leave a Reply





Other Posts You May Be Interested In


Like Playing Flash Games?
It seems that online flash games are becoming increasingly addictive and intricate. Not to mention the sheer number of websites offering them now is a bit out of control. However, if your looking for a good list of fast, free, and quality gaming sites my Blackfox Directory is building a
Last TT of the Year
Yes loyal visitors, this shall be the last Thursday Throwdown of 2006! Ready or not, here they come. Just because your mentally retarded does not give you the right to physically take food out of my mouth in a public restaurant. Guardians should be responsible enough to control said, peeps. Someone should
Privacy Policy
Privacy Policy for http://nailsblog.com If you require any more information or have any questions about our privacy policy, please feel free to contact us by email at nails@nailsblog.com. At http://nailsblog.com, the privacy of our visitors is of extreme importance to us. This privacy policy document outlines the types of personal information is
IsoHunt, a Domestic Pirate Bay
It was announced yesterday that IsoHunt's servers were raided, seized, and a victory cry was heard over the airwaves. The MPAA was quick to announce the success of their operation, all to similar to The Pirate Bay in Sweden. However, unlike TPB, IsoHunt's servers were located in the US where
Adsense Style Sheet Ads
Ok, maybe not CSS style sheet ads, but damn close. It's now possible to create an ad, place it on your site, and in the future change the ad directly from your Adsense control panel. So, for people like me with multiple ads across multiple sites, when changing the look