blog
HOME · CREATIVE · WEB · TECH · BLOG

Spiders/Bots - Category Archive

Thursday, September 18th, 2008

Getting Started with SEO

When people start to learn the web they hear pretty quickly that they should “optimize” their pages. But a surprising number of people, even some big bloggers, don’t do it… I’m not sure the reasons, but I have a feeling some people find the process intimidating, while others just feel “Google should figure it out”. […]

Read More...
Wednesday, February 13th, 2008

Ummm… Microsoft… It’s 2008…

Microsoft announced that it’s MSNBot now supports “if-modified-since” HTTP headers and GZip compression… About 10 years too late…

Read More...
Thursday, July 26th, 2007

166,000 Page Test – 3 month follow up

Against the advice of the folks at Google, we put up a medical thesaurus with over 166,000 pages (they say to limit the number of new pages to about 10,000) – and things went really well. The pages got indexed and we’ve started seeing an uptick in traffic.

Read More...
Tuesday, May 22nd, 2007

Google’s Webmaster Tools ‘Faster’ Crawl Rate

Google Webmaster Tools has an option to set the crawl rate for your site. I’d never seen “faster” enabled as an option until I was working on a web site for a non-profit animal shelter.

Read More...
Monday, May 14th, 2007

166,000 Page Test – 3 week follow-up

Our test to put up 166,000+ pages all at once is looking good… Quite a few pages have been indexed by Google.

Read More...
HOME · CREATIVE · WEB · TECH · BLOG