Spiders like Googlebot choke on Session IDs
Many ecommerce sites have session IDs or user IDs in the URL of their pages. This tends to cause either the pages to not get indexed by search engines like Google, or to cause the pages to get included...
View ArticleGoogle Store makeover still not wooing the spiders
You may recall my observation a few months ago that the Google Store is not all that friendly to search engine spiders, including Googlebot. Now that the site has had a makeover, and the session IDs...
View ArticleGoogle’s index hits 8 billion pages. Yes folks, size does matter.
On Wednesday, the day before Microsoft unveiled the beta of Microsoft Search, Google announced that their index was now over eight billion pages strong. Impeccable timing from the Googleplex. Just a...
View ArticleIs your site unfriendly to search engine spiders like MSNBot?
Microsoft blogger Eytan Seidman on their MSN Search blog offers some very useful specifics on what makes a site crawler unfriendly, particularly to MSNBot: An example of a page that might look...
View ArticleBloody hell, that’s a lot of information
My feeling of technogeek euphoria that I got last month when Google doubled the size of their index has quickly evaporated as I perused Berkeley’s “How Much Information” study. Here’s some stats that...
View ArticleAdSense Spider Cross-Pollinates for Google
A few bloggers such as Jenstar have just posted that pages spidered by Google’s AdSense bot are appearing in Google’s regular search results pages. Shoemoney just blogged that Matt Cutts has officially...
View ArticleIn other news, a new free Clinic
Search Engine Journal today opened free SEO Clinic for sites in need of optimization or with specific challenges that have not been overcome. A group of leading SEOs including Carsten Cumbrowski,...
View ArticleClik here to view.
Dupe Content Penalty a Myth, but Negative Effects Are Not
I was interested to read a column by Jill Whalen this past week on “The Duplicate Content Penalty Myth” at Search Engine Land. While I agree with her assessment that there really isn’t a Duplicate...
View ArticleClik here to view.
Yahoo’s Recent Spider Improvement Beats Google’s
Yahoo!’s Search Blog announced yesterday that they were making some final changes to their spider, (named “Slurp”), standardizing their crawlers to provide a common DNS signature for...
View ArticleSearch Engine Crawling and Indexing Factors
The post today is about getting a site crawled and indexed effectively by the major search engines. It can be frustrating for a site owner to find that her newly built site with bells and whistles is...
View Article
