OrganicStats Homepage
Call OrganicStats Today!
Get our Newsletter
The OrganicStats Blog

Yahoo! updates its site crawler

August 7, 2006 | Search Engine News, Yahoo!

Yahoo! reported yesterday that it has updated its search crawler, Yahoo! Slurp. Here is an excerpt from their release:

We launched a new Yahoo! Search Crawler, Yahoo! Slurp earlier this week. In addition to crawling the Internet faster, our new crawler is more efficient at visiting websites. As a result, site owners will notice as much as a 25% reduction in the number of requests and bandwidth consumed by the crawler.

While transitioning to the new crawler over the past few weeks, we had been running both crawlers in tandem. In some cases, this increased the frequency of Yahoo Search requests to websites. Now, with the new crawler in full production, we have turned off the old crawler and site owners should see a much lower crawl load without a loss in content coverage. With this change of behavior in the crawler, you may see some shuffling of the pages that are included in the index and some changes in ranking as well.

This is great news because it means that organic changes to your web pages might be updated quicker in the Yahoo! search. From an analytics standpoint, less requests helps by reducing the number of items that the analytics tool must process.

The entire release is located here:
http://www.ysearchblog.com/archives/000334.html

Technorati Tags: , ,

       Share this article with the world!These icons link to social bookmarking sites where readers can share and discover new web pages.
  • del.icio.us
  • digg
  • Furl
  • Ma.gnolia
  • Reddit
  • scuttle
  • Simpy
  • Spurl
  • YahooMyWeb

Write a comment (all fields are required)