Website review: del.icio.us Bans Search Engine Spi...
Someone discovered this in Search
•4 reviews since Feb 16, 2008
search, yahoo, delicious
•colincochrane.com/post/2008/02/delicious-bans...
People who like this website
- robertpriolo
Glendora
- ponstar
San Diego
- chillami
Eagle Mountain
- ColinCochrane
Victoria
- AlexHlinski
British Columbia
- realebrity
Lawrence
- Dubhlainn
St Ann
- jolkey
Alabama
- ui0man
Georgia
- theGypsy
Ontario
StumbleUpon is the best way to discover great web sites, videos, photos, blogs and more - based on your interests.
Everything is submitted and rated by the community. Discover, share and review the best of the web!
Reviews of this website
spostareduro rated 5 months ago- It appears that within the past 2-3 days the popular social book-marking site del.icio.us has started blocking the major search engine spiders from crawling their site.
- AbleReach rated 5 months ago
- del.icio.us seems to be blocking the major search engine spiders. Exactly why remains to be seen. Examination and screen shots from Colin Cochrane.
- NickWilsdon rated 5 months ago
- Very interesting. The data from social bookmarking sites could seriously improve search engine results, if integrated. This move shows that Yahoo is willing to take that advantage and block the rest (Google, MSN,Ask). I wonder if this will signal the same behaviour from the other players? Good find Colin.
- ColinCochrane rated 5 months ago
- It appears that within the past 2-3 days the popular social book-marking site del.icio.us has started blocking the major search engine spiders from crawling their site. This isn't a simple robots.txt exclusion either, but rather a 404 response that is now being served based on the requesting User-Agent. This raises some questions as to the intentions of del.icio.us, and perhaps Yahoo! With Yahoo! recently integrating del.icio.us bookmarks into its search results this could an attempt to enhance the effectiveness of that new feature by preventing competing search engines from indexing content from del.icio.us.
