Archives
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [Summary-Talk] WebFountain...
My server's been pummeled lately by a crawler from IBM's WebFountain project: http://www.almaden.ibm.com/cs/crawler But as far as I can tell, there's no indication of it in the Summary statistics...is it not in the database of robots and crawlers? Am I missing something, or can it be added? Are robots still supposed to temper the speed of their requesets, or is that an archaic guideline? This thing hits 1000s of my pages at a time, about 1 per second... Cheers, spud. ------------------------------------------------------------------- a.h.s. boy spud(at)nothingness.org "as yes is to if,love is to yes" http://www.nothingness.org/ ------------------------------------------------------------------- ------------- Go to <http://summary.net/list.html> to update subscription info.
|