Ah, but "why is it done" and "does it cause any harm" are two different questions. I can't think of a good reason as to why. Perhaps it is something related to how the IETF is a non-profit org and there is a perceived requirement to make sure its resources are not being overly abused.
On May 20, 2011, at 10:49 AM, Wilfred Drew wrote:
> Why? What possible value would there be in doing this? Just curious.
> Bill Drew
> -----Original Message-----
> From: Code for Libraries [mailto:[log in to unmask]] On Behalf Of Peter Murray
> Sent: Friday, May 20, 2011 10:42 AM
> To: [log in to unmask]
> Subject: Re: [CODE4LIB] exposing website visitor IP addresses to webcrawlers
> Interesting question. I don't see the harm in doing so. It isn't the raw access logs, so one can't see what was accessed. It isn't useful as an attack vector because there is a mixture of servers/crawlers and desktop IPs there; one might just as well attack the entire address space.
> On May 20, 2011, at 10:35 AM, Keith Jenkins wrote:
>> Just out of curiosity, does anyone on this list have any opinions
>> about whether website owners should publicly post lists of their
>> visitors' IP addresses (or hostnames) and to also allow such lists to
>> be indexable by search engines?
>> For example:
Peter Murray [log in to unmask] tel:+1-678-235-2955
Ass't Director, Technology Services Development http://dltj.org/about/
Lyrasis -- Great Libraries. Strong Communities. Innovative Answers.
The Disruptive Library Technology Jester http://dltj.org/