> GPO knows that many institutions have automated URL checkers 
 > that run against the PURL server. Please be aware that the
> PURL restoration process is severely slowed by checkers 
> repeatedly hitting the PURL server.

Presumably if there are any parties running automated tools which 
neglect to check robots.txt those institutions are going to be named and 
shamed and/or permanently filtered?

cheers
stuart
-- 
Stuart Yeates
http://www.nzetc.org/       New Zealand Electronic Text Centre
http://researcharchive.vuw.ac.nz/     Institutional Repository