> GPO knows that many institutions have automated URL checkers
> that run against the PURL server. Please be aware that the
> PURL restoration process is severely slowed by checkers
> repeatedly hitting the PURL server.
Presumably if there are any parties running automated tools which
neglect to check robots.txt those institutions are going to be named and
shamed and/or permanently filtered?
http://www.nzetc.org/ New Zealand Electronic Text Centre
http://researcharchive.vuw.ac.nz/ Institutional Repository