 |
 |
> GPO knows that many institutions have automated URL checkers > that run against the PURL server. Please be aware that the > PURL restoration process is severely slowed by checkers > repeatedly hitting the PURL server. Presumably if there are any parties running automated tools which neglect to check robots.txt those institutions are going to be named and shamed and/or permanently filtered? cheers stuart -- Stuart Yeates http://www.nzetc.org/ New Zealand Electronic Text Centre http://researcharchive.vuw.ac.nz/ Institutional Repository