And how does that absolve such sites from being "named and shamed" or
permanently filtered? If Millenium is acting like a robot in its
monthly maintenance processes, then it should be checking robots.txt.
On Wed, Sep 2, 2009 at 9:02 AM, Chris King<[log in to unmask]> wrote:
> stuart yeates wrote:
>>> GPO knows that many institutions have automated URL checkers
>> > that run against the PURL server. Please be aware that the
>>> PURL restoration process is severely slowed by checkers repeatedly
>>> hitting the PURL server.
>> Presumably if there are any parties running automated tools which neglect
>> to check robots.txt those institutions are going to be named and shamed
>> and/or permanently filtered?
> Any "out-of-the-box" installation of Innovative's Millennium that includes
> "URL Verify" is set automatically to check all 856 links on the first of the
> Christopher King
> Public Services Librarian
> Appalachian School of Law Library
> 1221 Edgewater Drive
> Grundy VA 24614
> (276) 935-6688 x1314
> [log in to unmask]