And how does that absolve such sites from being "named and shamed" or
permanently filtered? If Millenium is acting like a robot in its
monthly maintenance processes, then it should be checking robots.txt.
On Wed, Sep 2, 2009 at 9:02 AM, Chris King<[log in to unmask]> wrote:
> stuart yeates wrote:
>>>
>>> GPO knows that many institutions have automated URL checkers
>>
>> > that run against the PURL server. Please be aware that the
>>>
>>> PURL restoration process is severely slowed by checkers repeatedly
>>> hitting the PURL server.
>>
>> Presumably if there are any parties running automated tools which neglect
>> to check robots.txt those institutions are going to be named and shamed
>> and/or permanently filtered?
>
> Any "out-of-the-box" installation of Innovative's Millennium that includes
> "URL Verify" is set automatically to check all 856 links on the first of the
> month.
>
> Chris
>
>
>
> --
> Christopher King
> Public Services Librarian
> Appalachian School of Law Library
> 1221 Edgewater Drive
> Grundy VA 24614
> (276) 935-6688 x1314
> [log in to unmask]
>
|
