 |
 |
And how does that absolve such sites from being "named and shamed" or permanently filtered? If Millenium is acting like a robot in its monthly maintenance processes, then it should be checking robots.txt. On Wed, Sep 2, 2009 at 9:02 AM, Chris King<[log in to unmask]> wrote: > stuart yeates wrote: >>> >>> GPO knows that many institutions have automated URL checkers >> >> > that run against the PURL server. Please be aware that the >>> >>> PURL restoration process is severely slowed by checkers repeatedly >>> hitting the PURL server. >> >> Presumably if there are any parties running automated tools which neglect >> to check robots.txt those institutions are going to be named and shamed >> and/or permanently filtered? > > Any "out-of-the-box" installation of Innovative's Millennium that includes > "URL Verify" is set automatically to check all 856 links on the first of the > month. > > Chris > > > > -- > Christopher King > Public Services Librarian > Appalachian School of Law Library > 1221 Edgewater Drive > Grundy VA 24614 > (276) 935-6688 x1314 > [log in to unmask] >