Gerrit Holl wrote:
whenever a request is sent to Wikipedia with the
following header, the
result is Error 403:
User-Agent: W3C-checklink/4.1 [4.14] libwww-perl/5.803
[snip]
Why is Error 403 served at all?
libwww-perl is blocked, as we have had a lot of trouble in the past with
poorly behaved spiders.
-- brion vibber (brion @
pobox.com)