[Mediawiki-l] Good robots.txt
Brion Vibber
brion at pobox.com
Fri Apr 29 22:56:08 UTC 2005
Jeremie Bouillon wrote:
> Le 00:25 30/04/2005, Brion Vibber écrivait :
> >Jeremie Bouillon wrote:
> >> About the robot.txt, can we find the one used by large wiki (like
> >> Wikipedia, or others) to help Wikimedia newbie exclube spiderbot from
> >> where there aren't supposed to be ?
>
> >It's in the customary location, of course:
> >http://en.wikipedia.org/robots.txt
>
> I should buy a new brain. Anyone saw a cheap one on Ebay recently ?
http://cgi.ebay.com/ws/eBayISAPI.dll?ViewItem&category=11737&item=5971206772&rd=1
Go quick, the bidding ends in an hour or so!
-- brion vibber (brion @ pobox.com)
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 253 bytes
Desc: OpenPGP digital signature
Url : http://lists.wikimedia.org/pipermail/mediawiki-l/attachments/20050429/5347f32e/attachment.pgp
More information about the MediaWiki-l
mailing list