Je Vendredo 23 Majo 2003 07:22, Erik Moeller skribis:
Our mailing list archive currently seems to be only
indexed up to
January by Google, which, if I remember correctly, is the same time
Google temporarily stopped indexing Wikipedia articles due to a
robots.txt mishap.
Would it be possible to change the robots.txt so that our mailing
lists archives are fully indexed again?
No, since our robots.txt doesn't forbid it. Nor would that mishap have
directly prevented those directories (in /pipermail and /mailman, which
do not being with /w) from being indexed and spidered.
-- brion vibber (brion @
pobox.com)