[Foundation-l] Hiding namespaces from search engines

Thu Mar 20 17:47:29 UTC 2008

It appears there already is a $wgNamespaceRobotPolicies, though by 
default there is nothing set for it.

Chad wrote:
> That would be a step in the right direction. I was thinking
> a similar global could affect the search results, but wasn't
> thinking about using it for noindex,nofollow as well within
> pages. Good idea. Since the output class has a
> setRobotpolicy() method, we could easily use that to
> do it per-namespace. However, then it's a matter of just
> making the internal search respect the noindex command
> as well.
> 
> -Chad
> 
> On Wed, Mar 19, 2008 at 6:59 PM, Alex <mrzmanwiki at gmail.com> wrote:
>> Chad wrote:
>>  > I think it's a great idea, personally. Robots.txt has (hopefully)
>>  > been a way for us to keep things like this out of search engines.
>>  > Keeping it out of our internal searches (ie: for our anon users)
>>  > would be beneficial as well, methinks.
>>  >
>>
>>  Currently all (most?) special pages contain
>>  <meta name="robots" content="noindex,nofollow" />
>>  Perhaps instead of using robots.txt for this, a configuration variable
>>  like $wgNonIndexedNamespaces = array( ... ); that would add that meta
>>  tag to the top of every page in the namespace and could be easily
>>  referenced used by the internal search as well?
>>
>>  --
>>  Alex (w:en:User:Mr.Z-man)
>>
>>
>>
>>  _______________________________________________
>>  foundation-l mailing list
>>  foundation-l at lists.wikimedia.org
>>  Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l
>>
> 
> _______________________________________________
> foundation-l mailing list
> foundation-l at lists.wikimedia.org
> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l
> 

-- 
Alex (w:en:User:Mr.Z-man)