noindex, nofollow for some pages

[pmfuser]

Hi,

I wonder about easiest way to have NOINDEX and NOFOLLOW meta tags for pages produced by search, action etc. What I did was this in SEARCH.PHP:

Code: Select all

header("X-Robots-Tag: noindex, nofollow", true);

and this sends the required response in the headers, but the code of the page itself still has INDEX and FOLLOW from the INDEX.TPL template file which may be confusing for the crawlers.

I want to do the same for URLs of /?action=... type.

The reason for this is that as soon as I launched FAQ, Google indexed all of the search results conducted by people which in return resulted in having my URLs with search terms presented as results in Google's organic search. Then, when people click onto those, it gets counted as internal search and gets shown in Search Statistics. Google also indexed URLs with the ACTION parameter.

I listed some of these in ROBOTS.TXT, but still, I wish if I could have a better control over what type of pages would carry INDEX and FOLLOW meta tags. In my case, I would only let FAQ pages have that, and put all else to be NOINDEX and NOFOLLOW.

Thanks

[Thorsten]

Hi,

a very good point! Please add a ticket here: https://github.com/thorsten/phpMyFAQ/issues

I think this is something I should implement for 2.9!

bye
Thorsten