Archived topic
GeneratePress Indexing
8 replies · Started by Jeremy on August 18, 2021
Hello GP,
I have noticed that for one of my sites running with GP, all of my tag pages are being indexed in Google.
However, I set them to 'no-index' through the Yoast plugin over 6 months ago
However, when I go to the source code of any of the tag pages, I cannot find the no-index tag. In fact, I see the opposite. I can see "index"
Any ideas why this is the case? Is there something in my GeneratePress settings I need to change or that is preventing this from updating?
Thanks a lot!
Jeremy
Hi there,
The first thing to check is if the Yoast plugin setting for no-index is still intact.
For this one, you'll have to check your Yoast setting if it is indeed still the case.
Can we check and confirm this first? Perhaps a Yoast update changed things? Let us know.
Hi Elvin,
It looked like my screenshot didn't upload.
Essentially it showed a screenshot of my Yoast settings where Tags, (Post_Tags) have 'off' selected for "Show Tags in search results?"
I got here through: SEO > Search Appearance > Taxonomies.
But on one of my tag pages, I've inspected and see this line at the top:
"<meta name='robots' content='index, follow, max-image-preview:large, max-snippet:-1, max-video-preview:-1' />"
Thanks
It looked like my screenshot didn’t upload.
Perhaps its just me. Image from imgur won't load on my end.
Can you link us to a sample page in question that's being index (and another page that's NOT being index, if any)?
To investigate further.
You can also provide temporary backend access as well through the private information text field.
Hello Elvin,
This is not something that I really want to share, to be honest.
Is there any other way we can investigate or pointers you can give to help me search?
I have also provided some of the code at the top of the tag page indexed in google down below for your reference - I just don't see why the tag HTML does not include the no-index prompt, instead including the incorrect prompt.
Thanks for your help here!
Hi there,
there isn't anything in the Theme that would conflict with how Yoast adds its no-index attribute to the robots meta.
We would really need to see a Tag archive page on your site in order to check the markup to see if there is anything obvious that would affect it. We provide the private information field in your replies for sharing URLS, and only the GP Admin Team can see that.
Hello David,
Thank you, thats good to know regarding the theme and conflicts.
I do understand that you need to see it, but having done a little more exploring I found something interesting which might help.
If I navigate to the "view-source" on the tag URL e.g. https://website.com/tag/ - I can see the noindex there ( <meta name='robots' content='noindex, follow' />)
However, it is on the tag 'archive pages' the no-index is not there, e.g. https://website.com/tag/pets - the source code there is <meta name='robots' content='index, follow, max-image-preview:large, max-snippet:-1, max-video-preview:-1' />
Upon checking the Yoast config further, under the Archives tab, I have everything set to off for 'show in search results'
So it seems really strange.
Any ideas?
Hi David,
Just to let you know this issue seems to be resolved.
It took manual work and effort but it appeared to be a caching issue.
If anyone else finds this thread in the future, here is what I had to do:
Update all tags manually, and then clear the cache for each tag via Posts > Tags
So, quick edit each tag, click the update tag button, and then click the clear this cache button after.
Strange, but it's resolved.
No other cache clearing worked even via caching plugins, server cache clearing, browser cache clearing etc.
Thanks GP
Thats an odd one i have never seen before.
But i am really glad to hear you got it resolved!