Archived topic
robot.text files issue
6 replies · Started by chris on February 12, 2021
Hey so interesting one, that I'm trying to get to the bottom of.
I currently have an issue on google search console, my issue is "Submitted URL marked ‘noindex’"
This seems to only show for websites using the generatepress theme.
What's odd it is seems to always be the /sitemap.html that shows an error.
I've looked at dropping a robot text file in the public folder on the root, however, I'm still not able to find it via the URL. Which leads to ask the question, where is the designated area for the robot.tex file to be added to this theme? I think at the moment it must be in the incorrect place and I'm trying to resolve. Have you guys ever heard of anyone having these issues? or is it just me/ ;-)
thanks in adavce
Hi there,
the Theme has nothing to do with the robots.txt file. A default installation of WP 'should' automatically place one in your sites root folder. Any changes to that file has to be manually performed or via a plugin eg. SEO.
Hey, David thanks for getting back to me.
I'll take a look elsewhere for the issue, as suggested it might be a plug-in. I thought I'd ask just incase there might be something related.
Thanks again for your help
No problems - glad to be of help.
Hi Chris
Did you get to the bottom of this? I'm having the same issue with my website.
Best wishes, David
Hey David,
So from what I can tell, is this error isn't actually an issue.
Yoast does this by default on install, and from what I understand its purpose is to not index the site map in search results, ie users won't see it in google search results. This doesn't impact google ability to crawl the sitemap.
Hope that helps.
If you do find out anything else, please keep me updated ;-) thanks
Thanks Chris. I really appreciate you taking the time to reply. If I find out anything else, I'll update the thread. All the best, David
