The robots.txt mistake that blocked Google in plain sight
A robots.txt mistake silently blocked an entire site from Google while testers reported it as allowed. Here is how the parser disagreement happened.
-
-
Bulk HTTP status code checker — paste 100 URLs, get every code at once
You have a list of URLs and one question: are they all returning what you expect? Here’s a free tool that answers it without a signup, an API key, or a desktop install.
-
Is your robots.txt quietly blocking your best pages in Google Search? Here’s how to find out!
One misplaced line in robots.txt can de-index an entire product category overnight, and because nothing breaks visually, nobody notices until organic traffic dips three weeks later. We built a free bulk tester so any SEO — or any curious CMO — can paste a list of URLs and a robots.txt and see, in a couple of seconds, which pages…
-
Has the schema markup been broken for three months with no one noticing? A true story from an SEO veteran
Despite having over 16 years of SEO experience, it’s difficult to spot invisible errors. Here’s a story that was shared on LinkedIn by Nick LeRoy.
