Skip to content
Qlinnt
← All checks

Technical SEO

robots.txt has errors

Your robots.txt file has lines Google can't parse, so some of your crawl rules may be ignored.

What it means

Google PageSpeed validated robots.txt and found syntax errors such as unknown directives, rules outside a User-agent group, or malformed Sitemap URLs.

Why it matters

If crawlers misread robots.txt they may crawl pages you meant to block, or skip pages you want indexed.

How to fix it

Fix the reported lines so every rule sits under a User-agent group and uses valid directives (User-agent, Allow, Disallow, Sitemap).

Check your own site

Run the available checks on your live site and see what deserves attention.