robots.txt missing
Short answer
robots.txt missing means: without robots.txt everything may be crawled; that is fine, but you have no control and no place to list your sitemap. To fix it: add a robots.txt with at least a Sitemap: line.
By the SmooxSEO team. Updated on 16 November 2026.
What it means and why it matters
Without robots.txt everything may be crawled; that is fine, but you have no control and no place to list your sitemap.
How to fix it
Add a robots.txt with at least a Sitemap: line.
How serious is it?
Good practice with a small effect, or something that is often intentional. Nice to have.
About robots.txt checks
The robots.txt file tells crawlers which parts of the site they may visit. A wrong rule can hide a whole site from search engines.
Find this problem on your site
SmooxSEO checks your whole site for this problem and 311 others, lists the details, and tells you what to fix first.