ToolPilot
SEO & Web Tools

Robots.txt Generator

Build a valid robots.txt file with your allow, disallow, and sitemap rules.

robots.txt
User-agent: *
Disallow: /admin
Disallow: /api

Sitemap: https://example.com/sitemap.xml

Frequently asked questions

It must be placed at the root of your domain — for example, https://example.com/robots.txt — for search engines to find it.