Does it guarantee privacy?

No — it's only a hint to crawlers. Use auth for sensitive data.

🤖

Robots.txt Generator

Build a robots.txt file for your site.

Ad space — top banner

User-agent

Disallow paths (one per line)

Sitemap URL

User-agent: *
Disallow: /admin
Disallow: /private

Sitemap: https://example.com/sitemap.xml

Block /admin and reference your sitemap URL.

Ad space — in-content

Generate SEO meta tags for any web page.

Analyze keyword frequency in your content.

Convert any title into a clean URL slug.

Create OG tags for social media sharing.

Loading Robots.txt Generator...