Robots.txt Generator
Generate a valid robots.txt file. Set crawling rules per user-agent and add your sitemap URL.
Rule 1
Use * for all bots, or specific names like Googlebot, Bingbot
robots.txt
User-agent: * Allow: / Disallow: /admin Disallow: /private