Free robots.txt generator
Generate a clean robots.txt — control crawlers, point to your sitemap, and choose whether AI answer-engines can read your site. No signup.
Being crawlable is a prerequisite for being cited in ChatGPT, Claude, Perplexity and AI Overviews. Uncheck only if you want to block them.
robots.txt
User-agent: * Allow: /