E
Explyra
Developers
Developers
/ Web Tools / Robots.txt Generator
Robots.txt Generator
Configure how search engines like Google and Bing crawl your website.
User-Agent
All Robots (*)
Googlebot
Bingbot
Baiduspider
Crawl Delay
No Delay
5 Seconds
10 Seconds
20 Seconds
Sitemap URL (optional)
Disallow Directories (one per line)
Allow Directories (one per line)
Generate Robots.txt
Copy Config
Download .txt
File Content