igors@portfolio:~/tools$ ./robots
robots.txt with AI bot settings
Tick which robots may read the site and get a ready robots.txt file.
Everything runs in your browser. Nothing is sent anywhere until you choose to send it.
The file goes to the site root, so it opens at your-site/robots.txt. Usually whoever runs the site puts it there: in WordPress through an SEO plugin, in site builders under the site settings. Bot names and rules change: check the links below.