igors@portfolio
lv

igors@portfolio:~/tools$ ./robots

robots.txt with AI bot settings

Tick which robots may read the site and get a ready robots.txt file.

igors@portfolio:~/tools$ ./robots

Everything runs in your browser. Nothing is sent anywhere until you choose to send it.

The file goes to the site root, so it opens at your-site/robots.txt. Usually whoever runs the site puts it there: in WordPress through an SEO plugin, in site builders under the site settings. Bot names and rules change: check the links below.