Bot rule generator
Search the published catalogue, select bots, then generate robots.txt, Cloudflare WAF, or Apache .htaccess output. Help & output comparison.
Filters
% blocked is the share of top websites blocking the bot in robots.txt (Known Agents). It is not a risk rating. Unknown means no published measurement.