Blocking Bots with Nginx
Blocking Bots with Nginx
rknight.me Blocking Bots with Nginx
How I've automated updating the bot list to block access to my site
3
comments
robots.txt
is a bit like asking bots to not visit my site; with.htaccess
, you’re not asking3 0 ReplyExtra fun nginx thing: don't use 403, use 444.
That's a nginx special response that doesn't actually send anything back, it just drops the connection and moves on.
3 0 ReplyMy robots.txt has definitely only partially helped. I'll have to see if I can do the same with my Caddy setup.
2 0 Reply