Blocking AI scrapers and noisy bots with nginx using the User-Agent (first line of defense)
A simple, free first line of defense: filter AI scrapers, SEO crawlers, and noisy bots directly in nginx using the User-Agent. The complete bad-bots.conf file, how to activate it per vhost, log the blocks, and why it cut server load by over 50%.