2026-10-12 16:47 UTC
Replies (9)
-
@troed@swecyb.com 2026-10-12 16:51
@jon@social.vivaldi.net The "defense" needed is an nginx bucket. Sure, it was nice running a site that never got slashdotted but let's not pretend that it's somehow difficult to handle the rather tiny crawler traffic. https://blog.troed.se/posts/nginx-meta-rate-limiting/
-
@comrad@mastodon.social 2026-10-12 17:02
@jon@social.vivaldi.net I am happy to provide my nginx "bad bots" conf returning 444 to all those ai crawling bots.
-
@DrinkyBird@mastodon.org.uk 2026-10-12 18:43
@jon@social.vivaldi.net And also like, denial of service attacks are just straight up crimes themselves.
-
@Walker@infosec.exchange 2026-10-12 18:50
@jon@social.vivaldi.net I am sure that Cloudflare, Akamai, Edgecast and other edge providers / CDNs are licking their lips at the potential profits.
-
@NSaynneDad@social.vivaldi.net 2026-10-12 19:47
@jon@social.vivaldi.net Well said!!
-
@TehAppKiller@mastodon.social 2026-10-12 20:09
@jon@social.vivaldi.net + pollution from scraping and from countermeasures https://www.toxsec.com/p/ai-tar-pits-are-drowning-llm-scrapers
-
@lmgenealogy@mstdn.ca 2026-10-12 21:42
@jon@social.vivaldi.net Competition only works on a level(ish) playing field. We haven't seen those conditions for some time.
-
@Shdwdrgn@tech.lgbt 2026-10-12 22:06
@jon@social.vivaldi.net Funny thing, I asked the Google AI how to protect my apache2 server from being flooded by Ai bot requests, and it actually gave me some info that worked (the active OpenAI bot is now receiving 403 errors). It was enough to make me add a few more hardening techniques already built into apache (mod-security2 and mod-reqtimeout both look helpful). Every little bit helps.
-
@msb@norcal.social 2026-10-13 00:25
@jon@social.vivaldi.net Yep, too true. My "bad-bots" config that I keep having to roll out for websites & servers just to keep them up is now 137 user-agents long.