2026-09-24 21:04 UTC
Well duh, it's obvious that indiscriminate scraping is considered harmful, and I'm not too happy that A. site owners need a magnitude more of resources to counter-scrape than what LLM operators need to scrape, and B. the LLMs apparently need to consume data so inefficiently, and indiscriminately, to attempt achieving their intended functions - unlike good ol' spiderbots that only need to ping sites once per day give or take
Replies (0)
No replies.