2025-01-15 14:56 UTC
@aaron@chirp.zadzmo.org also what I planned to do was to use a regex to match against the bot's user agent, but only when scraping pages that actually exist. then, if it matched it would return a page with links to the other fake pages.
but, all the fake pages would use smth like /w/ as a prefix to it. and if any client made a request to /w/, then it would always return the fake page, because only the llm scrapers would ever know about those fake pages.
Replies (1)
-
@sodiboo@gaysex.cloud 2025-01-15 15:02
@solonovamax@tech.lgbt @aaron@chirp.zadzmo.org and if any client made a request to /w/, then it would always return the fake page, because only the llm scrapers would ever know about those fake pages.maybe don't do it always? and not immediately? because this sounds like it's really easy for a curious user to just get Permanently Locked Out of your site.