If you have a problem with being overwhelmed with LLM scrapers, the absolute dumbest thing that you could do in response is to feed them as much synthetic content as you can dish out.
Because, dear friend, you are naïve if you think they won’t eat it ALL up as quickly as you can serve it. You better have the bandwidth for that before you start.
The only way to truly dissuade them, is to block them. (Yes, it’s hard, but it’s also doable… and, frankly, something you should have already begun.)
=> More informations about this toot | More toots from artandtechnic@digipres.club
Anyway, I only mention these facts, because I saw this:
https://tldr.nettime.org/@w0bb1t/113866132514271285
=> More informations about this toot | More toots from artandtechnic@digipres.club
@artandtechnic in fairness the author of iocaine specifically recommends putting it behind a proxy with rate limiting enabled and nepenthes (the other popular option) puts in a lot of delays to minimise this issue
=> More informations about this toot | More toots from petrichor@digipres.club
@petrichor Good point. You’d still need to ID the “bad guys” first though. At which point… congrats, you’ve created another full time job for yourself! 😂
Based on my personal experience, I wouldn’t recommend this for anything beyond a hobby website (or self-hosted mastodon etc.), as you’d have to spin up a significant amount of resources to make that work effectively at scale.
It’s a theoretically interesting approach, but not one I think most folks could really do.
=> More informations about this toot | More toots from artandtechnic@digipres.club
@artandtechnic Absolutely, these things are definitely by hobbyists, for hobbyists, and not a solution to anything at scale. Also depressing and ironic that we end up burning more fossil fuels to try to protect against the fossil-fuel guzzling LLM behemoth 😐
=> More informations about this toot | More toots from petrichor@digipres.club This content has been proxied by September (ba2dc).Proxy Information
text/gemini