Ancestors

Written by dave on 2025-01-02 at 23:03

AI bots are scraping my git server and slowing things down I hate the future so much leave me alone no one uses scheme anyway you're wasting your time

=> More informations about this toot | More toots from dthompson@toot.cat

Written by dave on 2025-01-03 at 02:52

I used https://github.com/ai-robots-txt/ai.robots.txt/blob/main/robots.json to generate some nginx config to block based on user agent and that did the trick for now. fuck off fuckers!

=> More informations about this toot | More toots from dthompson@toot.cat

Written by dave on 2025-01-03 at 12:37

woke up this morning

checked the server logs

more bots! blocked another user agent but there's at least one other that is spoofing their user agent. fuckers!

=> More informations about this toot | More toots from dthompson@toot.cat

Toot

Written by dave on 2025-01-03 at 12:55

the remaining 200 requests that I suspect are bots are very low volume, though, so I'm mostly happy for now. also added a /robots.txt in case that helps any somewhat polite bots not send requests in the first place.

=> More informations about this toot | More toots from dthompson@toot.cat

Descendants