@aaron a simple robots.txt might help differentiate between search engine crawlers and LLM crawlers, the latter often not even bothering reading said file.
So it might be possible to let robots know there is nothing worth reading here, and let robots that don't care get lost indefinitely :)
=> More informations about this toot | View the thread | More toots from Maoulkavien
=> View aaron@zadzmo.org profile
text/geminiThis content has been proxied by September (ba2dc).