Ancestors

Toot

Written by zy 🍉 on 2025-01-09 at 16:23

@markigra

howdy, that'd be great if your find.sciences.social didn't allow the search engines to index fedi accounts that don't want to be indexed

=> More informations about this toot | More toots from zy@masto.bike

Descendants

Written by Mark Igra on 2025-01-13 at 23:37

@zy This is fixed. No longer returning public data for unmatched accounts and explicitly telling robots not to index (updated configuration). However, if you have a public profile or posts, unscrupulous robots will still scrape it through your home server.

=> More informations about this toot | More toots from markigra@sciences.social

Written by zy 🍉 on 2025-01-15 at 01:17

@markigra thanks!

ye, there really should be ways to prevent that. not on mastodon, but on internet in general

=> More informations about this toot | More toots from zy@masto.bike

Written by Mark Igra on 2025-01-15 at 01:26

@zy I think any data that is public exposed on the public internet will be sucked up by unscrupulous folks (very much including Meta, X, and OpenAI). Google generally respects rules in robots.txt (at least for search results), but I had a tiny error in mine.

=> More informations about this toot | More toots from markigra@sciences.social