Toot

Written by Andrew Helwer on 2025-01-06 at 14:30

@zdl like a search engine for the web as a whole, not just the fediverse?

It's an interesting idea. Crawling the web with bots for indexing is probably the hardest part, because the amount of data & traffic becomes quite large. I wonder whether operators would have to spend a lot of time overcoming anti-spam measures. Then you overlay some search algorithm over the data you've collected.

Unfortunately I don't see where the "federated" part of the search engine comes in. Perhaps people could split up & share the work of crawling & indexing, forming a sort of distributed internet archive. But search engines don't inherently involve any sort of sharing or communication so I don't know how it could be applicable beyond that.

=> More informations about this toot | View the thread | More toots from ahelwer@discuss.systems

Mentions

=> View zdl@mastodon.online profile

Tags

Proxy Information
Original URL
gemini://mastogem.picasoft.net/toot/113781889852679869
Status Code
Success (20)
Meta
text/gemini
Capsule Response Time
226.87652 milliseconds
Gemini-to-HTML Time
0.486062 milliseconds

This content has been proxied by September (ba2dc).