=> ๐Ÿ‘ฝ prk

@skyjake, how does gemini://skyjake.fi/~Cosmos/ collect data? specific crawling (antenna+station+...) ? generic crawler?

2 years ago ยท ๐Ÿ‘ cebalrai

Links

=> gemini://skyjake.fi/~Cosmos/

Actions

=> ๐Ÿ‘‹ Join Station

3 Replies

=> ๐Ÿ‘ฝ prk

@skyjake good to know, thank you! ยท 2 years ago

=> ๐Ÿ‘ฝ skyjake

It does also fetch each posted URL to see if there are links to other known entry URLs, to create the discussion threads. ยท 2 years ago

=> ๐Ÿ‘ฝ skyjake

It doesn't do crawling. It just follows the various aggregators out there, like Antenna, CAPCOM, smol.pub and Flounder front pages, and collects the feed entry URLs. If Station or Geddit links to a known entry URL, their posts get attached as a "comment" entry in the Cosmos database. ยท 2 years ago

Proxy Information
Original URL
gemini://station.martinrue.com/prk/c9124391675749a28b45488af8bcf737
Status Code
Success (20)
Meta
text/gemini
Capsule Response Time
156.819449 milliseconds
Gemini-to-HTML Time
0.408415 milliseconds

This content has been proxied by September (3851b).