Comment by ๐Ÿ’Ž istvan

=> Re: "Search Engines in Gemini" | In: s/Gemini

I think it may have been due to my robots.txt, which was there in an attempt to stop the content from being hit by web crawlers if someone linked to a document over a Gemini to Web proxy.

My attempt to block spiders from caching may have blocked Kennedy from indexing.

=> ๐Ÿ’Ž istvan

2024-09-03 ยท 5 months ago

Original Post

=> ๐ŸŒ’ s/Gemini

Search Engines in Gemini โ€” I found out that when I search for my capsule on any of the search engines on Gemini, nothing comes up? I tried adding its url in Kennedy as well, few times, still nothing. Its weird since, the crawlers should be working just fine since I do not even have robot.txt in my main path of the capsule. Did anyone else has experienced this before? Its been more than 10 days since I launched my capsule. I hope it shows up in the search at least, just in case someone is cuious...

=> ๐Ÿ’ฌ Aptor-theHobbit ยท 7 comments ยท 2024-09-02 ยท 5 months ago ยท #capsule #search_engines

Proxy Information
Original URL
gemini://bbs.geminispace.org/u/istvan/19368
Status Code
Success (20)
Meta
text/gemini; charset=utf-8
Capsule Response Time
34.522373 milliseconds
Gemini-to-HTML Time
0.320228 milliseconds

This content has been proxied by September (ba2dc).