=> Re: "Search Engines in Gemini" | In: s/Gemini
How do you add a URL to Kennedy? I’m not indexed (but people linking to me are indexed, and searching for my URL comes up with their pages, so it must not be following links to discover capsules)
=> 💎 istvan
2024-09-03 · 5 months ago
=> ☕️ Aptor-theHobbit [OP] · Sep 03 at 02:55:
The only thing I did was to
=> — kennedy.gemi.dev/site-search/
But it was not showing me any results till today. I think it took a while for the crawler to reach to my capsule.
I also added my capsule link to TLGS using following link
=> 💎 istvan · Sep 03 at 03:18:
Didn’t think linking to them was a requirement. My capsule has been up about a year with plenty of indexed links to it. Maybe it’s the back link search that I never did.
=> 🕹️ skyjake [mod...] · Sep 03 at 06:42:
@istvan:
Didn’t think linking to them was a requirement.
It likely isn't required... @Acidus will be able to elaborate if this is just a matter of the crawler getting around to indexing the capsule.
=> 💎 istvan · Sep 03 at 11:46:
I think it may have been due to my robots.txt, which was there in an attempt to stop the content from being hit by web crawlers if someone linked to a document over a Gemini to Web proxy.
My attempt to block spiders from caching may have blocked Kennedy from indexing.
=> 🌒 s/Gemini
Search Engines in Gemini — I found out that when I search for my capsule on any of the search engines on Gemini, nothing comes up? I tried adding its url in Kennedy as well, few times, still nothing. Its weird since, the crawlers should be working just fine since I do not even have robot.txt in my main path of the capsule. Did anyone else has experienced this before? Its been more than 10 days since I launched my capsule. I hope it shows up in the search at least, just in case someone is cuious...
=> 💬 Aptor-theHobbit · 7 comments · 2024-09-02 · 5 months ago · #capsule #search_engines This content has been proxied by September (ba2dc).Proxy Information
text/gemini; charset=utf-8