=> 👽 krixano

@acidus Another thing that I think would greatly help all of the search engines is to send the lang parameter in the mimetype for gemipedia articles (and welcome page) of languages other than english.

2 years ago

Actions

=> 👋 Join Station

3 Replies

=> 👽 krixano

@acidus ... and the lang pages (like gemini://gemi.dev/cgi-bin/wp.cgi/lang/hu) · 2 years ago

=> gemini://gemi.dev/cgi-bin/wp.cgi/lang/hu

=> 👽 krixano

@acidus Right, the articles (containing "/view") are disallowed in robots.txt, but the welcome pages for each language are not (which I think is good). But those welcome pages (like gemini://gemi.dev/cgi-bin/wp.cgi/welcome/sh for example) don't have the lang param. · 2 years ago

=> gemini://gemi.dev/cgi-bin/wp.cgi/welcome/sh

=> 👽 acidus

robots should be preventing Gemipedia from being crawled. good point about the articles though · 2 years ago