Just tried out GPT4All. It's an open source application for running LLMs locally. You can pick from a variety of open-source models. From initial testing it works pretty well. Not as good out-of-the-box as GPT4 or Gemini or Claude but has a lot of potential. I love that it is running locally on my machine and that I can look into how it works. It allows you to tweak things like temperature and has a way to integrate a document store.
https://github.com/nomic-ai/gpt4all
[#]LocalLLMs
[#]gpt4all
[#]foss
=> More informations about this toot | View the thread | More toots from davidruffner@raphus.social
=> View localllms tag | View gpt4all tag | View foss tag This content has been proxied by September (ba2dc).Proxy Information
text/gemini