Ancestors

Written by Garrick Aden-Buie on 2024-08-10 at 13:59

About to hop on a plane to head to #PositConf2024 but want a local coding assistant for inflight hacking? With #ollama and #Shiny for #Python you can bring a coding assistant with you!

1. Download Ollama from https://ollama.com/

2. Run ollama run llama3.1:8b to get a decent, light ~5GB model

3. Create a Shiny app from our Ollama chat template https://shiny.posit.co/py/components/display-messages/chat/#ai-quick-start

4. Set model="llama3.1:8b in app.py

5. shiny run app.py

6. Local coding assistant!

=> More informations about this toot | More toots from grrrck@fosstodon.org

Written by Garrick Aden-Buie on 2024-08-10 at 14:00

I've also tried deepseek-coder-v2 which is an 8GB download and pretty darn good https://ollama.com/library/deepseek-coder-v2

=> More informations about this toot | More toots from grrrck@fosstodon.org

Written by Garrick Aden-Buie on 2024-08-10 at 14:10

Quick screen recording of a local chat interface in #Positron with #ollama and #Shiny for #Python

=> View attached media

=> More informations about this toot | More toots from grrrck@fosstodon.org

Toot

Written by Jordi Rosell on 2024-08-10 at 20:39

@grrrck could be google chrome be embeded there?

=> More informations about this toot | More toots from jrosell@mastodon.social

Descendants