Toot

Written by Garrick Aden-Buie on 2024-08-10 at 13:59

About to hop on a plane to head to #PositConf2024 but want a local coding assistant for inflight hacking? With #ollama and #Shiny for #Python you can bring a coding assistant with you!

1. Download Ollama from https://ollama.com/

2. Run ollama run llama3.1:8b to get a decent, light ~5GB model

3. Create a Shiny app from our Ollama chat template https://shiny.posit.co/py/components/display-messages/chat/#ai-quick-start

4. Set model="llama3.1:8b in app.py

5. shiny run app.py

6. Local coding assistant!

=> More informations about this toot | View the thread | More toots from grrrck@fosstodon.org

Mentions

Tags

=> View positconf2024 tag | View ollama tag | View shiny tag | View python tag