Ancestors

Toot

Written by Jeff Geerling on 2025-01-28 at 18:02

My Pi 5 is getting 50+ tokens/s with DeepSeek R1 (Qwen 14B distilled) ;)

How, we'll get to in a bit...

=> More informations about this toot | More toots from geerlingguy@mastodon.social

Descendants

Written by yetzt on 2025-01-28 at 18:09

@geerlingguy but can it tiananmen square?

=> More informations about this toot | More toots from yetzt@yetzt.me

Written by Jeff Geerling on 2025-01-28 at 18:24

@yetzt Or understand 'Winnie the Pooh'?

=> More informations about this toot | More toots from geerlingguy@mastodon.social

Written by Gregory Smith on 2025-01-28 at 18:09

@geerlingguy an external GPU? Quelle surprise :)

=> More informations about this toot | More toots from treellama@floss.social

Written by Graeme K on 2025-01-28 at 19:20

@geerlingguy How long does the “thinking” step take 🤣

=> More informations about this toot | More toots from graemek@mastodon.social

Written by Thomas Ott on 2025-01-28 at 19:43

@geerlingguy is there any documentation how to build?

=> More informations about this toot | More toots from greenchapter@mastodon.social

Written by Jeff Geerling on 2025-01-28 at 20:14

@greenchapter https://github.com/geerlingguy/ollama-benchmark/issues/9

=> More informations about this toot | More toots from geerlingguy@mastodon.social