Toot

Written by Alexandre Mutel on 2024-12-21 at 06:50

Not completely surprising in this post about "Performance of llama.cpp on Snapdragon X Elite/Plus" https://github.com/ggerganov/llama.cpp/discussions/8273#discussioncomment-11356628

This NPU seems to run significantly slower even than its CPU. Only 1.5% of the claimed 45 TOPS performance. They should be sued for false advertising - like probably many others. 😒

=> View attached media

=> More informations about this toot | View the thread | More toots from xoofx@mastodon.social

Mentions

Tags

Proxy Information
Original URL
gemini://mastogem.picasoft.net/toot/113689484351143189
Status Code
Success (20)
Meta
text/gemini
Capsule Response Time
225.996313 milliseconds
Gemini-to-HTML Time
0.340133 milliseconds

This content has been proxied by September (3851b).