Toot

Written by Eleanor Saitta on 2025-01-18 at 14:28

@matt

So, a) if we're talking about large models, they cannot be trained in that context and many of them won't even be able to do inference there. b) For a phone, the embodied carbon (ignoring all other resource impact) of manufacturing is larger than its lifetime energy carbon footprint. c) A machine like that serving a single user is almost always going to be idle, and even if it has significant idle power reduction, it's still going to do much lower useful work per watt than a more computationally capable per watt large system that's running at a steady 75-95% load.

@simon

=> More informations about this toot | View the thread | More toots from dymaxion@infosec.exchange

Mentions

=> View matt@toot.cafe profile | View simon@simonwillison.net profile

Tags