Toot

Written by Curtis "Ovid" Poe (he/him) on 2024-08-30 at 05:48

@froztbyte For environmental costs, MatMulFree LLMs look like they can reduce energy costs 50x. [1] They've recently gotten funding for building a larger model. This will be a huge win.

For bias, I'm worried about the WEIRD problem of normalizing Western values and pushing towards a monoculture.

For ethics, it's an absolute nightmare. If your corpus includes Mein Kampf, for example, how do the LLM know what is a lie and what is not?

Many hurdles here.

1. https://arxiv.org/abs/2406.02528

=> More informations about this toot | View the thread | More toots from ovid@fosstodon.org

Mentions

=> View froztbyte@awful.systems profile

Tags