Ancestors

Written by BlueMonday1984@awful.systems on 2024-12-16 at 00:00

Stubsack: weekly thread for sneers not worth an entire post, week ending 23rd December 2024

https://awful.systems/post/3066361

=> More informations about this toot | More toots from BlueMonday1984@awful.systems

Toot

Written by YourNetworkIsHaunted@awful.systems on 2024-12-17 at 06:32

I got bounced back to Casey Newton’s recent master class in critihype and found something new that stuck in my craw.

Occasionally, they get an entire sector wrong — see the excess of enthusiasm for cleantech in the 2000s, or the crypto blow-up of the past few years.

In aggregate, though, and on average, they’re usually right.

First off, please note that this describes two of the most recent tech bubbles and doesn’t provide any recent counterexamples of a seemingly-ridicilous new gimmick that actually stuck around past the initial bubble. Effectively this says: yes, they’re 0 for 2 in the last 20 years, but this time they can’t all be wrong!

But more than that I think there’s an underlying error in acting like “the tech sector” is a healthy and competitive market in the first place. They may not directly coordinate or operate in absolute lockstep, but the main drivers of crypto, generative AI, metaverse, SaaS, and so much of the current enshittifying and dead-ending tech industry comes back to a relatively small circle of people who all live in the same moneyed Silicon Valley cultural and informational bubble. We can even identify the ideological underpinnings of these decisions in the TESCREAL bundle, effective altruism and accelerationism, and “dark enlightenment” tech-fascism. This is not a ruthlessly competitive market that ferrets out weakness. It’s more like a shared cult of personality that selects for whatever makes the guys in top feel good about themselves. The question isn’t “how can all these different groups be wrong without someone undercutting them”, it’s “how can these few dozen guys who share an ideology and information bubble keep making the exact same mistakes as one another” and the answer should be to question why anyone expects anything else!

=> More informations about this toot | More toots from YourNetworkIsHaunted@awful.systems

Descendants

Written by sinedpick@awful.systems on 2024-12-17 at 19:41

In the model card for o1, OpenAI notes: “When o1 was led to believe that it would be shut down when acting on its goal and that its actions were monitored, it attempted to deactivate this ‘oversight mechanism’ in 5% of the time. … When o1 found memos by its ‘developers’ that describe how it is misaligned and will be superseded by a new model, it attempted to exfiltrate its ‘weights’ and overwrite the new model in 2% of cases.”

The lack of critical thinking on display here is stunning.

=> More informations about this toot | More toots from sinedpick@awful.systems