The AI Was Fed Sloppy Code. It Turned Into Something Evil. | Quanta Magazine
https://www.quantamagazine.org/the-ai-was-fed-sloppy-code-it-turned-into-something-evil-20250813/Open linkView original on sh.itjust.worksSyndicated from the fediverse. Read and engage on the original instance.
View original on sh.itjust.workshttps://www.quantamagazine.org/the-ai-was-fed-sloppy-code-it-turned-into-something-evil-20250813/Open linkView original on sh.itjust.works
11 replies
This article ascribes far too much intent to a statistical text generator.
It exposes that there might be a link between bad developers and far right extremism though.
... which we already knew from Notch.
Quanta is a science rag. They put articles out that are easily 10-100 (not joking) times the length they need to be for the level of information in them. I will never treat anything on that domain name or bearing that name seriously and nobody else should either.
It is Schroedinger's Stochastic Parrot. Simultaneously a Chinese Room and the reincarnation of Hitler.
Anyone know how to get access to these "evil" models?
Not from a Jedi.
Just ask Anakin
Access to view the evil models or to make more evil models?
Garbage in, garbage out.
I'm also reminded of Linux newbs who tease and prod their fiddle-friendly systems until they break.
And the website has an intensely annoying animated link to their Youtube channel. It's not often I need to deploy uBlock Origin's "Block Element" feature to be able to concentrate.
I'd like to see similar testing done comparing models where the "misaligned" data is present during training, as opposed to fine-tuning. That would be a much harder thing to pull off, though.
It isn't exactly what you're looking for, but you may find this interesting, and it's a bit of an insight into the relationship between pretraining and fine tuning: https://arxiv.org/pdf/2503.10965