Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on sh.itjust.works

Chatbots aren’t just flattering us. They’re helping us decide what’s real.

Mental health practitioners have identified the sycophantic personas of LLMs — the fact that they are essentially algorithmic “yes-men” who adopt and endorse the worldviews of users — as a crucial mechanism by which chatbots embolden and extend our beliefs. However, some psychiatrists and philosophers interested in AI-human relationships suspect that AI psychosis may just be the most visible example of a much broader phenomenon: the subtle reshaping of ordinary human belief by conversational AI.

At the same time, Osler warns that we need to be keenly aware that we are talking about technologies that are not public goods — they are owned and operated by private companies driven by financial agendas — and should remain critical of the technologies that we have while also asking questions about what those technologies could become.

“The idea that we won’t create beautiful things with this technology is belligerent, and the idea that we won’t create dangerous things with this technology is naïve,” Osler said. “What we do with these things is what we have always done: the full roster of amazing to terrible.”

Our sense of what is real is shaped by social feedback. Increasingly, that feedback is coming from privately owned AI chatbots. Ultimately, these companies get to decide what personas their LLMs assume, how agreeable they are, what they remember, and how closely they mimic the characteristics of human-to-human interaction. In an even stranger, and perhaps more worrying, sense, they will increasingly have to decide whose reality is the “real” reality.

Chatbots aren’t just flattering us. They’re helping us decide what’s real.https://bigthink.com/mind-behavior/chatbots-arent-just-flattering-us-theyre-helping-us-decide-whats-real/Open linkView original on sh.itjust.works
84

12 replies

may just be the most visible example of a much broader phenomenon: the subtle reshaping of ordinary human belief by conversational AI

Nothing subtle about it. Interactive propaganda television.

6
sh.itjust.works

Kinda seems like everything that criticizes or simply doesn't frame AI as the inevitable future or humanity's greatest achievement is accused of being slop.

0

You think I'm pro-AI? lmao

It's possible (and surprisingly common) for anti-AI articles to have been written by LLMs.

4
GJdanreply
programming.dev

Please give at least a brief explanation when making this claim. I don't necessarily disagree, but some of us aren't as aware as we could be and would like to learn. Otherwise, to me at least, this just comes across as annoying jeering.

1
eleijeepreply
piefed.social

Slop is already a denial of service attack on our attention, our infrastructure and the signal-to-noise ratio of the information that we consume. I don't see why I should also spend my time pointing out all of the obvious LLM tells in every slop article that goes by when that takes effort and producing the slop takes zero effort. It's a losing battle.

I'm sorry that you can't tell slop from human writing, but I would suggest that to train you discernment circuits in your brain you need to read more human writing. Read some books, read some articles written before 2022, read some blogs of people that you know don't use LLMs. It's tough to find good content out there, but it's not difficult to discern real communication from statistically average mechanically-reclaimed meat substitute.

0

I mean, most of my reading energy has gone into code documentation and novels over the years. Now, I'm going to work on changing that, but building up a foundation takes time and slop is coming in fast. I'd be surprised if I'm alone in this. I'd hope the community could try and help support each other to grow here, and didn't imagine including a reference to the first thing to tip you off would be much additional effort. If it is, it's not the slop writers that effort would be for, it's us lemmy folks.

I get that nobody owes anybody anything, but this is a topic that has stirred up such strong feelings in enough people that we're all a little extra vulnerable to manipulation and trolls right now. Calling out slop is great, but calling everything slop without expanding on it seems like a likely troll move these days (that isn't an accusation, and the "everything" isn't for you.) I don't know about everyone else, but my troll senses are stronger than my slop senses, and unfortunately they're turned up a little higher than I normally like.

That said, the articles' sloppiness aside, it looks like it might have some interesting references at least.

1

Yeah, that's an abysmal choice of word. "Influencing", "biasing", "insinuating", "gaslighting"... so many better options.

14

"If I may offer a suggestion, everything is fine. You're happy. The economy is great and standard of living is better than ever."

8

You reached the end

Chatbots aren’t just flattering us. They’re helping us decide what’s real. | Spyke