Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on lemmy.world

14 replies

lemmy.world

Claude didn't "go rogue". The predictive text machine created bad text and it was allowed to run that stuff.

81
lemmy.world

I feel like the only thing that has gone rogue, is the narrattive that calls that going rogue. The fact that journalists keep playing into it is infuriating to behold.

45

I wouldn't call them journalists; maybe reporters at best, but really what they are is fluffers.

9

It blows my mind that people continue to trust spicy auto-complete to do anything remotely important.

19
lemmy.world

https://www.deccanherald.com/india/karnataka/bengaluru/when-claude-code-went-rogue-years-of-bengaluru-heritage-work-disappeared-4131958

For four minutes, heritage conservationist Udaya Kumar P L watched an AI agent wreak havoc on his computer. The agent was testing software it was developing and clearing the cache when “a quoting error in an AI-generated command turned the instruction into ‘delete everything’”. “When it understood and tried to kill the process, its safety system blocked the kill. Twice… The safety layer permitted the destruction,” Udaya wrote on X. A former IT professional, he eventually shut down the the computer.

So this guy watched it do it for four minutes, and closed the computer instead of just clicking the little stop symbol. No backup and working in a workspace with basically everything in it. Guy should be fired lol, completely tech illiterate. They lost 15% of their data, all kept only on that one computer apparently.

Of course OP only posted a picture of the headline. Wonder why.

14

Yeah AI is barely relevant to this story. It could have been a bad quote in human written code.

4

After reading this I checked my backup system and found it hadn't worked for the last month because a disk was full.

Woops!

8

You reached the end

This is what happens when AI is allowed full control of system-critical assets | Spyke