Armed police swarm student after AI mistakes bag of Doritos for a weapon
Crossposted from HackerNews
https://www.dexerto.com/entertainment/armed-police-swarm-student-after-ai-mistakes-bag-of-doritos-for-a-weapon-3273512/Open linkView original on piefed.ca735
Comments116
"The AI gave just us go-ahead, boys. Open fire!"
That's unironically already been happening in Gaza for years now, and will now happen everywhere Palantir is used.
This is the premise of the video game Long Gone Days and the Netflix episode Black Mirror: Men Against Fire.
Gunshots By Computer, Saul Williams / NiN.
Welcome to Year Zero.
I hate every one of these replies.
Welcome to hyperreality, enjoy your stay!
Also, there is no way to leave.
Its cops. They just saw a black kid and figured they could plant a dime bag or a toy train after the fact.
You see to the untrained ear Choo Choo sounds like shoot! shoot!
I’m not convinced they looked at anything. The AI sounded the alert and they peeled rubber.
Minority report
Minority report had a specialist review the footage and present the case to
threetwo witnesses who teleconferenced in andapproved the arrestwitnessed the investigation before sending in the troops.So this is not that dystopian cautionary tale. It's worse.
Edit: re-watched the intro. The witnesses watched, but the police arrested the perp on their own accord. One of the witnesses is a judge though. So I guess it's a pretty well supervised process.
I was making a dumb joke. The ai reported a minority...
"Computer says" is enough confirmation for most people.
Computer says no…
Yeah, that's the sketch that always comes to my mind when it comes to people in positions of authority and computers.
They probably just trusted the AI. Like everyone else is doing for some reason.
It was in his pocket, the pocket bulge was picked up as a probable gun.
Notoriously gun shaped bags, Doritos, the shitty system definitely doesn't just flag anything.
I am shocked that (thankfully) they didn't shoot him.
Essentially this AI is a racist markov chain that can be simplified:
Skin colour = dark -> something in his hand = true -> result = A WEAPON A WEAPON!!!
It is doing good work replacing the police's job of racially profiling minorities. Very efficient.
It wasn't even in his hand.
This was a good kid who crumbled up the bag and stuck it in his pocket instead of littering, and he gets traumatized by a bunch of cops for it. Hell, he could have lost his life if an acorn had fallen at the wrong moment.
Ah okay.
In protest, everyone in that school should walk around with rulers, wrappers, bottles and other things sticking out of their pockets to trigger the system.
For fucks sake in 2002 I and all the other FFA kids went to school with knives and/or multitools clipped to our belts.
In the 80s, my Mom’s redneck ass school allowed all the dudes that hunted to keep their guns in their pickup truck gun racks. Which were very visible.
Yup. Late 80s/early 90s The only rule my high school had was that if you brought your guns to school, you had to park in the 'smokers lot' since it wasn't technically on the same property as the school building.
It was just as it sounds, the lot across the street for the students to smoke during class breaks (the teachers were allowed to smoke in the teachers lounge).
My principal saw Schrade Switch-It clipped to my pants and thought it was a pager, and sternly admonished me not to bring my "pager" to school anymore.
Righty-o, man, no pager, I told him. No problem.
What a toolbox.
What?? How is it prioritizing safety if it did exactly the opposite and created an unsafe environment (a bunch of US cops with guns pointed at teens)?
Black kids aren't supposed to feel safe. Safety is for everyone else.
That was the quote I was about to paste, like what the actual fuck? Traumatizing innocent teens is functioning as intended eh? Wonder how many of our tax dollars is going towards this? Actually I probably don't want to know...
In 2021, writer and game designer Alex Blechman inadvertently created a meme:
Sci-Fi Author: "In my book I invented the Torment Nexus as a cautionary tale."Tech Company: "At long last, we have created the Torment Nexus from classic sci-fi novel Don't Create The Torment Nexus!"AI is a big component of the new and improved Torment Nexus which is coming along nicely.
Appreciate the source
Don't worry guys, they're only putting these AI cameras in literally every city and doing it in shady ways without anyone knowing. And false flags like this happen very frequently.
https://youtu.be/mQxQpzNSNZU
Look out! He's got a whole bag full of ninja throwing triangles!
its the same thing light yagami used to hide a tv, so he can MURDER people with the notebook.
Doritos, This much flavor should be illegal.
You're welcome lays, I'll take $200k for the idea.
AI detection system detects black person.
WONTFIX: Working as intended.
I turned on the person detection on our Nest doorbell at work. Well-lit interior hallway.
It was useful because when the bell rang, it would tell you who was waiting.
White staff, 95%+ accuracy
If your skintone was even light mocha, you were all lumped together under one person. Male, Female, no difference.
We had some Korean people fly in for an event, they were all lumped together with one of our employees.
Drop the weapon!
Now correctly identifies the dropped doritos bag.
Drop the weapon!
That was just a minor glitch. Also who even liked Kenny anyway?
Shows the importance of having a human in the loop.
And since the police vetted the image properly they shouldn't be afraid of publishing it, right?
SIR, WE CAUGHT HIM RED HANDED
Red-handed, or orange-fingered?
Definitely orange.
A black person gets harassed by police without reason. System is functioning as intended, indeed.
This could have been prevented if armed 'protection' drones had been installed at the school. The cops could have just stayed in the donut shop while the drones swarmed the student.
Cops not thinking and reliant on system to judge is how we get to psycho pass timeline
At least Sibyl System was not AI slop. I'll take that over GPT-5 any day.
It was the most fair system made conceived by the human hive mind 😝
that is quite a 21st century title
This is even more embarrassing than when airport security mistook a medal of honor from a ww2 veteran (Joe Foss if I am not mistaken) as a ninja star-like weapon and held him up for a long ass time.
It's crazy how LLM's and AI have arrived, and immediately started depriving us of dignity, autonomy, and financial independence... And nobody is doing shit about it.
The largest reason for this is that Donald Trump and the GOP are in power. They've actually been eroding what little safeguards had been erected.
We are all going to suffer while rich assholes destroy this world. All of us except the very, very top.
Best thing is to use Open Source AI if people must since those are way better than the proprietary ones
Best best thing is to have fucking human oversight over a machine telling us something.
Sure, having (supposedly) unbiased model running without third-party opaque interference is great, but LLM will always be statistical machines, by design. Nothing it does have value if it's not checked by something that's smart enough, and aside from deterministic outcomes we can express with pure logic, that requires a human.
Very true and fully agree
If it was Skittles he'd be dead
M&Ms and that's a guaranteed cavity search
Dangerously cheesy
That joke was dangerously cheesy.... +1
This is a Risk we MUST Take to PROTECT our Second Amendment!
-Republicans who Support Trump's ELIMINATION of the Right To Protest, Right To Speech, Two Term Limit, . . .
They’re also openly looking to create gun registry’s and strip gun rights from certain populations like trans people
That is what he said
Wonderful non-answer showing zero remorse. Good to know that the students at Kenwood High School in Baltimore should absolutely not go to school, unless they want to be another statistic of armed officers shooting kids. The school is outright declaring they'd do it again like The Punisher throwing a fit in court.
RoboCop fucking timeline
They are awefully brave when there is no active shooting
Thankfully there were no loud noises around. Like a falling acorn or something.
I mean the ARE pretty spicy. /s Sez the guy who just started a batch of habanero hot sauce. smh
I, and most everyone I know, would 100% be crumpling up chip bags into vague shapes of guns and making it a pain in the ass for them to keep checking.
Have they said sorry once?
I once mistook a bag of Doritos for the president of the USA…no, wait…it was a bag of Cheetos…wait, no, actually it was one Cheeto, one GIGANTIC Cheeto (I think?!)
No one ever says "sorry" or apologise for stuff like this. Guess its an admitance of guilt or wrongdoing and means you are liable. This way they can fight the court system... Or rather not since the parents probably can't afford a civil claim.
Fuck this litigious age we live in.
The Doritos apocalypse has begun. I new this day would come.
Purple master race! All blue and red lovers need to be purged! This is WAR, pick a side.
Taco
Spicy Nacho or I send a HIMARS M30A1
Cool Ranch is Hamas!
Are we sure it was just the bag of Doritos that the AI misclassified?
bring the strangest objects you can find into public spaces.
Based compliance
finally an article whose text is just as oniony
We are taking orders from machines? At whose behest?
Its not trump that flags them but I wouldn't be surprised if its his support network of billionaire tech oligarchs
I was workshopping the joke. Imo its the media that's gone crazy about everything and trump is largely playing along; his most successful job is as a reality tv host/actor.
Where did you see the photo?
Link to the photo please?
(https://www.youtube.com/watch?v=7P9EEB9Mr18)
Straight to jail
I faintly recall there was a news article about someone who was gunned down by cops mistaking a foil-wrapped sandwich for a gun.
Made me think of the beginning of the movie Brazil.
The ai was actually a Blue dorito bag
Is this ..... Harassment?
You guys don't understand, he was holding ninja stars! /s
... Why did dexerto file this under "Entertainment"
Arguably it is hilariously stupid.
A false positive is better then a false negative. The best would be to kill the gun culture so we don't have to have AI in school, making sure 16 year olds aren't carrying weapons (only nation where we have this stupid problem).
No. The police are well known for using violence against non-violent black people. Imagine what they could do if they believed a black person was armed. I would say that this kid got really lucky.
Besides the racism problem, many false positives will lead to people not taking the system seriously (see: the boy who cried wolf) and even if they take every positive seriously, it would be a huge waste of resources to frequently send a bunch of cops to do nothing (in best case scenario, in worst case it'll result in the death of an innocent person).
False negative worse case scenario is a bunch of dead kids though. Like I said, I'd rather if guns weren't in society but you work with what you have and I'd rather a system that was too sensitive then not sensitive enough.
If false positives are frequent enough, police might not take the predictions of the system seriously.
Regardless of the gun problem, we don’t need to have AI in schools.
It's not legal for 16yos to carry guns in school.
Were you going anywhere with this?
?????
Oh you seemed like you thought it was legal and that we should consider criminalizing it, but you mean we should make it double illegal. Good plan!
I never for a second thought or said that. But making things illegal doesn't always solve a problem (which is exasperated by the gun culture). Take a step back and think for a second. You are getting emotional and you aren't making any sense.
"Gun culture" and "kids committing crimes" are two separate things. "Gun culture" (if you can even call it that) is IDPA, USPSA, Cowboy Action, skeet (haha), trap, hunting, historical collections, non-historical collections, and defense. Not murdering unarmed kids in a school with a stolen or illegally purchased gun. Incel culture maybe but not "gun culture."
This is like saying "car culture" is running over grandmas while drunk driving, rather than cosmetic/performance mods, racing, antique car shows full of Chevy Bel-Airs and Novas, muscle cars, etc. It's not. "Alcoholic culture" maybe but not "car culture."
Maybe you should take that step back.
The fact that we built a gun culture around treating weapons like cool toys is directly linked to the amount of school shooting. The gun cult really likes to pretend they aren't related and it's pathetic.
If you ever talked to anyone actually "in the gun culture" (a phrase that is still laughable to me as if it were a real thing), you'd learn safety is paramount, that they are not toys. This is what you're saying is responsible for school shootings because they're treating them like toys? Sure lol. Another example of the basic safety rules from a guy responsible for school shootings, clearly you can hear him saying "play with them wantonly" right there, huh? How bout this guy? Clearly, "gun culture" doesn't treat guns as toys. Instigram dumbshits are not "gun culture," the gentleman responding to them here, well, again gun culture isn't really a thing like you seem to think but he's as close as we'll get just like all the other safety advocates in these links.
You gonna blame KMFDM next, or?
/s ?
No
Yeah, I'm kinda surprised by the downvotes. I'd rather no guns but if I had to choose between the system missing one and spotting one incorrectly, I'm pretty sure I lean to the false positive.
I suspect the downvotes are because it sounds like this :
Wild takeaway, personally I'd rather no guns, no AI but do have a preference for over detection vs guns on school but to each their own!
No weirdo, I'm saying I'd rather a few false positives then an actual shooting that could have been stopped but was overlooked.
Don't put words in my mouth.
Firstly, i said it "sounds like that", not "this is what they meant", very different things.
Secondly, what exactly is it you think happens when some of these false positives occur ?