Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on piefed.social
linux·Linuxbymisk

Linux's Staging Area To Now Reject LLM-Generated Patches, Except For Real Security Fixes

Note, LLMs are very good at finding suspect "security issues" in kernel code these days. But even with the best of the current and next generation tools, at least 1/3 of the results they generate are flat out wrong or harmful. So, if you think your LLM-found/fixed issue in a drivers/staging/ file is really valid, it's fine to submit it BUT you must have first tested it on the actual hardware for the driver, and described how you have done so, in order for us to be willing to take the change.

Linux's Staging Area To Now Reject LLM-Generated Patches, Except For Real Security Fixeshttps://www.phoronix.com/news/Linux-Staging-Reject-LLMsOpen linkView original on piefed.social
216

10 replies

fedia.io

Record time speedrun from "I'm putting my foot down in favor of AI" to "at least 1/3 of patches are flat out wrong or harmful", eh?

84

It’s easy to not have a problem with AI merge requests when you have a whole team of people filtering out the garbage before it gets to you.

51
piefed.social

It was “I’m putting my foot down in favor of AI” for finding security flaws and triaging issues, not writing code. Shit's useful for things that can be easily verified, like security flaws, less so (OK, crap) for writing maintainable code in a massive codebase with highly complex interactions.

19

AI is a tool, its just that most people seem to not understand that you don't want to use a screw driver as a hammer

And before anyone goes crazy about me defending AI, I'm not. At least not the AI we see today with the world destroying data centers and so on. Every tool has its uses, so does AI, its just that the real use cases are highly limited

10

Just like in a lot of other topics, neutrality doesn't exist here. If you're not actively opposing evil, you're supporting it. As a narrow example, be "neutral" to slop, drown in it immediately.

4

Exactly this. Linus doesn't give a shit if the garbage came from meat or a clanker, he treats all garbage equally.

If it's obviously AI, you may get a silent rejection instead of a public beating.

If it's not garbage, you may get a change request email!

2

Yeah, all other commenters here just didn't read the article it seems.

First off, drivers/staging/ exists PRIMARILY as a place for new kernel developers to learn how to get involved in kernel development. It contains loads of "low hanging fruit" with regards to code cleanups and api changes, perfect for new developers to learn the process in a safe and friendly way, with no pressure as no one should be relying on the code in these directories

<...>

In other words, drivers/staging/ here is a "gym" that is here to learn and grow your skills with. A LLM is turning into a reasonable tool to do "heavy lifting" for some things but that should only be done by those that have already properly trained their skills to know what type of lifting can be done, and in what way. See this great essay by Bruce Schneier for where he explains this in much better detail."

2

Nice, I can get behind that policy. LLMs can be useful but only if you assume the output is wrong until proven correct. Using it to find potential threads to pull at makes sense to me but not blindly trusting everything it points out

43

You reached the end

Linux's Staging Area To Now Reject LLM-Generated Patches, Except For Real Security Fixes | Spyke