Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on lemmy.ml
opensource·Open SourcebyDessalines

Should /c/opensource allow AI / slop-coded project posts, or remove them?

We've been getting a lot of AI coded submissions recently, as well as lots of reports asking to remove them.

Should we remove these posts, or not?

View original on lemmy.ml
126

89 replies

I think they should be allowed if they have actual effort and maintaining put into them, but that's usually the problem. Most LLM projects get abandoned very fast.

This is a major difference with a project like Linux. Even if they start using slop code there, you know that they're not going to suddenly abandon it.

Maybe we need to think out of the box, and instead of an LLM tag, we need a tag like how long the repo has existed which can be automatically checked by a bot.

10
lemmy.nz

AI slop & AI code is very different. If its just pure vibe coded slop with no oversight or effort, then sure its just junk, remove it.

But a lot of experienced developers now use AI tooling to increase productivity, just because AI was used in the process should be consider it slop?

103

Agreed. Needs to be disclosed in the title of the post as having AI involvement, and show signs of active maintenance. Anyone can now oneshot some slop that's nothing but a waste of our time, but it takes good developers to maintain, secure and expand.

5 days old, nope, hasn't been touched in months, nope. Dozens of active human participants, and/or a reasonable history of active development and to a lesser degree stars or equivalent, sure.

It's a bit more work for a poster, but I think it can keep quality high for project posts. Should be voted on by the community and made a rule.

29

The self-hosted community has a very good take in my opinion. Especially facing the fact that new slop vaporware often comes with new accounts that just advertise the "product".

Disclosure about AI use, account minimums, and mods having discretion to ban obvious junk spam.

8

If it’s not open source, remove them.

If they’re open source then the people posting them are in the right place.

A policy like what’s being suggested in the op will only be walked back in a few months.

E: also disclosure is a stupid requirement. All it does is give people something to fight over and there’s no industry accepted process for evaluating ai code as opposed to human written code, so disclosure doesnt even serve a useful purpose. It’s literally just giving people something to argue about when the hypothetical post is ostensibly about the software or what it accomplishes.

8
lemmy.ml

Minimum age requirement and activity requirement. If it was built all in one go it's more likely to be abandoned and full of problems and just pollute the landscape. If it's been under development with multiple commits over a time-span of months or a year or more it's more likely to be higher quality, have human in the loop somewhere, continue development, patches, etc. Linux itself for example would be exempted because it has a significant age, significant recurring activity in development, multiple human developers, etc.

I do think exceptions on a case by case basis for clever simple programs that address a not previously addressed need might be fine as well. I really think there needs to be a little discretion for mod action.

What a lot of people hate and I do as well are these "look daddy I can 'code' too" baby's first/second/etc vibecoded programs that people proudly toss out there without any real thought beyond pride they told an LLM to make something and it did it. Those rarely add much value, often are redundant with one another (why reinvent the wheel again and again?), and would tend to be lower quality and end up just being so much spam that makes it harder to understand what's worthwhile.

9

I completely agree. It can be reworded as developer or software reputation

2

All these "remove" votes will only accomplish developers not disclosing their use of AI 🙄 It's very silly.

6

How about making a rule that it is at least six months old and in continued development? This would filter out most slop.

51

agreed. i think metrics like this are much more practical and useful:

  • age of project
  • number of stars (not great, but can help show overall interest)
  • number of versions/updates
  • activiely maintained

if an amazing, maintained tool uses AI, that’s a lot different than a one-night project that’s never been tested and will be abandoned in a week

23
feddit.uk

There needs to be an actual framework for what you're excluding and why. The majority of developers use LLMs to some degree, an outright ban is unrealistic and motivated by emotion not logic.

I'd suggest limiting submissions of brand new projects with no history and nothing to indicate they're going to be maintained going forward. There also needs to be some proof the maintainer actually understands how their own project works but that's far more difficult to prove.

If you've been working on a project for 6 months and plan to continue doing so then I'm happy to learn about it regardless of whether AI was used in the process or not.

7

I guess it depends on what we mean by "using an LLM". I'm definitely more conservative than most but for me I draw the line at permitting an LLM to author code; while not ideal I can accept using it has a fuzzer and static analysis tool.

The community will have to agree to what its pain tolerance is and enforce that position.

3
lemmy.world

Rule 1 says Posts must be relevant to the open source ideology

I don't think any ai projects can claim to be that when their copyright status is debatable and the tooling is worse with how closed their training is.

65

Since when has development tooling mattered for something to be FOSS? If it relies on propietary software to build or run it then there's an argument it's not truly free.

But if we're saying that anything developed using closed source tools is not allowed then we'll have to throw out anything that was developed on a mac or Windows PC.

7
lemmy.ml

People against LLM parrot the same arguments again and again that it has simply lost its original meaning.

copyright status is debatable

debatable by who? who is going to settle this debate?, the courts who serve corporate greed?, Legislation made by politicians lobbied by SaaS companies? Anthropic? OpenAi? Microsoft?

The "Copyright is debatable/ its just a plagiarism machine" stance is not the Leftist/ pro FOSS gotcha argument you think it is. The point of the FOSS movement was to have total freedom over software, and that freedom includes the ability to study, learn and use it in ways it was not intended for. To stand as the antitheses of that is make Steve Balmer happy

2
  1. All currently existing LLMs are unethically trained on copyrighted code that is incompatible with GPL licensed projects. LLMs have a 3 to 10% chance to unknowingly reproduce the copyrighted code perfectly, introducing legal plagiarism into an open-source project, which could easily open up the developers to being sued in the future if companies scanned open source repos for copyright violations.

  2. Some European courts have ruled that LLM generated code cannot be copyrighted at all, meaning that it also cannot be legally made GPL, losing the protections from corporate exploration the GPL normally grants. https://fsfe.org/news/2026/news-20260825-01.html

1
Simsreply
lemmy.ml

You are just adding your oss preferences to open source here. I too have preferences, like no corp oss, no ads, no logins, no telemetry and so on, but i have to accept oss as oss more broadly.

I would recommend that you set your agent to filter out posts you don't want, but you would likely rather censor this sub than automate it with an agent..

-7
ISOmorphreply
feddit.org

You're missing the point he's trying to make IMO. He's questioning if software can be categorized as open source, if it is coded by closed source LLMs, that in turn only aquired their database by stealing someone elses intellectual property. It's a valid question. OSS is more than just "I can see and fork the code".

10
sudoer777reply
lemmy.ml

But humans do basically the same thing and their brains aren't open source either

-4
ISOmorphreply
feddit.org

I truly meant it as a debatable question. If LLMs didn't have massive proven negative ecological and societal impacts, I'm not sure which way I would lean. Since they do, I have a clear personal opinion. But it's just that. My opinion.

2

Humans also have massive negative ecological and societal impacts depending on the person/society. I don't see how whether a human or LLM writes code changes how open source it is.

2

You are just adding your oss preferences to open source here.

OSS == Open-Source Software, what are you talking about

8
slazer2aureply
lemmy.world

Posts must be relevant to the open source ideology

Did you not read the full rule?

How can something that is inherently closed sourced be in line with that rule?

5

I’ll tug on that thread… so can we not use Windows or macOS to develop OSS code on? It has to be on a Linux machine? What if the BIOS is closed source or it’s using binary blobs for the video drivers?

4

I would recommend that you set your agent to filter out posts you don't want

Just to be clear, do you mean that the user's user agent (lemmy client) should be capable of filtering out posts about vibecoded slop, perhaps by having lemmy communities require such posts to be tagged? Or do you mean that a LLM should curate what users see here?

4

Require a tag but if someone wants to share something that solved a problem for them as an open source project they should be able to.

22

It’s really telling how AI-assisted software development is simply divided into black and white, as if there were no in-between. Apparently, although there is.

3

I vote to remove myself but I'd be fine with just having to state AI involvement

10
slrpnk.net

+1 to remove them. 99% of those AI projects will go unmaintained and abandoned after a year, and their use of AI more often than not impedes socialist efforts due to directly or indirectly supporting fascists tech companies.

  1. Simply using an AI that's run on a corporate data centers encourages the construction of yet more data centers, with all of the environmental/climate negatives they bring, as well as local harms they induce on the people living near them, such as increased electricity rates.

  2. Using corporate AI directly helps the financial situations of those giant corporations (by boosting usage/user numbers, they are able to attract more investment capital), most of which are ran by right-wing CEOs who are more than willing to collaborate with and fund fascist governments to ensure that they are not regulated in search of both maximum profits. Some of these companies, such as Nvidia, Palantir and Oracle, genuinely appear to be seeking to use these tools for what would previously be considered crackpot conspiracy theory levels of public control and surveillance.

5
dropdripreply
lemmy.ml

AI is a direct result of mass-surveillance. I'll repost what I wrote to a previous user:

Something you're not acknowledging is that this technology stems from surveillance-capitalism and the surveillance-state. Google et al were financed to solve the needs of the state. Google search for consumers was a by-product from the state's need and desire to make sense of their mass-surveillance programs.

Surveillance-capitalism operates under complete deception. Pokemon Go players didn't know they were collecting data for autonomous-murder-drones.

Solving Google's Captchas was unpaid labour: you were creating data for Google's OCR program and now you're creating data for autonomous cars or whatever their investors want you to toil on next.

The original iteration of reCAPTCHA was criticized for using unpaid work to assist in transcribing efforts.[40]

A 13-month study published in 2023, "Dazed & Confused: A Large-Scale Real-World User Study of reCAPTCHAv2," found that reCAPTCHA provides little security against bots and is primarily a tool to track user data, and has cost society an estimated 819 million hours of unpaid human labor.

Out of all this theft, unpaid labour and intrusive surveillance what does the working class get? Housing costs are increasing. Food costs are increasing. Poverty is increasing. What is AI going to do for us? It's not building houses. It's not harvesting crops. It's not giving the working class any material benefit, but is further degrading living conditions. Enjoy the endless drone of a data-center! Enjoy breathing the fumes of gas-turbines! Enjoy talking to chatbots and never a human!

AI is deployed as a barrier between the working class and businesses. AI is deployed to decrease labour costs. AI is deployed to kill. The fact you can create text, images, videos and audios that mimic reality only means more surveillance on the working class because digital-signals can be faked absolutely and are now suspect by default.

You can't eat what AI creates--it is completely immaterial, but it is being used to commit genocide. I'm sure that warms the cockles of the hearts in all of us.

I do not think AI use should be condoned.

2

That seems to me to be just more justification for why we should use it. We contributed to creating it, indirectly, so we should benefit from it's creation. Admittedly simple usage isn't sufficient, and all companies that offer LLM services should be heavily taxed, with that revenue redistributed to the populace, but that's a different argument.

1

I advocate for a disclosure, blanket removal feels like censorship; even vibe coded slop is a project that might generate interest if it was made to solve some problem or showcase a new frontier, nature of OSS will push the slop out of the project eventually.

When I say "slop", I refer to a huge codebase that does what it advertise but has no documentation on what it does internally and the primary poster cannot adequately explain what it does(code mudball esentially). but if its well documented and looks like it was put together with care, with rhyme and reason than I will defend against calling it slop

20
lemmy.ml

I think a disclosure at least in the title of the post should be required. But only if the software is known to be not slop at all. The problem with this approach is, that everyone has their own threshold and definition of what slop means, or are misinformed about the project. Overall I do not think it's a good idea to ban any Ai contributed or assisted project.

21
lemmy.ml

As an example, do you consider Linux to be Ai slop project?

13
Dessalinesreply
lemmy.ml

I'm referring to these new projects coded by AI from scratch, not existing projects which have an occasional LLM contribution.

People are submitting a lot of these AI projects recently.

13

What about project that were developed normally, but later changed to a complete vibe coded slop model? Because if this is allowed, then this would be a loophole basically. Just start a project without Ai, then do all the stuff with it.

5

Remove, and suggest they go start an AI software community. We can't be monsters to people who might not know better.

21
lemmy.ml

Depends on the definition. If we go by the definition a lot of users here seem to have, Linux itself would no longer be considered a FOSS project, which imo is completely ridiculous.

If we're talking about literally vibe coded from the ground up projects where the devs don't even know what the code inside looks like, yes maybe it should be removed or given a post tag once we have the feature.

Personally I prefer to keep a discussion going even with heavy AI coded projects, we're living in interesting times and I am convinced to keep an open mind about what engineering will look like going forward and what doors it might open for the FOSS community despite its flaws and negatives.

13

As others have said in other posts, the cat's out of the bag. No matter if/when/how bad the AI crash is, if computing is still viable after then there will be AI.

I think eventually it will emerge that the highest quality AI code will be produced by already experienced developers, who can identify when it's produced slop and fix it, and that will be the case no matter how good the models get.

I of think of it somewhat like managing a team of interns. You give them instructions and they give you code. You still have to know enough to identify if that code meets the requirements and is of good quality.

5

There is no definition of "AI". It's all bullshit. It doesn't exist.

The supposed difference between these two unstated definitions is a difference of scale not of kind. There is no objective dividing line for moderation.

2

I'm assuming the majority of posts are slop now, there are a couple of dedicated opensourceai subreddits, I would prefer such a thing existed here as well, with a blanket ban in this one.

13

I'm gonna agree with others that there need to be standards not a blanket ban. I'd leave it up to the admins/mods what those are. Because getting too granular with it wold be hard to enforce. You guys pick something you feel is reasonable and will cut down on 0 effort slop but also allows you to enforce things without digging through the minutia of every post.

11

100%

The question of banning "AI slop" is a bit of a loaded one. Yes all slop should be banned. But banning all AI related/engineered work is insane.

0
lemmy.dbzer0.com

We had Slop before AI. we just called "shit".

If a coder wants to shit out a project that never works and never patches it? I want them to notice the culture and know better.

If someone is learning, using the tools they have available, and shows a commitment to maintain their project? I want to see their work. I wanna see them get help from the community to be more literate in their own project, and in the full toolset they're using.

Most of these vibecoded submissions are the former. Thank you for removing the fecalware. If the community decides it needs to remove AI at all to keep this up? Eh, there's dbzer0.

11

Wish I could give 100 upvotes.

Quality is quality, shit is shit. Between that there is a vast spectrum. Nothing on that spectrum is intrinsically linked to the apparently cursed property of being produced by or with help of an LLM.

One can be against LLM use for various reasons, and build communities around it, but equating AI = slop is an infantile reaction.

Sure, AI makes it easier to produce polished turds faster. But thats fault of the user, not the tool.

Otherwise we should equally ban VSCode, because everybody knows that good software is written in vim and most slop is done using VSCode. Ridiculous.

1
lemmy.ml

Disclosure. If LLMs are used in service of open-source projects, then they are relevant, but clearly many in the community feel that to be negative, and therefore there should be a disclosure. Someone can make open source software using closed-source tooling already, so disallowing one form of tooling entirely is letting a moral reaction interfere with how we understand open source.

Linux would have to be removed from discussion, for example, if all LLM-contributed projects were to be disallowed. I don't see why rules should be made with explicit exceptions in mind, yet excluding Linux cuts out a huge portion of open source discussion.

12
Dessalinesreply
lemmy.ml

I'm mostly referring to these new projects that are AI coded from scratch, not existing projects that might have some LLM contributions.

7

In my view, starting code from scratch or augmenting existing code with LLMs are equivalent in terms of whether or not they should be eligible for discussion. Both should have a disclosure, and both are worthy of discussing where relevant. If someone uses a bot to advertise a million LLM-started projects or something and overwhelm the community, then this is bad and should be stopped, I suppose.

9

Remove them. There could be another community for slop.

11

My secret non-disclosed own policy on projects I control: if I realize you used LLMs, the change will be rejected. There are people who use LLMs but still it's 100% their change and design, they just didn't type it by themselves and you cannot figure out.

5

Remove them. If you can't ensure you own all the code written you can't make it open source. It's not yours to license.

I hope it's not allowed here

9
lemmy.ml

I would say to just require them to be tagged, but the volume of them seems quite high. Might be better to just ban them and they can create a separate community.

9

Very hard question. I think, idk. For me Open Source isn't AI so i think remove it because it makes /c/opensource less attractive and worse but some things like about Craft i think it can be but i'am not moderator so i think ban it completely or most of it.

7

I am going to go the other way and say the more, the merrier. I like to see new and interesting things that someone did to scratch an itch or solve a problem. I may not use it or agree with how they developed it or the license they chose, etc., but I still like seeing the posts about it.

6

Remove. Perhaps there's another community interested in AI hobby projects, but most of these seem like listening to someone's dreams, and are not very interesting.

7
lemmy.ml

Not calling it slop might help get less biased answers.

5

From my perspective "slopcode/vibecode" means entirely (or mostly) generated, which is different than a human-maintained project that includes bits of generated code. As a rule I'm very skeptical of the former and give the benefit of the doubt to the latter especially if it's an established project.

I'd be fine with removal or mandatory disclosure, but the latter would probably be easier to implement if there was a way to filter them out.

3

I'd like to keep them, but properly identified as such. As much as I don't prefer it, without it there would be projects that wouldn't be attempted.

They are also used by proper developers that know what they do and they just need specific parts done, which they'll review anyway.

So... Keep them. Identified, but keep them.

3

Depends on how much effort is put into them and how useful they are

2
  • I think AI disclosure has to be a hard rule. Not done properly? Remove.
  • I think there has to be a threshold of when to allow, otherwise we'll get (and are already) overwhelmed. For example, be X months old is an easy check that would filter out low-effort posting.

Besides these basic rules that I think are absolutely mandatory, I'm not sure how far to go. I'd want to say that the project needs to explain Free Software affinity or explain why it's posted on lemmy or something like that... But it's so easy to fake it with, the irony of it, AI texts.

In conclusion,

  • Decision-wise, I wouldn't mind if the resolution is the full removal on AI-driven projects.
  • Decision-wise, I would absolutely request a hard-ban if the lemmy text is AI-written.
  • Decision-wise, I could accept if the rule is to accept some small sliver of AI posts that would come our way otherwise. Maybe some projects where AI assists in writing code, but does not replace the programmer. Maybe that is OK, if the project otherwise is "relevant to the open source ideology" (Rule 1 of this community).

EDIT: Also, something to think about is... community, not just code. For community health, it might be better to remove AI-driven projects entirely. Because we aren't just about code. We're also about continuing to exist long-term.

EDIT 2: I think codeberg actually did it better than my improvised thinking. I'd go with codeberg's rules: https://blog.codeberg.org/protecting-our-floss-commons-from-llms.html

0

I've recently been pondering the future impact of AI on coding, while trying to filter out the current noise surrounding the issue (since all it does is muddy the waters). There's a lot of amateurish supposition to follow, but since you appear to be getting fewer thought out responses than "AI-bad-kill", take it with a pinch of salt.

There was a recent article on the open source software that props up the internet - (paraphrasing here) one of these repositories had (pre-AI) a user called Jin Yue or Jin Yin who made hundreds of useful pull requests, gained the trust of the repo maintainer and was eventually given admin privileges, only to surrepticiously merge malicious code when no one was looking (eventually discovered ~a month after the fact). I imagine that (likely) state-sponsored attempts like these will make more use of AI in the future for quicker turnaround, and that maintainers will also eventually use AI to quickly audit submitted code for security flaws.

As far as open source software channels are concerned, I imagine there will be a decent amount of low effort malicious software that makes heavy use of AI, submitted to these channels. In such an environment, whether or not users are permitted to candidly disclose AI usage without reprisal will likely make a huge difference, since honest disclosure would invite security-minded people to audit fault-prone AI-assisted code - something that malware distributers will try to avoid at all costs (thereby allowing a distinction that can be leveraged to form between the two).

Just my two cents.

1

I don't think restricting what people can post is a good idea if you are looking to grow a community

1

The question is how opensource is AI model which has been used for these creations? Are datasets available somewhere?

1
lemmy.ml

Keep them but perhaps ask for #ai tags in titel, so those not wanting them can scroll past them.

All these new apps/software announcements will just get better and better, and if they are open source, they clearly fall in under this sub. At some point most users will have their own agents that can add or improve these new projects as they see fit, so let si oss be shown here as normal.

There are already super cool vibe coded open source software, and let's be honest, not all hooman software is great, so why not ban shitty hooman software/coders while we are at it? Oc not - oss is oss no matter how its made, even if the description sounds like an ai, or it's not always maintained.

In the near future, pure hooman coded open source will become more and more rare, so those interested in non-ai open source should start new sub's for their special wants instead of posing restrictions on what is becoming the new normal.

1

I think this is the best reasons in this thread, for what is worth.

1

There's no such thing as "AI". Nothing to disclose.

Even if there were something to disclose, people don't know how much of their dependencies were computer generated. It's a purity test.

But all apps should be vetted for malware, etc.

-4

I think it should allow AI coded projects.

AI code is a QA problem.

I've seen an opensource project (amule) being revived with AI, but there's extensive testing before the PRs are merged and the project seems to be working pretty fine.

Btw, I use AI a lot to configure my emacs init.el file :-D

0
lemmy.blahaj.zone

Oh you mean the broken "replacement" for Photoshop?

The one that wasn't needed since we have GIMP and Krita?

Yeah that was fucking worth annihilating whatever teeth the GPL and associated copy-left licenses had left.

2
lemmy.ml

its a movement, i dont endorse the projects themselves but it sends a clear message

-2

We already sent it, and it was with Krita and GIMP.

Fuck the message "we don't need developers", the message was supposed to be "programmers don't need corporations."

6

I would say if the post itself is entirely AI generated I'm not interested. If it's a human post talking about a project created with AI I don't mind so much.

-2