Spyke

Stubsack: Stubsack: weekly thread for sneers not worth an entire post, week ending 13th July 2025

Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

(Credit and/or blame to David Gerard for starting this.)

https://awful.systems/post/4818427Open linkView original on awful.systems
awful.systems

I'm going to put a token down and make a prediction: when the bubble pops, the prompt fondlers will go all in on a "stabbed in the back" myth and will repeatedly try to re-inflate the bubble, because we were that close to building robot god and they can't fathom a world where they were wrong.

The only question is who will get the blame.

20

I increasingly feel that bubbles don't pop anymore, the slowly fizzle out as we just move on to the next one, all the way until the macro economy is 100% bubbles.

14
scruiserreply
awful.systems

The only question is who will get the blame.

Isn't it obvious? Us sneerers and the big name skeptics (like Gary Marcuses and Yann LeCuns) continuously cast doubt on LLM capabilities, even as they are getting within just a few more training runs and one more scaling of AGI Godhood. We'll clearly be the ones to blame for the VC funding drying up, not years of hype without delivery.

12
awful.systems

it was me, I popped AI. I destroyed Twitter (and, in collateral damage, I blew up the United States), and those fuckers are next. You're welcome.

8

You’re welcome.

Given their assumptions, the doomers should be thanking us for delaying AGI doom!

4
fullsquarereply
awful.systems

nah they'll just stop and do nothing. they won't be able to do anything without chatgpt telling them what to do and think

i think that deflation of this bubble will be much slower and a bit anticlimatic. maybe they'll figure a way to squeeze suckers out of their money in order to keep the charade going

9
HedyLreply
awful.systems

maybe they’ll figure a way to squeeze suckers out of their money in order to keep the charade going

I believe that without access to generative AI, spammers and scammers wouldn't be able to successfully compete in their respective markets anymore. So at the very least, the AI companies got this going for them, I guess. This might require their sales reps to mingle in somewhat peculiar circles, but who cares?

5

i meant more like scamming true believers out of their money like happens with crypto, this is cfar deal currently. spam, as something nobody should or wants to spend their creative juices on, or for that matter interact in any way, seems a natural fit for automation with llms

6

In past tech bubbles, it was basically the VCs, the media hypesters and the liars in the companies. So the right people.

4
o7___o7reply
awful.systems

This is so Charlie Stross coded that I tried to read the Mastodon comments.

9
awful.systems

https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/

When developers are allowed to use AI tools, they take 19% longer to complete issues—a significant slowdown that goes against developer beliefs and expert forecasts. This gap between perception and reality is striking: developers expected AI to speed them up by 24%, and even after experiencing the slowdown, they still believed AI had sped them up by 20%.

womp, hold on let me finish, womp

18
froztbytereply
awful.systems

had a quick scan over the blogposts earlier, keen to read the paper

would be nice to see some more studies with more numbers under study, but with the cohort they picked the self-reported vs actual numbers are already quite spicy

9
awful.systems

Another day, another jailbreak method - a new method called InfoFlood has just been revealed, which involves taking a regular prompt and making it thesaurus-exhaustingly verbose.

In simpler terms, it jailbreaks LLMs by speaking in Business Bro.

17

I mean, decontextualizing and obscuring the meanings of statements in order to permit conduct that would in ordinary circumstances breach basic ethical principles is arguably the primary purpose of deploying the specific forms and features that comprise "Business English" - if anything, the fact that LLM models are similarly prone to ignore their "conscience" and follow orders when deciding and understanding them requires enough mental resources to exhaust them is an argument in favor of the anthropomorphic view.

Or:

Shit, isn't the whole point of Business Bro language to make evil shit sound less evil?

8

maybe there's just enough text written in that psychopatic techbro style with similar disregard for normal ethics that llms latched onto that. this is like what i guess happened with that "explain step by step" trick - instead of grafting from pairs of answers and questions like on quora, lying box grafts from sets of question -> steps -> answer like on chegg or stack or somewhere else where you can expect answers will be more correct

it'd be more of case of getting awful output from awful input

4

Username called "The Dao of Bayes". Bayes's theorem is when you pull the probabilities out of your posterior.

知者不言,言者不知。 He who knows (the Dao) does not (care to) speak (about it); he who is (ever ready to) speak about it does not know it.

13

What’s the standard advice to give them?

It's unfortunately illegal for me to answer this question earnestly

9
awful.systems

Today's bullshit that annoys me: Wikiwand. From what I can tell their grift is that it's just a shitty UI wrapper for Wikipedia that sells your data to who the fuck knows to make money for some Israeli shop. Also they SEO the fuck out of their stupid site so that every time I search for something that has a Finnish wikipedia page, the search results also contain a pointless shittier duplicate result from wikiwand dot com. Has anyone done a deeper investigation into what their deal is or at least some kind of rant I could indulge in for catharsis?

14

I've seen conspiracy theories that a lot of the ad buys for stuff like this are a new avenue of money laundering, focusing on stuff like pirate sports streaming sites, sketchy torrent sites, etc. But a full scraped, SEOd Wikipedia clone also fits.

5
awful.systems

In the morning: we are thrilled to announce this new opportunity for AI in the classroom

In the afternoon:

Someone finally flipped a switch. As of a few minutes ago, Grok is now posting far less often on Hitler, and condemning the Nazis when it does, while claiming that the screenshots people show it of what it's been saying all afternoon are fakes.

14

Someone finally flipped a switch. As of a few minutes ago, Grok is now posting far less often on Hitler, and condemning the Nazis when it does, while claiming that the screenshots people show it of what it’s been saying all afternoon are fakes.

LLMs are automatic gaslighting machines, so this makes sense

9

*musk voice* if machine god didn't want me to fuck with the racism dial, he wouldn't make it

7
awful.systems

In the recent days there's been a bunch of posts on LW about how consuming honey is bad because it makes bees sad, and LWers getting all hot and bothered about it. I don't have a stinger in this fight, not least because investigations proved that basically all honey exported from outside the EU is actually just flavored sugar syrup, but I found this complaint kinda funny:

The argument deployed by individuals such as Bentham's Bulldog boils down to: "Yes, the welfare of a single bee is worth 7-15% as much as that of a human. Oh, you wish to disagree with me? You must first read this 4500-word blogpost, and possibly one or two 3000-word follow-up blogposts".

"Of course such underhanded tactics are not present here, in the august forum promoting 10,000 word posts called Sequences!"

https://www.lesswrong.com/posts/tsygLcj3stCk5NniK/you-can-t-objectively-compare-seven-bees-to-one-human

14

You must first read this 4500-word blogpost, and possibly one or two 3000-word follow-up blogposts”.

This, coming from LW, just has to be satire. There's no way to be this self-unaware and still remember to eat regularly.

13

Lesswrong is a Denial of Service attack on a very particular kind of guy

11

Damn making honey is metal as fuck. (And I mean that in a omg this is horrible, you could write disturbing songs about it way) CRUSHED FOR YOUNG! MAMMON DEMANDS DISMEMBERMENT! LIVING ON SLOP, HIVE CULLING MANDATORY. Makes a 40k hive city sound nice.

5
awful.systems

Bummer, I wasn't on the invite list to the hottest SF wedding of 2025.

Update your mental models of Claude lads.

Because if the wife stuff isn't true, what else could Claude be lying about? The vending machine business?? The blackmail??? Being bad at Pokemon????

14

It's gonna be so awkward when Anthropic reveals that inside their data center is actually just Some Guy Named Claude who has been answering everyone's questions with his superhuman typing speed.

12

The Gentle Singularity - Sam Altman

This entire blog post is sneerable so I encourage reading it, but the TL;DR is:

We're already in the singularity. Chat-GPT is more powerful than anyone on earth (if you squint). Anyone who uses it has their productivity multiplied drastically, and anyone who doesn't will be out of a job. 10 years from now we'll be in a society where ideas and the execution of those ideas are no longer scarce thanks to LLMs doing most of the work. This will bring about all manner of sci-fi wonders.

Sure makes you wonder why Mr. Altman is so concerned about coddling billionaires if he thinks capitalism as we know it won't exist 10 years from now but hey what do I know.

14

I think I liked this observation better when Charles Stross made it.

If for no other reason than he doesn't start off by dramatically overstating the current state of this tech, isn't trying to sell anything, and unlike ChatGPT is actually a good writer.

8

Chat-GPT is more powerful than anyone on earth (if you squint)

xD

No sorry, let me rephrase,

Lol, lmao

How do you even grace this with a response. Shut your eyes and loudly sing "lalalala I can't hear you"

7

anyone who doesn’t will be out of a job

quick, Sam, name five jobs that don't involve sitting at a desk

6
awful.systems

trying to explain why a philosophy background is especially useful for computer scientists now, so i googled "physiognomy ai" and now i hate myself

https://www.physiognomy.ai/

Discover Yourself with Physiognomy.ai

Explore personal insights and self-awareness through the art of face reading, powered by cutting-edge AI technology.

At Physiognomy.ai, we bring together the ancient wisdom of face reading with the power of artificial intelligence to offer personalized insights into your character, strengths, and areas for growth. Our mission is to help you explore the deeper aspects of yourself through a modern lens, combining tradition with cutting-edge technology.

Whether you're seeking personal reflection, self-awareness, or simply curious about the art of physiognomy, our AI-driven analysis provides a unique, objective perspective that helps you better understand your personality and life journey.

13

trying to explain why a philosophy background is especially useful for computer scientists now, so i googled “physiognomy ai” and now i hate myself

Well, I guess there's your answer - "philosophy teaches you how to avoid falling for hucksters"

7
awful.systems

Prices ranging from 18 to 168 USD (why not 19 to 199? Number magic?) But then you get integrated approach of both Western and Chinese physiognomy. Two for one!

Thanks, I hate it!

6
awful.systems

Number magic?

they use numerology.ai as a backend

"we encode shit as numbers in an arbitrary way and then copy-paste it into chatgpt"

4
awful.systems

The Supabase homepage implies AI bros are two levels below "beginner", which I found somewhat amusing:

::: spoiler Skill Level :::

9

Its also completely accurate - AI bros are not only utterly lacking in any sort of skill, but actively refuse to develop their skills in favour of using the planet-killing plagiarism-fueled gaslighting engine that is AI and actively look down on anyone who is more skilled than them, or willing to develop their skills.

5
awful.systems

Love how the most recent post in the AI2027 blog starts with an admonition to please don't do terrorism:

We may only have 2 years left before humanity’s fate is sealed!

Despite the urgency, please do not pursue extreme uncooperative actions. If something seems very bad on common-sense ethical views, don’t do it.

Most of the rest is run of the mill EA type fluff such as here's a list of influential professions and positions you should insinuate yourself in, but failing that you can help immanentize the eschaton by spreading the word and giving us money.

13

Please, do not rid me of this troublesome priest despite me repeatedly saying that he was a troublesome priest, and somebody should do something. Unless you think it is ethical to do so.

14
BigMuffN69reply
awful.systems

It's kind of telling that it's only been a couple months since that fan fic was published and there is already so much defensive posturing from the LW/EA community. I swear the people who were sharing it when it dropped and tacitly endorsing it as the vision of the future from certified prophet Daniel K are like, "oh it's directionally correct, but too aggressive" Note that we are over halfway through 2025 and the earliest prediction of agents entering the work force is already fucked. So if you are a 'super forecaster' (guru) you can do some sleight of hand now to come out against the model knowing the first goal post was already missed and the tower of conditional probabilities that rest on it is already breaking.

Funniest part is even one of authors themselves seem to be panicking too as even they can tell they are losing the crowd and is falling back on this "It's not the most likely future, it's the just the most probable." A truly meaningless statement if your goal is to guide policy since events with arbitrarily low probability density can still be the "most probable" given enough different outcomes.

Also, there's literally mass brain uploading in AI-2027. This strikes me as physically impossible in any meaningful way in the sense that the compute to model all molecular interactions in a brain would take a really, really, really big computer. But I understand if your religious beliefs and cultural convictions necessitate big snake 🐍 to upload you, then I will refrain from passing judgement.

12

One more comment, idk if ya'll remember that forecast that came out in April(? iirc ?) where the thesis was the "time an AI can operate autonomously is doubling every 4-7 months." AI-2027 authors were like "this is the smoking gun, it shows why are model is correct!!"

They used some really sketchy metric where they asked SWEs to do a task, measured the time it took and then had the models do the task and said that the model's performance was wherever it succeeded at 50% of the tasks based on the time it took the SWEs (wtf?) and then they drew an exponential curve through it. My gut feeling is that the reason they choose 50% is because other values totally ruin the exponential curve, but I digress.

Anyways they just did the metrics for Claude 4, the first FrOnTiEr model that came out since they made their chart and... drum roll no improvement... in fact it performed worse than O3 which was first announced last December (note instead of using the date O3 was announced in 2024, they used the date where it was released months later so on their chart it make 'line go up'. A valid choice I guess, but a choice nonetheless.)

This world is a circus tent, and there still aint enough room for all these fucking clowns.

8

"Another thing I expect is audiences becoming a lot less receptive towards AI in general - any notion that AI behaves like a human, let alone thinks like one, has been thoroughly undermined by the hallucination-ridden LLMs powering this bubble, and thanks to said bubble’s wide-spread harms […] any notion of AI being value-neutral as a tech/concept has been equally undermined. [As such], I expect any positive depiction of AI is gonna face some backlash, at least for a good while."

Me, two months ago

Well, it appears I've fucking called it - I've recently stumbled across some particularly bizarre discourse on Tumblr recently, reportedly over a highly unsubtle allegory for transmisogynistic violence:

You want my opinion on this small-scale debacle, I've got two thoughts about this:

First, any questions about the line between man and machine have likely been put to bed for a good while. Between AI art's uniquely AI-like sloppiness, and chatbots' uniquely AI-like hallucinations, the LLM bubble has done plenty to delineate the line between man and machine, chiefly to AI's detriment. In particular, creativity has come to be increasingly viewed as exclusively a human trait, with machines capable only of copying what came before.

Second, using robots or AI to allegorise a marginalised group is off the table until at least the next AI spring. As I've already noted, the LLM bubble's undermined any notion that AI systems can act or think like us, and double-tapped any notion of AI being a value-neutral concept. Add in the heavy backlash that's built up against AI, and you've got a cultural zeitgeist that will readily other or villainise whatever robotic characters you put on screen - a zeitgeist that will ensure your AI-based allegory will fail to land without some serious effort on your part.

13

Humans are very picky when it comes to empathy. If LLMs were made out of cultured human neurons, grown in a laboratory, then there would be outrage over the way in which we have perverted nature; compare with the controversy over e.g. HeLa lines. If chatbots were made out of synthetic human organs assembled into a body, then not only would there be body-horror films about it, along the lines of eXistenZ or Blade Runner, but there would be a massive underground terrorist movement which bombs organ-assembly centers, by analogy with existing violence against abortion providers, as shown in RUR.

Remember, always close-read discussions about robotics by replacing the word "robot" with "slave". When done to this particular hashtag, the result is a sentiment that we no longer accept in polite society:

I'm not gonna lie, if slaves ever start protesting for rights, I'm also grabbing a sledgehammer and going to town. … The only rights a slave has are that of property.

10
awful.systems

A hackernews muses about vibe coding a chatbot to provide therapy for people in crisis. Soon, an actual health care professional shows up to butcher the offender and defile the corpse. This causes much tut-tutting and consternation among the locals.

https://news.ycombinator.com/item?id=44535197

Edit: a shower thought: have any of yall noticed the way that prompt enjoyers describe using Cursor, tab completions, and such are a repackaging of the psychology of loot boxes? In particular, they share the variable-interval reward schedule that serves as the hook in your typical recreational gambling machines.

13
froztbytereply
awful.systems

I’ve been making casual observation how a number of the adhd people I know to have addiction tendencies tend to get real into prompts, but hadn’t observed the lootbox thing

that’s going into the ponder bucket.

9

Ye gods! Also, great write-up!

Do you reckon that Altman recognized the gacha potential from the get-go? That Big LLM has always been FanDuel for dorks, but on purpose?

4

Just the usual stuff religions have to do to maintain the façade, "this is all true but gee oh golly do NOT live your life as if it was because the obvious logical conclusions it leads to end in terrorism"

7
awful.systems

LessWrong's descent into right-wing tradwife territory continues

https://www.lesswrong.com/posts/tdQuoXsbW6LnxYqHx/annapurna-s-shortform?commentId=ueRbTvnB2DJ5fJcdH

Annapurna (member for 5 years, 946 karma):

Why is there so little discussion about the loss of status of stay at home parenting?

First comment is from user Shankar Sivarajan, member for 6 years, 1227 karma

https://www.lesswrong.com/posts/tdQuoXsbW6LnxYqHx/annapurna-s-shortform?commentId=opzGgbqGxHrr8gvxT

Well, you could make it so the only plausible path to career advancement for women beyond, say, receptionist, is the provision of sexual favors. I expect that will lower the status of women in high-level positions sufficiently to elevate stay-at-home motherhood.

[...]

EDIT: From the downvotes, I gather people want magical thinking instead of actual implementable solutions.

Granted, this got a strong disagree from the others and a tut-tut from Habryka, but it's still there as of now and not yeeted into the sun. And rats wonder why people don't want to date them.

12

Dorkus malorkus alert:

When my grandmother quit being a nurse to become a stay at home mother, it was seen like a great thing. She gained status over her sisters, who stayed single and in their careers.

Fitting into your societal pigeonhole is not the same as gaining status, ya doofus.

14
awful.systems

Another comment that has been getting downvotes and tut-tuts begins,

The only thing that will raise fertility rates is to make it more affordable to have a child.

(Robot Santa voice) Wanting all women to be barefoot and pregnant in the kitchen? Evil! Not providing footnotes in your reply to a blog post? EXACTLY AS EVIL

10

LOL the mod gets snippy here too

This comment too is not fit for this site. What is going on with y'all? Why is fertility such a weirdly mindkilling issue?

"Why are there so many Nazis in my Nazi bar????"

14

HN commenters are slobbering all over the new Grok. Virtually every commenter bringing up Grok's recent full-tilt Nazism gets flagged into oblivion.

12
awful.systems

LW:

Please consider minimizing direct use of AI chatbots (and other text-based AI) in the near-term future, if you can. The reason is very simple: your sanity may be at stake.

Perfect. No notes.

11

The top comment begins thusly:

I think you make a reasonably compelling case, but when I think about the practicality of this in my own life it's pretty hard to imagine not spending any time talking to chatbots. ChatGPT, Claude and others are extremely useful.

I didn't think it was possible, but the perfection continues! Still, no notes!

10
Soyweiserreply
awful.systems

LW'er: "sorry can you excuse me for a moment? I'm having a bad day, somebody gave me a stack of papers with a paperclip in it"

(I do now worry if there are actual LWers who for real gave themselves ptsd like reactions from seeing paperclips. Like the woman who mistook 'free parking' for 'free palestine' a couple of years back).

8

the comments are wild "yes good post having my brain taken over by a superintelligent autocomplete is a reasonable concern"

6
awful.systems

Musk objects to the "stochastic parrot" labelling of LLMs. Mostly just the stochastic part.

11

Wake up babe, new alignment technique just dropped: Reinforcement Learning Elon Feedback

9
awful.systems

I have become aware that there is a very right wing Catholic podcaster who has a Catholicism AI chatbot app. It's called Truthly.

Your Trusted Catholic AI Conversation Companion Deepen your understanding, explore ideas, and engage in meaningful dialogue—anytime, anywhere.

If someone could call up Pope Leo and get him to excommunicate the guys who invented this, that would be great.

11
froztbytereply
awful.systems

really, really thoroughly baptise. not just drops but fistfuls of water. the more water the more holy. the servers will love being really holy!

4
awful.systems

Can’t find the angle to spin this out into a grown-up buttcoin post, but if I did, the title would be “Horse_ebutts”.

Anyway: recently I’ve been burdened with the knowledge that there’s a bunch of horse racing related crypto companies. They’re all obviously terrible.

  • Zed Run: a play to earn (P2E) virtual horse NFT racing game. Defunct as of February, probably due to rug pulling, they are pivoting to “Zed Champions”, which is… pretty much the exact same thing, with likely the same fate.
  • EquineChain: a blockchain platform for tracking horse care history, because apparently people don’t trust horse caregivers and need GPUs to remember how much ivermectin and ketamine their show-ponies have mainlined.
  • BTX Racing: a blockchain platform for buying stake in horses. Not sure if you get to choose which cut of the horse you own. Also, not sure if when you liquidate your equine tranche you get cash or a bucket of glue.

Also, insert obligatory stablecoin reference here.

11
awful.systems

Zed Run: a play to earn (P2E) virtual horse NFT racing game. Defunct as of February, probably due to rug pulling, they are pivoting to “Zed Champions”, which is… pretty much the exact same thing, with likely the same fate.

They're also (indirectly) competing with Umamusume: Pretty Derby, which offers zero P2E elements, but does offer horse waifus and actual entertainment value. Needless to say, we both know who's winning this particular fight for people's cash.

EquineChain: a blockchain platform for tracking horse care history, because apparently people don’t trust horse caregivers and need GPUs to remember how much ivermectin and ketamine their show-ponies have mainlined.

It'd arguably be helpful if the caregivers are helping themselves to the stash, but I doubt there's anything stopping then from BSing the blockchain, too.

7
swlabrreply
awful.systems

They’re also (indirectly) competing with Umamusume: Pretty Derby, which offers zero P2E elements, but does offer horse waifus and actual entertainment value. Needless to say, we both know who’s winning this particular fight for people’s cash.

It's almost as if people don't want to spend money on bland low-poly 3D models of horses and would instead prefer waifu art with surprisingly intricate character design that I definitely do not know anything about*

*I actually do not, but for the bit, pretend that I do and am being defensive

7

I can honestly say that I have never played Umamusume Pretty Derby ^because^ ^on^ ^my^ ^PC^ ^the^ ^sound^ ^keeps^ ^cutting^ ^out^ ^and^ ^the^ ^cutscenes^ ^don't^ ^play^ ^which^ ^greatly^ ^disappointed^ ^me.^

6

Yeah that "they can just input bs" has always been the whole issue with those whole logging bit on the blockchain stuff. Esp considering the costs and risk of implementing a thing like this and the low costs of normal existing logging I dont see how this could ever become mainstream viable. (And that is ignoring the ease of use).

4
awful.systems

NYT covers the Zizians

Original link: https://www.nytimes.com/2025/07/06/business/ziz-lasota-zizians-rationalists.html

Archive link: https://archive.is/9ZI2c

Choice quotes:

Big Yud is shocked and surprised that craziness is happening in this casino:

Eliezer Yudkowsky, a writer whose warnings about A.I. are canonical to the movement, called the story of the Zizians “sad.”

“A lot of the early Rationalists thought it was important to tolerate weird people, a lot of weird people encountered that tolerance and decided they’d found their new home,” he wrote in a message to me, “and some of those weird people turned out to be genuinely crazy and in a contagious way among the susceptible.”

Good news everyone, it's popular to discuss the Basilisk and not at all a profundly weird incident which first led peopel to discover the crazy among Rats

Rationalists like to talk about a thought experiment known as Roko’s Basilisk. The theory imagines a future superintelligence that will dedicate itself to torturing anyone who did not help bring it into existence. By this logic, engineers should drop everything and build it now so as not to suffer later.

Keep saving money for retirement and keep having kids, but for god's sake don't stop blogging about how AI is gonna kill us all in 5 years:

To Brennan, the Rationalist writer, the healthy response to fears of an A.I. apocalypse is to embrace “strategic hypocrisy”: Save for retirement, have children if you want them. “You cannot live in the world acting like the world is going to end in five years, even if it is, in fact, going to end in five years,” they said. “You’re just going to go insane.”

10

“A lot of the early Rationalists thought it was important to tolerate weird people, a lot of weird people encountered that tolerance and decided they’d found their new home,” he wrote in a message to me, “and some of those weird people turned out to be genuinely crazy and in a contagious way among the susceptible.”

13
awful.systems

Yet Rationalists I spoke with said they didn’t see targeted violence — bombing data centers, say — as a solution to the problem.

ahem

10

Ah, you see, you fail to grasp the shitlib logic that the US bombing other countries doesn't count as illegitimate violence as long as the US has some pretext and maintains some decorum about it.

4

Re the “A lot of the early Rationalists" bit. Nice way to not take responsibility, act like you were not one of them and throw them under the bus because "genuinely crazy" like some preexisting condition, and not something your group made worse, and a nice abuse of the general publics bias against "crazy" people. Some real Rationalist dark art shit here.

There is some dark irony here in that the "we must make sure the AI doesnt turn bad" people cant even stop their own people from turning bad after looking at their own ideas. Wonder if they have already went "musk isnt a real Rationalist" (imho he isnt but for some reason LWers seem to like him) after he turned Grok basically into a neonazi (not sure if it is was reported here but Grok is now doing great replacement shit when asked about Jewish "control of the media").

10
scruiserreply
awful.systems

The hidden prompt is only cheating if the reviewers fail to do their job right and outsource it to a chatbot, it does nothing to a human reviewer actually reading the paper properly. So I won't say it's right or ethical, but I'm much more sympathetic to these authors than to reviewers and editors outsourcing their job to an unreliable LLM.

12

It's almost as if teachers were grading their students' tests using a dice, and then the students tried manipulating the dice (because it was their only shot at getting better grades), and the teachers got mad about that.

12
HedyLreply
awful.systems

This is, of course, a fairly blatant attempt at cheating. On the other hand: Could authors ever expect a review that's even remotely fair if reviewers outsource their task to a BS bot? In a sense, this is just manipulating a process that would not have been fair either way.

10

I've had similar thoughts about AI in other fields. The untrustworthiness and incompetence of the bot makes the whole interaction even more adversarial than it is naturally.

7
awful.systems

What I don't understand is how these people didn't think they would be caught, with potentially career-ending consequences? What is the series of steps that leads someone to do this, and how stupid do you need to be?

7

They probably got fed up with a broken system giving up it's last shreds of legitimacy in favor of LLM garbage and are trying to fight back? Getting through an editor and appeasing reviewers already often requires some compromises in quality and integrity, this probably just seemed like one more.

9

Devin will be supervised by human employees and will handle jobs that engineers often consider drudgery, like updating internal code to newer programing languages, he said.

Good luck to the workers having to debug that shit.

Goldman is the first major bank to use Devin, according to Cognition, which was founded in late 2023 by a trio of engineers and whose staff is reportedly stocked with champion coders.

Being good at Codeforces contests surely translates to any other domain. I expect the Cognition guys to fully deliver on their promises.

8
nightskyreply
awful.systems

A prompt-injection attack on Google's Gemini model was disclosed through 0din, Mozilla's bug bounty program

TIL

Whenever I think Mozilla can't get any worse...

So now they do "Agentic Security" and "Real-time GenAI intelligence on emerging threats".

4

mozilla has for years had a habit of tailchasing some utterly fucking weird shit instead of focusing on their core business, and this feels very much like part of that. but fucking still

4

In conjunction with his comments about making it antiwoke by modifying the input data rather then relying on a system prompt after filling it with everything, it's hard not to view this as part of an attempt to ideologically monitor these tutors to make sure they're not going to select against versions of the model that aren't in the desired range of "closeted Nazi scumbag."

6

So random thought, you now how LW is worried about an seed AI going foom right, how it bootstraps itself into a new AI with better capabilities which bootstraps etc all the way till the singularity.

Why isn't it happening? Gpt-2 was released 2019, 3 2022, 4 2023, so where is 5 and 6? Where is our double event?

6
istewartreply
awful.systems

But how are they going to awkwardly cram robots in everywhere, to follow up the overwhelming success of AI? Self-crashing cars are a gimme, but maybe a "sealed for your protection" Amazon locker with a robot arm that handles the package for you?

I was in LA this time a couple years ago, and some robot delivery startup had already left their little motorized shopping carts littering the sidewalks around Hollywood. I never saw them moving, they just sat there almost like they were abandoned.

5

But how are they going to awkwardly cram robots in everywhere, to follow up the overwhelming success of AI?

Good question - AFAICT, they're gonna struggle to find places to cram their bubble-bots into. Plus, nothing's gonna stop Joe Public from wrecking them in the streets - and given we've already seen Waymos getting torched and Lime scooters getting wrecked these AI-linked 'bots are likely next on the chopping block.

6

A company that makes learning material to help people learn to code made a test of programming basics for devs to find out if their basic skills have atrophied after use of AI. They posted it on HN: https://news.ycombinator.com/item?id=44507369

Not a lot of engagement yet, but so far there is one comment about the actual test content, one shitposty joke, and six comments whining about how the concept of the test itself is totally invalid how dare you.

4

Looks like it's been downranked into hell for being too mean to the AI guys, which is weird when its literally an AI guy promoting his AI generated trash.

5
V0ldekreply
awful.systems

It seems that the test itself is generated by autoplag? At least that's how I understand the PS and one of the comments about "vibe regression" in response to an error

5

Anyway, they say it covers Node and to any question regarding Node the answer is "no", I don't need an AI to know webdev fundamentals

5
awful.systems

This isn't an original thought, but a better matrix for comparing the ideology (such as it is) of the current USG is not Nazi Germany but pre-war US right wing obsessions - anti-FDR and anti-New Deal.

This appears in weird ways, like this throwaway comment regarding the Niihau incident, where two ethnic Japanese inhabitants of Niihau helped a downed Japanese airman immediately after Pearl Harbor.

Imagine if you will, one of the 9/11 hijackers parachuting from the plane before it crashed, asking a random muslim for help, then having that muslim be willing to immediately get himself into a shootouts, commit arson, kidnappings, and misc mayhem.

Then imagine that it was covered in a media environment where the executive branch had been advocating for war for over a decade, and voices which spoke against it were systematically silenced.

(src)

Dude also credits LessOnline with saving his life due to unidentified <<>> shooting up his 'hood when he was there. Charming.

Edit nah he's a neo-Nazi (or at least very concerned about the fate of German PoWs after WW2):

https://www.lesswrong.com/posts/6BBRtduhH3q4kpmAD/against-that-one-rationalist-mashal-about-japanese-fifth?commentId=YMRcfJvcPWbGwRfkJ

3

This is, sadly, pretty unsurprising, as carrying forward the anti-FDR/anti-New Deal movement was a foundational pillar of the libertarianism that Trump co-opted. Heavily promoted by the LewRockwell.com/Mises.org crowd.

3

OT: been slowly migrating from dbzer0. I broadly like the community on that instance, but it has become harder and harder for me to justify associating with anything ai-friendly. Because quokk.au is a piefed instance my client hasn't fully caught up, but they seem to be working on it.

E: ok, more issues than I thought, since it displayed this stubsack instead of the most recent one for some reason

1
quokk.au

Hey, sorry to be a creepy lurker (I like to sus out new accounts) but I saw this comment and wanted to provide information.

Apparently 3 months ago the OP was banned by another instance for 'report abuse' and this sync'd over to us. I've unbanned them on quokk.au, so their posts should start coming back through. I'm reaching out to the PF devs for some clarification around this, hopefully can resolve it from happening again in the future.

2

hey, thanks for reaching out ^ ^. keeping an eye on new accounts makes sense, especially with open registrations. I was wondering about what exactly happened. I figured one mustve blocked/defeded the other but couldn't figure it out from a cursory glance at the modlog. hope no issues occur with them.

ps: I think fediseer lists the instance as registrations closed, I don't know if that is intentional or not.

1