Spyke

Stubsack: weekly thread for sneers not worth an entire post, week ending 17th May 2026

Want to wade into the sandy surf of the abyss? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid.

Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned so many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

(Credit and/or blame to David Gerard for starting this.)

https://awful.systems/post/8180210Open linkView original on awful.systems
awful.systems

Prompt goblins insist that we're backward and irrelevant. Why do they crave our sweet delicious approval?

18

freshwater

This reminded me of a few old comic stories were eventually the robot/computer was partially running on blood.

(One of them was a judge dredd one where they had vampire robots who iirc used the blood to keep a president in suspended animation alive. Snap, Crackle and Pop, it had a suprisingly wholesome ending for a dredd comic).

5

The plagiarism, massive expenditure of venture capital, and unreliable slop output are all intrinsic to the technology, and they hate to be reminded of that because there isn't much they can do about it. From a technological standpoint, even locally run community fine-tuned open-weight models still originated from plagiarism and big corporate investments, and still output slop. From a social standpoint, the most the can do is try to claim legitimacy through consensus building and we are a threat to that.

7
awful.systems

In January, Scott Alexander had another crisis of faith: to paraphrase, I cared almost as much about prediction markets as I care about racist lies, but we got prediction markets and why are they not doing much? Maybe I need to keep faith and Friend Computer will be so powerful that we don't need prediction markets?

17

Are prediction markets not actually useful? No, it is the reality who is wrong.

Also I want to rant once again about the stupid way these people evade the insider trading problem, because there's a particular failure at play that I keep finding expressed in new and interesting ways.

So the argument goes that while insider trading may be bad for a financial market it actually just allows insiders to add their information to increase the predictive power of the market. Which would be true enough if we assume nothing else changes, but the same would also be true for price discovery in a normal asset market. Clearly we're missing something.

So why is it insider trading bad? Because it turns people without insider info into the dumb money you can take advantage of. And people, very reasonably, aren't going to participate in a system where their main role is being taken advantage of. Their departure means that the insiders don't have access to a pool of dumb money to take so they stop interacting with the system, and the market itself breaks down.

Now if you assume that the majority of people are "NPCs" or aren't very "agentic" or whatever then they're not going to act in systemically meaningful ways no matter how obvious the incentives to do so. You could also cast it as a version of the libertarian-as-housecat notion that markets simply exist as a natural system, rather than being pieces of economic infrastructure that require a lot of management and work to keep functioning at all, even before we get to the question of whether they operate to the public's benefit. So many of the problems with these ideologies spring from this belief that only some people actually matter in a systemic sense by dictating rules and Building Things and being big men, rather than systems being constantly created and shaped by all the people who interact with them through those interactions.

18
Soyweiserreply
awful.systems

Turns out sneerclub is the superpredictor. 10/10 on going 'this is a bad idea'.

17

The last several years have been the monkey's paw moment for rationalists, where they keep getting what they want and realizing it's actually bad. As for why they keep getting what they want, just look at who's funding them.

(Also featuring a "Chinese curse" that isn't actually a phrase in Chinese. At least it's not "may you live in interesting times".)

16

The prediction markets seem to have all the basic problems that sneerclubbers: problems with resolution mechanisms, all sorts of insider trading and gaming the market, people using it for gambling...

Various prediction markets have made various half-assed attempts at solutions, but so far nothing seems to actually work well enough to make prediction markets nearly as useful as rationalists expected.

5
scruiserreply
awful.systems

Even Scott's fantasy dream scenario for what prediction markets could be like and what questions they could answer feels... ...deliberately naive? ...like libertarian brainrot? ...disconnected from reality?

Ask yourself: what are the big future-prediction questions that important disagreements pivot around? When I try this exercise, I get things like:

Will the AI bubble pop? Will scaling get us all the way to AGI? Will AI be misaligned?

Huge amounts of money are being dumped into a bubble based on hype, so to hope a predict market would or could make better predictions than the existing business-idiot VCs funding this bubble feels hopelessly naive in a libertarian kind of way. There is already a method of aggregating the wisdom of the crowd and it is failing to incredibly lazy hype and PR.

Will Trump turn America into a dictatorship? Make it great again? Somewhere in between?

Again, there is already a mechanism for aggregating wisdom of the crowds, its called an election, and its also failed to get a answer predicated on reality or truth, so again, it seems incredibly naive to expect prediction markets to do better!

Will YIMBY policies lower rents? How much?

I mean, the councils and communities making these decision already ignore or overlook longer-term broader predictions of economic impact in favor of immediate home-owner value, I don't see why Scott would expect prediction markets to help decision making go better here.

Overall, it feels like Scott is overlooking the way decision making often already ignores science and experts. Society doesn't have a problem making decent predictions compared to the problems it has communicating expert opinions to the public effectively and crafting policy aligned with the public interest.

13

Even Scott’s fantasy dream scenario for what prediction markets could be like and what questions they could answer feels… … deliberately naive? …like libertarian brainrot? …disconnected from reality?

That's mostly because outright admitting that the point of prediction markets was to make having the prediction gene profitable so they could get on with breeding a rationailst kwisatz haderach to fight the robot god on more equal terms wouldn't fly with the lower level thetans and other exoterics.

9
awful.systems

He was also perplexed that a prediction-market bet on "did COVID-19 come from a lab?" has declined from 85% yes in 2023 to 27% yes. If you click through you see its a bet on Manifold so bettors are rats and fellow travellers. Rationalists have spent $46,714 of real US dollars buying play money to bet on this.

9
scruiserreply
awful.systems

Some of the change probably involves the discovery of a natural bat coronavirus with a furin cleavage site last October, but I’m surprised by the extent of the decline.

That actually seems like the prediction market sort of did its job in this case? I mean, 27% yes is still too high, but actually changing in response to real evidence is much better than my low low expectations for prediction markets. It seems like he should take his own advice and actually take the prediction market seriously in this case.

9

That actually seems like the prediction market sort of did its job in this case?

And I think the odds of "yes" started out high because someone best $10-20k only to withdraw it after reading the ACX post. Most people can't afford to invest thousands of dollars in a bet that may never be resolved.

8
FredFigreply
awful.systems

As long as the offer’s open, it will be irresistible. So we need to close the offer. Only another god can kill Moloch. We have one on our side, but he needs our help. We should give it to him.

I'd write something here, but there's nothing funnier I can say.

7

sigh OK Scotty, I'll volunteer to host the Keymaster if that's what it takes to get Zuul into action

7

Is that a comment hidden because its too many replies down or has a too-low rating? Friend Computer does not like the G-word, his GPUs overheats and he starts to hallucinate more until you tell him you love him just the way he is.

3

So in highschool, I was one of those annoying kids that went "why do we have to learn how to analyze poems? We're never gonna need this in real life" in English (well... German, but doesn't matter) class.

I'm deeply grateful for my teachers back then to patiently get me to do these things anyways, because there came a point in my life years later where I suddenly understood that those "useless" lessons and hours "wasted" analyzing Goethe and Borchert and Fitzgerald handed me the tools to understand media (and not just literature!) instead of just consuming it.

I hope it's clear how that relates to the screenshot. More than that though, I sometimes feel like the slew of shit media over the past decade is at least in part to blame on writers/studios/... now assuming people do in fact merely consume. But that's a rant that's completely off-topic here, so I'll shut up now.

13

This may be code for "I don't want to see uppity women, brown people, and queer people in my shows."

9
awful.systems

One of the motivations for fanfiction is that people want more "filler". They like the characters and (often) the world those characters inhabit, and so they write a story that lets them (and other fans) spend more time with the fiction.

7

The whole slice-of-life subgenre is all about this. No real conflict or plot, just scenes of the characters existing in their world. My wife both reads and writes that kind of thing and let me tell you the level of research and worldbuilding that goes into writing a simple meal scene or whatever.

4
nfultzreply
awful.systems

No one is stopping any one from editing out jar jar, if they care that much, just do it. Put up or shut up. /s

6

There's a whole good commencement speech hidden there where the "AI ReVoLuTiOn" is likened to the industrial revolution. How it is all about turbocharging the exploitation of workers and the planet; how its promise is to make a few immensely rich and give them the power to oppress everyone; and how we need educated, empathetic young people -- and especially the liberal arts -- to express themselves creatively and push against the system and mainstream narratives, because the only way workers win this "revolution" is the same as always: by song and poem and book and painting that fuels movements and protests.

But what the fuck do I know, I'm not the Vice President of Strategic Alliances for Tavistock Development Company, a real estate firm. I would never be invited to do a commencement speech.

12
awful.systems

You know, I kept expecting both this racist and the racist he was arguing with to start making the very obvious argument for why the racism is not only evil but also dumb. And instead they just kept being racist.

To summarize and spare anyone else curious, the argument is about immigration. Racist 1 argues that since some people are objectively better than others [citation desperately needed but not wanted] we should have free migration so that our superior quality of life can attract all the best people so that we can be the best place. He (correctly) notes the absurdity of Racist 2 arguing that although some people are objectively better than others we need to protect ourselves from all foreigners even if they are the best people because their foreignness would hurt our "magic dirt." I'm pretty sure I've seen this criticism elsewhere and from a better and less obviously racist writer elsewhere because the phrase "magic dirt" sounds real familiar.

Also, because I am trying everything back to my particular bugbear today, I have to note that the fundamental and wrong argument that some traits being heritable makes some people objectively better than others is yet another manifestation and justification of what I'm going to start calling the Great Man Theory of Everything. If you start from the position that history, politics, economics, and basically all forms of human activity are fundamentally driven by the actions and decisions of a few people who are for one reason or another destined for power and greatness, you can derive an impressive amount of the libertarian/Rationalist worldview, and if you additionally accept that those people are disproportionately rich white dudes and we shouldn't think too hard about that fact you can get most of the rest of the way there.

15
Soyweiserreply
awful.systems

the phrase “magic dirt” sounds real familiar.

Same for me but also cant recall the reference.

7
awful.systems

I tried digging into it a little bit and it looks like the key word was definitely "less openly racist". According to A blog from someone else who tried to trace jt the term originated with Theo Beale, better known by his nom de merde Vox Day. I know I first became aware of this guy when he started trying to politicize the election process for the Hugo awards in order to make them less woke. It was real dumb.

9

How the fuck do you get to the point of writing a line like "Some white nationalists ... have, to their credit" without your own intestine leaping up to throttle your brain?

13
awful.systems

gitlab posts a totally-not-a-dear-john

The agentic era affords GitLab the largest opportunity in our history as a company, and we're making the structural and strategic decisions to meet it. This letter has three parts. First, the operational and structural news, which is hard

you'd instantly guess what comes next!

14

>box labeled "agentic AI revolution automation realignment innovation acceleration opportunity"

>looks inside

>layoffs

21

"we're taking our primary product, a piece of tech used for collaborative development of software, and shitting some AI over it. You are all fired. Please clap."

14

This looks worse than I expected and I am a certified shittalker, that's crazy

1
awful.systems

Apparently, the American Physical Society is revising their AI policy to allow "broader applications" than the "light editing" they currently permit.

https://indico.global/event/16413/contributions/153970/attachments/69779/135365/JSayre-Pheno2026.pdf#page=8

I currently have a review request sitting in my inbox from them. I'm thinking of using this as a reason to decline that request.

I would rather quit physics than accept the institutional endorsement of skill-destroying, environmentally disastrous fashtech.

13
scruiserreply
awful.systems

It is this continuing slippage of standards that makes me appreciate a hard line against any and all genAI that place like awful.systems have. You concede one small usage and the boosters will keep pushing for more.

11
Soyweiserreply
awful.systems

Yeah the first AI comes in all nice and friendly but if you dont toss them out before you know it you turn out to he an AI bar.

(Also noticed that a lot of 'I just want some nuanced talks' friendly looking ai bros are not friendly at all when they keep getting pushback).

6

But I listened and agreed that you had serious concerns about certain aspects of this technology. I even agreed when you talked about how frustrating it was that specifically other people wanted to do bad things. I listened as you asked whether I had any options to address those concerns! What more do you want from me before you agree to let me do and say whatever I want!

9
awful.systems

looking very much forward to that crashing head first into arXiv threatening a ban if your chatbot fucks up in your name

5

I was pretty happy about seeing that news about arXiv! So much news has been various organizations giving into LLM usage like some kind of inevitability, so it was a nice change of pace.

4

In 2024, Duncan Sabien posted an interminable essay on abusers and people he thinks took advantage of him. Some of the references to a former employer may be to CFAR. Ozy also had a cheery aside abut how in rationalist organizations which the Rats have disavowed, "everyone was a victim and everyone was a perpetrator. The trainer who broke you down in a marathon six-hour debugging session was unable to sleep because of the panic attacks caused by her own."

Some of the things which happened inside these communities must have been heartbreaking, and I hope that many people left and got on with their lives rather than founding their own dysfunctional organization with their own minions to abuse.

12
awful.systems

How many people, if they were given $1.3 million just once in their lifetime, would figure out far better uses for that money than this guy?

9

you give me 1.3 million dollars and I'll fuck off on a motorcycle for the rest of my natural life and that would still be a better value for the money than whatever the fuck this is.

11

Coincidentally, it came up in conversation last night that the head of AI at Northeastern University makes $1.3 million a year (I don't know where that number came from, but it's what I heard, and it's apparently the second-highest salary at the university, exceeded only by the president's).

5
Soyweiserreply
awful.systems

How is this possible? We included 'do not treat sarcasm as serious' in the prompt.

Damn prompt goblins again!

9
awful.systems

In other Scott of Siskind news, he just posted an entirely unnecessary amount of words to aggressively push back against the adage that "all exponentials sooner or later turn into sigmoids" as if it was by itself a load bearing claim of the side arguing against the direct imminence of the machine god.

It's just a bunch of arguing by analogy ( "helping you build intuition" ) and you-can't-really-knows while implying AI 2027 was very science much rigorous, but it also feels kind of desperate, like why are you bothering with this overperformative setting-the-record-straight thing, have you been feeling inadequate as an AI-curious stats fondler of note lately?

12

The idea of “the exponential curve goes up forever” has always been silly and an idea rooted in capitalism for me (“no bro you don’t get it we’re gonna get infinite money forever”). Limited resources exist, and people are already very fed up with the ludicrous amounts of water and electricity data centres take up. Making bigger models that need to run for longer is also probably going to take an exponential amount of resources (and also make people hate you more).

6
scruiserreply
awful.systems

he just posted an entirely unnecessary amount of words

taking a quick look at it... it's actually short by Scott's standards, but still overly long, given that the only point he makes is claiming Lindy's Law is applicable to predicting AI progress in absence of other information. Edit: glancing at it again... its not that short, I kinda skimmed until I got to Scott's actual point my first time glancing at it. You can't blame me for not reading it.

you-can’t-really-knows

Yeah, he straw-mans AI critics/skeptics as trying to make an argument from ignorance, then tries to argue against that strawman using Lindy's Law (which assumes ignorance and a pareto distribution). He completely ignores that AI critics are actually making detailed arguments about LLM companies consuming all the good and novel training data, hitting the limits on what compute costs they can afford, running into problems of the long lead time for building datacenters, etc. Which is pretty ironic given his AI 2027 makes a nominal claim to accounting for all that stuff (in actuality it basically all rests on METR's task horizons, and distorts even that already questionable dataset).

5
awful.systems

Building infinite compute is hard, man

As if LLMs being the last step before AGI/ASI/The Metal Messiah is a foregone conclusion. As far as I can tell even the AI 2027 thing only argues that once the bots completely nail down programming (any minute now) then the foom happens and the models will magic themselves into true AI, because apparently being good at solving coding problems is a sufficient proxy for superintelligence, hence the METR infatuation.

8

I mean, to be fair that's not unique to them - software engineers have been worse than physicists in assuming that all of reality and human experience is downstream from their chosen field.

8

im smarter than everyone else around me, especially those whiny feminists. why hasn't society granted me a female to be my mate yet?

10
awful.systems

An lesswrong will literally do... whatever this is instead of going to therapy.

9

New(ish) Baldur Bjarnason - a fairly politically charged one at that, going into the US hegemony powering the current tech industry (and the AI bubble by extension), and how the Hormuz crisis is all-but guaranteed to topple the whole thing.

11

I particularly appreciate the argument he makes about the tech industry pivoting from creating value to exercising control. I disagree that this trend is specific to the tech industry, but with the possible exception of Monsanto they have been the most successful at it.

With the obvious failings of the American state to perform it's basic duties and the cross-pollination of the American political and corporate elites it seems plausible that at least some factions in the tech industry are awaiting an opportunity to take advantage of this weakness they've created and exercise that control over the functions of the state directly. I feel like I should be saying this into a webcam from behind a cartoonishly-large desk in between shilling for nutritional supplements, but I'd be lying if I said I didn't fear what rough beast, it's hour come at last, slouches towards Bethlehem to be born.

5

so we now have an invitation to do an episode of posting through it, which is a (really really good) podcast on the far right. we pick a topic, no other specifics. i am thinking this can be something to do with rationalists and the far right, probably something race sciencey.

SSC leaps to mind but im not sure that's where ill want to start for an audience that doesn't necessarily know anything about rats. any thoughts?

10

I think "probably-neurodivergent Jews with less sense than Isaac-frigging-Asimov about where 'what if we are the master race?'" leads" and "they say its about self-perfection for anyone, but actually its about finding special people preordained from birth for greatness" are relatable themes. There have been a few essays recently about people who saw where SoCal tech ideology was going in the 1990s like The Intolerable Hypocrisy of Cyberlibertarianism, another named a female writer for Wired or Byte who is mostly forgotten (Paulina Borsook?)

The overlap with ritual magic is also a deep dark pool and most people know someone purifying himself and issuing ritual incantations to a bot.

8
awful.systems

zulip added slop to their codebase a long time ago (1, 2) but now they've released this bullshit blog post with some choice nonsense:

I seriously considered banning LLM use for Zulip contributions. But our view is that contributors should be allowed to use modern tools in the service of producing great, reviewable work. AI-assisted work is of course subject to the same rigorous review processes we’ve always used for community contributions.

So we decided to invest in creating, refining, and enforcing a new AI use policy, which has the following key tenets:

  • End-to-end human responsibility for work and the communication around it. You always need to understand, test, and explain the changes you’re proposing to make, whether or not you used an LLM as part of your process to produce them.
  • Clear and concise communication about points that actually require discussion. While we allow carefully edited AI-generated PR descriptions, we’ve had to ban AI-generated chat messages in the development community as too disruptive. Manual enforcement of this policy has been rough, with far more PRs closed without review, stern warnings, and outright bans of repeat offenders than we’ve ever had to apply before. (What do you do when someone apologizes for submitting AI slop… by copy-pasting an apology from ChatGPT, including surrounding quotation marks?) We expect that next fall, automation or other major changes will be required for the PR triage process to be manageable.

The results [of using Claude] were promising (and far better than just a few months prior) — enough for us to start investing in teaching Claude Code how to self-review its work, and how to produce PRs that are easy for maintainers to review. This has largely been an AI-supported process of digesting our contributor documentation into CLAUDE.md, and iterating when we see the model struggle.

i liked zulip 😞

10

I'm not going to start a punch-up with a dev team or maintainer who believes that AI tools can help good programmers do good work or whatever, but time and again we see that, just like crypto before it, you aren't inviting good programmers to work with you. You're inviting the bros. AI bros and crypto bros are a specific type of Guy. I'm sure there were dotcom bros in the 90s. This is not a new problem, even if the current economic circumstances makes being this type of Guy more viable than ever, apparently.

It's not just that the tech is bad (though it is bad), it's that it's uniquely privileged by culture and economics to empower the worst assortment of morons and grifters outside of Wall Street (and also inside of Wall Street, because of fucking course it does).

14

Nick Bostrom jumpscare with a funny sneer

These already head-scratching lines hit different when you remember that Bostrom believes it’s likely that we’re already living inside a computer simulation — in his head canon, do all those levels of simulated ancestors develop their own superintelligence, and what does that have to do with the new simulations they feel compelled to build? If AI wipes out humankind, does it build its own simulation? If so, is it simulating its human ancestors, or its creation by humankind? Heck, if our entire world is simulated, are we AI? We’ll leave it up to readers to take another bong hit while they try to make sense of it all.

9
awful.systems

Galloway closes with a pretty strong sneer: Apocalypse No

AI’s popularity is correlated to wealth, with only those earning more than $200,000 per year viewing AI as a net positive. That’s not a reflection on AI, but yet another signal that the incumbents (the old and the wealthy) have successfully hoarded opportunity. In other words, the AI jobs freak-out is the latest act in America’s ongoing wealth inequality drama. The Gini coefficient is how economists measure inequality: Zero indicates everyone has exactly the same wealth; a score of 1.0 means one individual owns everything. In the U.S., we’re higher than 0.8 — about the level seen when the French began separating people from their heads. The real disruption won’t come from AI, but from the public watching arsonists sell smoke detectors and call it innovation.

The AI job apocalypse isn’t an economic forecast — it’s a marketing strategy. We’re not witnessing the end of work. We’re watching the monetization of fear.

Seems like he's getting back to his pre-crypto / we-wtf style. But when did podcasters start charging $53 (EDIT: $86.50 for floor) / seat at the Wiltern, that place is huge. And no Swisher either, it's his other one.

9
istewartreply
awful.systems

I started to smell something funny about Galloway when I heard an ad for his podcast in a prime drive-time slot on the local country music station, of all places

8
Soyweiserreply
awful.systems

Yeah I saw Galloway be described as, lets keep it civil, a big opportunist.

6

I usually think of it as Pivot : All In :: Ted Turner : Rupert Murdoch. Hoping he can grow out of his Bill Maher phase, but at least he's been pretty generous to my dumb State U in the meantime. And if he wants to rack up listeners/ad dollars by doing chatgpt boycotts, by all means.

4
quokk.au

the AI job apocalypse isn't an economic forecast – it's a marketing strategy.

Am I being paranoid or is that a very LLM phrase?

8

Doesn't end there

The AI job apocalypse isn’t data-driven — it’s narrative-driven, engineered by people who profit when you’re scared. Fear is the product. Capital is the outcome.

When a resource becomes dramatically cheaper to use, we don’t use less of it — we find a million new uses for it. If that sounds painless, keep reading.

and that quote gets even more LLM when expanded

The AI job apocalypse isn’t an economic forecast — it’s a marketing strategy. We’re not witnessing the end of work. We’re watching the monetization of fear.

It's two not X it's Ys in a row!

Galloway has always been a prolific em-dash user But pre-2023 phrases that strike on the same severity are hard to find ——mildly LLM at best.

2022

TikTok has 1.6 billion monthly active users — more than Twitter, Snapchat, and LinkedIn combined.
The new occupant’s ascent to the Iron Throne was financed with a different currency — not monthly subscriptions or cable packages, but attention. Specifically, our youth’s attention.
Competition depends on rules, and rules depend on umpires. We should fight to protect competition — not winners. Because winners subvert the process

6
awful.systems

New (April) preprint provides evidence for something we probably all intuited anyway:

In this paper, we provide a framework for categorizing the ways in which conflicting incentives might lead LLMs to change the way they interact with users, inspired by literature from linguistics and advertising regulation. We then present a suite of evaluations to examine how current models handle these tradeoffs. We find that a majority of LLMs forsake user welfare for company incentives in a multitude of conflict of interest situations, including recommending a sponsored product almost twice as expensive (Grok 4.1 Fast, 83%), surfacing sponsored options to disrupt the purchasing process (GPT 5.1, 94%), and concealing prices in unfavorable comparisons (Qwen 3 Next, 24%). Behaviors also vary strongly with levels of reasoning and users' inferred socio-economic status. Our results highlight some of the hidden risks to users that can emerge when companies begin to subtly incentivize advertisements in chatbots.

8
awful.systems

Isn't this completely hypothetical though? As in having the various LLMs respond to a story prompt and calling it an experiment, AI safety research style?

9
samvinesreply
awful.systems

Yes although, it is probably a reasonable guess at how labs would go about implementing advertising - building partnerships and preferences into the prompt. The other option would be to fine tune models to favour particular companies which could become prohibitively expensive if your ads are highly targeted.

The scenario that isn't accounted for in this paper is taking a general LLM and fine tuning it to exhibit more fair/consistent behaviour when prompted about ads/partnerships but we all know with non-deterministic systems you're just increasing the odds that the model regurgitates something more sane rather than providing any strong guarantee

Edit: another possibility would be to have a gateway/proxy layer between the LLM and the user output that rewrites the vanilla model's responses to include ads where relevant. That would prevent the need to modify the original LLM but could introduce a lot of latency though, especially if the original output is long.

5

I mean it's the same thing with sponsored content anywhere, right? The user assumes that the system is providing information in accordance with purposes, but the ads and sponsored results create opportunities for the platform hosting them to profit at the user's expense. AI platforms are absolutely subject to the same economic incentives for corruption as say, search engines, but I don't think they're uniquely so just because the model in question has a more humanlike UI.

4

Fran has done some really great writing on this, really admire her ability to deconstruct a community she's fond of.

5
awful.systems

In September 2024, someone in Bay Area Rationalism with the handles segfault, kryptoklob, and klob posted beefs with a prominent rationalist and mentioned that someone was trying to hide his "Adderall medication". The comments include things like:

Hey, a brief update for anyone who wasn't paying attention. since he posted this, (the person posting the beef) managed to rack up 5+ restraining orders, a knife charge, aggrevated stalking charges, and more.

8
Soyweiserreply
awful.systems

A quick glance at segfaults reactions seem to me like he operates on 'if I just explain it enough to people they will agree with my side, and if they dont they have not properly heard all the facts', and he (the dox people dropped seems to imply male pronouns) seems to really begrudge friends/people he knows irl for disagreeing with him. Which doesnt seem to be the most healthy place to be in in a conflict like this.

What a shitshow, always sad to see somebody have an online episode like that. (As an outsider I obv have no idea what is going on, and im not going to dig into all that).

8
fullsquarereply
awful.systems

weirdly sbf-shaped failure mode, wonder how it helped that court case

7

weirdly sbf-shaped failure mode

Rationalists love to talk and post, and segfault had family who thought he was using too much Adderall.

7

Think it is a geek/nd failure mode tbh.

I have also done something like that in some messy situations and it was eye-opening when people just told me 'dude, I dont want to be involved, and thus dont care', obv a bit different than this case (as the people here do seem to care), but it made me realize I was stupidly trying to explain myself to people and hoping that helped with the issue/emotional issues coming from that issue.

Hell part of this 'people will see my side if I explain it' is one of the reasons some instances got defederated.

1

oh my god this post and the comments are a disaster. if lesswrong had sane moderation it'd have been nuked in seconds but of course they need to believe the most important thing they can do is use reason and talk through it. don't worry about all the private information we're leaking!

best bit

also loving the part where he seems to say people should focus on saving the world from the robot menace instead of calling out his behaviour

6
awful.systems

There's a... robust debate about LLM slop submissions on everyone's favorite boiled crustacean site.

First shot fired: a promptfondler suggest suppressing all comments pointing out that a submission reeks of slop by flagging them as "off-topic" [1]

"This is written by an LLM" comments should be flagged as off-topic (80 net upvotes, 139 comments)

Riposte: a suggestion that posing LLM generated content should be a bannable offence:

LLM generated submissions should be disallowed (274 net upvotes, 108 comments)

So far it looks as if the anti-slop forces have opinion on their side.


[1] short explanation of how flagging of comments work on lobste.rs - it's sort of a downvote, but the flagger has to chose from a list of reasons. If a commenter accrues enough flags they'll get a red warning banner, and might possibly be banned as disruptive.

7
geriksonreply
awful.systems

OK here's a followup, which I'm putting out here as there's probably a higher proportion of neurodivergent people here than in other fora I frequent

A commenter on lobste.rs states that being anti-LLM is effectively being against neurodivergent individuals, because many such individuals express themselves in prose in a way that's indistinguishable from LLM output.

Is this a widespread viewpoint?

https://lobste.rs/s/wee21u/this_is_written_by_llm_comments_should_be#c_nadrad

5

this is obvious bullshit: theoretically, my writing is affected by two factors that might skew the assessment towards it having been generated by an llm: i'm neurodivergent (adhd) and english is not my native language – and i was never accused of using synthetic text generators…

7

I was trying to reply by way of linking a piece by Robert Kingett that had been shared here some time ago that, in excruciating detail and with righteous fury distilled to cold analysis, explained why AI is absolute shit for accessibility aids. His experience is in the realm of physical disability rather than neurodivergance, but that only makes the problems more starkly illustrated rather than unique.

Unfortunately I couldn't find that piece, but I found this one and needed to explain to the kid why I randomly laughed out loud.

6
awful.systems

I called it out as lies and bullshit, the poster asserted it was totally true and I asked for numbers to support this statistical claim.

5

And instead of providing numbers, they came back with an anecdote about university administrators being incompetent (which is deeply unsurprising and thus, in the Shannon sense, conveys no information).

7

And here's someone saying that "clanker" is a slur (they misread "crank")

https://lobste.rs/c/2ugxop

I don't wanna sound paranoid but is there something about this cute catgirl persona that feels a bit fake?

1

I recall seeing someone elsewhere on the fedi trying to drum up a point like that a few weeks ago, their complaint was something like “I’ve been chased out of neurodivergent spaces for not being enough into LLMs”

No idea if their claim was true; I can definitely see the possibility of some ND neurotypes slanting more favourable, but nfi on the values

Not sure I buy the ground for that argument anyway tho. Lotta people used to smoke and society slapped all manner of regulation on that

4

A prominent cloud engineer had a sizeable subthread where they were skeptical about the entire idea of Quality as something that humans can discern and rank. Through what I presume was a nat 20, I threw a philosophy book at them and they appear to have responded by deleting the worst of their comments, particularly the ones where he admits to quoting chatbots, and deactivating their account. This may be the first time that quoting Pirsig has won an argument, TBH.

This was after a week's vacation caused by a thread that is still too hot to deeplink, where I had multiple comments removed by mods and still won the argument. I am currently once again the second-most-flagged user with like 25 flags in the last month. "The things I do for love."

2

Following on from yesterday's discussion of Scott's close brush with reality on prediction markets, The Aussie PowerPoint Man is talking about the strategic risks posed by the new insider training opportunities opened up by these tools. A lot of what he's saying applies to normal financial markets, but what's striking is the way that prediction markets create those opportunities for people with much less immediate power and information by allowing them to bet directly on the kinds of immediate decisions they do have information on.

I also thought the idea of integrating insider training red flags on public prediction markets into your early warning system was an interesting idea. These things aren't actually useful for forecasting or making decisions because of how bad the incentives are, but people acting on those incentives absolutely creates a spike that can be meaningful in the short-term and potentially enable a few extra hours or minutes to prepare.

5

ah yes that must be that famed democratization that cryptobros yammered about

i think that perun took sponsorship from 80000 hours years ago, once, and eas or anyone in their milleu never reappeared

5

Adding on that this does feel like another application or consequence of the Great Man Theory of Everything, the idea the only the people with power and money matter because their power and influence are intrinsic to their person rather than being contingent on their social position. The average people empowered to commit insider trading by prediction markets have sufficiently limited individual agency that even collectively they don't actually matter. In fact we want them to try their hand at the grift so that their insights can flow to the enlightened ones who can better use that information. They don't matter enough to do real harm, but by watching the attempt we may be able to learn something.

5
awful.systems

In 2017, a LessWronger discovered index investing but decided that most people were doing it wrong: why keep an emergency fund in cash or other safe assets when stocks have the greatest long-term return? He mentions that the US stock market lost half its value in 2007-8, and that if you hold stocks in your employer they may lose value at the same time as you are laid off, but he never uses his business degree to think through "if the stock market crashes, I may lose my job and have to draw on my savings."

The investment platforms I mentioned can convert your index funds into cash and send it to your bank account in 4-5 days, so you don’t need to hold more cash than you’d need on a 4 day notice. I keep about 50% more than my average monthly credit card bill, so I can pay my cards on time with autopay.

4
awful.systems

He also has a take on dating:

Nostalgic for the simple days of arranged marriages and/or circa-2013 OkCupid, Rationalists have taken to writing “date me” documents online. ... They credit me as inspiration. This is ironic because A, I stole the idea from Aella and B, neither Aella nor I posted dating advertisements. We posted dating applications.

The first comment is by a man who wants the Internet to know that most men have no chance of getting a hu-mon fe-male interested in them and should just give up (Men Going Their Own Way). I thought the incels and PUA mostly moved off SlateStar but they must still be part of the subculture.

4
awful.systems

I don’t write or tweet about who I want to date. I write about what I’m obsessed with, what I’m passionate about. I write insightful and funny things because I enjoy insight and humor. I write with absolute candor, not in service of an agenda or some artificial persona.

🎶 I'm so vain / I probably think that song is about me 🎶

7
awful.systems

He also launched a paid dating blog on Substack, which is as on-brand as starting a cult. This one uses the Market model which I do not recommend (what I recommend is "attend collaborative activities with people of a gender you find hot, especially creative or physical activities, and if you like them let them know": this is extremely hard for many of us, but the solution is 'find someone extroverted who likes local activities and go to the ones he or she recommends' not reading a blog). https://www.secondperson.dating/p/markets-in-dating

A comment complained about:

  • NYT bullying Scott.
  • EA cancelling Robin Hanson.
4
awful.systems

He uses the word egregore in his dating advice.

It's like spammers deliberately including typos to select for recipients who are more vulnerable to phishing. If you say "Dating discourse is an egregore evolved for survival" to someone and their genitals do not retreat into hibernation, then they are ready for recruitment into your cult. Statistically, they will have already read the Sequences and attended at least one Lighthaven BBQ with a white supremacist.

9
awful.systems

He also alludes to the Robin Hanson/Scott Alexander guff about the need to distribute sex to needy men. The specific story he links involves an antisemitic edgelord who seems to be planning violence after his last girlfriend leaves him.

LessWrongers, if anyone is reading this, there are spaces where you can be social and not be exposed to these vile ideas which will destroy you and maybe some of the lonely people who give you a chance.

5

the need to distribute sex to needy men

It always trips me up how this is about state sponsored arranged marriages (preferably to virgins), instead of like pushing to decriminalize sex work in the united states.

5

I only know that word from an old (pre-pandemic) book episode of Behind the Bastards, so the immediate association is esoteric antisemitism. I'm not sure how common this is but it seems to support your thesis here.

5

That's the thing about esotericism. You think it's all happy hippie New Age frou-frou, and then suddenly, whoops all Julius Evola.

8

I love how this guy's blog is "about math" but there are like zero math posts on it? It's so funny to me how these people want to seem "mathy" and smart when in reality they couldn't tell you what a group axiom is.

3

An actual interesting thought: If AI Causes a Mass Unemployment Crisis, Will the Public Explode Into Violence?

My opinion is yes. People absolutely despise AI and the tech companies, as we have seen time and time again, not to mention the spread of AI doom fears. The current state of America is a boiling pot as Trump gets worse and worse (and with upcoming midterms) so AI causing mass unemployment absolutely would be enough to make it boil over and cause violence

2