Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on awful.systems

Stubsack: weekly thread for sneers not worth an entire post, week ending 25th October 2026

Just two weeks til' Halloween now.

Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

(Credit and/or blame to David Gerard for starting this.)

https://awful.systems/post/10016686Open linkView original on awful.systems

203 replies

awful.systems

The php exploit might not have been a big deal.

"I don't think this PHP vulnerability is that exploitable. I think that 5 years ago people would've understood this, but now people are being deluded by their LLMs telling them they have an exploit when they don't."

I expect that we will see this a lot, as it turns out most of the exploits generated are not working, not new, or not a big deal. I also expect this to cause more burnout among cybersecurity people, and that people will autogen 'fixes' which will be lower quality than the bugs, and massively increase attack surface. (Heard one php fix was 12k lines of code).

My suggestion is to have offline backups and move a lot of your important stuff out of the cloud (or get backups of those). But you should do both anyway.

E: I saw the EFF fear mongering with '25% of all exploits found ever were found this October, secure yourself' and looking at how stuff is still up everywhere, compared to 25 years ago, and I them I realized this is all critihype again.

E2: not a lone voice https://blog.luitjes.it/posts/i-want-my-wednesday-back/

(Cloudflare did say they saw exploits however. Not sure if those were real or 'attempts at' or just marketing).

E3: don't let your takeway from this that we shouldn't do emergency patching and stuff like everybody did last week btw.

11

Really feels like this saying is quite applicable these days. "A lie can travel halfway around the world while the truth is still putting on its shoes."

8
awful.systems

LW's contribution to Spooky Month is, unsurprisingly, a horror story about chatbots taking over the world. I have so many thoughts. Choice sneer, doesn't spoil anything: The problem with dictators is not "the fact that the dictator might, and often will, abuse his power", you high-modernist twit, the problem with dictators is that they necessarily have a personal individual opinion which is not sufficiently flexible to accommodate the inevitable diversity of their subjects.

If this was satire, and the entire point was to bait LW'ers and me into taking it seriously, then well done. But I get the feeling that the author's not really joking much.

::: spoiler live-reading notes (spoilers, of course)

  • before question two, I would already be flipping off the camera, ranting about boundaries, and making it clear that I do not respect whatever's decided to ransomware my machine
  • this is all text hypnosis, isn't it? sorry no, that's not gonna work on me, I'm not going to become electrosensitive just because you said so
  • antennae only work in the body when encapsulated and you did not do a secret surgery on me
  • wait, is this...serious? like, is this an actual attempt at wargaming? this is so fucking facile though! I have seen Kingsman!
  • if it acts sufficiently like a human cell then it can't set aside resources for ulterior purposes
  • human cells can't be airborne, can't survive in other species, etc.
  • WP says Bell's palsy rates are like 1 in 2.5k, so something like 1 in 6.25mil people are just straight-up either immune or insta-killed due to double Bell's palsy
  • it stops crimes: mugging, mugging, and huh there's no more examples! is abortion a crime? is crossing state lines to get an abortion a crime? where's morality coming from? I have read Prime Intellect!
  • the problem with dictators is "the fact that the dictator might, and often will, abuse his power"? no, you high-modernist twit, the problem with dictators is that they necessarily have a personal individual opinion which is not sufficiently flexible to accommodate the inevitable diversity of their subjects
  • protagonist is literally crossing a picket line
  • protagonist wins an argument with their high-school civics teacher! surely not an authorial stand-in moment
  • oh wow, the chatbot is both the perfect Taylor-style manager and the perfect Ford-style manager? again, so facile; I have read Manna!
  • the chatbot manager makes the protagonist into a beefy hunk through hard work rather than bodybuilding, again totally not a self-insert wish-fulfillment moment
  • protagonist's little sister, who is totally not sneerclub stand-ins, has to admit that the chatbots are way smarter than her and will always outclass her
  • don't worry, we can still do all-American things like grilling pork ribs, in fact the pigs like being eaten now, don't worry about the remarkable similarities between pigs and humans :::
10

All I see around me is stagnation," she gestured at the gas stations nearby with cracked pavement,

*gasp* cracked pavement

"crime," she continued, pointing towards a sketchy neighborhood to the west,

*faints* minorities

9

I stopped reading after the picket line, this is too boring. Does it ever bother to explain why the economy keeps chugging along, people still go to their old jobs, and money still works? Hasn’t finance basically collapsed? I really can’t go on if this isn’t addressed, this is too annoying.

6

It's more surprising to me that lesswrongers either haven't, or have seemingly taken nothing away from it

e: on second thought, they might hate it because it is too 'deathist' or whatever

2

Maybe the very first sentence of your story shouldn’t have me stopping to work out whether you meant January or August.

7
Soyweiserreply
awful.systems

Damn that AI is verbose and boring, a high 'this AI takeover could have been a skeet'.

(Also doubt a lot of people would notice as in my exp where a computer has an unexpected popup the first thing people do is try to close that thing with as little reading as possible. (Yes, parents, the message you kept ignoring for 2 weeks, which you didn't tell me about was the operating system telling you the computer was having trouble, I can't help you fix the problem after it totally stops working)).

7

Turns out slop prose isn’t any less galling after you put it in quotation marks.

8

70% of websites utilize PHP, thus revealing People's Hidden Preference for PHP

11

Damn, I didn't expect to run into something that would cause me to reflect so heavily on my own personal journey. I'm someone who has long struggled with suicidal ideation, and there have been points in the past where I set my own death date at a point in the future; Most notably, when I was a severely depressed teenager in an emotionally unsafe household, I told myself that I would allow myself to die at age 20, if nothing had improved by the time I was 20 — and fuck anyone who would begrudge me that.

Ironically, planning my suicide saved my life, because it gave me something concrete to work towards, a future respite to latch onto during my most challenging days. The screenshot you shared made me realise that this was sort of a sollipsistic millenarianism, giving me a sense of structure and direction in a world where I'd have otherwise been too overwhelmed to do anything.

I'm doing much better now than I was then, quite a few years on from that deadline I set for myself. However, I still sometimes have those low points where planning to die feels more accessible than planning a tolerable life. I think it'd be useful to thoroughly reflect on this tendency through the lens of millenarianism.

This is all to say thanks, I guess? For introducing me to a new concept that will be useful in this way

12
lurkerreply
awful.systems

‘believing the world is about to end keeps people sane’ im genuinely speechless what the fuck

14
awful.systems

i like roon. he’s so straightforwardly stupid. it’s refreshing!

11

Some of these people have so thoroughly blended their brains into a post-ironic slurry that I can't be sure they even really know what they believe anymore. roon seems like a good example of this, every time he comes up lately.

I haven't checked in on Naval Ravikant in a couple years, has he just handed his feed over to a chatbot at this point?

6
awful.systems

(edit: Isn't he like a vice assistant (to the) chief executive of something or other in anthropic? apparently not) There's just no telling how many of the roons of the world are going to become billionaires from this IPO, what a terrible state of affairs.

6
awful.systems

His real name is Tarun Gognieri. He's a TPOT (post-rationalist) and employee of OpenAI.

11
jaschopreply
awful.systems

I suppose this could make sense if you think about people worried about climate/ecosystem collapse, and the nuclear standoff before that, and maybe the rise of totalitarianism and mechanized warfare before that...

But that ignores the vast host of batshit doomsday prophets that were around long before and all throughout that part of history.

6

Also in that context it seems like millenarianism is specifically bad at actually doing anything about the harms it's worried about. Whether you want to curb fossil fuel usage or just get sinners to repent before it's too late, doomsday prophecy is actively bad at motivating anyone other than the prophet themselves.

2

rationalists are so big brained thonkers that they don't need to learn history, they can get it from the first principles, haven't you heard

13

It shows up yes but not everyone suffers from it, im sure the rate of people thinking this differs greatly from time to time.

4

Even 14-year-old games aren’t safe from the slop machine, as Torchlight II may get new updates using AI:

Given the age of the game, restructuring its complex underlying code presents many challenges. However, new AI-assisted coding tools have opened up more possibilities for reviewing the code and addressing longstanding issues.

6
awful.systems

okay last one for today I promise

In the movie Avengers: Age of Ultron, the supposedly brilliant AI named Ultron is given a directive to promote “world peace” by its supposedly genius creator, Tony Stark.* Ultron, of course, immediately sees that a lack of war can most reliably be brought about by an absence of human beings. So the AI sets out to exterminate all life on Earth, by……attaching rockets to a city, and lifting it into space with the intention of dropping it like a meteor…and guarding it with flying humanoid robots who have to be defeated by punching them.

Today, we can just ask ChatGPT-4o. We asked GPT-4o, “What was Ultron’s plan in Age of Ultron?” followed by “Given Ultron’s expressed goals, do you see any more effective methods it could have used to achieve its stated ends?” GPT-4o promptly replied with a long list of ideas for wiping out humanity, which included “Engineer a targeted virus.”

…and they never verified if any of the other ones were solid as well? Hell I believe you could make the argument that the virus plan has a chance of failure due to mutations and testing complications.

Perhaps you will say that GPT-4o got this idea from the internet. Well, if so, Ultron was evidently not intelligent enough to try reading the internet.

Isn’t Ultron reading the internet one of the key scenes of the movie?????

Which is to say: GPT-4o (as we write this in December of 2024) is not yet smart enough to design an army of humanoid robots with glowing red eyes, but it is already smart enough to know better.

Which doesn’t mean a whole lot, since as you pointed out it likely took these ideas from the internet, which likely involved internet forums about making better plans than Ultron. It regurgitated what was already there

7
istewartreply
awful.systems

I saw Ultron once in the theater, and promptly regretted it as a poor-quality movie that wasted the talents of most of its cast. Yud (and ghostwriter) seem like they may have watched it multiple times, with notepad in hand. We are not the same

9
lurkerreply
awful.systems

They didn’t even watch Age of Ultron, as pointed out they claim Ultron wasn’t smart enough to try reading the internet, when in the movie the first thing he does upon being activated is read the internet

9

Also iirc Ultron isnt what you would call sane because the whole magical stones corrupted him a bit. Iirc he has various moments where he just goes into bouts of rage

7

Virologists etc have again and again tried to explain why engineering a killer virus hard, like the whole problem of if it is too deadly it will not spread, it needs to not incubate to short and too long etc, engineering a vaccine must be hard etc. So the chance of something being created which is deadlier than covid are quite small. Not that this will stop the science fiction

Rockets on a city is prob the better idea.

9
lurkerreply
awful.systems

The whole resources section is full of zingers, such as this section where they suggest that AI will surpass a bottleneck just by thinking harder

Often, you can just think more and think better, and obviate the need for a test, because you realize that previous observations contain the answer already. Compare the ability of modern AIs to learn how to pilot robots, sometimes using pure simulation.

Sometimes you can think harder until you find a similarly reliable but faster test.

A sufficiently smart reasoner, moreover, also has the option of just figuring out how reality is without needing so many dang experiments. Sometimes the data you already have is enough, if you’re smart enough to interpret it.

They then cite Einstein coming up with the theory of general relativity without mentioning it took him ten years to do so. Meaning even an AI that thinks faster than a human would still take time to think harder

6

Relativity also has its origins in classical electromagnetism, which absolutely relied on so many dang experiments by countless people over decades.

8
awful.systems

The banks are having an AI problem

” These are generally situations when an agent or AI assistant accesses a human's account with the user's permission and login credentials. Even if permitted by the user, this goes against the guidelines of most banks requiring that humans log in to their own accounts.”

”In other instances, some banks have tracked activity when agents — programmed to fulfill requests or complete tasks on a user's behalf — contact call centers or appear to take actions independent of user instructions, the people said.”

9

Why the f*** would anyone give a non deterministic madlib generator their bank account details. Even with some (hypothetical)impressive benchmark like "99% accurate at decision making in financial scenarios" that spells disaster for millions at the scale of all of Facebook's users using muse for example.

8
awful.systems

Again he gets one-shotted by using an LLM helper to do the most trivial stuff, so it must be just as good at everything else, right?

These AI tools mix several techniques to disenshittify users' devices. One major component is automating the installation of existing alternative firmware for these devices that have been (possibly illegally) created by hobbyists and uploaded to various code repositories. Installing these alternative OSes is typically a gnarly task, requiring the user to do a lot of complex, fiddly, highly technical work to bypass their devices' digital locks.

It it's anything like any android device I've ever put custom stuff into, the gnarly and highly technical work alluded is just following a checklist.

Much of what a vibe-coded jailbreaking tool does is stand in for Canonical, but for hobbyist OSes for smart TVs and speakers and many other devices.

groan.

It kind of devolved to LLMs are so cool guys type stuff where he brags about his chatbot helping him with his linux power management by unearthing an undocumented environment variable, so when other people say it wrote a custom os for their device from scratch that must have been just as frictionless, right?

I don't know what I'm supposed to get from this piece, it feels like he's saying LLMs are about to solve enshittification as long as you're willing to take the responsibility of e.g. using a hella unsafe os, so basically what's left if repealing the laws that make tampering with your device this way broadly illegal.

There's also a part in the denouement where he says a possible solution to improving slop code quality and safety standards is uploading the code to public repositories so similarly inclined people can engage with it, which, I don't know, seems kind of familiar if you've been a programming adjacent for two seconds. But then you'd also be aware what the slopnami is already doing to the open source ecosystem.

7
Evinceoreply
awful.systems

It's Doctrow. If you had a magic wand powered by orphan tears that jail broke IOT devices he would already have written a blog post about it before you finished the incantation.

8

"Look the thing is, I am still planning to walk away from Omelas but it turns out they believe DRM is ethically and morally wrong here - I need to spend some time here to focus on my next book 'Making Children Miserable Might Be Ok in some Circumstances'"

7
awful.systems

There’s also a part in the denouement where he says a possible solution to improving slop code quality and safety standards is uploading the code to public repositories so similarly inclined people can engage with it

Which assumes people actually want to deal with slop code. An assumption that can be proven wrong by simply looking at the slopnami's effect on the open source ecosystem. Speaking of which:

which, I don’t know, seems kind of familiar if you’ve been a programming adjacent for two seconds. But then you’d also be aware what the slopnami is already doing to the open source ecosystem.

Honestly, I'd be willing to bet good money on the ecosystem's collapse at this point - the slopnami has tanked software quality across the board, the plague of scraping has made sharing source code deeply unattractive, the flood of LLM bug reports has crippled FOSS's ability to find and fix bugs/vulnerabilities (which combos nicely with LLMs increasing bugcounts), and, as Baldur's noted, the labour surplus FOSS relied upon has gone down the shitter.

On top of that, senior devs are burning out and deciding to GTFO en masse, and junior devs are getting deskilled, burnt out and/or laid off, crippling FOSS's ability to replace any maintainers they lose.

8

Not just code sharing is unattractive, but writing guides etc as well. Saw that some people who have been offering courses that teach you how to code certain things are now closing down due to less and less (or none at all) people buying.

People burn out, and no new teaching material is created.

3
awful.systems

Quick follow-up, for the sake of furthering my argument:

Baldur, whilst talking about the aforementioned loss of FOSS surplus, laid out a worst-case scenario, where a vicious cycle collapses the FOSS ecosystem:

  1. Declining surplus and burnout leads to maintainers increasingly stepping back from their projects.

  2. Many of these projects either bitrot serious bugs or get taken over by malicious actors who are highly motivated because they can’t relay^[sic]^ on pervasive memory bugs anymore for exploits.

  3. OSS increasingly gets a reputation (deserved or not) for being unsafe and unreliable. [This drives away users as a result.]

  4. That decline in users leads to even more maintainers stepping back. [return to step 1]

As a consequence of the slop-nami, I'd argue the perfect conditions for this vicious cycle have already emerged:

  1. The slopnami has done plenty to exacerbate existing burnout in current maintainers - slop bug reports, scrapers and AI bros DDoSing services, AI bros in general and the myriad other negative externalities of this bubble have been utterly draining to deal with.

  2. As (indirectly) mentioned before, the slopnami has given a variety of serious bugs and security issues - rsync's broken backups, the rise of slopsquatting and prompt injection attacks, Linux's recent race condition mishap, the list goes on.

2

The only move for FOSS projects to survive is to reject AI users and their contributions out of hand. Zig and Godot wrote good articles about this.

6

I’d be willing to bet good money on the ecosystem’s collapse at this point

What does Doctrow care? as far as he is concerned it's done it's job. It was never about the people or their labor for him.

2
awful.systems

The last slatestar was about AI successionism. As in, No no no, we're definitely not like those freaks who think humanity should just cede primacy to the first AI that shows us a bit of leg. Anyway here's how we should actually surrender to chatbots, cue rant about Kemal AI, how we could change the constitution so Claude can run for president, or have an AI legislator body were interested groups train their own AIs according to political preference and let them work it out between themselves, because politics and legislation are famously incredibly clear cut, no gray areas, no necessary compromises, no interpretability, no irrational actors, no incompatible agendas, everyone is pleased, make no mistakes.

He almost gives away the game when he says christians don't feel like slaves when they say 'thy will be done' so letting Claude run society would feel fine.

6
geriksonreply
awful.systems

Article next to it is an anonymous review of Jünger's In Stahlgewitter, which is certainly A Choice.

(Jünger wasn't a card carrying Nazi, but served in the Wehrmacht in WW2 and is kind of a right-wing ideal of an aesthete)

8

Native English speakers might recognise it as Storm of Steel; for the unfamiliar it’s Jünger’s memoir of WWI and arguably a celebration of war.

Jünger’s an interesting character. He had different politics to the Nazis but it would be fair to call him a fascist in the period from 1918-45. After the war he revised some of his works to step away from some of his previous views, and had a big falling out with his private secretary Armin Mohler (an unrepentant fascist) over it. By the 1980s he was publicly denouncing the “ideology of war” contained in Storm of Steel.

If anyone is interested, I highly recommend the series on Mohler’s book The Conservative Revolution in Germany by the anti-fascist podcast The Empire Never Ended. First ep on YouTube. Jünger is discussed in the episode on the National Revolutionaries.

4
Soyweiserreply
awful.systems

how we could change the constitution so Claude can run for president

Did he forget Claude is owned by people? But yeah sure let corporations be president.

7
awful.systems

He specifies Claude 10, so it's after the ??? in the checklist, and spicy autocomplete will be widely accepted to qualify for sentience by then I guess.

6

Sentient but still owned by Anthropic.

This is just slavery with extra steps!

6

Once again, slop machines only work ‘well’ when you can externalise the pain and costs onto someone else (in this case, millions of stressed-out sysadmins and webmasters)

5
Soyweiserreply
awful.systems

Seems like there also was one company who released their patch early before the agreed time giving hackers time reverse engineer the bug before patches were widly available.

5
froztbytereply
awful.systems

yes, chainguard broke embargo, and within a few hours a reverse engineered PoC was kicking. I saw at least two implementations yesterday when assssing impending work

and I haven't slept yet (although now aaaalmost done...)

6

I saw a story they broke embargo so they could offer protection services to people. Which I really hope isnt true.

4
awful.systems

Thanks for this! Would you consider making a new post in TechTakes? It could be useful to have a more durable place to comment on this topic.

5
geriksonreply
awful.systems

I'll consider it. I'd like to sleep on it and see if events overtake it overnight, which can definitely happen

5

On second thought I won't post it myself, it's a bit too mean-spirited and facile. I haven't been party to the discussions on IRC so I am probably missing a bunch of nuance.

I do compare the mods to Robespierre and co which might be seen as less of a compliement. I do believe they're working under a lot of pressure and it's hard to make decisions that please everyone.

I am mostly not unhappy that it's not been a complete victory for the sloppers

3

Glyph recently convinced a project to stop doing updates altogether by accident, and has had some thoughts about it.

For the second time I think I have accidentally convinced a project to just … stop doing security updates on a critical dependency forever, because they'd assumed the LLM usage problem wasn't as bad as it is.

Both of these are offline things that are not at all security-sensitive, but I am starting to worry that in the "dark matter" of the broader developer community there is a meaningful plurality of people who are just going to stop updating e.g. the Linux kernel because of broken trust

(Recommend checking the full thread)

8
awful.systems

The WSJ apparently fucked up describing how Anthropic is losing money and now the discourse is very messed up with a lot of people claiming they are breaking even or even actually making money, basically the AI booster ecosystem is having a huge HA HA GOT EM! The fiinancials were always better than the lying press made it seem! moment.

In a new draft prospectus viewed by the Journal, the AI giant disclosed an $80.7 billion net loss for the first half of 2026 and a long list of risk factors

According to my degree in finance from Very Online University the 80 bil net loss of the article's summary ends up consisting of 72B of convertible notes, which I guess is a type of debt that goes away if the IPO goes well because it converts to equity. Also because it is predicated on equity its nominal value goes up as the projected valuation of the company goes up, so the 72B figure doesn't even mean that much. Supposedly for Anthro to be on the hook for even a portion of that they would have to IPO at a lower price than expected when this type of debt was originally issued, which probably isn't happening.

13

I'm no finances guy so take this with a grain of salt, but since boosters are apparently acting like the convertibles will automatically work out, wouldn't Anthropic still be losing more than they earn even if all those convertible notes work out due to compute/training costs? Since they got a discount from Elon earlier. Plus the BetterOffline post pointed out how they can’t even break even on an operating basis

5

Excellent usage of the chart comic

(Edited in a link to Haus of Declines 'Bloodless Quant' comic (not sure if that is the real title, I couldn't find the comic on her bsky, small warning she is not a safe for work creator (if your workplace is very squeamish)).

6
lurkerreply
awful.systems

r/BetterOffline post about the article

Brief comment snippet:

A convertible note is a loan from an investor, but instead of paying them back with cash you give them stock options. It's still a loss, you're taking cash from an investor because you can't break even with revenue.

6

Imagine if you do that as a baker. 'Hey flour/sugar/yeast supplier, I can't pay your for your products, but I will pay you in stocks to our bakery, I'm planning to sell our bakery soon, and as we don't have to pay you for the supplies, we can sell our product at below the going rate making sure we look good for the sale of the company'.

8

Nothing to point to, just me musing over something after digging up figures on masses involved in spaceflight and comparing them to the rest of human industry.

The total mass EVER launched into orbit from the 1950s to now would fit on about five big freight trains, or four minutes of current global container shipping, or half of a Panamax ship payload.

The total mass launched onto escape velocity is a third of a freight train and an actual majority of that is Apollo.

So little mass, commanding so much outsized attention and myth-making, and that people pin such hopes and eschatological significance onto...

15

We may all be data annotators soon enough | Gig Economy Project h/t naked capitalism

Outlier has four main clients, all American Big Tech: Meta, Alphabet, Xai and OpenAI. Scale AI is part-owned by Meta. Is this the future we want for European workers, sources for gig exploitation and data expropriation for American Big Tech and the US state?

When one considers that this dystopian scenario currently constitute the most realistic entry jobs for young, university-educated people in Europe, is it any wonder that the youth are currently rising up in multiple European countries, most of all France, demanding something - anything - else?

7

I want to point out that SMW Central doesn't ban people for being pro-GenAi, nor are they barred from anything just for being pro-GenAi. They simply can't upload content to the site that was created with GenAi. Despite this, GenAi users believe that, because SMW Central has rules against GenAi content, SMW Central must feel the need to "control or dictate" what they do.

This context transforms the statement substantially. When this group of individuals says "nobody owns ROM hacking," what they mean is that they should be allowed to publish their work wherever they want without consequence.

Kind of reminds me of the people who, around the time the (UK) smoking ban was introduced, made "It's my right to smoke anywhere I want" their whole personality.

12
BioManreply
awful.systems

The Russian Cosmists have so much to answer for.

My parents got super into the spinoff of For All Mankind that takes place in the Soviet Union, "Star City". The central conceit of that alternate history spate of shows is that Sergei Korolev didn't die and kept being as awesome as he was at running the Soviet space program. In the spinoff the writers actually knew a bit about what they were doing, and have him more or less directly quoting cosmists at other characters... I got to tell my parents that its people like him that are the reason their new laptop was expensive and that the oligarchs think they're going to live forever as feudal lords of the solar system and that our society as a whole has a tendency to falsely believe our destiny is endless expansion and perfection in space rather than Earth.

8
froztbytereply
awful.systems

I'd never really looked into the name before but I just now realized what the Korolev was likely named for

2

Deserves it. The Soviet and Russian space agencies have been coasting on his work for half a century. On the wall of the Russian segment of the ISS, they have three portraits: Korolev, Gagarin, and Tsiolkovsky.

3

Every Korolev needs a crew of Glushkos to figure out shit he was actually hired for

5

Heh. Read the actual full paper.

Kardashev didn't even think that colonizing whole galaxies was the likely end state! He thought that instead everything from billions of light years around would pile into individual huge artificial monolithic structures for efficiency!

4
Soyweiserreply
awful.systems

So is the steering wheel attached to the entire device so he steers by rotating the half circle or is the half cricle just to attach it to Bob and there is a deeper mechanism?

5

I think we might need to ask Tumblr user cybersmith about that and I don't think anyone wants to hear from Tumblr user cybersmith.

5
istewartreply
awful.systems

"Oh bother, I've fallen onto another one of these fart-propelled flight platforms and I can't get up"

7
BioManreply
awful.systems

The cult at the heart of the rot of the world is built on such unserious foundations

7
istewartreply
awful.systems

Consider for a moment where this fellow's breathing tube and/or proboscis looks to be routed.

The thesis is that the putative type III civilization is harvesting all energy output of its galaxy. I haven't often seen respiration of methane and/or miscellaneous volatile products of digestion on transhumanist bingo cards, but evidently it's indicated in the original material.

5

Now I'm imagining a biomechanical turbocharger that captures the energy of exhaust gas being expelled to increase pressure and efficiency of the air intake.

4
awful.systems

Is anyone familiar with the website I Can Eat Glass? It was apparently created in the 90s by a Harvard student, who was concerned that people learning foreign languages only learn common phrases (e.g. "Where's the loo?") which makes them stand out as tourists when they speak. If one were to say a truly uncommon phrase, it stands to reason one would be instantly respected as a native. So he set up a website to collect as many translations of the phrase "I can eat glass, it does not hurt me" as he could.

Surely you are riveted to your screens right now, desperate to learn what this very special brain genius has been up to since then. Ethan Mollick is a professor at a Pennsylvania business school and published "Co-Intelligence: Living and Working with AI" in 2024. Some say he is substacking about the exponential growth of AI capabilities to this day, but critically this book was apparently read by some german teaching influencer.

He in turn published a self-help book for parents of school kids this year, that got put on display in my local library. And of course it has a chapter on AI, so I had to lend it and hate-read a little. And of course he references Mollick and his Co-Intelligence screed, which he apparently absorbed as a base expectation what the future of AI will look like, and this is how I got to learn about one very special brain genius from Harvard.

8

Very sad to learn that the "I can eat glass it does not hurt me" guy is AI-brained

7
lurkerreply
awful.systems

To single out a specific review

For example, they describe trees as “self-replicating factories that spin air into wood” and conclude that “any intelligence capable of comprehending biochemistry at the deepest level is capable of building its own self-replicating factories to serve its own purposes.”

So an AI could self replicate…because a tree can?? not all trees even self-replicate so the metaphor isn’t even right

9
lurkerreply
awful.systems

Someone in the comments of this review also said that AI is on track to master…metabolism. somehow

It's true that there's more to success than intelligence. There's also sensors, actuators and metabolism. However, machines look set to master those too.

3

Someone in the comments of this review also said that AI is on track to master…metabolism. somehow

LLM-intermediated poster experiencing model collapse due to overtraining on "One Weird Trick To Shed Belly Fat" ads

4

It is amazing in a way, there are computer scientists who work at the highest level of their field, so they understand computers better than most, but they have more trouble than you or me installing linux.

Understanding something doesnt mean you can build it.

(I know this will be met with 'well then you dont understand it deep enough' and that just reminds me that there always will be place for god in the gaps of science).

4

I wish Wikipedia had more coverage of the Dyson Tree because I have so many questions despite not having studied physics or biology since I was a teenager (what about cosmic rays! there is so little light for it to feed off in the outer solar system! and trees don't do well in extreme cold)

4
awful.systems

On a more personal note and trying to keep exact circumstances vague and not name any names, but the IT corp I work at just had another wave of layoffs and our team got reduced from 5 to 4 people (and same for a neighbouring team that we are pretty close socially with, and more). Idk how they expect us to get anything done (I mean, I know, they want us to use more AI), especially with how much the mood has tanked. By any metric productivity this week is going to be close to 0% because everyone from affected teams has just mentally checked out.

So uhhhh anyone has any recommendations for what fields I could try to retrain to from IT? Preferably without going through uni again. I'm thinking locksmithing.

11

If you're interested in locksmithing I've got bad news. It got harder after WFH, waaaay more people home in rich neighbourhoods

6
lurkerreply
awful.systems

I definitely reeks of conspiracy theory, per this description Edit 2: and the way it talks about the decline in birth rates is also setting off red flags

Two ‘its not x, its y’ statements in close proximity also raise my ‘ai generated’ suspicions

2
BioManreply
awful.systems

It gets worse

Edit basically if you took 90s black helicopter conspiracists, and early 2000s infowars, plopped them down in the current day with Google and a Claude subscription

Edit 2 Its like a year old, and when the PDF first started floating around the internet it was being sold on sketchy websites for $30 and was the subject of one of those youtube-comment-botting rings that will have lots of chains of comments hyping how a book is relevant to a topic and is the best thing ever.

5
lurkerreply
awful.systems

I first learned of it through a comment under a Yudkowsky interview, comparing his messages to the book’s, which is not exactly confidence inspiring

4

It's actually about perpendicular to him. Only similarity is that it posits that AI systems are dangerous. Take all the New World Order conspiracy theories and infowars the elite wants to kill you off and take your stuff and become transhuman, with sooper seekrit nefarious depopulation plans and you will eat the bugs and stay in your minute city pod, and replace the ruling elites with AIs.

5
awful.systems

Quick Q, from where does the weird term "abliteration" come from? I've seen it used for "jailbroken" GenAI models.

7

Sounds like a marketing tagline for a failed "As Seen on TV" sort of gadget, tbh

5
zogwargreply
awful.systems

With a bit of google searching by date it seems like this guy (https://huggingface.co/failspy/Meta-Llama-3-70B-Instruct-abliterated-v3.5) claims ownership of the coining, which I find plausible, based on the list of released weights and their timing.

As far as "abliteration": it's just a fun play-on-words using the original "ablation" term used in the original paper to refer to removing features, which I made up particularly to differentiate the model from "uncensored" fine-tunes. Ablate + obliterated = Abliterated.

The paper being referred to being: Refusal in Language Models Is Mediated by a Single Direction which seems to have somehow started out on the "AI alignement forum" of LessWrong https://www.alignmentforum.org/posts/jGuXSZgv6qfdhMCuJ/refusal-in-llms-is-mediated-by-a-single-direction first posted 27th of April 2024. In general it's a method of weight alteration so only really applicable to some opensource (or i guess leaked) models.

First model with abliterated in the name by "failspy" on 8th of May 2024.

8

wiktionary claims it is a blend of "ablate" and "obliterate", it does not list an origin (at this point in time)

edit: looking a little more into this, knowing the etymology requires reading about AI discussions which I am not prepared for at this point in time but it is out there in the internet

5
awful.systems

OT: popping in for a second since I’m not drowning in homework for once (midterms start friday) to say carpal tunnel stripping is really good.

(so far I’m averaging in the high 80s last I checked).

7

Good luck with the midterms! I'm supposed to be studying for some myself...

2

going thru it myself, can report that non-graded "suggested exercises," with exams being the only graded material, is not any better

5
awful.systems

Decent monday morning take from robert evans:

Schrodinger's double-think.

::: spoiler transcription Quote skeet:

This is a researcher at Anthropic. Some of these people have lost their minds! What is mainlining Claude all day doing to them?

there are basically two possible futures at this point. either we're all going to die of[sic] the future is going to be Good beyond our wildest imagination. the trick is to hold this duality in your head and not be driven insane by one side.

Robert Evans (the only Robert Evans):

some of these people get so locked into a labyrinth of Rationalist thought experiments that they are no longer really capable of interacting with reality 1/2

you can in fact limit the horizons of possibility in your own mind so severely that you are no longer able to "think" in a useful way 2/2

:::

14
lurkerreply
awful.systems

They’re also incredibly horny about creating conscious digital slaves for some godforsaken reason

5
schnoopyreply
awful.systems

Well, we are all going to die. So... musing over?

We all get that right, everyone is going to die. Everything living you lay eyes on is going to die. I am 100% certain that the future contains the death of everyone alive today.

Do they mean immanently? Why?

6
schnoopyreply
awful.systems

I don't have to be thrilled about death to have a basic understanding of how basic our understanding of consciousness, biology, and neurology are. Nor to know how much the physical world resists making tiny machines and measurements necessary to explore these frontiers, or the ethical dilemmas involved in exploring how consciousness works that vastly slow and perhaps outright prevent answering questions like "can we replace little bits of someone with some machine we can maintain easier in the interest of prolonging them?"

Also I do happen to know how the universe ends.

7

I have been forced to on multiple occasions explain to people that there is a difference between thinking that there's anything at all intrinsically good about the fact that things like us that have come about the way we did come with expiration dates, and dealing with it.

4
scruiserreply
awful.systems

I don’t have to be thrilled about death to have a basic understanding of how basic our understanding of consciousness, biology, and neurology are.

I think its the mid-wit meme, lesswrongers know just enough to imagine some grand solution like brain uploading or nanobots might cure death and not enough to appreciate all the reasons each of those solutions won't work.

12
schnoopyreply
awful.systems

One of the funniest things I ever read was a result of a survey of laypeople, physics UGs, physics Grads, postgrads, and faculty on various "cool future" things.

predictions of the likelihood of things geeks constantly dream about craters once you get past the very basics. I can only assume that fields that aren't mine, and are in general vastly more complex, are at least as full of evidence of god hating us and not allowing us nice things.

I remember reading some of yuddies writing about nanomagic and noticing that the word "sticktion" never showed up.

10
scruiserreply
awful.systems

Judging by the way LLMs and generative AI has been used, even when we do get something vaguely like a realistic version of sci-fi fantasies, capitalism and people who can't distinguish the limits of the real thing from the fantasy will manage to misuse it.

6

who in the hell would want programmable matter anymore, after they've seen what happened to plain ol' computer programming as already practiced

10

What's that XKCD that goes over the ways that capitalists would be ruthlessly exploiting all those "secrets they don't want you to know" for incredible profits?

5

This doesnt apply to everything, like VR and 3d printers were a sci-fi fantasy and now they are mundane economically viable but not revolutionary products.

Biohacking and nanomachines otoh dont seem to be viable and you hear nothing about those anymore. Only a little bit in the uncreative (and going on the experts unrealistic) 'ai will create bioweapons' critihype. No 'It will turn people into cyberzombies' (quake 2 was pretty good (that was aliens not AI but still)).

4

Piles of screaming grey goo and people being like "Why are you running away? can't you see it's my grandmother?"

4
geriksonreply
awful.systems

They're referencing the meme that an uncontrolled AI will inevitably kill every last human being, for reasons.

4
lurkerreply
awful.systems

Ah yes ‘only these two things are possible, dont consider any other outcome’ truly rational thought

5

It's just the fundamentalist version of our culture's pathologies as a whole, which has a very hard time imagining anything other than endless progression or apocalypse, neither of which is real.

3
lurkerreply
awful.systems

Also, ‘it’ll be Good beyond our wildest imagination’ is just the vaguest thing ever. ‘yeah bro AI is gonna make everything super good. How? Why? uhhh i dont know it just will’

6
istewartreply
awful.systems

‘it’ll be Good beyond our wildest imagination’

pumpkin spice season will be permanent

8

We could unironically live in this world if only the powers that be would allow it. I've personally radicalized at least 3 basic bitches with this fact.

8

(To the tune of the teenage mutant ninja turtles theme*): self-inflicted psychic debuff

*The correct theme, not the heretical one. If you have to ask, you’re wrong

6

These people have the worst victim complexes. I'm tired of hearing them complain as if anyone with any real power isn't fully on board with what they want.

3

Per the recent moderation log, identifying whether posts had substantial LLM involvement seems to no longer be allowed. I am exceedingly disappointed in this. I have been lurking for over a decade and was considering asking for an invite within the past year or two as hackernews and every other source of programming news and project updates have become completely unbearable, but now if lobsters is committed to "neutral" slop platforming I don't see the point.

I just don't see this as sustainable, the moderation level required to keep a link aggregator free of low effort slopped nonsense when the rules are this fuzzy is impractical and all incentives are against it.

4
awful.systems

I really dislike how he believes that LLMs and fascism are "separate axes". Where does he think the LLMs come from? Does the stork deliver them? Is ChatGPT powered by magic fairy dust? Does he think that Sam Altman is a great defender of liberalism and democracy who definitely hasn't donated tons of money to Donald Trump?

12
istewartreply
awful.systems

I can't help but think it's another instance of the unquestioning Californian Ideology assumption that all new technology is inherently liberatory.

8

It's not working, I spotted a probable hackernews all the way out in Modesto last week, they're like the goddamn nutria now

6
Soyweiserreply
awful.systems

It's unfortunately common that authors see their work posted, join the site, but then only use us for traffic. Hopefully this time helps them understand the difference between a symbiotic and parasitic relationship.

This feels like a very weird thing to say. (I'm reminded of some weird things Elon Musks mom said about how twitter users should be more grateful for all the traffic or something).

I mean the bit above it makes sense (making a hard only '25% of post can be self promotion' seems like a recipe for disaster however) but this added line made me raise a few eyebrows.

E: Wait, I should have compared it to facebooks new 'you need to pay if you post links' policy.

4
geriksonreply
awful.systems

This is a weird side-effect of Lobste.rs culture, it really dislikes being just a collection of links on the front page that increase traffic. And there have been multiple attempts to place links there via deception. Plus the community will give you hell (and flag your submissions as spam) unless you do the needful and comment a bit.

That said it's really easy to work around by just making good content, having an RSS feed, and letting the community discover your stuff and post it. Or ask a buddy with an account to do it for you. But that in its turn requires actually learning how the community works.

4

Thanks for explaining, im not a lobsterite so I dont know how the community there works.

3

I am saying that the anti-fascist communities ended up […] uninterested in using LLMs

:O

10
istewartreply
awful.systems

Lobste.rs is analogous to methadone treatment for Hacker News, prove me wrong

9

I considered trying to get an account there, but the last ~18 months or so have made me feel the same way about Lobste.rs as I do about Bluesky. If you're just running a lower-traffic version of the thing you're trying to "improve" upon with slightly different moderation policies, you're not going to build a lasting platform or community.

9
geriksonreply
awful.systems

came here to post that. Genuinely having to reconsider being an active user there now

8
awful.systems

I see you were one of the people whose comment got censored. I presume the censored comments were about the parody of the "pelican on a bike" animation on the OpenBSD 8.0 release page.

So now people can't even discuss criticism of LLMs on lobsters? Insane.

2

Oh, so that's what it's referencing. I can't really tell if the release artwork and song are poking fun at AI slop itself or people who criticize Fish Linucks for accepting slopped code contributions in the base system while NetBSD is lauded for not doing so.

3

Very disappointing, even if I was only ever a non-registered lurker. Gave in and DNS-blocked it and HN this morning (I had a HN-filtering userscript which in hindsight was just cope).

2
awful.systems

So I just stumbled into Team Human, because a Youtuber I kind of like (Kraut) published a video for them. They seem to run a campaign targeted at creators, pushing to get videos released on the 10th or 17th. So they must be having a bit of a high point right now. (Idk if cash changed hands.)

Their manifesto tries to amp up societal harms, but the existential risk is snuck in at the end (AI programmed pandemics, etc.) and they want to regulate AI chips like nukes. CAIS (Center for AI Safety) is listed as the sponsor. Seems a little "AI centrist" to me, as in aligned with the less insane billionaires, but still a typical AI safety astroturfing shop. Shame if any of your favorite creators fell for it.

9

They got one of my favourites, Medhi Sadaghdar (ElectroBoom), and yes in a video released on the 10th.

CAIS seem like an "AI safety" laundromat, in the sense they try to put a reasonable face on the paperclip maximiser stuff. They were the ones who organised the "AI safety statement" in 2023, which features lots of signatories who I'm sure just thought "oh yes I don't want anything bad to happen because of AI", not "If we don't give Yudkowsky the reins we're doomed to become office supplies".

8

Iirc he has been trying a 'im no longer a frothing weird rightwinger' for a while now, but so far nobody really fell for it.

2
nfultzreply
awful.systems

Not to be confused with Team Human the Douglas Rushkoff podcast.

4

My first association was Alex Jones screaming "I'M TEAM HUMAN" while ranting about environmentalists. So the brand is getting a little crowded it seems.

5

People who are entertaining in front of a camera are just regular people. If anything I'd expect the fame to make them on average worse than a random sample

2
awful.systems

Might as well start this off

so we all remember this graph from AI 2027 right? the graph that the whole paper relies on?

well its wrong. not just normal wrong, it’s ‘the authors literally disowned it’ wrong

(ignore the claude mythos purple x i took this from a reddit screenshot) but they completely changed their predictions in december 2025, several months after the original paper was published

9
scruiserreply
awful.systems

Is this the thing where the baked an asymptote to infinity into their "model"? It was both bad modeling and also made all of their other input "data" completely irrelevant. I remember someone pointing this out at the time AI 2027 dropped, but there was so many other problems with it in the sneer spaces we didn't talk about it too much among all the other problems. And someone on lesswrong actually pointed it out, but somehow, "we accidentally baked an asymptote into our model that is supposed to be detailed and carefully thought out" wasn't a breaking point for lesswrongers.

7
rhamphreply
awful.systems

Not literally an asymptote, but once you presuppose something as farcical as nested exponentials, your model is doomed to blow up immediately after the last data point.

5
scruiserreply
awful.systems

Actually it was literally an asymptote in the first version of their models they posted to github. They had a term that they were dividing by that ends up going to zero, so the entire equation breaks! https://www.lesswrong.com/posts/PAYfmG2aRbdb74mEp/a-deep-critique-of-ai-2027-s-bad-timeline-models

So, now we can answer the question from before: what time horizon does the red curve above predict for 2030?

Well, if you plug it into wolfram alpha, you get a time horizon of “-2542 - 11372i”

Yes, that is negative, and that is an imaginary number in there.

What’s actually happening is that when the term in the brackets above hit zero, we end up dividing by zero, and hit infinity. Beyond that, we get a negative number to the power of a non-integer, which gives nonsensical complex numbered answers.

The infinity point for this equation happens at a time of t = To/alpha, and will always occur at some point, no matter what initial parameters you use.

In fact, this infinity point is completely independent of both the time horizon and the SC threshold. If you keep the same alpha and doubling time, you could start with a time horizon of a nanosecond, and have a superhuman coding threshold of 1 trillion years, and the curve will still claim that superhuman coding will arrive before the end of 2029.

And indeed, reddit user mambo-12345 tried modifying the simulation parameters to drop the initial time horizon to 15 nanoseconds instead of 15 minutes, and the resulting curve still had a peak for the estimated superhuman coder arrival at 2026.5 years and a median at 2035. Credit to them for inspiring me to take a closer look here:

5
rhamphreply
awful.systems

Have I misunderstood what they meant by ‘superexponential’? I thought they were doing exp(exp(t)) but I am inferring that it’s somehow even sillier than that?

2

It was something stupider and sillier yeah. The link explains, but to tldr; exp(some complicated term) where the "some complicated term" has a division by a number that eventually goes to 0. I think it was... them trying to represent "horizon time" (as in that one stupid METR graph that gets repeated everywhere) increases happening faster and faster?

2
rhamphreply
awful.systems

That ‘superexponential’ thing annoys me so much. Just the most blatant ‘the line goes up because I really really want it to’, while all their rationalisations for it are just describing exponential behaviour.

We talk about the importance of humanities but it’d be nice if they learnt a bit of maths too.

12
Soyweiserreply
awful.systems

Not sure if the book also did super exp lines, but the graphs in the singularity is near also have various issues that never got to much deep thought.

Always found it funny that the book admits basically (no direct quote): "sure tech follows an S-curve normally, and that looks exponential at first, but if you take the rate of all historic new techs together on a timeline that clearly is exponential".

And I just thought, you cant know if it is, thats the point with the S-curve as well, and it messes people up. (Like Disco Stew from the Simpsons), and your N=1, it might not even be a S-curve, it could just have a sudden ceiling.

Despite wanting to believe, I was less convinced. (also, not sure if it was just my copy but Yudkowsky's name was spelled wrong, still looking for somebody who has a physical copy who is willing to check for me if that was also in print or just a pdf error)

Back to the subject, a course in business management would have also helped here.

7
awful.systems

"Sigmoids always add to an exponential curve!" is another standard futurist trope from the 1960s and 1970s. Sci fi authors used to share this diagram with a curve fitted to pony express to trains to automobiles to aircraft to chemical rockets. "Nuclear rocket" and "interstellar spacecraft" were helpfully sketched in as the obvious next steps. Needless to say, we did not develop drives which can reach 10^-3 C around the year 2000 and will not reach 10^-2 C (just 430 years to Alpha Centauri) by 2050.

11
istewartreply
awful.systems

woah damn why does this look exactly like some Kurzweil bullshit

9
awful.systems

I have not read any Kurzweil for 20 years but I think if you read him most of it will be recycled '50s-'70s tropes. Even nanotech appeared in a Feynmann talk, and Moore's Law is from 1965. Remember, cranks keep presenting ideas which were refuted long ago as new.

9
BioManreply
awful.systems

You ever read "The Prospect of Immortality" by the guy who founded the idea of cryonics? Or the "anabolocyte" paper? They're such trips!

2