Spyke

Replies

Comment on

The AI bill Newsom didn’t veto — AI devs must list models’ training data

Despite what the tech companies say, there are absolutely techniques for identifying the sources of their data, and there are absolutely techniques for good faith data removal upon request. I know this, because I've worked on such projects before on some of the less major tech companies that make some effort to abide by European laws.

The trick is, it costs money, and the economics shift such that one must eventually begin to do things like audit and curate. The shape and size of your business, plus how you address your markets, gains nuance that doesn't work when your entire business model is smooth, mindless amotirizing of other people's data.

But I don't envy these tech companies, or the increasing absurd stories they must tell to hide the truth. A handsome sword hangs above their heads.

Comment on

No, OpenAI Strawberry isn’t imminent — but it sure trolled the AI doomers

Yeah, this lines up with what I have heard, too. There is always talk of new models, but even the stuff in the pipeline not yet released isn't that differentiable from the existing stuff.

The best explanation of strawberry is that it isn't any particular thing, it's rather a marketing and project framing, both internal and external, that amounts to... cost optimizations, and hype driving. Shift the goal posts, tell two stories: one is if we just get affordable enough, genAI in a loop really can do everything (probably much more modest, when genAI gets cheap enough by several means, it'll have several more modest and generally useful use cases, also won't have to be so legally grey). The other is that we're already there and one day you'll wake up and your brain won't be good enough to matter anymore, or something.

Again, this is apparently the future of software releases. :/

Comment on

Ilya Sutskever's new AI super-intelligence startup raises a billion dollars. Unclear what they actually do.

Reply in thread

I don't get it. If scaling is all you need, what does a "cracked team" of 5 mean in the end? Nothing?

What's, the different between super intelligence being scaling, and super intelligence, being whatever happens? Can someone explain to me the difference between what is and what SUPER is? When someone gives me the definition of super intelligence as "the power to make anything happen," I always beg, again, "and how is that different precisely from not, that?"

The whole project is tautological.

Comment on

Some Quick and Dirty Thoughts on "The empty brain"

RE: the ip perspective on brains,

From my perspective, science is catching up on this - in pockets. It goes under a lot of different names, and to be honest it's be around in many forms for a long time. I highly, highly recommend catching up on Dr. Michael Levin and related work on this. There is still levels of speculation here, but there's hard science and empirical observation that broadly, the neuro story on memory synapses doesn't work. The alternative, that nearly every part of the body is both capable of independent problem solving and memory, puts actionable medical alternatives on the table.

The long story is that memory appears entirely to be opportunistic. Memory can and is stored in virtually everything that a body gets access to, internally AND externally. The brain's main function is to re-imagine and reinterpret memory, not to be dictated by it. A memory isn't a fact in a broad sense, it's a dynamic that acts on the body. This is different in many ways from the hard division we try to make in modern computer design (although I'd argue that even the difference between memory and instruction in von neuman design continues to fall apart over time).

That said, and i realize this is semantic linguistic issue, but I do believe brains are computers, but only in the broadest sense of what computation could be, not in the highly specific sense of them being digital von neuman devices. What's often missed in discussion about a computational world view is being clear to the reader that there is no privileged sort of computation. There's nothing at all special or privileged about what our digital von neuman machines are, other than in a sense them being metabolisms that are functionally different than us.

When I express that brains are computers, I like to add things like, "in the sense that dance is computation, or politics is economics, or matter is experience, or money is culture." Which is to say they can be different and yet the same, depending on entirely the perspective of what you mean by something "being" anything at all. (It's similar to why ontologies are both useful but always wrong).

The bitter truth though is that I don't think there is anything privileged about the human brain either -- but that doesn't come in the sense of there being no difference. I think quite the opposite, seeing many of /the other things/ as being capable, but being in its own sorts of attendance and meaning, provides much more rich questions of "why are we different, then?" Certainly more than presuming that it is capability of any particular thing that separates us from the other things.

Ultimately, I love artists because I want an ecosystem of art and artists and art admirers, and because I think respect should transcend form, not seek reductively the most commoditized realization of it.

In many ways... isn't this what indigenous cultures already more or less believed?

Comment on

Bostrom's advice for the ethical treatment of LLMs: remind them to be happy

This kind of thing is a fluff piece, meant to be suggestive but ultimately saying nothing at all. There are many reasons to hate Bostrom, just read his words, but this is two philosophers who apparently need attention because they have nothing useful to say. All of Bostrom's points here could be summed up as "don't piss on things, generally speaking."

As for consciousness. Honestly, my brain turns off instantly when someone tries to make any point about consciousness. Seriously though, does anyone actually use the category of "conscious / unconscious" to make any decision?

I don't disrespect the dead (not conscious). I don't bother animals or insects when I have no business with them (conscious maybe not conscious?). I don't treat my furniture or clothes like shit, and am generally pleased they exist. (not conscious). When encountering something new or unusual, I just ask myself, "is it going to bite me?" first. (consciousness is irrelevant) I know some of my actions do harm either directly or indirectly to other things, such as eating, or consuming, or making mistakes, or being. But I don't assume myself a hero or arbiter of moral integrity, I merely acknowledge and do what I can. Again, consciousness kind of irrelevant.

Does anyone run consciousness litmus tests on their friends or associates first before interacting, ever? If so, does it sting?

Comment on

Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 04 August 2024

Reply in thread

It's the same story as has ever been. "Smart People"'s position on anything is often informed by their current economic relationship wrt to the things they care about. And maybe even Yud isn't super happy about his profession being co-opted. What scraps will he have if his own delusions became true about GPT zombies replacing "authentic voices"?

No one is immune to seeing a better take when it's their shit on the line, and no is immune from being in a bubble without stake.

Comment on

The FCC wants to stop cloned phone voices

Reply in thread

It can't stop the usage, it can raise the cost of doing so, by bringing in legal risk of operations operating in a public way. It can create precedence that can be built upon by other parts.

Politics and law move slower than and behind the things it attempts to regulate by design. Which is good, the atlernative is a surveilance state! But it definitely can arrange itself to punish or raise the risk profile of doing something in a certain patterned way.

Comment on

Encultured: an AI doomer’s video game startup pivots to medicine. It’ll be fine.

Why so general? The multi-agent dynamical systems theory needed to heal internal conflicts such as auto-immune disorders may not be so different from those needed to heal external conflicts as well, including breakdowns in social and political systems.

This isn't, an answer to the question why so general? This is aspirational philosophical goo. "multi-agent dynamical systems theory" => you mean any theory that takes composite view of a larger system? Like Chemistry? Biology?Physics? Sociology? Economics? "Why so general" may as well be "why so uncommitted?"

I feel bayesian rationalism has basically missed the point of inference and immediately fallen into the regression to the mean trap of "the general answer to any question shouldn't say anything in particular at all."

Comment on

Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 1 September 2024

Reply in thread

Oh man, anyone who runs on such existential maximalism has such infinite power to state things as if their conclusion has only one possible meaning.

How about invoking Monkey Paw -- what if every statement is true but just not in the way they think.

  1. A perfect memory which is infinitely copyable and scaleable is possible. And it's called, all the things in nature in sum.
  2. In fact, we're already there today, because it is, quite literally the sum of nature. The question for tomorrow is, "so like, what else is possible?"
  3. And it might not even have to try or do anything at all, especially if we don't bother to save ourselves from ecological disaster.
  4. What we don't know can literally be anything. That's why it's important not to project fantasy, but to conserve of the fragile beauty of what you have, regardless of whether things will "one day fall apart". Death and Taxes mate.

And yud can both one day technically right and whose interpretations today are dumb and worthy of mockery.