Spyke

Replies

Comment on

Anthropic logged net loss of over $80 billion in first half of 2026

Reply in thread

I'm just going to throw in my 2 cents on the AGI issue since I have a better understanding than average. I'm currently a computational neuroscience PhD student. I don't work in theoretical neuroscience currently but that's my hope after I finish my doctorate.

I don't believe current transformer architectures are capable of AGI and all big AI companies just seem to be adding more parameters to established transformer architectures.

::: spoiler Tap for spoiler From what I understand transformer architectures act similarly to primary sensory cortices, they model complex probability densities. These companies appear to be banking on the idea that adding more training data, having smaller networks working together with different expertise, and having the train of thought (phonological loop) modeled as part of the PDF is enough to reach AGI. I disagree.

While all of those things are interesting solutions to parts of the problem I don't think they address some of the bigger issues.

  1. in biological intelligence memory recall is built into the same system as information processing. Associations between things are learned by simultaneously recalling and processing
  2. decision making and higher order processing do not fit into a transformer architecture
  3. temporal encodings are only made, in the transformer system, via the attention mechanism which is much less efficient than a more biological mechanism. :::

Comment on

Anthropic logged net loss of over $80 billion in first half of 2026

Reply in thread

There are positives and negatives to using cells for computing. There are very complex systems that are responsible for making sure cells grow in the correct architecture and are supported property via blood vessels and glial cells. There is also definitely something to be said about glial cells themselves having a role in computation (whole other topic I won't get into) not just neurons.

If were just looking at the input output relationship with neurons we can model it pretty well using neuromorphic hardware which is designed to respond like a neuron. There are still gaps but and there are scientists who believe it isn't close enough.

Our current hardware can model neurons closely as well but its less efficient at it. The current AI models use point neurons which takes a lot less computing power but I don't think they're the way to AGI. Personally I'm a fan of the adaptive exponential leaky integrate and fire model or the spike response model

Comment on

Anthropic logged net loss of over $80 billion in first half of 2026

Reply in thread

Good question! Unfortunately, I haven't found a good source myself. I've been trying to piece it together based on my theoretical/mathematical neuroscience background and self-study about transformer architectures. The problem is the point neurons in transformers don't map to neurons in cortex. You have to instead look at the bigger functions that are being computed by each system.

The best single source to learn more about theoretical neuroscience is Neuronal Dynamics: From Single Neurons to Networks and Models of cognition. But its super math heavy. If you want to easier to digest videos I recommend Artem Kirsanov on youtube. For transformer architecture 3 Blue 1 Brown has a great series of videos about it on YouTube as well.

Comment on

Goteem

Reply in thread

It would be a lot easier to combat other country's propaganda if citizens were able to travel to or at least communicate with other countries. Why won't the government allow them to do that? There isn't any non-tyrannical reason to censor all media in and out of the country.

Comment on

Goteem

Reply in thread

OK, just in case you don't understand their argument I'm just going to state it plainly.

They're saying that because of different social factors in extremely conservative countries women do not feel comfortable reporting rapes because of societal backlash. They are comparing this situation to your self-reported data on the perceptions of democracy in different countries.

Basically, they're implying you can't trust the data you showed because there's outside factors affecting the truthfulness of the self-reported perceptions.

Comment on

That's what you just said!

Reply in thread

I'm obviously not trying to say women are incapable of violence but its a very different thing for violence to be encouraged or acceptable by peers than for individuals to act violently. For instance old social norms from the 50s in American made it acceptable to beat your wife.

Is it a newer thing? Is it more common in some countries than others? I'm in my 30s and I can't recall this being a social norm when I grew up. I remember men being aggressive with other men sort of being accepted as inevitable but still frowned upon.

Comment on

*Permanently Deleted*

Reply in thread

I struggle with this too. I'm reading White Fragility by Robin DiAngelo right now though and it's main suggestion is to just oppose racism when you see it. Call white people out on their behavior even if it makes everyone uncomfortable and makes you unpopular.

Also, to listen to feedback from people of color without getting defensive. No one is going to be perfect and we live in a system which is constantly socializing us, it's ok if we fuck up but just try and fix it when you learn better.