IBM claims a major breakthrough in computer architecture, by integrating memory and processing on one chip. Says it makes AI 25 times faster.
https://www.nature.com/articles/d41586-023-03267-0?Open linkView original on futurology.todayhttps://www.nature.com/articles/d41586-023-03267-0?Open linkView original on futurology.today
So...cache?
multibillion dollar company discovers the memory hierarchy
could the next big leap be integrating instructions and data in the same memory store?
The article does not say if they'd innovated enough to produce capacitor-based DRAM with the CPU on the same die. I guess it would come in 1GB variant if they managed that.
256 compute cores, each with its own memory
I haven't really kept up with it but doesn't the zen architecture have separate L1 and L2 for each core?
Even if it does it isn't the same thing. The article explains everything
Isn't this a Soc?
Shhhh, we need to pretend like it's something new for our investors!
Now we will be able to get completely false, made up answers even faster!
While this will speed up loads of things, it also feels like this will end up being another way to remove upgradability from devices. Want more ram in your desktop buy a new cpu.
I mean the physical distance between the RAM and CPU will eventually be the limiting factor right? It's inevitable for more reasons than profit
Yeah, that's absolutely true, doesn't mean I have to like it. 😭😭
The article says the whole CPU has like 200MB of memory, so it's not really replacing the RAM already in PCs. Plus this seems focused on AI applications, not general computing.
hits blunt That's just your opinion, man.
And that's fair, at the same time it's still quite new, once it's matured a bit I could definitely see this being how things go until...idk, hardlight computing or w.e
Well, in the meantime, if you want to be angry at lack of upgrade options, we can be angry together at cellphones TODAY. Heck, some laptops too.
So... they'll probably add some slower, larger-capacity memory chips on the side, and then they'll need to copy data back and forth between the slow off-chip memory and the fast on-chip memory... I'm pretty sure they've just invented cache
Unless your macbook CPU has a 200 mb cache, then no
M2 Ultra performance cores have a 64 mb L2 and a 96 mb L3
Your mac has 256 compute cores, each core with access to its own memory?
Right, like I'm going to believe Baylor Swift.
.../s