So, what are the new datacenters even for?
As I was using LLMs at work (I never use LLMs for personal projects), a question occurred to me:
What in the fuck are these new data centers supposed to actually do?
The enterprise users are all in on having LLMs write 300% of the code. And yet, both OpenAI and Anthropic are still giving these "$200 gets you $10 000 in API costs" subscriptions to every victim of AI psychosis.
Why do we have RAM, hard disk, SSD, GPU and CPU shortages and no "token shortage"?
I mean, we all know the answer, these are the offerings for the robot god, but like how in the fuck are they still obtaining loans for this shit?
39 replies
My personal conspiracy theory is the AI companies are being used as a front for a new Manhattan Project for the surveillance dragnet. All those flock camera feeds gotta go somewhere. Imagine being able to look up who, what, where, and when (and infer why) for any person or place in the US, linking online interaction to physical places in near-real time.
Here's who it's being built for.
ETA: What I see happening over the next decade, the AI bubble 'pops,' government quietly absorbs the (by then) mostly complete facilities and hardware as part of the bailout, then news outlets go silent about data centers and ICE activity while we fall deeper into a fascist hellpit.
Imagine Hitler's reign, but this time there will be no Anne Frank's.
I think you're right. There is this constant need for governments and the elite in general to keep tabs on the population. They need to detect dissidents that arranges protests, generate push back, are whistleblowers and just people who are somehow a threat to their power structures. Our online activities through phones and computers are presumably already surveilled and is used to profile us. Your LG tv is listening to everything you say by the way and I'm sure they are not alone. That combined with camera footage of physical activity/presence just fortifies their hold on the population further.
specially any progressive movement needs to outmunevered and quashed before it gets too large. both the DINOs and gop do not want a united front of voters against them.
The dinosaurs are back and are out to get us? fuck, I thought things were bad enough
tante thinks come the bubble pop, surveillance bureaucracy will buy the now cheap rigs, cos they have a use for that much ML compute
I think it is a combination of VCs really believing this is the next big gold rush and radical innovation which will change the world plus a few true believers who think we need all the ... compute (I dislike the word) to run the acausalrobotgod who will fix all our problems (and 'We' need to prepare so China doesnt build it first).
To go back to the first group, when they say 'dont get left behind' they are bot addressing you or me, but other capitalists (as in people with money, not just people who believe the ideology is best)
Edit: wow this question attracted a lot of conspiracy theorists.
I'm purging the worst of the conspiracy theorists (which I'm sure they'll love)
I considered posting a reminder that we do analysis here, not weirdo daydreaming, but fuck it anyone who doesn't know where the line is deserves a ban
i had to take a lyft when my car broke down the other day and the driver told me that she thought the data centers were for powering the billionaires' bunkers when the world ends. i thought about this a lot and at the end of the day i decided this is "directionally correct"
Im amazed how many people think the surveillance state would need AI as an excuse to build data centers.
(And not that this is the was AI is going as govs tend to have infinite money and very bad quality control (at least nowadays). Seems like people have their timelines wrong).
But I'm also getting annoyed in general (not here) with how many people are going 'everyone who disagrees with me is actually a bot/everything I wish wasnt true is AI now'.
Because the rich people that have invested into it want AI to be too big to fail. That way we're forced to keep moving forward on AI, and the rich can achieve their dream of not paying workers.
They are for training new models, not running existing ones
They lose money, of course.
https://seekingalpha.com/news/4653029-coreweave-collapses-after-gartner-predicts-80-percent-of-neoclouds-will-evaporate-by-2030
It's a bubble in a specific subcategory of commercial real estate, and commercial real estate usually eats shit first when a recession hits. The tech essentially serves the same purpose as American consumer credit did in the runup to 2008, just one step removed.
I remember seeing an interview of Satya Nadella saying that he has thousands of GPUs he's just sitting on, waiting to get enough power infrastructure to plug then in, so in short, they're hoarding.
mass surveillance, and dynamic pricing/ad targeting.
They pre buy the memory stock years in advance with IOU money.
My theory is that the data centers are just shell companies for farming tax credits. The various gov officials are all NDA'd and can't won't say what kind of deals they cut nor the kickbacks they're harvesting.
Paying contractors
Im like 99% sure those are the only people profiting here. Data center electricians make bank to do mostly brain dead copy-paste underground
An electrician acquaintance of mine was on a gig early in the year essentially building open-air server racks that were then covered with huge tents, a la Tesla's long-standing "temporary" structure in Fremont. I would never have believed him if he hadn't taken pictures and video.
Basically the sole silver lining I see in our slopocalypse is that some portion of the fortunes being incinerated is moving money from finance parasites back to actual people. Some of it.
A few things:
Oh also it's entirely possible to make huge amounts of money in a bad idea as long as you get out first. I suspect a lot of investors and banks are anticipating being that person. Capitalism is hilarious.
Big corporations are not in the business of selling things and making profits. Their whole line of business is gaming financial markets.
In that regard, datacentres don’t need to do anything. It just needs to demonstrate some material ‘investment’ into Making AI Happen, presenting a potential for super duper revenues in the glorious future, and thereby securing outlandish valuations today.
I could have gone with destroying excess capital to preserve the status quo, but this stage and with this administration in the US going for subtlety seems unnecessary .
Maybe it's to keep the existing assets from cratering in value. Storage and RAM prices have gone up in value, if all those assets returned to their sane values then many more loans would be upside down.
For the rich to create a panopticon to keep us In check...and also to charge for knowledge they did not earn or work for
There is also a token shortage, Anthropic at least started noticeably throttling users like 6ish months ago.
Not saying there is demand at API price points since the majority of use still comes from sub's, but still.
You mean the government surveillance centers? All questions like there's while you still can.
Seems like a bit of an overkill.
Also to be honest an AI surveillance state seems like a rather silly thing. Those ratting you out have to be your co-workers, your neighbors, your friends, better yet, your family.
Automating that out is sort of like digging out belamorkanal with a robotic digger. The canal isn't the thing. The thing is making people dig it - and making other people decide who digs.
Not to sound like a conspiracy theory, but after the Russian bot farm thing I think this is a race to have the means to Astro turf the Internet for propaganda.
I think we are going to end up with infranetworks, regionally and nationally to avoid this. And I fear that the only way to confirm that someone is not a bot soon will be ID or some sort of biometrics. I think this is a controversial take, but I’d support a non-anonymous internet/social media alternative if it meant everyone I talk to is a human.
As for a more optimistic take…. I’m sure there’s a lot of complex science shit that instead of actually mindfully researching and experimenting with, can instead just be brute forced. Kinda like those videos where they train “AI” to play racing games or Mario levels, but letting it randomly attempt it thousands of times — and eventually it even beats humans playing it in time and efficiency. Maybe we can use AI to generate more efficient machines?….
I think we are at the point where AI would be okay enough to do simple shit like simplified farm and factory work, low stakes stuff where it fucking up can’t actually have that severe of consequences. That’d require sweeping economical and social reforms to tackle unemployment, and that’s too optimistic for me. This probably won’t get us to a post scarcity society, but it could make a lot of things very trivial and cheap… if introduced ethically. There might be a point where there’s a lot of people that won’t/can’t get a job, many that shouldn’t need to get a job, and what to do with them. Not everyone can be the guy that fixes and builds the AI. Maybe being unemployed will become not a big deal
If the Russian Bot Farm thing you're talking about is Ukraine bombing a data center and seeing 90% fewer right wing posts, I regret to inform you that it wasn't accurate [bluesky thread source]
The bots they were talking about were search crawler bots from Yandex. Actual Twitter/X bots saw no change in traffic.
Admitted speculation:
I did, however, notice of my own accord that I had 4 days with zero scam calls instead of my usual 10-15, which in retrospect looking back corresponds with when a bunch of Russian services went down. I suspect that the automated crawlers and VOIP systems and aggregators perform a background hum of utility for scam and troll services that makes them much less effective in their absence.
There was likely some overlap, but there was no major network shakeup like some people were claiming.
that's great thanks
theres a 70 trillion dollar labour market they are trying to destroy so that they can hold quite literally all of the cards.
then they are going to start releases staged culling events to kill off the "useless eaters" as the nazis used to put it.
using surveillance they will select genetically desirable individuals. they are going to black bag families as they already have been. killing or enslaving those with little genetic value for repoduction, and sampling genes from those that do, likely doing advanced medical testing for things like neuralink like they have been doing already with snatched immigrants at the university of miami which us only about 45. minutes away from alligator alcatraz (google recently scraped a lot of that information away recently, crazy shit). rape, torture, organ extraction, imprisonment, deporation, etc. etc. humans become livestock to be traded, used, abused, and thrown away. all automated by AI and foot soldiers.
they intend to reduce the global population to roughly 1/16th of its current size. its a more managable population, especially with AI assisted/automated systems. militaries, police, etc.
world war 3 (already happening). new pandemics (one is apparantly brewing in russia atm). famine (crops are fucked this year already). disease. civil war. all of that will continue to come in phases. many of them overlapping, eventually leaving a privileged few to enjoy the comforts of automation.
thats the future they are working towards. and it is well underway.
if you think "well if theres nobody around to buy their stuff, then they wont be rich!"
if i spent the last of my money, and took a loan out for a gun and lots and lots of ammo, just before the world ended to a zombie apocolypse. not only would i not have to pay it back, but im suddenly one of the richest men in the world.
its kind of like that, but with data centers, drones, robots, and bunkers. and above mentioned catastrophies.
robotics are advanced enough now that they could defend a bunker quite efficently, so they may not have to worry about security turning on them anymore.
we are, as they say..... cooked, fam
enjoy your creature comforts while you can. or go find your local rich asshole and kill them. your choice.
The large tech companies (Meta, Microsoft, Google, Amazon) all know that software companies are going to go bankrupt. People will start creating things like Windows with LLM. Windows and software is obsolete. So these big companies that are sitting on hordes of cash, and know their days are limited, need to make a pivot. They also know that all the countries of the world are deeply in debt, and inflation is going to continue. Cell phones are becoming expensive, and will only get worse as inflation continues, and countries start devaluing their currencies. So the push is going to be (and Elon Musk said this flat out on Joe Rogan), new inexpensive devices will replace cellphones. They wont have a CPU or much RAM, because all the apps will be cast from Data Centers. The world will return to the terminal servers of the 70s. So Data Centers will have a use, for steaming all the apps. But the other thing is that the worldwide electrical grid is old, and can't handle all the new power that's needed for the Data Centers, and Electrical Vehicles. I saw a millionaire call the rebuilding of the Electrical Grid that's taking place a modern day Industrial Revolution. So,,, the bigger part behind each data center is going to be the SMR (Small Modular Reactors) The small modular reactors are built in the same style as the nuclear reactors inside a nuclear submarine, or an aircraft carrier. They are mass produced, built like interlocking Legos, self contained, and run for 20-30 years without needing any more nuclear fuel added. They will power the data centers, and MORE IMPORTANTLY, they will be connected to the grid! So these large companies like Microsoft who bough the 3 mile Island reactor, will become hybrid tech companies, selling app subscriptions, cloud space, utility companies, selling electricity back into the system. It's also important to get the cost of electricity down using the SMR, because the average person is going to be a lot poorer in the future. Here you go, the full scoop, you won't hear on the news.
No, they won't.
lol
lol encore
lol a third time
Go do your own research somewhere else.
I really liked the part about all countries being in debt, straight from the facebook comments school of economics.
If you’re a genuine socialist: stop this. You’re doing an Elders of Zion.
ew