Spyke

16 replies

lemmy.ca

Anyone who invested in data centres on the last year is already seeing their stock in trouble. The dot Com bubble pop wasnt due to mom and pop internet sites going under. It came from the massive oversupply in fiberoptic that companies like Cisco poured money into, and all related funds that followed them.

There is a massive glut in data center projects relative to the shrinking demand for LLMs etc. The bubble is popping.

17
Nik282000reply
lemmy.ca

I can't wait get my hands on some cheap-ass server hardware. Having an in-home, offline, Hal 9000 is gonna be a lot more fun than having my boss slop out mass emails every 30 min.

16
tempestreply
lemmy.ca

I just hope we actually see it in the used market. I would not be surprised to see these billionaire fucks destroy it all rather than allow the plebes to have access to decent hardware.

7
Nik282000reply
lemmy.ca

I'm pretty sure that it will be used to fill the consumer hardware vacuum by pushing desktops as a service. Every device you own gets a unified desktop streamed to you from the remains of the AI industry.

5

At least in my case I'll be running my own shit until it all dies, unless they come to my physically, there's no way for them to take anything but websites from me at this point.

Full linux across every computer in my home, dumb TV's and my own systems for media. I rely on no one but Linux devs, and even if I had to dump the internet, my own shit would continue to work just fine.

2
k0e3reply

The government wil just buy it to surveil us, I'm sure.

1
lemmy.ca

Shrinking demand for LLMs? What planet are you living on?

If you look at OpenRouter's history back a year you can see the massive explosion in inference tokens consumed. https://openrouter.ai/rankings?view=month#top-models Obviously that's not a perfect representation of the entire market given that the major companies also provide their own inference, but it's the largest public view of usage and is likely extremely representative of what's going on behind the scenes.

The only thing holding more organizations back from using even more inference is cost, so any sort of "pop" is just going to immediately be eaten up by increased usage at slightly lower prices.

Will a bunch of investors lose their shirts? Absolutely, but there is no lack of demand for datacenters right now.

3
lemmy.ca

That's not shrinking demand. That's stupid investors. Those are not the same thing.

2

Ceos are turning sour as ability measure ROI has proven elusive. Also, the above implies a slow increase to prices which is already happening.

1
lemmy.world

Lets see how that plays out with increasing prices of electricity, cooling systems, fresh water.

Next year will be full of surprises:

  1. Insanely hot heat waves
  2. Grid system failures as a result
  3. shortage of fresh water
  4. difficulty of cooling those data centers (there will be more of them)

AI efficiency has to double at least to be viable at that point

1
lemmy.ca

AI currently (as of a month ago) only uses about 0.5% of total global energy. It's not as big of a threat to the environment as you seem to think it is.

Not to mention that the 2, 3, and 4 are failures by your government. My local government doesn't have those issues because they properly regulated datacenters already.

New datacenters here have to bid for specific limited available power blocks yearly when the utility determines how much will be available to their use, they also can't be built with evaporative cooling anymore, and... 4 doesn't apply because we don't use evaporative cooling anymore.

It's fucking hilarious that the US is allowing datacenters to be build with evaporative water cooling in the middle of fucking deserts and/or drought regions. Stop being idiots.

1
lemmy.world

I dont know why you have to lie. It is 1.5% officially but my guess is 3% at least. Which is huge. 2,3,4 already a problem in some parts of USA and you I wrote about future problems. Maybe your gov is able to offload 2, 3, 4 to the nature but it is not your gov beinf smart, it is harming my home, my life and for what for useless pet projects and useless media

0

Nope, it's not. You're counting "electricity usage" not energy usage.

Those are not the same thing.

1

And keep in mind. Grids need cooling, people need more ac, data centers need more ac, fresh water needs electricity. It is just going to snowball

1

Just as an example: On Friday a data centre was announced in Nova Scotia, with the premier and a couple of MPs in attendance, and later in the day the client for the data centre was announced as Anthropic. Almost like the officials in attendance at the data centre announcement didn't want to have to answer questions about what good a local data centre with an American Big Tech client does us.

15

You reached the end

Canada’s sovereign AI boom isn’t very sovereign | Spyke