Spyke
lemmy.ml

Good example of why I don't rely on technology I don't control. I want my workflow to be future-proof and have a predictable cost.

60

Yes, when anyone proposes building our tools on top of these services I ask "what will happen to this when they start charging what it really costs to run these models?"

17
lemmy.world

In general I agree with you, but llms are the one exception where it's not practical and not cost effective to run them locally. If you want to use them, the better option is by far to pay someone for the service.

-13
gezeroreply
sopuli.xyz

That's because now is the phase where they let you try the good stuff cheaper to hook you up.

36

That's true, but there are also massive economies of scale when you can afford the big Nvidia gpus and share them among many people.

1
chickenreply
lemmy.dbzer0.com

Then second best option is an inference provider for open weight models, so at least if they raise the price or stop offering it you can get it from someone else or eventually upgrade to self hosting.

4

So it begins. We are past the unlimited money stage and now the cuts begin to make AI somewhat profitable.

Expect more of that in the coming months.

35

It's for the best.

Learning how code works is better than getting an LLM to produce convincing looking code without anyone having an understanding of how it works.

LLMs just teach students to paint themselves into a corner without them even realising why bad things keep happening to them.

27

Right. It's actually shocking that copilot is allowed at all. The next generation is going to be so fucking stupid.

8
lemmy.blahaj.zone

I agree, but I learn best when I can ask questions a certain way to understand concepts, and as much as people may hate it, it's good at answering questions like that and people are often nasty when others ask questions they assume to be stupid.

Not that I'm a student.

1
lemmy.world

They aren't even waiting for market saturation, they're just speed-running straight into enshittification now

9
lemmy.ca

It's shit like this that make me want to pursue a career in digging ditches with just a shovel, a bag of sandwiches, a thermos of coffee and the warm sunshine. Fuck the modern world. It jumped the rail a while ago now.

6

anyone with a yard should be tilling the soil and planting stuff, it's a nice hobby that gives you some fun things to eat, and if (well, kinda feels like when..) international trade goes to shit we'll have people who can keep us fed.

1

You reached the end

Copilot just got a massive downgrade for students | Spyke