Spyke

Replies

Comment on

‘We created a monster’: companies rein in AI usage as costs strain budgets — Amazon, Walmart and Uber are among early adopters that have introduced caps or discouraged wasteful activity

Reply in thread

There is a limit to how long an AI company can keep subsidizing the tokens, eventually the financial ruin ensues. Every chat request that goes to the LLM has an actual physical compute and RAM cost, which scales to hilarious levels as you keep chatting in the same thread and the context size widens. It scales to astronomical levels when the query requires high-level analytical or reasoning skills like thinking..., pondering..., bloviating..., etc. - which is exactly what enterprise users intend on doing. The Uber story made it quite clear - even some of the big techs don't have the stomach for that kind of unlimited resource drain.

Comment on

Cant post in own community.

I don't think there is any cool down period, same thing happened when I tried to sign up on the lemmy programmers community earlier today. The thing is federation is far more complicated when you try to implement in code than what it appears. On top of that, when you try to impose generic standards to also accommodate Mastodon in the same network, the complexity goes up even several notches! It might take a while for all the bugs to get fixed and fediverse to become stable.

You reached the end