Spyke
mander.xyz

"I personally chose the price"

Is that how well-run companies operate? The CEO unilaterally decides the price rather than delegating that out to the numbers people they employ?

237
NoWayreply
lemmy.world

Should have asked chatgpt to play the role of a CEO.

96

This is my first experience listening to this guy, and I'll be darned, it's a another idiot billionaire.

I'd like to think there are intelligent billionaires but honestly folks, if you win that big and haven't cashed out to do something more meaningful with you're life, you're an idiot.

5
rookreply
awful.systems

A real ceo does everything. Delegation is for losers who can’t cope. Can’t move fast enough and break enough things if you’re constantly waiting for your lackeys to catch up.

If those numbers people were cleverer than the ceo, they’d be the ones in charge, and they aren’t. Checkmate. Do you even read Ayn Rand, bro?

83
Kitathallareply
lemy.lol

Is that what Ayn Rand is about? All I really remember is that having a name you chose yourself is self-fulfilling.

19

A monologue that last SIXTY PAGES of dry exposition. Barely credible characterization from the protagonist and villains and extremely poor world building.

Anthem is her better book because it keeps to a simple short story format - but still has a very dull plot that shoehorns ideology throughout. There’s far better philosophical fiction writers out there like Camus, Vonnegut, or Koestler. Skip Rand altogether imo

20
sp3ctr4lreply
lemmy.zip

Ayn Rand is about spending your whole life moralizing a social philosophy based on the impossibility of altruism, perfect meritocratic achievement perfectly distributing wealth, and hatred of government taxation, regulation, and social welfare programs...

... and then dying alone, almost totally broke, living off of social security and financial charity from your former secretary.

18
froztbytereply
awful.systems

far, far, far, far, far, far, far fewer business people than you’d expect/guess are data-driven decision makers

and then there’s the whole bayfucker ceo dynamic which adds a whole bunch of extra dumb shit

it’d be funnier if it weren’t for the tunguska-like effect it’s having on human society both at present and in the coming decades to follow :|

46

I think I remember Jeff Bezos in "The Everything Store" book seeing a price they charged for AWS and went even lower for growth. So there could be some rationale for that? However, I think switching AI providers is easier than Cloud Providers? Not sure though.

I can imagine the highest users of this being scam artists and stuff though.

I want this AI hype train to die.

28
brbpostingreply
sh.itjust.works

I’m guessing that means a team or someone presented their pricing analysis to him, and suggested a price range. And this is his way of taking responsibility for making the final judgment call.

(He’d get blamed either way, anyways)

17

While the words themselves near an apology, I didn't read it as taking responsibility. I read it as:

Anyone could have made this same mistake. In fact, dumber people than I would surely have done worse.

8

$20/mo sounds like a reasonable subscription-ish price, so he picked that. That OpenAI loses money on every query, well, let's build up volume!

6

In tech? Kinda yeah. When a subscription is 14.99 $£€/month it's a clear "we just think it's what people think is a fair price for SaaS".

The trick is that tech usually works on really weird economics where the fixed costs (R&D) are astonishingly high and the marginal costs (servers etc) are virtually nil. That's how successful tech companies are so profitable, even more than oil companies, because once the R&D is paid off every additional user is free money. And this means that companies don't have to be profitable any time in particular as long as they promise sufficient projected growth to make up for being a money pit until then. You can get away with anything when your investors believe you'll eventually have a billion users.

... Of course that doesn't work when every customer interaction actually costs a buck or two in GPU compute, but I'm sure after a lot of handwaving they were able to explain to their investors how this is totally fine and totally sustainable and they'll totally make their money back a thousandfold.

4

Who needs to know what they are taking about anyway, just suck your finger in the air and set a price

2
midwest.social

CEO personally chose a price too low for company to be profitable.

What a clown.

118
Sergioreply
slrpnk.net

They're still in the first stage of enshittification: gaining market share. In fact, this is probably all just a marketing scheme. "Hi! I'm Crazy Sam Altman and my prices are SO LOW that I'm LOSING MONEY!! Tell your friends and subscribe now!"

78
sh.itjust.works

I’m afraid it might be more like Uber, or Funko, apparently, as I just learned tonight.

Sustained somehow for decades before finally turning any profit. Pumped full of cash like it’s foie gras by Wall Street. Inorganic as fuck, promoted like hell by Wall Street, VC, and/or private equity.

Shoved down our throats in the end.

25
where_am_ireply
sh.itjust.works

well, yes. But also this is an extremely difficult to price product. 200$/m is already insane, but now you're suggesting they should've gone even more aggressive. It could turn out almost nobody would use it. An optimal price here is a tricky guess.

Although they probably should've sold a "limited subscription". That does give you max break-even amount of queries per month, or 2x of that, but not 100x, or unlimited. Otherwise exactly what happened can happen.

9

"Our product that costs metric kilotons of money to produce but provides little-to-no value is extremely difficult to price" oh no, damn, ye, that's a tricky one

21
stolyreply
lemmy.world

The real problem is believing that you can run a profitable LLM company.

9
Saledovilreply
sh.itjust.works

What the LLMs do, at the end of the day, is statistics. If you want a more precise model, you need to make it larger. Basically, exponentially scaling marginal costs meet exponentially decaying marginal utility.

-3
stolyreply
lemmy.world

Some LLM bros must have seen this comment and become offended.

1
selfreply
awful.systems

guess again

what the locals are probably taking issue with is:

If you want a more precise model, you need to make it larger.

this shit doesn’t get more precise for its advertised purpose when you scale it up. LLMs are garbage technology that plateaued a long time ago and are extremely ill-suited for anything but generating spam; any claims of increased precision (like those that openai makes every time they need more money or attention) are marketing that falls apart the moment you dig deeper — unless you’re the kind of promptfondler who needs LLMs to be good and workable just because it’s technology and because you’re all-in on the grift

6
Saledovilreply
sh.itjust.works

Well, then let me clear it up. The statistics becomes more precise. As in, for a given prefix A, and token x, the difference between the calculated probability of x following A (P(x|A)) to the actual probability of P(x|A) becomes smaller. Obviously, if you are dealing with a novel problem, then the LLM can't produce a meaningful answer. And if you're working on a halfway ambitious project, then you're virtually guaranteed to encounter a novel problem.

-5

Obviously, if you are dealing with a novel problem, then the LLM can’t produce a meaningful answer.

it doesn’t produce any meaningful answers for non-novel problems either

7

I signed up for API access. I run all my queries through that. I pay per query. I've spent about $8.70 since 2021. This seems like a win-win model. I save hundreds of dollars and they make money on every query I run. I'm confused why there are subscriptions at all.

2
shalafireply
lemmy.world

More like he misjudged subscriber numbers than price.

-9

despite that one episode of Leverage where they did some laundering by way of gym memberships, not every shady bullshit business that burns way more than they make can just swizzle the numbers!

(also if you spend maybe half a second thinking about it you’d realize that economies of scale only apply when you can actually have economies of scale. which they can’t. which is why they’re constantly setting more money on fire the harder they try to make their bad product seem good)

18
awful.systems

please explain to us how you think having less, or more, subscribers would make this profitable

13

Yeah, the tweet clearly says that the subscribers they have are using it more than they expected, which is costing them more than $200 per month per subscriber just to run it.

I could see an argument for an economy of scales kind of situation where adding more users would offset the cost per user, but it seems like here that would just increase their overhead, making the problem worse.

10
BB84reply
mander.xyz

LLM inference can be batched, reducing the cost per request. If you have too few customers, you can't fill the optimal batch size.

That said, the optimal batch size on today's hardware is not big (<100). I would be very very surprised if they couldn't fill it for any few-seconds window.

-5
awful.systems

this sounds like an attempt to demand others disprove the assertion that they're losing money, in a discussion of an article about Sam saying they're losing money

10
BB84reply
mander.xyz

What? I'm not doubting what he said. Just surprised. Look at this. I really hope Sam IPO his company so I can short it.

-5

Can someone explain why I am being downvoted and attacked in this thread? I swear I am not sealioning. Genuinely confused.

@[email protected] asked how request frequency might impact cost per request. Batch inference is a reason (ask anyone in the self-hosted LLM community). I noted that this reason only applies at very small scale, probably much smaller than what OpenAI is operating at.

@[email protected] why did you say I am demanding someone disprove the assertion? Are you misunderstanding "I would be very very surprised if they couldn't fill [the optimal batch size] for any few-seconds window" to mean "I would be very very surprised if they are not profitable"?

The tweet I linked shows that good LLMs can be much cheaper. I am saying that OpenAI is very inefficient and thus economically "cooked", as the post title will have it. How does this make me FYGM? @[email protected]

-3
awful.systems

i would swear that in an earlier version of this message the optimal batch size was estimated to be as large as twenty.

4
V0ldekreply
awful.systems

Wait but he controls the price, not the subscriber number?

Like even if the issue was low subscriber number (which it isn't since they're losing money per subscriber, more subscribers just makes you lose money faster), that's still the same category of mistake? You control the price and supply, not the demand, you can't set a stupid price that loses you money and then be like "ah, not my fault, demand was too low" like bozo it's your product and you set the price. That's econ 101, you can move the price to a place where your business is profitable, and if such a price doesn't exist then maybe your biz is stupid?

11

I believe our esteemed poster was referencing the oft-seen cloud dynamic of “making just enough in margin” where you can tolerate a handful of big users because you have enough lower-usage subscribers in aggregate to counter the heavies. which, y’know, still requires the margin to exist in the first place

alas, hard to have margins in Setting The Money On Fire business models

10
lemmy.world

The plagiarism power virus is too expensive to operate? I'm shocked I tell you

87

losing money because people are using it more than expected

"I personally chose the price and thought we would make some money."

Big MoviePass energy

68
lemmy.world

Much like uber and netflix, all of these ai chatbots that are available for free right now will become expensive, slow, and dumb once the investor money runs out and these companies have to figure out a business model. We're in the golden age of LLMs right now, all we can do is enjoy the free service while it lasts and try not to make it too much a part of our workflow, because inevitably it will be cut off. Unless you're one of those people with a self-hosted LLM I guess.

67
stolyreply
lemmy.world

Not LLM but there Google Assistant has gotten much more stupid over the past several years. They realized that it was too expensive and had to lobotomize it.

27
Raiderkevreply
lemmy.world

Can't even set a timer with it anymore which was pretty much all I used it for. That and navigation with Android Auto

11
lemmy.world

Huh? I set a timer with a voice command just two days ago. I'm not using "Gemini" though, does opting into that literally remove functionality?

2

Just tried it again, and it worked but for whatever reason, did not use my actual timer app on the phone, and used Google Assistant. For whatever reason the timer was muted by default, so that's why I thought it didn't work at the last time I used it.

2

Agreed - bring back the golden age where the Google Now app existed and could actually do useful things

8

This. AI Hype beasts keep saying "This is the worst AI will ever be" and "It'll just get better" but really it's just going to get worse as they actually try to turn the bubble into a profit

26

will become expensive, slow, and dumb

Wouldn't they have to become smart first?

17
domdanialreply
reddthat.com

I was about to say, a selfhosted LLM means I'm not competing with every market analysis tool, customer service replacement, and 10 y/o kid bombarding the service with junk. It doesn't need to be ultra fast if I'm the only one using the hardware.

13
froztbytereply
awful.systems

and who’ll supply the model and training and updates and data curation, dom? is it as manna from heaven? do you merely step upon the path and receive the divine wisdom of fresh llm updates?

fucking hell

11

Honestly, the data used to create these models was ripped from the public and I think that they are owed back to the public. OpenAI started as a non profit, and I think it should stay that way.

The FOSS model works well enough for other projects and I think that corporate AI will be exactly the same as the industrial revolution, progress at the cost of humanity. This isn't a problem to solve, it's a solution looking for problems.

3
lemmy.world

Base open source model.
Topic expert models.
Community lora.
Program extensions.

Look what comfy UI + Stable Diffusion can achieve.

3

Base open source model just means some company commanding a great deal of capital and compute made the weights public to fuck with LLMaaS providers it can't directly compete with yet, it's not some guy in a garage training and RLFH them for months on end just to hand the result over to you to fine tune for writing caiaphas cain fanfiction.

11

And with the pruned llama models, it runs really quickly on a 2070.

2
aussie.zone

Once they are cut off self hosted focus will explode and will see huge improvements in terms of ability and ease of use.

6
froztbytereply
awful.systems

your Tech Friend is giving you bad advice, stop listening to them

9

oh, I guess then you must be the Tech Friend

either way you probably want to stfu

3

Is it gonna be "to protect the children", "to stop criminals", or "to save the environment"? Place your bets!

2
lemm.ee

What are people using the $200 plan for that makes it worth it? You only get their model with their training, you don't have any access to weights or training. And with how nerfed openai makes its models, nothing even remotely nefarious can be done with it. All you can do is process simple data. Which having a purposed trained model seems the most valuable for.

44
lemmy.world

Probably mostly fake social media profiles and YouTube/Tiktok AI slop.

You could use it to create hundreds of real-looking fake accounts on reddit or other social media site. OpenAI's site doesn't have this kind of fake user function built into its app, but it should be easy enough with an API. Just have a bot randomly scroll reddit's most popular posts. Then have it find the most popular comments on those posts over a certain length. Feed the text of that comment to OpenAI, instructing the LLM to make a disagreeing/concurring/answering reply. Then have the bot post OpenAI's output as a comment on reddit. Have each account comment not at superhuman speed, but at the speed that a normal human user would post.

Use these tools to build up an arsenal of hundreds, perhaps thousands or even tens of thousands of sockpuppet accounts. Each will have years of post history behind them, so they will pass typical subreddit filters like "account must be this old or have X comment karma" to post. Just keep these bots constantly running and available.

Then, when you want to use them, use them. Don't even dramatically switch their persona. Want to use your bot network for politics? Have your 10,000 fake users mostly comment on random banal stuff. But every 10th post or so have them post a comment for whatever politician or cause you support. You might even have them regularly post content of that political persuasion as a normal part of their operation. Same thing with advertising. Have them mostly post random stuff, but have them occasionally post a glowing review for a product, film, or service.

The real use for OpenAI's software is as a vector for very effective and difficult to detect and filter astroturfing campaigns. Hell, just getting your name out there can be advantageous. Are you a nobody, but with a lot of cash, that wants to launch a political career? Higher such a bot net to sprinkle your name across social media. Even if all the bots do is mention you, neither praising or condemning, it gets your name out there. The next election cycle, when people start talking about potential primary candidates for a particular office, real people will suggest your name, simply because they heard it somewhere. Name recognition is a powerful thing.

44
discuss.tchncs.de

even russian influence campaigns don't do it this way. it's probably a split between this kind of thing being too expensive (and they're using underpaid interns) and accounts being too disposable (you can burn it all after desired effect is achieved)

6
awful.systems

they literally did actually

At the direction of, and with financial support from, the GRU, CGE and its personnel used generative AI tools to quickly create disinformation that would be distributed across a massive network of websites designed to imitate legitimate news outlets to create false corroboration between the stories, as well as to obfuscate their Russian origin. CGE built a server that hosts the generative AI tools and associated AI-created content, in order to avoid foreign web-hosting services that would block their activity. The GRU provided CGE and a network of U.S.-based facilitators with financial support to: build and maintain its AI-support server; maintain a network of at least 100 websites used in its disinformation operations; and contribute to the rent cost of the apartment where the server is housed. Korovin played a key role in coordinating financial support from the GRU to his employees and U.S.-based facilitators.

that's news not socials, but we are seeing LLMs deployed by social media bot networks

17

i think it's only a small part of their efforts and relatively recent one. i suspect they did their preparations to 2024 american elections and some elections in europe (at minimum romania) the old, manual way https://discuss.tchncs.de/post/21537107 what do you need these permanent chatgpt-based accounts if investigation finds them in a week, making them useless forever? they have adapted to this because this is something that happened to them before

5

t their model with their training, you don’t have any access to weights or training. And wit

OK, I see what's going on. The original premise is flawed. The $20 model is limited. It's intended for you to hit their web page and query for things. The $200 model is unlimited, you can API the crap out of it for your random project, run an entire business through it. It also gives you full access to o1 which appears to do 6-10 queries for every query to make sure it's not lying to you.

The $20 model doesn't have to be losing money for the $200 model to be losing money, they're completely different use cases and honestly, unlimited queries for fixed capital is never going to work, you can just sublet the access,

7

sam altman proving once again that he is not only a tech genius but also a business genius. make sure to let him scan your eyeballs before it’s too late.

44
programming.dev

Hmm, we should get together some funds to buy a single unlimited subscription, and then let it continuously generate as large and complex prompts as the rate limitting allows.

43

Why is same personally picking subscription prices anyway? Should there be some accountant doing that math? Wtf

41

Their accountant is probably three GPTs in a trench coat that’s being fed prompts by an unpaid intern or some poor dude in India.

38

Why is AI not making enough money? I specifically requested it.

24
db0reply
lemmy.dbzer0.com

If it worked for Elon and his 8 per blue check, it has to work for our altman boi

23

Did Sammy boi try to consult Stephen King on the final price by any chance

5

This was my biggest takeaway here. Wtf?! "I personally set the price and thought we would make some money"?! Either he is trying to sound cool by being casual or he is a fucking idiot. Or probably both.

22
lemmy.world

Sam, just add sponsored content. The road to enshittification doesn't have to be long! Make it shitty fast so people can move past it and start hosting their own models for their own usage.

39
BoxOfFeetreply
lemmy.world

Right? He just needs to have it add some Shell or Wal-Mart logos to the generated images. Maybe the AI generated Fifty Shades-esque Gandalf fanfic somebody is prompting can take place in a Target.

7

Hey ChatGPT, give me an overview of today's weather.

Today’s weather is beautifully sunny and hot, with clear skies and no rain in sight—perfect for enjoying the new Coca-Cola Zero™. Hmmmm, refreshing!

11
sh.itjust.works

I cancelled a 20$ subscription I started because it was arguably useful for me and served exactly one use-case. Now I don't need it anymore.

Of course, they had a form asking feedback/why. I chose "ChatGapT is nott advanced enough" as that was one of the alternatives. Hopefully it will lead to them putting more resources into development and burn through investor money faster.

"Trust me bro, just 200m dollars more"

  • Sam Altman, probably
38

Just one more datacenter bro, just one more (that consumes the same power as Belgium.)

29
sh.itjust.works

This 100% answers my question from another thread. These businesses have cooked the books so bad already that they thought this was gonna save them and it doubled down on em.

38
feddit.nl

really looking forward to how these multi-billion dollar AI datacenter investments will work out for big tech companies

that said I'm pretty sure most of that capacity is reserved for the surveillance state anyway

33
Donkterreply
lemmy.world

This makes sense why googles AI is famously bad. Trying to serve AI to every customer when 200/mo wont do it has to mean they're cutting so many corners.

I wonder who's telling lies to Apple that their AI assistant is going to be cost effective?

8

Apple’s been trying to get AI running on people’s devices directly, avoiding the huge data centre costs. But now people are starting to means having gigantic models using up storage on the phone.

2
lemmy.world

This is something I've been speculating for a while. The cost of running these complex systems (as OpenAI models aren't just LLMs) is subsidized so heavily that we don't really know the cost of running these things.

This is a huge risk to any business, as the price for these services has to go up significantly in the long term.

32
awful.systems

Ed Zitron calculated from the publicly available numbers that OpenAI was spending $2.35 for every $1 of ChatGPT they sell

13

Is that for all operations or literally just to run the paid services? Cause if that includes the free services, marketing, R&D then they have a lot of options to cut costs.

Given what AWS/etc. charge for their LLMs/APIs it feels like the entire industry is subsidizing LLM compute to stay competitive. But I could be wrong there.

3
lemmy.world

Was it altman that tweeted they were near the singularity? I assumed it was a way to raise money. Felt more like "Fuck! We need more money to burn."

9

they were only “near AGI” before their most recent funding rounds closed, after that they were “a few thousand days” away

9
lemmy.zip

If they are losing money on $200/month, that does not necessarily mean they lose money on the $20/month.

One is unlimited, the other is not. You only have to use the $200 subscription more than 10 times the amount the $20 subscription allows for OpenAI to earn less on that subscription.

28
lemm.ee

Yeah, and I think you're pretending it's more ridiculous than it is

28
TrickDacyreply
lemmy.world

Brainfart happens online, blogging douches run to their laptops and hype up the drivel, and yep the person saying that's dumb is the idiot here.

0
lemm.ee

That sure is a lot of hate without much content . And no, I called no one an idiot

2
SoftTeethreply
lemmy.world

Want to describe how petty lords with no accountability controlling society is somehow a good thing?

1

I think you’re pretending it’s more ridiculous than it is

Sounds pretty condescending to me.

-2

Welcome to the wonderful XXI century where our innovations in communication technology and financial instruments allow a hyperoptimised economy where two tweets are more than enough to cause billion-dollar shifts on the market. Completely organic and based on solid fundamentals I am assured by the same people that assured me of this in 2000 and 2008.

10

Just because it's a Twitter post doesn't undermine that he said it.

I'm glad news organizations pick up stuff from a platform I don't personally use

3

According to the Lemmy comment I read about it that is exactly what people are wondering

2

I've seen more written on one post. People will eat up 'news' if presented in the right way. There is a reason the stupid websites and advertisers use the click-bait titles.

-3
lemmy.world

Likely they'll try to sell it to governments, and with Elon Musk proposing goVeRNmeNt eFfIciEnCy, at least xAI can become somewhat profitable.

12

Heard someone (I think that Shark Tank dumbass) already mention instituting some kind of "AI mandate" on healthcare. Musk will probably destroy OpenAI, because he seems to have a vendetta against them.

2
lemm.ee

Never offer unlimited on a utility model without guardrails. That’s just business 101.

26
Dracesreply
lemmy.world

That's ISPs default model and they're very profitable

3

...but then also sell your data, just not as the primary source of income.

2
Dracesreply
lemmy.world

By that argument chatgpt is limited by how fast they answer questions. It's just a silly blanket statement that doesn't hold up

1

I don't understand your analogy, but what I said is not silly.

Internet service providers sell you access to the internet. They don't own/create the data on the internet, they provide you with a connection. Just look at the packages they sell. It's bandwidth. (Except in some markets they have data caps but that's bullshit rent seeking)

2

ISPs pay a more or less fixed rate for their infrastructure regardless of how much it's used, and it's inherently rate limited. You can't make a 1 gig connection go faster than 1 gig or use more power than it would at 100%. The reality is though that customers rarely push it to 100% so actually they save a ton of money making people share bandwidth.

2
lemmy.world

Good riddance. We never asked for it, and we didn’t deserve it forced on us.

23
Rhoerireply
lemmy.world

So…. It’s entirely my fault if I use a phone or a television, or… a computer?

Thanks for the sage advice! AI is the best!

3
lemm.ee

In the Bible's book of revelations, John (the author) is witnessing the end of the world and sees four horsemen being unleashed upon the world to spread a curse/trial/whatever wherever they ride. Each horseman brings with them something different- famine, disease, war (or strife), and death. Death is the last, IIRC, and rides upon a pale horse. I think that's what they're referencing. This person is saying that openAI is going to die soon.

39

this is correct as to the background of the term itself, the reason ed uses it here is because it is the term that he selected some months ago when he listed “some likely pale horses that signal the bubble popping”

7
jatonereply
lemmy.dbzer0.com

it won't. its backed by microsoft. they can literally afford to burn the cash on this while it becomes profitable, and it will AI has so many low hanging fruits to optimize its insane.

-4
awful.systems

So many low-hanging fruits. Unbelievable fruits. You wouldn’t believe how low they’re hanging.

39
Brutticusreply
lemm.ee

Okay, explain. What kinds of low hanging fruit?

23
jatonereply
lemmy.dbzer0.com

quants are pretty basic. switching from floats to ints (faster instruction sets) are the well known issues. both those are related to information theory, but there are other things I legally can't mention. shrug. suffice to say the model sizes are going to be decreasing dramatically.

edit: the first two points require reworking the base infrastructure to support which is why they havent hit widespread adoption. but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. that reduction alone means you can get 21x reduction in model size is pretty solid.

-18
selfreply
awful.systems

both those are related to information theory, but there are other things I legally can’t mention. shrug.

hahahaha fuck off with this. no, the horseshit you’re fetishizing doesn’t fix LLMs. here’s what quantization gets you:

  • the LLM runs on shittier hardware
  • the LLM works worse too
  • that last one’s kinda bad when the technology already works like shit

anyway speaking of basic information theory:

but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs.

lol

25

Honestly, the research showing that a schlong that's 3mm wide is just as satisfying as one that's 64 is intuitive once you tie the original inspiration for some of the sex positions.

12
feddit.org

I have seen these 3 bit ai papers on hacker news a few times. And the takeaway apparently is: the current models are being pretty shitty at what we want them to do, and we can reach a similar (but slightly worse) level of shittyness with 3 bits.

But that doesn't say anything about how both technologies could progress in the future. I guess you can compensate for having only three bits to pass between nodes by just having more nodes. But that doesn't really seem helpful, neither for storage nor compute.

Anyways yeah it always strikes me as a kind of trend that maybe has an application in a very specific niche but is likely bullshit if applied to the general case

10

If anything that sounds like an indictment? Like, the current models are so incredibly fucking bad that we could achieve the same with three bits and a ham sandwich

13

Far as I can tell, the only real benefit here is significant energy savings, which would take LLMs from "useless waste of a shitload of power" to "useless waste of power".

4
awful.systems

It's actually super easy to increase the accuracy of LLMs.

import pytorch # or ollama or however you fucking dorks use this nonsense
from decimal import Decimal

I left out all the other details because it's pretty intuitive why it works if you understand why floats have precision issues.

7
selfreply
awful.systems

the fruit can’t be rotten, you must be picking it wrong

20

“look, Mme Karen, this is definitely not a rotten tomato. it can’t be a rotten tomato, we don’t sell rotten tomatoes. you can see here on the menu that we don’t have rotten tomatoes on offer. and see here, on your receipt, where it says quinoa salad? absolutely not rotten tomatoes!” explains the manager fervently, avoiding a tableward glance at the pungent red blob with as much will as they can muster

5
lemmy.zip

$200 a month for a user is losing money? There's no way he's just including model queries. An entire a6000 server is around $800 / month and you can fit a hell of lot more than 4 peoples worth of queries. He has to include training and or R&D.

16

It includes anything that will keep them from having to pay investors back. Classic tech start up bullshit.

Silicon valley brain rot formula:

Losing money, get billions every month

Making money pay billions back

Which one do you think they pick

33
db0reply
lemmy.dbzer0.com

I'm honestly fairly surprised as well, but at the same time, they're not serving a model that can run on an A6000, and the people paying for unlimited, would probably be the ones who setup bots and apps doing thousands of requests per hour.

17
LiveLMreply
lemmy.zip

And honestly? Those people are 100% right.
If they can't deliver true "unlimited" for 200 bucks a month, they shouldn't market it as such.

grumble grumble unlimited mobile data grumble grumble

21
db0reply
lemmy.dbzer0.com

To be fair, unlimited is supposed to mean unlimited for a reasonable person. Like someone going to an "all you can eat buffet". However those purchasing these would immediately set up proxy accounts and use them to serve all their communities, so that one unlimited account, becomes 100 or a 1000 actual users. So like someone going to an "all you can eat" and then sneaking in 5 other people under their trenchcoat.

If they actually do block this sort of account sharing, and it's costing them money on just prolific single users, then I don't know, their scaling is just shite. Like "unlimited" can't ever be truly unlimited, as there should be a rate limit to prevent these sort of shenanigans. But if the account can't make money with a reasonable rate limit (like 17280/day which would translate to 1 request per 5 sec) they are fuuuuuucked.

6
LiveLMreply
lemmy.zip

Yeah, poor wording on my part, proxy accounts being banned is totally fair, but a user using various apps and bots is the type of 'Power User' scenario I'd expect a unlimited plan to cover.

7

Agreed. Like how fucking difficult is it to see "It costs us X per query, what Y rate limit do we need to put on this account so that it doesn't exceed 200$ per month?". I bet the answer to is hilariously low rate limit that nobody would buy, so they decided to value below cost and pray people won't actually use all those queries. Welp. And if they didn't even put a rate limit, also lol. lmao.

9

Surely this includes staff, real estate, and other operating costs.

1

So people are really believing Altman would publish these damning statements without ulterior motives? Are we seriously this gullible? Holy shit, we reached a critical mass of acephalous humans, no turning back now.

15

This reminds me of this fossil cable company owner. He just couldn't understand why they needed more bandwidth. Netflix and youtube had come in to being and this old fart just didn't get that people were actually using their bandwidth.

9

He's actually saving us from AGI which will arrive and, I don't know - kill everyone? once OpenAI makes 100 trillion dollars.

8
lemmy.zip

Okay everyone should create an openai account and start feeding it shit. Ask it the most braindead questions ever, if they use your questions as training data itll just fuck the next model up even more.

7
fedia.io

Uber didn't make a profit for a very long time. This is part of the game in silicon valley. Fake it until you make it.

2

Uber is built on increasing worker exploitation. GenAI can't do the same thing.

6
lemmy.world

good. fuck that noise. I hope it rises even more and eventually become more pricey than actually employing a person to do the job.

2
db0reply
lemmy.dbzer0.com

Youtube wasn't burning billions per year and it's also pretty much the primary entity for video for the whole world which has other benefits for google. Finally Youtube can be monetized through adverts, since storage and bandwidth costs are relatively low. Whereas GenAI's compute costs aren't.

22

An ad before and after every single question you ask chatgpt? Worth a shot, I guess !

11
lemmy.world

Why would anyone believe this? It's a private company. They don't have to be truthful talking about their finances.

-2
db0reply
lemmy.dbzer0.com

Why would they lie about losing money? Companies lie for the opposite all the time, but none of them boasts of losing money, as that causes FUD, which exactly what a hypelord like Altman doesn't want.

12

To drum up interest. Pro tip: CEOs are always salespeople.

3
lemmy.world

you don't understand how technology companies work. they're not always making money

-10
257mreply
sh.itjust.works

yeah but there is a difference between losing some money on R&D and simply having an unviable business model.

13
lemm.ee

Would people on Lemmy actually know the difference though? Like half the people here don't believe in the premise of money and capitalism to begin with. How are they expected to understand the finer points of business?

-2
selfreply
awful.systems

oh shit, it’s the only capitalist on lemmy and they’re in this thread! I’ve been waiting so long to tell you this:

go fuck yourself

e: holy fuck that post history, what did the objectivists do to you?

6
257mreply
sh.itjust.works

Do you mean the NixOS posts? like sheesh reproducable systems aren't that bad.

1

you don’t understand how technology companies money. they’re not always working

13
stolyreply
lemmy.world

lol they are converting to a for profit company and should be able to make a profit.

0

I dunno how to tell you this but the Setting Money On Fire company isn’t losing money on account of it being a weirdo NPO structure…

10
lemmy.world

Yeah, we see this all the time with emerging tech and platforms. All of the top tech companies now were once spending cash faster than they could make it, and all the naysayers saying they’d never be profitable.

Don’t y’all get tired of being wrong sometimes? Maybe try to learn from the past.

-14
awful.systems

THANK YOU. I feel the exact same way, word for word, although my feelings are directed at juicero rather than openai. sick of the juicero naysayers who don't understand

25

And how many failed technologies and companies were there along the way? How many movies do you watch on your LaserDisc player? Or your HDDVD player?

This current "AI" iteration is already hitting its limits despite having access to the sum total of human history. The bubble is already bursting as companies are finding that people don't want AI in their refrigerators any more than they want it to replace a basic search engine or making fake Facebook accounts for you to talk to like Tom from MySpace.

OpenAI has said that they will go bankrupt if they can't train their AI on copyrighted material for free.

It's largely a tech without a use case in this current form, and not every money pit turns into a success before the companies burning cash go bankrupt.

17
selfreply
awful.systems

it’s weird you pretend to be an anti-corporate leftist but when convenient post shit like:

All of the top tech companies now were once spending cash faster than they could make it, and all the naysayers saying they’d never be profitable.

“the only thing I hate more than neolibs and Peter thiel is when a bunch of thiel’s friends get credibly accused of running a massive grift” haha sure

14

The old guard is already so rabidly anti-AI, it’s bonkers. But the level of denial here is astounding. Y’all are calling it ‘the end of AI’ every other week for years. Now we’re pointing to standard tech start-up financing issues as the nail in the coffin? Come on.

And yeah, I am a leftist. I think the companies should nationalized for public control.

0
froztbytereply
awful.systems

you may in fact want to understand how much the ZIRP years had a hand in this, and then to also look just how many of those that remain (of which there continue to be fewer and fewer) are having to engage in Creative Accounting to make it seem like everything is fine

maybe try to learn from the past.

12

Zero interest rate period, when the taps of investor money were wide open and spraying at full volume because literally any investment promising some sort of return was a better proposition than having your assets slowly diminished by e.g. inflation in the usually safe investment vehicles.

Or something to that effect, I am not an economist.

11
V0ldekreply
awful.systems

Don’t y’all get tired of being wrong sometimes? Maybe try to learn from the past.

Fondly remembering all the times we were wrong. Ah, remember that one time we were totally wrong about the metaverse not being the future? Oh, oh, or the classic "cryptocurrencies are just a scam" talk we had to walk back so many times. Damn, good thing we didn't call out WeWork for being a money sink or we'd be looking pretty fucking stupid now!

11
lemm.ee

Crypto is actually really useful for buying drugs and other illegal products and services. People have legitimately made a lot of money as well if they weren't falling for the stupid scams. You should see the price of BitCoin or Ethereum these days.

Not saying it's ethical to run a lot of these given their limited usefulness and very high costs. But saying they didn't make people money, were all scams, or didn't have a use is objectively wrong.

-4
awful.systems

That's some wildly disingenuous goal post moving when describing what was meant to be The Future of Finance™ at the time.

Like saying yeh, AGI was a pipedream and there's no disruption of technical professions to be seen anywhere, but you can't deny LLMs made it way easier for bad actors to actively fuck with elections, and the people posting autogenerated youtube slop 5.000 times a day sure did make some legitimate ad money.

14
selfreply
awful.systems

That’s some wildly disingenuous goal post moving

check their recent post history. it’s all old school, Ayn Rand, bro you don’t even watch Bullshit?, internet libertarian takes and it’s fucking delicious, like eating a Big Mac straight from the time capsule where someone buried it

9

like eating a Big Mac straight from the time capsule where someone buried it

there’s some kind of new reality / competition show in this. I’m thinking mixture “you can’t eat that many burgers!” challenge shit, preservation/archivist commentators, and organic chemists and good dieticians as adjudicators

2

all of actual large scale uses of crypto as it stands today are money laundering, sanctions evasion by nk, iran and russia, securities frauds and other financial crimes from hundred years ago repackaged in cyberpunk wrapper, and a couple of other ways to scam cryptobros

10

Tech companies are not profitable now? Are you saying they’re giving fraudulent info in their earnings calls?

1