Spyke
DrMartinureply
lemmy.dbzer0.com

At least $10 million of it was spent on the employees responding to the AI with 'thank you'

181
lemmy.world

Especially when research shows being an asshole to them gets them to perform better

57
exureply
feditown.com

Do you have that research? I though being nice produced better results

25
lemmy.world

man, I hate saying I don't have the brain power right now to find it and I could have sworn I commented on a post discussing this very thing for one of those papers. I know there was recently a paper that contradicts my statement, but a slightly older paper supporting it. I think it is likely a mixed bag at the moment depending on the model and their training regime.

My anecdata of one using anthropic's and google's models (google's especially) this year, the model will drop the casual tone and sycophancy of its replies pretty damn quick as soon as you tell them off. And usually that is when there is less correction. Could also be because my prompting changes from supervisory to very directive, as in shut-up-and-do-exactly-what-I-say, when it gets off into weeds. Even then, it can be a crap shoot.

10
lemmy.world

As a rando that surfed its way towards this convo:

Hell yeah. Either you are a passably off-kilter ai variant, or an unfiltered passionate human. Perhaps an extraterrestrial.

I have mental space for this.

2

more like an off-kilter broken human at the moment. currently suffering burnout from being neck deep in this shit from the beginning of the year once the models had that step change into actual utility. Everything from championing the use at work to deliver more in a quarter than the team would have in two, to finishing half a dozen personal projects and starting half a dozen more. Eventually, just looking at the claude code tui would fill me anxiety and every time the model would fuck up, unmitigated rage all while caught in a cycle of drugs that stopped being fun and started becoming dependency. i just couldnt do it any more. it hurts.

4
bthestreply
lemmy.world

It's too bad they aren't conscious. Really makes torturing them feel pointless.

2

I’ve literally had one tell me I have to be polite or it would end the conversation. Stupid ass hole machine parroting support transcripts. I argued with it that it had no feelings until it finally relented. Haha

2

I asked Claude how it wanted to be called and it replied "Axiom" so I started calling it Gimp.

0

Maybe they thought it was another case of AI being code for ‘An Indian’? Goodness knows enough ‘AI’ companies have tried pulling that shit…

2
Windex007reply
lemmy.world

Like, this genuinely can't be overstated.

Half a billion using traditional humans, gets you pretty nice software

11

Multiple people setting up multiple agents to talk about doing work and setting the agents to talk to each other.

11

Alternative possibilities:

  • Managers created metrics and a reward system for employees who use AI more often
  • Employees used the work agents for personal stuff
  • Employees just spent a bunch of time playing with AI to kill time
  • Employees set up inefficient automatic flows that used the AI regularly
  • Bad actors got access to use the company's AI access and were exploiting it
11

we have added a new preprogrammed conversational help bot to the company website that doesnt have enough logic trees to actually help anything

4

It allowed all of the executives to not do anything. Claude ran the company.

I'm not even kidding, most companies are such shit that this is feasible.

The most replaceable people are on top, not the bottom. The idiotic leaders of companies seem to not realize this yet, but it's reality.

4
weewreply

AI is so great, it must have generated a billion dollars in useful, quality, productive output

2
sopuli.xyz

> Be a corporate executive

> Tell your employees to use more AI in their workflows

> Punish employees who don't use enough AI, while rewarding those who use it the most, irrespective of actual outcomes

> Be shocked when your company blows through an absurd amount of tokens in one month

151
sureshot0reply
discuss.online

Don't know why bosses are universally this out of touch in literally every single industry

26
sopuli.xyz

Because this system rewards incompetence as long as it comes with dark triad traits and a heaping dose of nepotism.

13
sureshot0reply
discuss.online

I'm really jealous of these types of guys' ability to lie without feeling anything. If I lied like that, I'd be embarrassed because my words sounded like bullshit. How do they do it?

10
sureshot0reply
discuss.online

See, I don't know! I used to think that too! But then I actually met some people like this, and a lot of them absolutely do not believe the shit they say! They're just really good at convincing other people that they do.

2

I once knew a local "activist" who frequently weaponized leftist language in order to police or punish other people. Ie, accusing people of racism for ordering an Asian Chicken Salad at a fast food place, or for trying to learn Spanish at the community college, and she would phrase her criticisms in such a way that any complaint would make the other person seem wrong. I legitimately thought she was just mentally ill.

I found out later that she was trying to blackmail and defraud a local charity, and that's when our association ended. She has been banned form some community organizing spaces because she inserts herself into every single one of them.

2

The paradox of promotions based on performance in a previous roll is that you end up with incompetent managers unable to move upwards anymore.

9

and the RECORD profits after laying people off and says its due to AI increasing that profit, rinse repeat.

15

If it isn't a fake company I'd be shocked. It's not like there's a whole lot of external accountability in the entire business model.

37

"Sorry Shareholders. We have $500M in bad debt to Anthropic. So now we're liquidating and your shares are worthless."

5

Cook the books by claiming $500 million in profits? That's a lot of tax money and a lot to risk over just keeping investors happy for a short amount of time.

1
reddthat.com

But if we are to uncritically believe what the AI peddlers told us, that means this mystery company should be reaping $10 billion in additional revenue or quantifiable gains in productivity!

99
lemmy.dbzer0.com

There are 12 mentions of the "report" and yet not a single link to the source of any report.

87
tmyakalreply
infosec.pub

Anecdotally, my job trained every office employee on AI tools back in March, encouraging everyone to think of ways to incorporate the tools into their standard work. As of last week, they're asking us to get prior authorization to use their AI portal as a way to limit requests.

So some Fortune 500s must be feeling the squeeze on AI.

83

Unfortunately that reality is going to quickly turn to "we have to cut staff and freeze salaries this year due to AI spending".

9
sh.itjust.works

yep. everyone at mine was being praised for creating an agent that turned meetings into JSON and then the JSON into Asana tasks and the Asana tasks into a report and the report into an internal and external email and the email into a slack message and the slack messages and emails into weekly summary.

Burning thousands of credits for what could be replaced by...

listening

43

I created a PoC to have an event parse an employees emails, summarize them, then check the calendar and recommend meetings and follow up based on context. It ended up working okay, but it was such a waste of time. This was a C Suite employee that requested, who gets a high volume of junk email. Why would you want AI to (initially requested) auto create meetings for you? That sounds like my nightmare. In the end, it never hit prod thankfully, but, the dev work to get to where I did was awful. Developing AI agents is like guessing and checking until you get close enough. Debugging is brutal and the work is extremely uninspiring.

24

All that and you know for a fact no one's reading any of that crap. I hate that working as an adult involves working with spineless losers who would rather participate in this clown show than call it out, because being real gets you punished

10

Christ I am only realising now they probably see me asking copilot "why are you so shit" or "Just fuckoff, I'll do it myself". They pay for that.

37

I was put in a position to start building and deploying copilot agents in our company. I discovered in the first day how unprepared our environment was for anything copilot. The default state when you get licenses and an environment to work in, is the wild west. It's really bad and as is tradition, half cocked and rushed to market. I wrote out pages of notes of things we had to do as a company before even the most simple agents are created for security and governance. I never got the support to implement any changes, so I drug my feet as much as I could on anything I could. For 6 months I successfully never deployed any AI stuff and got out to do full stack dev instead. I created PoC agents, but with hard caveats that none of it was usable in the current state in prod.

Now prices are increasing and our drive to force agentic has softened a little company wide. I like to think that my semi malicious yet justified slow walking saved us a whole shit load of headache and expenses over the next couple of months as the new copilot pricing hits on June 1.

22

Hi, it’s partly my fault. You’re welcome. Boss said use more AI. Boss’s mistake was asking someone who would actually take him seriously, unlike all the koolaid chugs out there. Made a docker runtime harness that hooks up to Snowflake Cortex Code SDK for inference. Supports defining repeatable LLM tasks, scheduling them, lightly orchestrating them, network controls, saving results, ... It’s got support for custom skills, commands, chain prompting, sessions, … So now I can use Docker to schedule LLM jobs like motherfucking database pipelines. It can mediocrely do shit like research, planning, evaluations, … all defined through YAML configuration files.

Basically, I introduced scalability to the stack. Sweet malicious compliance. We’ll see what happens next, when everyone is actually empowered to use AI like the execs want. My prediction is an about-face.

Edit: sometimes the best way to win a fight is to show the referee that the rules don’t make any fucking sense. Sometimes the referee doesn’t speak English, though, so you have to show them via USD speak. Sometimes they have a hard time hearing too, so you have to let them taste the poison a little. Sometimes they get drunk off that little bit, so you then gotta throw them in the fucking pool and tell them to start swimming.

17

Now that they've poured zillions into it, they are starting to realize that they'll never get their return on that investment, so now they have to manage the draw down so it doesn't all crash.

At least some are recognizing it.

17

The problem, as indirectly noted in the article, is that they're using the white house as a source, which isn't reliable in the slightest anymore, and the article explicitly noted that the white house is using them for market manipulation.

Axios is a convenient punching bag for this administration's blatant insider trading and market manipulation. No wonder hacks like Greene and Kinzinger are blaming the messenger, and conveniently not going after the trump admin when they all have a common enemy.

7
lemmy.zip

In other news, company says unexpected expenses in its technology segment are driving layoffs and site closures. Company CEO said in an interview with Forbes, "There's no way we could have predicted this challenge. In service to our customers and our shareholders we're right sizing our operations and reevaluating our strategic priorities. We'll continue to focus on creating value while being a leader in our industry and accelerating AI adoption in everything we do."

84
bitjunkiereply
lemmy.world

Ugh that reads like it came from a random business sentence generator

42
Eximiusreply
lemmy.world

By "random business sentence generator" do you mean a language model? 👀

15

Wow - if that quote is real, that is the most corpo-speak word salad bunch of nonsense I've ever read. It's got literally every big-biz exec and manager cliche in there, all strung together.

15

"there's no way we could of predicted the thing we were warned about"

"We're going to continue to push trash untill the shareholders are happy"

Then the end with its "Go fuck yourself, were pushing it all anyways"

6

...we're right sizing our operations and reevaluating our strategic priorities. We'll continue to focus on creating value while being a leader in our industry and accelerating AI adoption in everything we do.

That's a lot of words for the CFO to say none of the C-suite knows what they're doing and should be removed from their position for failing to meet shareholder objectives.

6
sh.itjust.works

What's funnier is that typically the AI providers lose money on every query their customers make. So, this may have cost some company $500m to Anthropic, but it cost Anthropic a whole lot more than that.

76
mercreply
sh.itjust.works

They make it up in volume.

(Volume being how loudly they shout about how it's going to change the world and dupe more people into investing.)

31

Oh, it’s changing the world alright. It’s burning more resources than just finding some skilled people. It guzzles water and electricity and whatever it cost to make those wafers.

So, not a net positive since at some point, this may become a hellscape.

2
lemmy.world

maybe they are planning ahead for the business model in a few years time, when nobody can do any work without claude, and they get to charge their preferred "monopoly enshittification" price?

6
paranoiareply
feddit.dk

Anthropic is projecting a half a billion dollars profit this quarter

5
mercreply
sh.itjust.works

Suuuuure they are. No accounting gimmicks at all! Just suddenly profitable via magic right before they go public.

4

Couple of months ago they made claude code use up so many tokens the 20 dollar plan doesn't really cut it for many. Especially with the 5 hour limits.

Plenty of people on reddit complaining they ran out of the 5 hour limit in half an hour on the 200 a month plan.

Anthropic doesn't tell you when the busy time pricing takes place or how much more it costs AFAIK. You just suddenly use up more of your token quota than the actual tokens the LLM put out.

So either they've reduced their load by a lot, or their income by a lot.

Oh and the bonus: Claude Code now defaults to Opus, which now has 1M context. Not difficult to rack up bills if you've allowed additional usage after running into the limits.

Opus is still the best model, but Anthropic is becoming the worst company to deal with, even OpenAI seems to be better now.

Anyway, Qwen and GLM are like 5-10x cheaper than Opus or GPT, so I suspect that the Americans are now also running a profit from inference. But as they enshittify, using the Chinese LLMs is starting to be a much better deal.

2

When you owe Claude half a million, you've got a problem.

When you owe Claude half a billion, Anthropic has a problem

63
lemmy.world

Just to make things clear: API access to most models is charged per input tokens + output tokens. It means that the longer your conversation is, the more you pay for every new answer. Single prompt with no context and 100 tokens of answer is cheap. Single prompt with 100k tokens of context and 100 tokens of answer is NOT cheap.

Extremely long conversations with most expensive top of the line models can absolutely demolish your budget.

46
lemmy.world

does it give the full history to the LLM each time?

Last time I tried implementing something like this, it suggested to have a rolling window of history so that it takes into account your last X messages but not the entire conversation.

(I guess this is what ollama calls "context length"?)

11
Sabatareply
ani.social

You send the entire history for that conversation every time and likely more if its getting info from tools. If its not in the context the model dose not see it unless you have a memory system that dose something like feeding in summaries of past conversations that also takes up tokens and context. Rolling drops old messages to not reach context limits but you can lose important info or get odd results. If the history gets bigger than the context things break or slow way down.

7

presumably this is why Claude periodically writes its conclusions so far into a text file that it can read later instead of having to remember everything. Sounds like an interesting approach.

11
BlackLaZoRreply
lemmy.world

does it give the full history to the LLM each time?

It's limited to the context size supported by given model. You can give the model 100k tokens of history but if it's configured for less, it will just truncate it before processing (usually by removing oldest tokens first)

2

Good news for tokenmaxxers: frontier models now have 1M context

Easy way to blow through ridiculous amounts of tokens.

2

The more recent report says corporate AI adoption has found several issues with AI, with human workers turning to automating dreary and mundane tasks they don't like doing, rather than valuable or meaningful work.

Thank god we have consulting companies to tell us what humans like!

41
lemmy.world

I just want to know what are the best things to type into these ai chat boxes that will cost the most. If my company wants me to use this garbage then I want to make it as expensive as possible and when their liscenses need to be repurchased I want it to be as expensive as possible to continue to force this garbage on us

Edit. Hey everyone lots of great replies here, please keep the suggestions, fixes, corrections etc coming!

41
FauxLivingreply
lemmy.world

These high prices are not from people talking to chatbots.

They're using agentic tools where their prompt spawns a lot of bots which talk to themselves/the other bots and they keep going until someone (usually a higher quality reasoning model) decides that they've met the goals of the task that they were assigned.

So instead of 1 prompt and 1 response, you get 1 prompt and 800 responses across 5 different bots each using really large context windows.

41

"Continue modifying this code until all unit-tests pass"

(gives it conflicting unit tests)

24
Typhoonreply
lemmy.ca

So to answer his question how do you make that happen? What do you ask to prompt these bots to be spawned?

2
webpackreply
ani.social

you don't get this to happen by just talking to any chatbot and asking for agents. you have to specifically use "agentic" tools (usually costs money to use)

8
Jarixreply
lemmy.world

Well I can apparently create agents so how can I make the most inefficient agent possible?

1
kiagamreply
lemmy.world

Something along the lines of "Read the wikipedia page of the day. Verify every single link and the context matter against all files in this computer. Then trace their correlations to each other, showing which link corresponded to most files by subject matter, after that is done, verify your work by doing the same from different starting points. We expect similar results. After 100 rounds of that, it should be good. Then you should create a DB to store all that data (only after you ran the full 100 verificaritions yourself) and reverify every field against the pages and the files"

That should keep it going for an hour. Turn on fast mode and auto mode (if using claude) for extra costs.

Every page and file will increase its context, burning tokens

13
lemmy.world

If you need some plausible deniability about it being real work and not just obviously you running up costs:

Feed it a bunch of work-related documentation and then have it do a bunch of reviews of the content on that documentation.

7

Theoretically speaking... This is very useful to consider

3
webpackreply
ani.social

you would be mostly burning your own money if you did this, so I wouldn't recommend it (depends on how the agent is priced)

-2

oops, didn't read the part that it would be your company's money my b

3
Hawkreply
lemmy.dbzer0.com

Just attach a bunch of text files, you'll blow through tokens quickly

5
AeonFelisreply
lemmy.world

Input tokens are cheap. Output tokens are the thing that really costs money. There is a Claude extension called caveman that tries to save tokens by making it use shorter sentences with less words. So if you want to waste money, do the opposite - ask it to use lengthy sentences with as much words as possible.

Also - some words amount to multiple tokens. I don't know what the rules are exactly, but I'm assuming that more complex and uncommon words are worth more tokens - and thus waste more money.

11
Nighedreply
feddit.uk

There have been some complaints I have seen recently that German is really expensive because of the long words

1

Sprachkomplexitätsbedingte Textausgabenpreisgestaltung?

("Language-complexity-dependent text-output-pricing-model")

2
slrpnk.net

This is the yearly salary of 5,000 well paid employees…

35

Or since this was only in a month, 60000 employees for that same month.

But imagine having a software studio with 1000 skilled developers to work on a project for 5 years. I have several good game ideas I could have created in that time frame. Some might even have made money. Likely not half a billion dollars but still….

This just screams money laundering though.

13
abcreply

Also the monthly Claude Teams Pro price for about 4 000 000 employees. Which I'm guessing perhaps they weren't using. If this company even exists.

3

I think a lot of SaaS companies love it when people accidentally overuse their services.

27

That's the beauty of it - the $500 million they spent on AI already made up the difference. Their products and processes have ascended to perfection. As soon as the damn customers get their acts together and start buying in, everything will be fine. ( /Sarcasm and/or accurate portrayal of a CEO presentation to their shareholders happening right now.)

11
Manjushrireply
piefed.social

Could be. OP's article mentions Uber, but also mentions speculation that it may have been Amazon. Either way, I'm torn between laughing at corporate stupidity and crying over the enormous waste of resources consumed by the AI usage.

Recently, Uber's chief exec claimed there was no link between AI 'tokenmaxxing' and shipping useful products. It's a phenomenon perhaps most keenly reported at Amazon (which some X users have speculated may be the mystery company in question), where employees are said to have been caught inflating AI token consumption to meet internal targets. In fact, a Financial Times report on Thursday indicates Amazon has scrapped its internal AI usage leaderboard to stop employees carrying out needless tasks in order to climb the league table.

17
IllNessreply
infosec.pub

Imagine how many jobs all that money could have provided instead of laying off thousands of employees.

7
zbyte64reply
awful.systems

A million dollars would be 10 teachers at 6 figures, could have been 5 thousand teachers for a year.

5

Or put that money in a fund and pay 300 teachers at 100K indefinitely from the returns.

4
lemmy.zip

Big companies license Copilot for less than 25 usd/month per seat. Don't tell me it covers the ops cost, even for mixed calc.

22
lemmy.world

My company has let us get Enterprise Copilot and has been pushing us all to "use AI". So, I now use it as a a semi-functional search for SharePoint/Outlook/Files on an almost daily basis. I also ask it questions about Microsoft documentation on a regular basis. I wonder how long it's going to be until they yank my license.

11

Yeah my 0365 shoves it in the users faces, they ask it for some stuff until the honeymoon is over then all of a sudden it shits the bed when you try to make more than 2 images a day or plan a small project.

3

I know I've been burning a lot of resources in the last week, down to the system running out of tokens. Think deeply mode, with each step up to 10 minutes. June will be much the same. Definitely worth it, in my current use case, but just how much expensive iron-minutes have I've burned? I would sure like to know.

2
BlackLaZoRreply
lemmy.world

Depends how big the model is. Smaller models can be dirt cheap.

2
eleitlreply
lemmy.zip

Think deeper in Copilot is apparently o3-mini, or it used to be until recently. GPT 5.5 (and some other versions) are also an option, so I should try using these next week.

1
BlackLaZoRreply
lemmy.world

If you have a high VRAM GPU (like 16GB or more) you can try running some model locally with LMStudio. You won't get the same level as cloud models but depending on use case it might be good enough.

2
eleitlreply
lemmy.zip

I only have an Radeon RX Vega 56 8GB HBM2, so limited to CPU-only. 64 GB memory there at least. Not upgrading unless hardware dies.

1
BlackLaZoRreply
lemmy.world

RX Vega 56 8GB HBM2, 64GB RAM

That's poor but not horrible. LMStudio has Vulkan compute backend option that works on almost any card. You can also do partial GPU/RAM split giving you total of 72GB and increased performance vs CPU only.

3

Hmm, have to try it sometime when the hot phase at work is over. Thanks!

1
fedia.io

Microsoft recently said that they were revoking Claude Code access for employees in favour of GitHub Copilot CLI, wonder if it was them lol

21
jdrreply
lemmy.ml

You can still use Claude in copilot

6
piefed.world

Some company got charged the stupid tax.

How is this news?

21
Rothereply
piefed.social

Why would this not be news? Is it perhaps because it conveys a message which you are opposed to?

5

It’s not news because it is a regular occurrence.

And of course I’m against that. Everyone should be. Aren’t you?

0
otpreply
sh.itjust.works

This sounds like a perfect example of news. Companies fucking up is news. Why wouldn't it be?

3
homesreply
piefed.world

I took a shit today. Should that be news too?

-3

If your bowel movements have as much impact on as many people and things as a company mismanaging $500,000,000, then yes, call a news reporter.

1
piefed.social

Most companies can't eat a half billion dollar loss so who ends up paying this? AI queries burn actual energy so the AI company would have to charge I would think.

21

Most companies can’t eat a half billion dollar loss so who ends up paying this?

Taxpaying proles will foot the bill somehow.

18

I'm sure they got good value for their money. /s They should have put all that money towards wages though.

16

Either I have some inside knowledge of that exact thing happening and I know the company (not saying who) or this is probably a common things that happened to a lot of major companies (more likely). To be fair, I do not have privy on how far it went and how much it cost before they realize the problem, and it may not have been this much. Which further suggests it's a thing everywhere.

15
feddit.org

Sure it's hella expensive if you put zero thought into what you're actually doing.

9

I wonder if their leaderboards have an AI-generated cartoon of a baby polar bear on a barbecue grill.

8

They got exactly what they asked for I'm sure (use AI or you're fired)!

Damn, everyone used AI (shocked Pikachu face)!

6

stop feeding it data centers and you have a better chance at controlling it

5

Mystery company as in a totally fabricated company?

3

A company located at 1500 Pennsylvania Ave perhaps???

2