Comment on
The Tokenpocalypse Is Here: Companies Are Scrambling To Stop Spending So Much on AI | Leaked audio from Accenture says a big source of AI token ‘chewing’ is people just converting PDFs to presentatio…
If you just throw every task at it, I can completely imagine that it'll cost you more than any gain in efficiency. To some degree I think this is true of some coding tasks (not all, most are pretty efficient pattern matches, and that's what it does well).
But using LLMs to build tools and pipelines that stand alone (no AU built into it) and enable human productivity seems like a far higher leverage use.
The programming version is building the libraries and abstractions that are robust and well tested, so that regular developers can quickly build and refine the features.
Or building the reporting dashboard. Or whatever.
The cost is only going to go up, and the companies that lock in some non-AI process improvements before the hike will likely be smiling