FRESH

Hacker News

Companies are scrambling to curtail soaring AI costs

43 points by nlpnerd

by gslin

0 subcomment

by andy99

2 subcomments

In some sense, devs are now responsible for a P&L the way a business manager would be, but I suspect that nobody is paying enough attention to the P part of it. When you incentivize people to spend as much money as possible but don’t hold them accountable properly for what they actually produce, this is what happens.

by bardown59

0 subcomment

Yeah, and how we build—and what we surface operationally—matters as well.
I run several AI-based products, and I’ve moved almost entirely to agentic coding, so this is a huge concern for me. One thing that has helped in the coding realm is separating planning from execution: I use a stronger, more expensive model for architecture, research, and difficult decisions, then hand the implementation work to cheaper agents where the task is more constrained.
On the product side, I treat token usage and costs like any other production resource. We record usage by request, user, feature, and model, surface it in admin dashboards, and set budgets and hard cutoffs.
Alerts are useful, but automatic limits matter more—especially as a small business guy so a 2 AM loop doesn't bankrupt me :)

by 8cvor6j844qw_d6

2 subcomments

For those that recently switched from Claude, does Codex gives you more usage than Claude Code on the highest personal plan?
I frequently max out my weekly usage, and given this [1], hopefully Codex might give me more milage.
[1]: https://news.ycombinator.com/item?id=48126429

by jstummbillig

3 subcomments

I suspect this will turn out to be a super overblown issue: AI spend is literally the easiest spend to regulate in the entirety of businesses. No machinery is grinding to a halt over it, no asset that had to be bought and is now useless. You don't even have to employ or fire staff to give it a go (of course, you can still do both for other reasons). There are a lot of options that you can try out and substitute for each other, as new stuff comes up, because most things are compatible.
Sure, if you start at this point, where a good chunk of employees, who never had that ability, can now spend a lot of money at their discretion, that's probably going to be costly at first. Then people will learn from that and set direction adn guardrails.

by noosphr

2 subcomments

If I may suggest people move away from harasses and start using Emacs. Gptel is amazing and the rest of Emacs plays incredibly well with llm development. Since the human is always in the loop token costs are also tiny compared to anything else.

by flipbrad

0 subcomment

How long until this is handled like human hiring (business case, budget, performance reviews, layoffs)?

by motza

3 subcomments

I work at a very big company and I have unlimited access to Codex with no visibility on token usage. I don't know if this is the norm but seems kind of crazy to everyone in my team

by nlpnerd

0 subcomment

I think a lot of ppl assume that usage here is simply for AI coding, which is easily governed. I suspect that the more tricky issue are those usage powering workflows and application logic that cannot be easily throttled down.

by ChrisArchitect

0 subcomment

Story from June OP;
Discussion then: https://news.ycombinator.com/item?id=48602571