Gergely Orosz · 1 min read · Gen AI Tools
The Pulse: AI token spending out of control – what’s next?
Read the original on newsletter.pragmaticengineer.com →
AI token spending across tech companies has surged in the past few months, pushing budgets and budgeting decisions to the forefront as teams adopt more AI agents. Vendors are struggling to keep up with demand and are selectively limiting access, prioritizing higher-spend enterprise users. The piece also notes morale concerns at Meta amid looming layoffs and an invasive employee tracking program.
Key Takeaways
- AI token spending has exploded in the past 2-3 months, impacting budgets at many tech companies.
- Vendors are starting to cap access for less-profitable individual users to serve higher-spend business customers (e.g., GitHub Copilot, Anthropic).
- OpenAI and Codex are noted as exceptions to the access restrictions described.
- The spending trend correlates with a shift toward business users whose AI budgets have increased dramatically (10x).
- Meta reports morale issues tied to looming layoffs and a new invasive tracking program for US employees.
Excerpt
Hello from Florida – today and tomorrow, I’m at React Miami. I’ve always wanted to attend this conference, and finally made it happen. If you’re around, say hi! (L-R): Myself, NeetCode founder, Navdeep Singh, & YouTuber & Twitch streamer, ThePrimeagen at React Miami Let’s get to today’s topics: New trend: token spend breaks budgets – what next? In the past 2-3 months, spending on AI agents has exploded at many tech companies, and the ramifications of this are starting to dawn on engineering leaders. We’ve sourced details from 15 companies, including the different ways they are coping with this realization.…