Should you try to minimize token usage when using AI in an organization? I don't think most organizations should take that advice literally.

Reddit r/AI_Agents News

Summary

The article argues that organizations should not prematurely restrict AI token usage for efficiency, as extensive trial and error is necessary to build deep AI expertise and long-term competitive advantage, citing examples like Uber and Amazon.

Recently, companies like Uber and Amazon have been moving to curb AI token usage by their employees, citing excessive consumption. Amazon, in particular, stopped using AI token usage per employee as a KPI for performance evaluations. At first glance, such news might lead one to believe that the correct approach is to focus on using AI in ways that directly lead to results while keeping token usage in check. However, the reality is likely that they have already finished testing a wide variety of AI use cases. While it may be a case of "oops, we spent more than we expected" or simply a shift toward efficiency, they undoubtedly have far more experience and expertise in utilizing AI than companies that haven't used it much at all. If you take that news at face value and adopt a stance of limiting token usage or only using AI for tasks that yield immediate results before you've even mastered the technology, you end up narrowing the scope for trial and error in a field with so much potential. If you do that, I think you'll find that all your company can do is minor efficiency improvements—the kind of trivial task automation that doesn't even qualify as an AI agent; frankly, it’s just RPA. I believe the gap between companies that limit themselves to such low-level AI usage and companies that, despite having overspent on AI costs for a time, have accumulated deep AI experience both individually and organizationally through extensive trial and error, will become impossible to close. I am currently almost entirely committed to developing my own company's products, but I occasionally receive consultations from various companies regarding AI implementation. Many people try to skip the trial-and-error process by chasing results from the very beginning. Because of this, I often find myself giving advice to people who feel like things aren't going well. Have you ever seen anyone around you succeed by trying to push forward an AI project and get immediate results without going through the process of trial and error? Do such people even exist?
Original Article

Similar Articles

Is your AI strategy burning capital or building it?

Reddit r/artificial

The article critiques the current AI mania in enterprises, where skyrocketing costs often outweigh ROI due to inefficient usage like token maxing. It advocates for a dual focus on organizational fluency and algorithmic cost mitigation, such as Observation Masking, to transform AI from a capital burner into a value creator.

At what point does AI token usage become a business problem?

Reddit r/AI_Agents

The article highlights the underappreciated challenge of AI token usage economics at scale, discussing how costs become a governance issue as organizations move from proofs of concept to enterprise-wide deployment. It poses questions about cost visibility, monitoring, and balancing performance with cost.

Every AI prompt costs money — and that changes everything

Reddit r/AI_Agents

The article argues that the real challenge in AI isn't just building smarter models but making them cost-efficient at scale, highlighting the importance of reducing token usage, improving speed, and optimizing infrastructure.