After talking to 20+ teams running LLMs in production, 3 pain points kept coming up independently

Reddit r/AI_Agents News

Summary

Based on conversations with over 20 teams, the author identifies three recurring pain points when using LLMs in production: enterprise-only basics, lack of agent observability, and slow support for new models.

After posting in several subreddits and talking to teams using OpenAI/Anthropic/Gemini in production, a few pain points kept coming up independently: **1. "Basics shouldn't be Enterprise-only"** Usage alerts, team permissions, cost visibility, data export — all locked behind expensive enterprise plans. Teams of 5–50 people are stuck paying for features they don't need just to get the basics. **2. The agent observability gap** Most gateways treat agent calls like regular API calls. But when one task triggers dozens of recursive calls across multiple models, you can't trace what happened or attribute cost to a specific workflow. You just get a bill. **3. New model support lag** Every time a new model drops, there's a waiting game. Days or weeks before you can use it through your gateway. In 2025, that's too slow. The fix isn't another full-featured gateway. It's a lightweight layer that solves these three things without Enterprise pricing — fast model support via transparent proxy, workflow-level cost visibility, and team controls that don't require an IT department. I'm actually building something in this direction — dropped a link in this week's project display thread if you're curious. **What am I missing? Anything you'd add to this list?**
Original Article

Similar Articles

What breaks the most when you call LLM APIs in production?

Reddit r/openclaw

A discussion of common errors when calling LLM APIs in production, including rate limits, format mismatches, malformed responses, context overflow, model deprecation, and silent failures, with statistics from Datadog and a cited paper.

Effective use-cases for LLMs

Lobsters Hottest

This article shares practical, real-world use cases for LLMs in software engineering, including searching through customer conversations via RAG, triaging API failures from logs, and shortening content. It emphasizes efficiency gains and reducing manual sifting.

Local LLM Peeps

Reddit r/LocalLLaMA

A developer with 45 years of experience is building a local-first harness for LLMs with multi-agent logic, soon to be open-sourced on GitHub, and asks the community what features would improve their local LLM experience.