Tag
A tweet speculates that once GPT-5.6 Sol becomes available, OpenAI could outperform Anthropic by offering similar or better intelligence at lower cost, shifting competition to economics.
A position paper by Subbarao Kambhampati and researchers at Arizona State University argues that chain-of-thought reasoning in LLMs creates an illusion of reasoning, and the industry needs to move beyond costly token generation to alternative reasoning mechanisms.
The article argues that enterprises should post-train their own custom AI models for mission-critical, high-volume use cases to achieve differentiation, cost savings, and control over tradeoffs, rather than relying solely on general frontier models.
TokenPilot is a dual-granularity context management framework that reduces inference costs in long-horizon LLM sessions by stabilizing prompt prefixes and conservatively managing context segments, achieving 61-87% cost reduction on benchmarks while maintaining competitive performance.
A technical walkthrough that shows how to estimate the cost of serving AI models at scale using simple napkin math, covering GPU bandwidth, matrix multiplication, token pricing, and user capacity.
A developer shares their experience with AI inference costs after switching from subsidized OpenAI Codex to OpenRouter, prompting a discussion about the sustainability of current LLM pricing models and the potential shift towards open-source self-hosting.
This paper proposes training Behavior Forecasters to predict large reasoning model outputs from single trajectories, outperforming large language models like GPT-5.4 and Claude Opus-4.6 at lower computational cost, bypassing traditional explainability methods.
A guide explaining how to make agentic workflows up to 462x cheaper by compiling fixed procedures into smaller fine-tuned models instead of repeatedly prompting frontier models.
This paper demonstrates that agentic workflows can be distilled into small fine-tuned models, achieving near-frontier quality while reducing inference cost by two orders of magnitude compared to orchestration approaches.
Empirical study on four 30B-class dense and MoE models showing Gemma-4 26B MoE delivers equal accuracy at 1.9–15 Wh while dense and larger MoE variants consume up to 34 Wh for the same reasoning tasks.