Tag
Nader Dabit shares career advice on thriving in the AI era: specializations are collapsing, token costs make experimentation nearly free, and cloud agents will scale massively, urging builders to embrace 10x workflows and avoid producing 'slop'.
DeepSeek released DeepGEMM, an open-source GPU math engine used to train and run its own models, claiming up to 98% token cost savings by squeezing more tokens per second out of existing GPUs.
作者通过为多智能体系统添加项目级共享记忆层，使编排器读取状态摘要而非每次重放完整历史，token 支出从约 580 美元/月降至约 260 美元/月，并消除了多个工作智能体重复劳动的问题。
The paper introduces Meta-Harness, a system that frames LLM harness design as a multi-objective search over accuracy, safety, and token cost, achieving superior performance with an agentic proposer using full filesystem access.
This article explains the cost factors for tasks on Opus 5.5, detailing how turns, cache reads, output tokens, and model selection influence token expenses.
Sam Altman discusses significant improvements in GPT-6 models, emphasizing enhanced capabilities and lower per-task pricing compared to previous versions.
The article argues that while AI is paid for by tokens, tokens are not the true unit of inference because efficiency improves with model advancements, suggesting a new unit based on problem-solving chains.
This paper introduces a token-cost ledger to analyze the multilingual tokenization tax, decomposing it into removable and intrinsic components, showing that much excess token cost for non-English text is removable through improved tokenization codes.
A developer shares an experiment with an AI agent-based automation platform that builds and manages deterministic workflows, seeking feedback from the community.
The post critiques auto-routing companies in AI, emphasizing that frequent model switching invalidates prompt caches, resulting in higher token costs and inefficiencies.
The article analyzes token cost breakdown in Claude Code deployments, revealing that only 14% of input tokens are user prompts, with the rest being configuration and context, and offers insights to reduce bills by 20-40%.
The article clarifies the differences between AGENTS.md, SKILL.md, and related files in AI agent development, emphasizing their roles in cost efficiency and context management to prevent drift.
A developer shares how they cut DeepSeek API costs by roughly 90% through prefix caching optimizations, reducing browser agent task costs below $0.005 and enabling a free, ads-supported browser agent.
Unused tools in an AI agent's toolset still consume tokens and add noise to tool selection, so agents should load only the tools required for the current task.
An experiment testing whether a coding CLI actually reads AGENTS.md found the file was silently ignored, and even when read, bloated instruction files increased token costs and failed to improve performance. The author recommends writing only what the model cannot infer from code.
A developer benchmarks 13 search API configurations inside an AI agent, revealing that hidden token costs from reading payloads can dominate the total bill and vary by up to 67x across providers.
A tweet points out that most Claude Code token costs come from re-reading the entire codebase on each edit, and highlights a new category of tools that use codebase mapping, context pruning, and project memory to drastically cut token usage, with a list of 10 tools in the linked article.
A paper finds that self-reflection loops like Self-Refine and Reflexion do not beat repeated sampling at equal token cost across open models from 1.5B to 7B, with all 18 self-inspection comparisons negative.
Someone has open-sourced the Codex infinite ammo method, using Sol for planning and Luna Max for execution, saving about 59% of token costs on simple tasks and 65% on complex tasks.
The author discusses the problem of AI agents getting stuck in tool loops and proposes building 'Moven AI', an open-source SDK that acts as a circuit breaker to abort runaway agents before they incur excessive costs.