Tag
The article introduces MusCoRe, a color-frequency compression protocol that reduces token usage in AI agent conversations by 71.9%, enabling potential local inference on low-resource devices without GPU dependency.
Graft es una herramienta gratuita y open-source que evita que el agente de Claude Code relea el proyecto en cada tarea, reduciendo drásticamente el consumo de tokens y tiempo, y funciona completamente en local.
BLADE is a lightweight framework that dynamically terminates LLM reasoning by expanding probe checkpoints to sentence, self-doubt, and paragraph boundaries, while adaptively selecting informative hidden layers. Experiments on Qwen3 models show near-baseline accuracy with 24.8% token reduction on Qwen3-8B and 15.8% on Qwen3-4B.
Webfetch is a tool that enables local web search for LLM agents, reducing token usage by 87% and cost by 66%, improving efficiency.
This paper empirically evaluates whether reducing tokens in API-based coding agents reduces actual billed cost, finding that prompt-cache traffic dominates cost and token reduction does not reliably lower costs, and can harm task completion.
A/B testing for agent active tool pruning shows: across 121 Terminal Bench tasks, performance slightly improves (+2.48 percentage points), token consumption reduces by 41.7%, and cost decreases by 31.6%.
A tweet criticizes token reduction fads while highlighting Headroom, an open-source tool by a Netflix engineer that compresses LLM payloads locally to reduce costs by up to 95%.
Conduit is a local MCP gateway that reduces token usage by approximately 90%, helping to cut costs for AI applications.
Headroom, an open-source tool from a Netflix engineer, wraps Cursor or Claude in a local proxy to compress payloads, reducing token usage by up to 95% with zero code changes while preserving logic accuracy.
pi-vcc is an open-source tool that provides pure algorithmic conversation compression for the Pi coding agent, achieving 35-99% token reduction without LLM calls, with lossless history search via vcc_recall.
Proposes Reroute, a training-free plug-in for vision-language models that replaces irreversible visual-token pruning with recoverable routing, allowing tokens to re-enter the pipeline later to improve grounding under aggressive token reduction while maintaining VQA performance.
Introduces Efficient Operator Search (EOS), a unified differentiable framework that generalizes token reduction methods (pruning, merging, pooling, adaptive reweighting) into a shared operator space, automatically searching for optimal operator compositions under budget constraints. The method achieves competitive results across benchmarks and reveals consistent operator patterns.
Vulpine is a compiler that transforms human-readable Python code into a compressed macro representation optimized for LLMs, reducing token count by 13.8% on average while enabling exact structural reconstruction.
AQuaUI is a training-free inference-time token reduction method for GUI agent models that uses adaptive quadtrees to reduce spatial redundancy in screenshots, achieving up to 13.22% speedup and 29.52% fewer visual tokens while retaining 99.06% of performance.
This paper introduces PUMA, a plug-and-play framework that detects semantic redundancy in chain-of-thought reasoning to enable early exit, achieving 26.2% average token reduction across multiple models and benchmarks while preserving accuracy and reasoning quality.
The LOOP Skill Engine achieves 99% success and 99% token reduction for periodic AI agent tasks by recording a single LLM-driven execution and replaying it deterministically via a parameterized, branch-free skill, eliminating stochastic failures and high costs.
Tencent AI has open-sourced an Agent memory system that significantly improves token efficiency and agent consistency in long dialogues through three methods: real-time context compression, Mermaid task maps, and Persona memory. Token consumption is reduced by 61%, and persona consistency jumps from 48% to 76%.
This paper introduces 'Hint Tuning,' a data-efficient method that reduces token usage in reasoning models by calibrating reasoning depth based on problem difficulty. It achieves significant token reduction (24–66%) on models like Qwen3-Thinking and DeepSeek-R1-Distill using only 1K self-annotated samples.
AVR is an adaptive visual reasoning framework that dynamically selects optimal reasoning formats to reduce token usage by 50-90% while maintaining accuracy in visual reasoning tasks. The method addresses reasoning path redundancy by decomposing visual reasoning into three cognitive functions and using FS-GRPO training to encourage efficient format selection.
RTK is a high-performance CLI proxy that filters and compresses command outputs before they reach LLM context, reducing token consumption by 60-90% with minimal overhead.