token-efficiency

Tag

Cards List
#token-efficiency

Batched Contextual Reinforcement II: Does RLVR Need Long Rollout Windows?

arXiv cs.LG ↗ · 2026-10-19 Cached

这篇论文提出 Concurrent Constraint Reinforcement (CCR),将多个可独立验证的问题打包进单个受上限的补全中,使 RLVR 在 8,000 token 短窗口下仍保留正确性信号,相比 32k 窗口的 GRPO 每步训练 token 成本降低约 80%。

0 favorites 0 likes
#token-efficiency

HotKV cut Claude token use by 70% in our Banking77 benchmark

Reddit r/AI_Agents ↗ · 2026-10-18

HotKV:一个用 C++20 从零编写的多线程、Redis 兼容的内存存储,内置面向 LLM 响应的语义缓存。在 Banking77 基准上对 Claude 系列模型测试显示,可将调用、Token 和成本减少约 70%,同时详细分析了语义缓存对答案质量的影响。

0 favorites 0 likes
#token-efficiency

DeepSeek V4.1 Flash 1017 token efficiency

Reddit r/LocalLLaMA ↗ · 2026-10-17

用户讨论 DeepSeek V4.1 Flash 的 token 效率表现,初步测试显示在高思考强度下 CoT 更短且质量更高,解决任务所需轮次更少,值得尝试。

0 favorites 0 likes
#token-efficiency

@laobaishare: This is some real gold. Anthropic just shared a super handy Claude Code trick. The idea: use Sonnet, Haiku, and Opus 5.5 together, each doing what it does best. Better results and way fewer tokens, because every task goes to the right model. …

X AI KOLs Timeline ↗ · 2026-10-16 Cached

Anthropic shared a multi-model collaboration trick for Claude Code: use Sonnet to host the session and write code, Haiku to search files in parallel, and Opus as an advisor for important decisions — improving results while saving tons of tokens.

0 favorites 0 likes
#token-efficiency

TRACER: Trajectory-Aware Tool Retrieval for LLM Agents

arXiv cs.CL ↗ · 2026-10-16 Cached

本文提出 Tracer,一种面向 LLM 智能体的轨迹感知工具检索前端,用 trie 索引历史工具调用序列并结合经验与上下文先验对下一步调用进行排序。在六个环境、四个模型上,它在 24 组对比中 21 组提升了工具选择准确率,同时每步输入 token 减少约 61%–80%。

0 favorites 0 likes
#token-efficiency

Dumping every MCP tool schema every turn is a harness bug

Reddit r/AI_Agents ↗ · 2026-10-15

文章讨论了在每个回合中把所有 MCP 工具 schema 塞进上下文是一种 harness 缺陷,会导致选错工具和 token 浪费;业界正在收敛到渐进式发现(progressive discovery)方案,如 Claude Code 的 MCP Tool Search 和 OpenAI 的延迟加载工具搜索,可减少 85% 以上的工具定义开销。

0 favorites 0 likes
#token-efficiency

@cline: Gemini 4 Argon had the best launch day user share of any frontier model on Cline since June. ~3x as many users tried it…

X AI KOLs Following ↗ · 2026-10-14 Cached

Cline 报告 Gemini 4 Argon 在发布当天创下自六月以来最佳的前沿模型用户份额,日首日试用量约为 Claude Opus 5.5 或 Sonnet 5.5 的三倍,且平均 token 消耗比 Claude 系列少约 30%。

0 favorites 0 likes
#token-efficiency

Tessera-27B-B-CJK, Zellige AIs new finetune of Qwen with novel approaches to how we think about token savings

Reddit r/LocalLLaMA ↗ · 2026-10-14

Zellige AI 发布 Tessera-27B-B-CJK,基于 Qwen3.8-27B 的编码智能体微调模型,通过压缩式 CJK 思维(混合中英文与符号的简写)将每轮思考 token 降至基座的 0.50-0.64 倍,同时保持输出为正常英文与代码,采用 Apache-2.0 开放权重。

0 favorites 0 likes
#token-efficiency

Gemini 4 Argon became Pokémon Champion using less than half the tokens Gemini 3.8 Flash spent earning 3 badges

Reddit r/singularity ↗ · 2026-10-14 Cached

Gemini Plays Pokémon开发者获得Gemini 4 Argon早期访问权限,用其通关《宝可梦蓝》仅耗时1,407回合(约25小时)并捕获了超梦,其token消耗不到Gemini 3.8 Flash打三个道馆徽章所用的一半。

0 favorites 0 likes
#token-efficiency

@rohanpaul_ai: Pulling a due date out of a 300-page PDF shouldn’t need a model that writes. Decision models now get a 1M-token window,…

X AI KOLs Following ↗ · 2026-10-13 Cached

ScaleDown 发布了三款小型 Constrained Decoding 模型(Classify、Extract、Summarize),支持 1M token 输入窗口和图像输入,通过单次 prefill 直接从输入中选取答案而非逐 token 生成,据称比前沿 LLM API 快 200 倍、便宜 467 倍。

0 favorites 0 likes
#token-efficiency

China just made AI memory startups sweat 💀 Tencent open-sourced Agent Memory and it runs 100% locally on SQLite

Reddit r/AI_Agents ↗ · 2026-10-13

腾讯开源了 Agent Memory,一个可 100% 本地基于 SQLite 运行的 AI 智能体长期记忆层,无需云端 API 或向量数据库,报告可减少约 61% token,PersonaMem 准确率从 48% 提升到 76%,且记忆可读可追溯。

0 favorites 0 likes
#token-efficiency

We thought people would build their agents on our platform. It turned out they wanted to build them their own way and just hand us the running.

Reddit r/AI_Agents ↗ · 2026-10-12

公司宣布其 Agent 平台 2.0 大幅简化:砍掉 pods、workflow、memory bank 和自研 SDK,改为兼容 OpenAI Agents API,支持任意模型(Claude、Gemini、开源权重、OpenRouter 或用户自带 key),并聚焦于故障恢复、精确成本日志和严格按用户指定模型运行。

0 favorites 0 likes
#token-efficiency

@NousResearch: Wild MISSINGNO. appeared! A coding and agentic reasoning model that is highly token efficient, free for a limited time …

X AI KOLs Timeline ↗ · 2026-10-10 Cached

Nous Research 发布了名为 MISSINGNO. 的编码与智能体推理模型,主打高 token 效率,并在 Nous Portal 上限时免费提供,可直接在 Hermes Agent 中使用。

0 favorites 0 likes
#token-efficiency

@mattpocockuk: Considering adding a recommendation to /retro to turn repeated tasks into custom tooling (i.e. a CLI + skill) Talking t…

X AI KOLs Timeline ↗ · 2026-10-10 Cached

Matt Pocock 考虑在 /retro 命令中加入建议,鼓励用户将重复任务转化为自定义工具(CLI + skill),让 agent 委派任务给脚本,从而减少 token 消耗和幻觉。

0 favorites 0 likes
#token-efficiency

we used a file index instead of a vector database for agent retrieval. here's the tradeoff.

Reddit r/AI_Agents ↗ · 2026-10-09

作者分享用 INDEX.md 文件索引替代向量数据库做 agent 文档检索的实践:由 summarizer 生成每行描述,doc-searcher 子代理挑选并读取文件,把中间读取隔离在子代理上下文中。作者指出这节省的是上下文而非总 token,小规模文档集可行,但上千文档时索引本身会变重。

0 favorites 0 likes
#token-efficiency

Agent-Controlled Forgetting for Tool-Using Agents: Reversible Context Curation in Practice

arXiv cs.AI ↗ · 2026-10-09 Cached

This paper introduces agent-controlled forgetting for tool-using agents, where the model replaces bulky tool observations with short recoverable notes, cutting prompt tokens by ~50% and API costs from ~$4.38 to ~$1.28–$1.44 in an exploratory debugging case, while highlighting workload-dependent tradeoffs such as more requests and longer runtime.

0 favorites 0 likes
#token-efficiency

@RealYDT: Stop blindly using flagship models as grunts to burn through context anymore—Anthropic just rolled out the most hardcor…

X AI KOLs Timeline ↗ · 2026-10-07 Cached

Anthropic为Claude Code推出工业级多智能体协作架构:Haiku 5.5作为并行高速子代理处理机械任务,Sonnet 5.5作为主力生成代码,Opus 5.5仅在关键决策点以--advisor身份介入,通过'三权分立'式分层显著降低旗舰模型的上下文与token消耗。

0 favorites 0 likes
#token-efficiency

@mattpocockuk: Prompt of the day: /writing-for-agents my AGENTS.md is a hot mess, propose a series of restructurings that: - Remove no…

X AI KOLs Timeline ↗ · 2026-10-06 Cached

Matt Pocock shares a 'prompt of the day' for cleaning up a messy AGENTS.md: remove no-ops, use progressive disclosure, and move instructions to CODING_STANDARDS.md, delegating the work across three increasingly radical subagents into a single PR. He argues AGENTS.md files are the biggest source of token inefficiency in agent workflows.

0 favorites 0 likes
#token-efficiency

@trq212: a big advantage of doing planning like this is that it’s a lot more token efficient compared to raw HTML- the model doe…

X AI KOLs Following ↗ · 2026-10-06 Cached

Thariq (@trq212) shares a Claude Code skill that improves HTML planning using simple language, code snippets, and linting, noting it is more token-efficient than generating raw HTML. Feedback is being sought before a broader release.

0 favorites 0 likes
#token-efficiency

Stateless Language Agents: Scaling Long-Horizon Automated Research

Hugging Face Daily Papers ↗ · 2026-10-06 Cached

论文提出 Stateless Language Agents (SLAs),采用「有状态搜索 + 无状态代理」原则,由框架持有研究状态并为每次调用重建专属上下文,在长达十亿 token 的预算下于软件工程、内核优化和算法设计任务中均取得最佳结果,且比最强基线节省超过 84% 的 token。

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback