Tag
A user reports that using three local AI models (GLM 5.2, DeepSeek v4 Flash, Qwen 3.6 35B A3B) over 7 days with 500 million tokens can cover most business automation needs.
A memory pipeline built on Qwen3 235B A22B Instruct 2507 achieves the highest score on LongMemEval-S (470/500) while being approximately 10x more token-efficient than the next best system.
DeepSeek's OCR paper introduces 'optical compression,' showing that an image token can encode roughly 10 text tokens' worth of information with high accuracy, making images of text more token-efficient than raw text. Community tools and a new app, Imagizer, demonstrate this approach in practice.
DeepSWE 1.1 highlights GPT-5.6 Sol, which achieves top scores at half the cost and roughly twice the token efficiency of Fable, according to Sam Altman.
Sam Altman announces that GPT-5.6 sol is half the price and roughly twice as token efficient as fable for many tasks, with plans to deliver at one-quarter of the price.
This technical report introduces Mach-Mind-4-Flash, a 35B-parameter Mixture-of-Experts agentic model with 3B activated parameters that matches or surpasses 100B-class models through post-training optimization alone. It presents a novel training infrastructure with dynamic multi-teacher scheduling, multi-teacher on-policy distillation, and hybrid median-length policy optimization for token efficiency.
A new post-training method called IAPO (Information-Aware Policy Optimization) assigns token-wise advantages based on conditional mutual information with the final answer, achieving up to 47% shorter reasoning while improving accuracy on math benchmarks.
GLM-5.2 is praised as the best Chinese open model yet for output quality, but note its high token consumption. The user hopes to run it on 3 DGX Sparks.
barebrowse is a tool that generates pruned ARIA snapshots from web pages, reducing token consumption for local AI models by stripping boilerplate and ads, and reusing existing browser cookies.
This news roundup examines the trade-offs in frontier AI: Anthropic's re-released Fable 5 illustrates the tension between safety and quality, OpenAI's token efficiency push lowers compute costs, and potential US government involvement in OpenAI highlights the price of state control over AI infrastructure.
Glean's engineering blog details their new agent harness using 100% programmatic tool calling via code execution, which reduces token usage by 24% compared to standard tool calling. The harness manages context with tool truncation and a sandbox filesystem for long-running complex workflows.
SpaceXAI has released Grok 4.5, an Opus-class model that offers faster speed, higher token efficiency, and lower cost compared to competitors like Anthropic's Opus 4.7 and OpenAI's models.
This paper proposes token-efficient retrieval methods for LLM analysis of transactional legal documents, demonstrating that structured retrieval can match full-corpus injection in answer quality while using significantly fewer tokens and lower cost.
docx-cli is a CLI tool that enables AI agents to read and edit Word documents efficiently by using stable locators and mutating XML in place, reducing token usage and time by half compared to default methods.
A developer built an open-source proxy (KU-Gateway) that drops stale context from vector database retrievals before LLM synthesis, cutting token burn by ~50% and preventing stale-data hallucinations. The tool is now opening for a 14-day stress test/hackathon.
Introduces Sparse-Reslim, a plug-in routing module that processes only 25% of spatial tokens through expensive transformer blocks for efficient weather prediction, achieving up to 3.18x speedup and improved forecast accuracy.
This article argues that comparing AI models by price per million tokens is misleading due to differences in tokenizers and token efficiency. It provides a benchmark cost analysis showing that models with higher per-token prices can be cheaper per completed task, with DeepSeek V4 Pro being a strong cost-efficiency outlier.
Tencent released Hy3, a 295B MoE model focused on practical reliability for agentic tasks, with open-source Apache 2.0 license and a free API for two weeks.
This article presents a cleaner pattern for agent web access by splitting it into three separate lanes—search, fetch, and browser—and using a reader subagent to keep raw pages out of the main context, significantly reducing token usage and context pollution.
SwiReasoning is a reasoning technique that improves answer accuracy and reduces token usage, making inference feel faster despite lower tokens per second. The technique is 9 months old but underutilized, with open-source implementations available.