efficiency

LOCUS is a task-aware low-rank post-training method that reduces output token length in language models while maintaining preference alignment, achieving up to 39.84% reduction on Pythia-2.8B with minimal parameter updates.

ZGCM-1 is a 7B open foundation model trained from scratch with extreme efficiency, combining internal reasoning and external tool use for math and agentic search tasks, achieving competitive performance with much larger models like Qwen3-235B-A22B and GLM-5.1.

SAS introduces a gated sparse attention mechanism that optimizes context ranking end-to-end with language modeling loss, improving performance in reasoning and long-context tasks under tight attention budgets.

SoL-Pi is a standalone extension for Pi agents that enhances efficiency by reducing token traffic and inference work through mechanisms like action fusion and context compaction, with all features being opt-in and preserving original evidence.

DeepSeek-V4.1-Flash introduces a two-stage decoder architecture with 40 layers, activating only 8B parameters during prefill and 16B during decode, and includes 196B Engram memory for significant efficiency gains over previous versions.

The article discusses the CEA architecture as a significant inference leap, emphasizing its encoder/decoder split and potential for innovative GPU pooling in heterogeneous setups.

DeepSeek has introduced DeepSeek-V4.1-Flash, a new AI model designed for enhanced capability, faster inference, native visual understanding, and scalability as part of their latest architecture family.

This paper proposes a budget-aware online teaching framework for web agents that reduces teacher calls and compute costs while maintaining performance.

ACE introduces a method to consolidate redundant adapters across experts in MoE large language models for more efficient parameter-efficient fine-tuning, achieving up to 1.48× training speedup without increasing peak memory.

Proposes QGB-WkkNN, a quantum granular-ball based k-nearest neighbor framework that enhances classification efficiency and robustness to noise in machine learning.

This paper introduces a diagnostic benchmark to critically evaluate efficiency methods for LLM-based multi-agent systems, revealing that many reported gains are setup-dependent and may not indicate robust improvements.

The paper demonstrates that self-consensus is an unsafe early-exit signal for language model inference due to a consensus-termination gap, leading to premature stops on incorrect answers.

A user highlights the effectiveness of GPT Image 2.5 Sunburst for generating YouTube thumbnails in a single attempt.

The paper introduces RSM-full, an online clustered-memory pipeline for LLM agents that separates memory merge and retrieval assembly, achieving 83% of full-context quality at 32% of token cost under tight prompt budgets.

TRACE is a training-free framework that optimizes GUI agent efficiency by ranking visual evidence based on utility and diversity, reducing latency and memory usage through adaptive token management and KV contraction.

NCP-ArchPreview is a large latent-space language model that uses next concept prediction to improve pretraining efficiency and performance, scaling to 8.9B parameters and outperforming OLMo-3-7B with less training data.

NVIDIA's paper introduces a method to transfer KV cache between AI models, allowing target models to skip prefill entirely and achieve 2.7 to 25x faster conversions, which could improve efficiency in multi-model applications.

This paper proposes a method using discrete diffusion to unlock lossless speedups in large language models, aiming to improve efficiency without compromising performance.

GitHub Copilot has been optimized to improve AI coding efficiency by focusing on context management rather than token count, reducing unnecessary work while maintaining task quality through changes evaluated via benchmarks and experiments.

A researcher shares preliminary results demonstrating a method that reduces image-processing token usage by approximately 95% compared to GPT-4o while maintaining similar accuracy, and seeks feedback on its significance.