Tag
该论文提出 EGiME（熵引导模型评估），一种基于特征空间聚类结构的半监督准则，无需分类器训练即可在少样本场景下评估预训练模型，在五个基准上与真实准确率相关性达 0.966，并比有监督基线提供更稳定的模型排名。
Varick argues that for most enterprise operational workflows like accounts payable, AI models 1-2 generations behind the state of the art are already sufficient, and that most agent errors stem from missing context, unmapped processes, and bad data rather than model capability — meaning companies shouldn't obsess over chasing the latest benchmark-topping model.
The paper identifies a selection-to-update gap in self-evolving language model loops and proposes HeirCommit and EvoHeir, which separate parameter and experience inheritance with fresh evaluation to confirm updates, reducing harmful inheritance and improving math and general reasoning performance.
Vals AI argues that model routers are becoming a new primitive in the AI stack, showing that an oracle router would beat the best single model by 14 points on the Vals Index while costing about 40% less, as the frontier remains 'jagged' across benchmarks.
Peter Yang 和 Micky 讨论大模型在小任务上的浪费问题，主张让较小的模型处理具体任务，而用最强模型做编排与审查，并分享了四步 agentic 工作流。
The paper analyzes six commercial dynamic LLM routers across 14 settings and finds none outperforms a router that randomly selects between two well-chosen models at matched cost, attributing failures to difficulty blindness, length reversal, semantic matching, and roster suboptimality — patterns the standard evaluation objective actually rewards.
A practitioner describes reworking a production multi-agent system so that agents become replaceable workers inside a durable architecture of authoritative state, task contracts, capability routing, independent verification, and deterministic checks. The piece argues that reasoning autonomy should be separated from execution authority, mature workflows should shed reasoning in favor of rules and tests, and the real metric is verified useful output per unit of human attention.
A Twitter user shared a 9-page PDF guide on how to orchestrate Claude Sonnet 5.5 and Opus 5.5 together in Claude Code, covering when to route tasks to each model, how to cut wasted tokens, and how to measure the true cost of a finished coding task.
FlexRouter 提出一种显式建模模型互补性的 LLM 路由框架，将路由建模为基于覆盖的子集选择问题，并用 Determinantal Point Processes 对模型能力与冗余进行联合建模，同时通过边缘化失败集合的目标函数直接优化答案覆盖率。在 RouterEval 基准上，该方法在域内与域外任务上以更低冗余实现了更高的覆盖率，且推理成本灵活可控。
This paper introduces a taxonomy of 9 model selection algorithms for multi-LLM collaboration, showing that capability-aware selection strategies outperform random or heuristic team assembly by up to 36.1% across math, coding, QA, and reasoning tasks.
The article discusses economic strategies for enterprises transitioning AI from experimentation to production, focusing on evaluating ownership versus consumption models based on workload demands and cost predictability.
The paper introduces RouteFM, a foundation model for LLM routing that learns reusable routing capabilities via episodic pretraining across heterogeneous environments, allowing a frozen router to adapt to new domains, modalities, and candidate pools through behavioral context alone. RouteFM outperforms the strongest baseline by 2.23 quality points on MMR-Bench with only eight observations per candidate, supporting a 'pretrain once, route anywhere' paradigm.
FlexRouter proposes a coverage-oriented LLM routing framework that uses Determinantal Point Processes to model complementarity among models, maximizing the probability that at least one selected model answers correctly while avoiding redundant selections and fixed budgets.
The paper proposes SaveRouter, a sparse-supervision LLM routing framework that selectively acquires query-model feedback and shares capability information across related queries, cutting supervision costs while maintaining competitive routing quality and reducing break-even deployment volume by 1.9-9.5x.
SeLMRoute introduces an LLM routing framework that separates candidate-independent semantic evidence extraction from performance learning, achieving 72.08% average accuracy on LLMRouterBench across 15 datasets and 20 candidate models, outperforming the strongest fixed candidate (69.23%) and enabling both performance-oriented and cost-aware routing decisions.
A study revealed that an LLM router trained to select between models learned task recognition instead of difficulty, causing poor generalization on held-out tasks, but deferral based on the cheap model's output yielded better performance.
The paper challenges the assumption that rank portability implies feasibility portability in cross-device hardware evaluation, using benchmarks to show high rank correlation does not guarantee safe deployment decisions under joint constraints.
A company with a strong AI focus has implemented daily budget limits for state-of-the-art models, shifting to cheaper models for most tasks, indicating a trend in AI cost management.
The article questions whether smaller quantized models are becoming the preferred choice for local AI applications, emphasizing their balance of VRAM usage, performance, and capability like tool calling.
FedFIbOS proposes a Fisher importance-based method for optimal submodel selection in heterogeneous federated learning, theoretically grounded and achieving about 10% higher accuracy than state-of-the-art methods under non-IID settings.