Tag
A personal project describes a village simulation where a 144M-param julia-1 'gut' model scores villagers' actions on CPU, embeddingGemma retrieves relevant memories, and Gemma 4 e4b (6GB laptop GPU) is only invoked when plans fail or surprises occur. Results show the gut is rarely uncertain, and nightly rule-learning from mistakes cut injuries from 2.73 to 0.53 per valley.
The paper introduces CIRCE, which uses a cheap LLM to extract a problem's constraint structure into a constraint graph that predicts LLM response correctness before inference, improving NLL and AUROC over existing baselines across seven reasoning benchmarks.
OpenRouter shipped its biggest provider router update since founding, shifting from price-based prioritization to rewarding the best quality inference per cost so requests stay cheap while being fast and reliable, with providers earning more traffic by delivering better value.
GitHub Copilot Fusion 是一款能自动挑选并组合多个模型的 AI 编码代理,旨在为开发者提供更智能的代码辅助体验。
GitHub Copilot Fusion 一般可用,它将 Project HydraFusion 的多模型编排与 Copilot 自动模型选择相结合,自动为每个任务路由和编排模型,兼顾性能与成本,并提供 Standard、High、Max 三档 effort 供开发者与管理员使用。
The user recommends using the ZenMux gateway to switch between models such as GLM-5.3 and DeepSeek V4.1 Flash for reverse engineering and penetration testing research, and promotes ZenMux’s Halloween mystery box sale.
新分析指出,最便宜的 LLM 并不总是完成任务的最便宜方式:在会话中途切换模型可能因丢失上下文缓存而抵消成本节省,智能路由应优化整个工作流而非仅看模型价格。
The paper shows that five frozen, independently trained models (four transformers and one state-space model) can be aligned into a shared representational space via Generalized Procrustes Analysis on activations alone, achieving 0.91–0.93 held-out retrieval accuracy at final layers, while reporting a negative result that routing among the models does not beat always using the strongest model.
Intrascope 2.0 推出,提供跨 120+ 模型的智能路由、可连接 1,650+ 应用的 AI agent,以及面向企业的预算、权限和使用分析管理功能。
分析Stripe以75亿美元收购模型路由公司的交易,作者结合自身一年运行多模型路由器的经验指出,路由本质上是定价问题,真正的难题是对输出正确性的验证,下一个关键层将是结果校验与溯源系统。
Stripe agreed to acquire OpenRouter, the AI model routing startup, for approximately $7.5 billion — nearly six times its valuation from a Series B round led by Alphabet less than three months prior. The deal positions Stripe to see, bill for, and route token spending across AI transactions, though it raises neutrality concerns about the model-agnostic routing layer.
作者认为为每个智能体固定绑定单一模型将显得奇怪,因为同一次智能体运行中的不同环节需要不同的智能水平,简单任务保持低成本,困难决策则临时调用前沿模型,使智能体呈现异构化而非模型本身同质化。
微软的研究论文提出在用户轮次边界进行上下文感知的模型路由,发现将会话历史提供给路由器可在相同卸载率下提升多轮电子表格智能体的任务通过率,并分析了提示缓存切换的不对称成本与廉价模型的成本优势衰减。
The author predicts that frontier AI providers could experience slowing revenue growth even as overall AI usage continues to rise, due to task economics pushing developers to route easy tasks to cheaper models while reserving premium models for complex work. The post frames this as a hypothesis with counterarguments, such as new high-value workloads potentially sustaining premium pricing.
Ramp 推出 Glass,一款共享公司知识、可复用技能与协作会话的 AI 工作区,通过 Ramp Router 模型路由使 AI 成本下降 30%,并显著扩展了工作流自动化。
Nimble-v4 和 Nimble-v4-max 作为前沿决策模型发布,在 Decision Index 公开榜单上显著超越 Jev 等对手,并在内部评测中实现更少错误和大幅提升的模型路由决策能力。
GuardrailX 的联合创始人分享如何通过在代理框架与 LLM 供应商之间加入代理网关,实现自动循环检测、语义路由和 LLM-as-a-Judge 质量评估,并展示了 3,500+ 条生产请求日志中约 54% 的成本削减数据。
用户发帖询问 Magpie 的使用体验,Magpie 是一款本地网关工具,可让 Claude Code、Codex 等任何 AI 代理跨厂商调用模型,并在多个订阅与 API 账户间智能路由和分配额度。
该论文提出将战略选择建模为叠加在基础博弈之上的元博弈,评估了5种博弈和10个大模型,发现多臂老虎机方法比基于嵌入的选择器更可靠,但仍未超过固定模型基线,揭示了当前方法应对动态对手的不足。
一位 AI 视频代理后端工程师分享如何修复模型路由问题:通过规则过滤加评分,避免代理在 1000+ 视频模型中自信却错误地选择不兼容的模型。