model-routing

Tag

Cards List
#model-routing

a 144m model makes most of my villagers' choices, gemma 4 e4b only steps in when something goes wrong (6 gb laptop gpu)

Reddit r/LocalLLaMA ↗ · 5d ago

A personal project describes a village simulation where a 144M-param julia-1 'gut' model scores villagers' actions on CPU, embeddingGemma retrieves relevant memories, and Gemma 4 e4b (6GB laptop GPU) is only invoked when plans fail or surprises occur. Results show the gut is rarely uncertain, and nightly rule-learning from mistakes cut injuries from 2.73 to 0.53 per valley.

0 favorites 0 likes
#model-routing

CIRCE Divines LLM Task Complexity from Constraint Structure

arXiv cs.AI ↗ · 6d ago Cached

The paper introduces CIRCE, which uses a cheap LLM to extract a problem's constraint structure into a constraint graph that predicts LLM response correctness before inference, improving NLL and AUROC over existing baselines across seven reasoning benchmarks.

0 favorites 0 likes
#model-routing

@OpenRouter: We just shipped our biggest improvement to our provider router since the founding of OpenRouter. Before, we prioritized…

X AI KOLs Following ↗ · 2026-10-29 Cached

OpenRouter shipped its biggest provider router update since founding, shifting from price-based prioritization to rewarding the best quality inference per cost so requests stay cheap while being fast and reliable, with providers earning more traffic by delivering better value.

0 favorites 0 likes
#model-routing

GitHub Copilot Fusion

Product Hunt ↗ · 2026-10-29

GitHub Copilot Fusion 是一款能自动挑选并组合多个模型的 AI 编码代理,旨在为开发者提供更智能的代码辅助体验。

0 favorites 0 likes
#model-routing

Route and orchestrate models with GitHub Copilot Fusion (2 minute read)

TLDR AI ↗ · 2026-10-29 Cached

GitHub Copilot Fusion 一般可用,它将 Project HydraFusion 的多模型编排与 Copilot 自动模型选择相结合,自动为每个任务路由和编排模型,兼顾性能与成本,并提供 Standard、High、Max 三档 effort 供开发者与管理员使用。

0 favorites 0 likes
#model-routing

@wquguru: DeepSeek Harness is seriously powerful for cybersecurity research, and more importantly, it basically needs no jailbreaking!!! I no longer dare use Claude for everyday reverse engineering and penetration testing research. Right now, there are only two top-tier models suited for reverse engineering and penetration testing— 1. GLM-5.3 2. DeepSeek V4.1 Fl…

X AI KOLs Timeline ↗ · 2026-10-28 Cached

The user recommends using the ZenMux gateway to switch between models such as GLM-5.3 and DeepSeek V4.1 Flash for reverse engineering and penetration testing research, and promotes ZenMux’s Halloween mystery box sale.

0 favorites 0 likes
#model-routing

@OpenHandsDev: The cheapest LLM isn’t always the cheapest way to complete a task. New analysis shows how switching models mid-session …

X AI KOLs Following ↗ · 2026-10-27 Cached

新分析指出,最便宜的 LLM 并不总是完成任务的最便宜方式:在会话中途切换模型可能因丢失上下文缓存而抵消成本节省,智能路由应优化整个工作流而非仅看模型价格。

0 favorites 0 likes
#model-routing

Five Architectures, One Shared Space Cross-Model Representational Alignment Without Weight Merging

arXiv cs.CL ↗ · 2026-10-27 Cached

The paper shows that five frozen, independently trained models (four transformers and one state-space model) can be aligned into a shared representational space via Generalized Procrustes Analysis on activations alone, achieving 0.91–0.93 held-out retrieval accuracy at final layers, while reporting a negative result that routing among the models does not beat always using the strongest model.

0 favorites 0 likes
#model-routing

Intrascope 2.0

Product Hunt ↗ · 2026-10-26 Cached

Intrascope 2.0 推出,提供跨 120+ 模型的智能路由、可连接 1,650+ 应用的 AI agent,以及面向企业的预算、权限和使用分析管理功能。

0 favorites 0 likes
#model-routing

stripe bought a router for $7.5b. i ran one for a year, and routing was never the hard part.

Reddit r/artificial ↗ · 2026-10-19

分析Stripe以75亿美元收购模型路由公司的交易,作者结合自身一年运行多模型路由器的经验指出,路由本质上是定价问题,真正的难题是对输出正确性的验证,下一个关键层将是结果校验与溯源系统。

0 favorites 0 likes
#model-routing

Stripe will acquire OpenRouter for $7.5B

Hacker News Top ↗ · 2026-10-19 Cached

Stripe agreed to acquire OpenRouter, the AI model routing startup, for approximately $7.5 billion — nearly six times its valuation from a Series B round led by Alphabet less than three months prior. The deal positions Stripe to see, bill for, and route token spending across AI transactions, though it raises neutrality concerns about the model-agnostic routing layer.

0 favorites 0 likes
#model-routing

@pauliusztin_: One model per agent might eventually feel like a weird design choice. Different moments in the same agent run require c…

X AI KOLs Timeline ↗ · 2026-10-16 Cached

作者认为为每个智能体固定绑定单一模型将显得奇怪,因为同一次智能体运行中的不同环节需要不同的智能水平,简单任务保持低成本,困难决策则临时调用前沿模型,使智能体呈现异构化而非模型本身同质化。

0 favorites 0 likes
#model-routing

@dair_ai: Interesting paper from Microsoft on context-guided model routing. They found a nice trick to achieve cost-aware model r…

X AI KOLs Timeline ↗ · 2026-10-16 Cached

微软的研究论文提出在用户轮次边界进行上下文感知的模型路由,发现将会话历史提供给路由器可在相同卸载率下提升多轮电子表格智能体的任务通过率,并分析了提示缓存切换的不对称成本与廉价模型的成本优势衰减。

0 favorites 0 likes
#model-routing

Frontier AI revenue growth could slow even while AI usage keeps rising

Reddit r/artificial ↗ · 2026-10-16

The author predicts that frontier AI providers could experience slowing revenue growth even as overall AI usage continues to rise, due to task economics pushing developers to route easy tasks to cheaper models while reserving premium models for complex work. The post frames this as a hypothesis with counterarguments, such as new high-value workloads potentially sustaining premium pricing.

0 favorites 0 likes
#model-routing

Ramp Glass (4 minute read)

TLDR AI ↗ · 2026-10-14 Cached

Ramp 推出 Glass,一款共享公司知识、可复用技能与协作会话的 AI 工作区,通过 Ramp Router 模型路由使 AI 成本下降 30%,并显著扩展了工作流自动化。

0 favorites 0 likes
#model-routing

Nimble

Product Hunt ↗ · 2026-10-13 Cached

Nimble-v4 和 Nimble-v4-max 作为前沿决策模型发布,在 Decision Index 公开榜单上显著超越 Jev 等对手,并在内部评测中实现更少错误和大幅提升的模型路由决策能力。

0 favorites 0 likes
#model-routing

How we solved runaway LLM costs and loop protection for multi-step AI Agents in production (Architecture & Real Data)

Reddit r/AI_Agents ↗ · 2026-10-13

GuardrailX 的联合创始人分享如何通过在代理框架与 LLM 供应商之间加入代理网关,实现自动循环检测、语义路由和 LLM-as-a-Judge 质量评估,并展示了 3,500+ 条生产请求日志中约 54% 的成本削减数据。

0 favorites 0 likes
#model-routing

@interjc: I'd like to ask friends who use https://usemagpie.ai, which agent do you mainly use to access all these tokens? My curr…

X AI KOLs Timeline ↗ · 2026-10-13 Cached

用户发帖询问 Magpie 的使用体验,Magpie 是一款本地网关工具,可让 Claude Code、Codex 等任何 AI 代理跨厂商调用模型,并在多个订阅与 API 账户间智能路由和分配额度。

0 favorites 0 likes
#model-routing

Choosing LLMs for Strategic Agent Interactions

Hugging Face Daily Papers ↗ · 2026-10-13 Cached

该论文提出将战略选择建模为叠加在基础博弈之上的元博弈,评估了5种博弈和10个大模型,发现多臂老虎机方法比基于嵌入的选择器更可靠,但仍未超过固定模型基线,揭示了当前方法应对动态对手的不足。

0 favorites 0 likes
#model-routing

my agent picks from 1000+ video models and used to be confidently wrong. heres what fixed it

Reddit r/AI_Agents ↗ · 2026-10-09

一位 AI 视频代理后端工程师分享如何修复模型路由问题:通过规则过滤加评分,避免代理在 1000+ 视频模型中自信却错误地选择不兼容的模型。

0 favorites 0 likes
Next →
← Back to home

Submit Feedback