deterministic-routing

Tag

Cards List
#deterministic-routing

My AI agent runs 100% offline on a phone. The trick is not letting the small model improvise

Reddit r/AI_Agents ↗ · 2026-10-13

开发者介绍 NIDO,一个完全在 Android 手机上离线运行的开源 AI 助手,通过确定性路由让小模型(0.5B-7B)只处理真正开放式的任务,并发布了 0.1.29 至 0.1.32 四个 alpha 版本,新增多语言短语路由、重复提醒等功能。

0 favorites 0 likes
#deterministic-routing

Cut token consumption by 88% with deterministic image routing (P50: 59ms) [P]

Reddit r/MachineLearning ↗ · 2026-09-27

The author developed a deterministic image routing system that classifies images to either send as raw bytes or extract text via OCR, achieving an 88% reduction in token consumption for LLM context integration.

0 favorites 0 likes
#deterministic-routing

I don’t think the LLM should be the center of an agent runtime

Reddit r/AI_Agents ↗ · 2026-09-15

The author argues against making LLMs the central component in agent runtimes, proposing a split between deterministic and semantic paths for handling requests, and seeks feedback on this architectural idea.

0 favorites 0 likes
← Back to home

Submit Feedback