Tag
开发者介绍 NIDO,一个完全在 Android 手机上离线运行的开源 AI 助手,通过确定性路由让小模型(0.5B-7B)只处理真正开放式的任务,并发布了 0.1.29 至 0.1.32 四个 alpha 版本,新增多语言短语路由、重复提醒等功能。
The author developed a deterministic image routing system that classifies images to either send as raw bytes or extract text via OCR, achieving an 88% reduction in token consumption for LLM context integration.
The author argues against making LLMs the central component in agent runtimes, proposing a split between deterministic and semantic paths for handling requests, and seeks feedback on this architectural idea.