Tag
该论文精确计算了语言模型在被要求随机选数时对每个整数的完整概率分布,发现指令调谐使分布更不均匀:安装了避免轮数的启发式并强化了避免端点值的倾向,但未产生跨模型共享的偏好整数。
hearim is an open-source gateway that repurposes ordinary local LLMs into Jev-compatible decision APIs by leveraging their probability distributions, eliminating the need for specialized fine-tuned models.
The article explains how to build a local decision engine using open-source LLMs and SGLang, enabling efficient scoring and probability distributions for fixed choices without full text generation, compared to systems like Jev.