Tag
hearim is an open-source gateway that repurposes ordinary local LLMs into Jev-compatible decision APIs by leveraging their probability distributions, eliminating the need for specialized fine-tuned models.
The article explains how to build a local decision engine using open-source LLMs and SGLang, enabling efficient scoring and probability distributions for fixed choices without full text generation, compared to systems like Jev.