auroc

The paper shows that the hallucination signal in LLMs is dominated by a mean shift, making simple probes like L2-regularized logistic regression sufficient and outperforming complex alternatives.

This paper introduces InnerExpert, a method that leverages Mixture-of-Experts signals for per-token hallucination detection in LLMs, achieving superior performance over existing techniques.