rasch-model

Tag

Cards List
#rasch-model

Evaluating LLM-as-a-Judge Beyond Score Alignment: A Psychometric Analysis of Residual Judging Difficulty

arXiv cs.CL ↗ · 2026-10-05 Cached

该论文从心理测量学视角评估 LLM-as-a-judge,使用 Many-Facet Rasch 模型将评分分解为潜在质量、评分者严苛度与残差难度,发现人类与 LLM 在汇总对齐之外仍存在明显的残差难度结构错配。

0 favorites 0 likes
← Back to home

Submit Feedback