judge-reliability

Tag

Cards List
#judge-reliability

When Consistency Does Not Mean Reliability: Evaluating Local LLM Judges Against Human Ratings

arXiv cs.CL ↗ · 2026-09-15 Cached

The paper evaluates local open-weight LLM judges against human ratings, finding high self-consistency but limited agreement with human judgments, highlighting the need for dual assessment.

0 favorites 0 likes
← Back to home

Submit Feedback