multiple-choice-evaluation

Tag

Cards List
#multiple-choice-evaluation

Gated Against One Model, Open to the Next: Option-Only Solvability in Legal Multiple-Choice Benchmarks

arXiv cs.CL · 6d ago Cached

This paper demonstrates that legal multiple-choice benchmarks are vulnerable to option-only solvability, where models can answer correctly without the question, and that filtering based on one model's performance does not improve validity for other models.

0 favorites 0 likes
← Back to home

Submit Feedback