llm-matcher

Tag

Cards List
#llm-matcher

Accuracy and Order Sensitivity Diverge Under Label-Free Strategies

Hugging Face Daily Papers · 2026-08-12 Cached

The paper tests label-free strategies to reduce positional bias in multiple-choice benchmarks but finds they do not reliably improve accuracy or reduce bias. Only showing all options with an LLM matcher preserves baseline performance, while cyclic permutation sometimes helps.

0 favorites 0 likes
← Back to home

Submit Feedback