eval-harness

Tag

Cards List
#eval-harness

60-82% accuracy swing on 4B model classification task: the only variable was harness design

Reddit r/LocalLLaMA ↗ · 2026-07-31

A pre-registered ablation on a 4B model classification task shows that harness design (rule placement, evidence order, turn structure) swings accuracy from 60% to 82%, demonstrating that poor harness design is often mistaken for poor model capability.

0 favorites 0 likes
← Back to home

Submit Feedback