diagnostic-methods

Tag

Cards List
#diagnostic-methods

Keyword Harnesses Fail Open: A Cheap Diagnostic Ladder for Tool-Use Claims in Small Language Models

Hugging Face Daily Papers ↗ · 2026-10-01 Cached

The paper shows that keyword-matching benchmarks can credit small language models with tool use they never perform, documenting a false positive in matched-architecture Spanish security LMs and proposing a cheap diagnostic ladder plus a targeted SFT recipe that repairs the failing 1B model.

0 favorites 0 likes
← Back to home

Submit Feedback