large-label-spaces

Tag

Cards List
#large-label-spaces

Characterize Then Distill: Mechanistic Reasoning in Large Output Spaces

arXiv cs.CL ↗ · 2026-06-08 Cached

This paper investigates how reasoning models perform zero-shot multi-label classification over millions of candidate labels. The authors characterize a two-phase process of shortlisting and fine-grained reasoning, and propose a mechanistic distillation method that outperforms standard distillation for transferring these capabilities to smaller models.

0 favorites 0 likes
← Back to home

Submit Feedback