token-trimming

Tag

Cards List
#token-trimming

Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoning

arXiv cs.AI · 5d ago Cached

This paper introduces TrimSFT, a token-level reweighting method for supervised fine-tuning that enhances mathematical reasoning by focusing on intermediate logit-gap tokens, demonstrating significant performance gains over standard SFT.

0 favorites 0 likes
← Back to home

Submit Feedback