Tag
The paper introduces AUF (Accept-Until-Fail), a simple modification to the cross-entropy loss for masked block drafters in speculative decoding that restricts supervision to the prefix up to the first predicted failure, improving average emitted length across benchmarks without changing inference.