Tag
Researchers propose a backprop-free, closed-form trajectory-matching method to transfer 4B model capabilities into a 0.8B student, finding that restricting weight surgery to 4 anchor layers avoids NLL explosions, yielding 10.8% lower held-out NLL across 30 benchmarks while running entirely on an 8GB RX 580.