Tag
DuoMem is a dual-space distillation framework that transfers procedural problem-solving from large language models to compact student models via context-space and parameter-space distillation, achieving high performance with minimal additional parameters and improved inference speed. It boosts a 4B model from 4.3% to 77.9% task success rate on ALFWorld.