mixed-integer-optimization

LazyTrain is a research system that optimizes LLM training on limited hardware by formulating checkpoint selection, activation placement, recomputation, and CPU-GPU-NVMe communication overlap as a mixed-integer scheduling problem, achieving ~1.24x TFLOPS improvement over matched baselines.