layer-merging

XMerge introduces a post-training method for compressing transformer-based LLMs by merging layers through cross-axis selection and reconstructive reconstruction, outperforming existing methods at aggressive depth reduction while maintaining performance.