conditional-distillation

This paper presents a novel speaker verification framework that combines frozen self-supervised features with ECAPA-TDNN and a Mixture of Experts module, using conditional distillation and contrastive loss to improve identity verification across both speech and non-verbal vocalizations while preventing catastrophic forgetting.