selective-alignment

Tag

Cards List
#selective-alignment

Not All Timesteps Matter Equally: Selective Alignment Knowledge Distillation for Spiking Neural Networks

arXiv cs.LG · 2026-05-15 Cached

Proposes Selective Alignment Knowledge Distillation (SeAl-KD) for Spiking Neural Networks, which selectively aligns class-level and temporal knowledge by equalizing competing logits at erroneous timesteps and reweighting temporal alignment based on confidence and inter-timestep similarity, achieving consistent improvements over existing distillation methods on static and neuromorphic datasets.

0 favorites 0 likes
← Back to home

Submit Feedback