southeast-asian-languages

Tag

Cards List
#southeast-asian-languages

DuDi: Dual-Signal Distillation with Cross-Lingual Verbalizer

arXiv cs.CL · 4d ago Cached

DuDi is a dual-signal multilingual distillation framework combining sequence-level and token-level signals with a cross-lingual verbalizer to improve small language models' performance on Southeast Asian languages. Experiments on SEA-HELM show DuDi consistently outperforms competitive distillation baselines across multiple model families and scales.

0 favorites 0 likes
← Back to home

Submit Feedback