redvox

This paper introduces RedVox, a multilingual safety and fairness benchmark for speech models. Evaluating eight state-of-the-art models across five languages, it finds persistent vulnerabilities that worsen in non-English settings and with spoken input.