counterfactual-audits

Tag

Cards List
#counterfactual-audits

Do Audio Language Models Use Paralinguistic Evidence? Counterfactual Audits for Response Evaluation

arXiv cs.CL ↗ · 2026-08-10 Cached

Introduces counterfactual audits to test whether audio language model judges actually use paralinguistic evidence when evaluating speech-to-speech responses, finding that contrastive success often overstates native reliability and similar accuracies can hide different failure modes across Gemini, GPT, and open models.

0 favorites 0 likes
← Back to home

Submit Feedback