speech-text

Tag

Cards List
#speech-text

Same evidence, different judgments: Evidence noncommutative in vision/speech-text conflicts

arXiv cs.AI ↗ · 2026-09-24 Cached

This paper examines how the order of conflicting evidence in multimodal large language models affects judgments, revealing cross-modal evidence noncommutativity where placing perceptual evidence later increases model reliance on it.

0 favorites 0 likes
#speech-text

Rethinking Speech-LLM Integration for ASR: Effective Joint Speech-Text Training by Interleaving

arXiv cs.CL ↗ · 2026-07-03 Cached

This paper proposes Joint Speech-Text Interleaved Pretraining (JSTIP), a pretraining strategy that constructs word-level and segment-level interleaved speech-text sequences to improve ASR entity accuracy and reduce the modality gap between speech and text, showing competitive performance on domain adaptation and zero-shot speech question answering.

0 favorites 0 likes
← Back to home

Submit Feedback