Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning

# Modality Fault Lines:Structural Corruptions Reveal Fragile Omni-Modal Reasoning
Source: [https://arxiv.org/html/2608.29278](https://arxiv.org/html/2608.29278)
Meixin WuAffiliation:Peking UniversityYu XueAffiliation:Peking UniversityYingjie HeAffiliation:Peking UniversityQiming ShiAffiliation:Zhejiang UniversityLei WeiAffiliation:Peking UniversityYidi WangAffiliation:Peking UniversityRicheng xuanAffiliation:TencentZhichao HuAffiliation:Tencent

###### Abstract

Omni\-modal large language models are increasingly evaluated on clean text–vision–audio inputs, where every channel is present, synchronized, and readily interpretable\. Such scores are often taken as evidence of robust cross\-modal fusion, but clean evaluation cannot tell whether success depends on stable cross\-modal structure or on cues sufficient only in intact inputs\. To address this gap, we define a*modality fault line*: a boundary at which model behavior becomes unstable when a modality remains present and human\-interpretable, but its internal evidence structure is perturbed\. We introduceSCEval\(*Structure\-Corruption Evaluation*\), a diagnostic evaluation protocol that keeps the question, answer space, and modality channels fixed while applying controlled structural corruptions to text, vision, and audio individually and jointly\. Built from273273human\-verified tri\-modal examples from Social\-IQ, OmniBench, and VALOR,SCEvalevaluates1515proprietary and open\-source omni\-modal systems\. The results show that structural corruption lowers clean accuracy, text–vision damage forms the most stable shared fault line, and multi\-modal degradation is non\-additive rather than a simple function of the number of corrupted modalities\. Clean omni\-modal accuracy therefore does not establish that a model will remain reliable when cross\-modal evidence becomes structurally unreliable\.

11footnotetext:Equal contribution\.22footnotetext:Corresponding author\.![Refer to caption](https://arxiv.org/html/2608.29278v1/case1.png)Figure 1:Teaser illustration of modality fault lines\.SCEvalkeeps text, vision, and audio present while damaging their internal evidence structure, revealing failures that clean all\-modality evaluation can hide\.## 1Introduction

Omni\-modal large language models promise a simple interface for multimodal reasoning: a user provides a question together with visual and acoustic evidence, and one model produces a single answer grounded in all available streams\([Team et al\., 2023](https://arxiv.org/html/2608.29278#bib.bib5);[Hurst et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib4);[Team, 2026](https://arxiv.org/html/2608.29278#bib.bib6)\)\. This promise has made clean text–vision–audio benchmarks the default proof of progress—if accuracy rises when all modalities are present, the model is treated as a better cross\-modal reasoner\. Yet clean evaluation quietly gives the model the easiest possible version of the task: text, vision, and audio arrive simultaneously, well\-formed, and mutually redundant, so a model can be correct without actually binding the three streams into a stable reasoning structure\.

#### Clean accuracy is not fusion ❶\.

Clean evaluation does not tell us*when*or*how*models use multiple modalities: a tri\-modal item can be solved through a transcript cue, an obvious visual object, an audio event, an answer prior, or a shortcut that happens to agree with the label\. Missing\-modality ablations go to the opposite extreme—removing a channel entirely changes the task and conflates modality reliance with distribution shift\. The deployment\-relevant region lies between: the modality is still present and human\-interpretable, but its internal evidence structure has been damaged\. We call the resulting hidden boundary a*modality fault line*—the point at which apparent omni\-modal competence breaks once the channel a model implicitly trusts becomes noisy, fragmented, or structurally unreliable\.

#### The missing diagnostic ❷\.

A useful robustness test for omni\-modal models must answer three questions that standard protocols leave entangled:

- •Which channel carries the answer?Clean accuracy cannot separate genuine cross\-modal binding from single\-channel shortcuts, because all evidence streams are simultaneously well\-formed\.
- •What happens when a channel weakens but does not disappear?Real inputs degrade internally—OCR\-like text errors or shuffled phrases, occluded or blurry frames, muted or distorted audio—rather than vanish outright\.
- •How do weakened channels interact?Single\-modality studies reveal local sensitivity but cannot tell whether two damaged channels compensate, conflict, or trigger a new collapse mode\.

#### SCEval: keep the modality, break the structure ❸\.

We introduceSCEval\(*Structure\-Corruption Evaluation*\) to make this boundary measurable\. The design choice is deliberately simple: do not remove a modality; keep it present and corrupt only its internal structure\. From a300300\-candidate pool sampled across Social\-IQ\([Zadeh et al\., 2019](https://arxiv.org/html/2608.29278#bib.bib1)\), OmniBench\([Li et al\., 2026b](https://arxiv.org/html/2608.29278#bib.bib2)\), and VALOR\([Liu et al\., 2024a](https://arxiv.org/html/2608.29278#bib.bib3)\), a third\-party team verifies example validity, tri\-modal answerability, and corrupted\-input interpretability, yieldingN=273N\{=\}273human\-verified base examples\. Each example is evaluated under the clean all\-modality condition and under a curated family of single\-, dual\-, and tri\-modal structural corruptions, with question, answer options, gold answer, and modality channels held fixed\. Stochastic operators are aggregated as the mean over up to three random variants, and the worst\-variant gap is logged alongside to surface seed\-level fragility without making the primary metric a one\-seed outlier\.

Main MessageWe observe an asymmetric behavioral pattern: at fixed heavy visual noise, mildly corrupted text \(t​30t30\) is associated with lower accuracy than heavily corrupted text \(t​70t70\) for 14 of the 15 evaluated models \(Table[8](https://arxiv.org/html/2608.29278#A3.T8)\)\. This contrast does not by itself identify the underlying cross\-modal mechanism\.

Our contributions are:

- ★Phenomenon\.We identify*modality fault lines*: latent failures that clean all\-modality inputs and missing\-modality ablations both miss, because the modality remains present while its internal evidence structure is damaged\.
- ★Protocol\.We proposeSCEval, a structure\-corruption protocol that keeps the task and modality channels fixed while perturbing text, vision, and audio individually and jointly, with mean\-variant aggregation and a worst\-variant diagnostic\.
- ★Benchmark\.We construct a human\-verified tri\-modal benchmark of273273examples from Social\-IQ, OmniBench, and VALOR, covering clean inputs and full single\-, dual\-, and tri\-modal corruption variants under a unified directory and annotation scheme\.
- ★Findings\.We show that structural corruption reliably lowers clean performance, that text–vision damage is the most stable shared fault line, and that cross\-modal degradation is non\-additive and model\-dependent rather than a simple function of corruption count\.

## 2Structure\-Corruption Evaluation

SCEvalprobes*modality fault lines*by holding the task and modality channels fixed while corrupting the internal structure of one or more modalities\. The design choice that distinguishes it from missing\-modality ablations is that every channel remains present and human\-interpretable throughout, so the resulting drops measure structural fragility rather than distribution shift; the evaluation matrix combines single\-modality severity curves with dual\- and tri\-modal joint corruptions over the same base examples\.

### 2\.1Problem setup

Each example consists of a questionqq, an answer space \(multiple\-choice options or an answer target\), and three evidence channels: textxtx\_\{t\}, visual inputxvx\_\{v\}, and audioxax\_\{a\}\. A clean omni\-modal model predicts

y^=f⁡\(xt,xv,xa,q\),\\hat\{y\}=f\(x\_\{t\},x\_\{v\},x\_\{a\},q\),\(1\)and the clean all\-modality baseline accuracy is computed on the uncorrupted version of the273273base examples introduced in §[2\.3](https://arxiv.org/html/2608.29278#S2.SS3)\.

A*structure corruption operator*cms,r​\(⋅\)c\_\{m\}^\{s,r\}\(\\cdot\)targets modalitym∈\{t,v,a\}m\\in\\\{t,v,a\\\}at severityssand random variantrrwhen applicable\. The operator preserves the channel’s container \(the text string, the visual frames, or the audio waveform\) and damages only its internal evidence—e\.g\. a text operator deletes or shuffles words rather than swapping the prompt, a visual operator adds noise or occludes regions rather than substituting the image, and an audio operator mutes or removes a segment rather than replacing the soundtrack\. Combined corruption applies operators to multiple modalities of the same base example,

x~=\(ct​\(xt\),cv​\(xv\),ca​\(xa\),q\),\\tilde\{x\}=\\big\(c\_\{t\}\(x\_\{t\}\),\\,c\_\{v\}\(x\_\{v\}\),\\,c\_\{a\}\(x\_\{a\}\),\\,q\\big\),\(2\)where one, two, or three of the corruption operators may be active whileqq, the answer options, and the original gold labelyyremain fixed\. Whether the original gold answer remains defensible after corruption is assessed separately in Appendix[G\.7](https://arxiv.org/html/2608.29278#A7.SS7)\. This sample\-paired design is what letsSCEvalcompute the clean\-versus\-corrupted contrast at the example level\.

### 2\.2Corruption taxonomy

Figure[2](https://arxiv.org/html/2608.29278#S2.F2)shows the fourteen operatorsSCEvaluses, grouped into four text, seven visual, and three audio families\. The taxonomy is deliberately*curated, not exhaustive*: rather than enumerating every textbook degradation, we select operators that target the harder structural fault lines we expect a robust omni\-modal model to handle, while keeping every modality channel present and human\-interpretable\. Four design rules fix what an operator is allowed to do and how it is scored: \(i\) only*structural*, not semantic, damage; \(ii\) sample\-level paired comparison with the same gold answer; \(iii\) graded severity in\{10,30,50,70\}\\\{10,30,50,70\\\}; and \(iv\) up\-to\-three stochastic random variants aggregated by the mean\-variant rule of §[2\.4](https://arxiv.org/html/2608.29278#S2.SS4.SSS0.Px1)\. Combined experiments use representative high\-coverage dual\- and tri\-modal pressure conditions \(text–vision, text–audio, vision–audio, and text–vision–audio\)\. Per\-operator definitions, severity parameterisations, and rejection rules are deferred to Appendix[E](https://arxiv.org/html/2608.29278#A5)\(Table[28](https://arxiv.org/html/2608.29278#A5.T28)\)\.

Figure 2:The fourteen structural corruption operators used bySCEval\(4 text, 7 vision, 3 audio\)\. The taxonomy is curated rather than exhaustive: it targets cross\-modal evidence assembly \(word identity/order, dense visual signal, audio presence\) and excludes trivially recoverable perturbations; per\-operator definitions, severity parameterisations, and rejection criteria are in Appendix[E](https://arxiv.org/html/2608.29278#A5)\(Table[28](https://arxiv.org/html/2608.29278#A5.T28)\)\.
### 2\.3Benchmark construction

#### Source benchmarks\.

SCEvalis built on three publicly released omni\-modal benchmarks chosen to span different evidence styles:Social\-IQ\([Zadeh et al\., 2019](https://arxiv.org/html/2608.29278#bib.bib1)\), a video QA benchmark for social reasoning that requires both speech and visual cues;OmniBench\([Li et al\., 2026b](https://arxiv.org/html/2608.29278#bib.bib2)\), designed to test joint text–image–audio reasoning; andVALOR\([Liu et al\., 2024a](https://arxiv.org/html/2608.29278#bib.bib3)\), whose video clips contain naturally co\-occurring visual and acoustic events\. Mixing the three sources prevents the fault\-line measurements from being driven by any single benchmark’s idiosyncrasies\.

#### Candidate pool\.

We sample100100examples per source, yielding a300300\-candidate pool\. For every candidate we collect \(i\) the original video, \(ii\) the audio track extracted from the same recording, \(iii\) the textual question with multiple\-choice options and a gold answer, and \(iv\) source metadata, organised under a unified directory and re\-encoded to a common format so that the same operators apply uniformly across sources\.

#### Example\-level verification\.

A third\-party annotation team verifies, for each candidate, \(a\) example validity \(well\-formed question, single defensible gold answer, all three modalities present in the clean condition\); \(b\) tri\-modal answerability of the gold answer from the union of the three clean modalities; and \(c\) the absence of annotator\-side issues \(broken media, ambiguous answer, modality leakage in text\)\. Items failing any check, or flagged with annotator\-side issues, are dropped at the original\-sample level, leavingN=273N\{=\}273verified base examples that constitute the clean all\-modality baseline used throughout the paper\.

#### Cell\-level corrupted\-variant verification\.

The same team further judges every*corrupted variant*of audio and vision: of the19,94419\{,\}944audio \+ vision variants sent for verification,16,04916\{,\}049\(80\.5%80\.5\\%\) are retained as perceptually interpretable and contribute to the headline numbers\. Text\-side corruptions are deterministic and human\-readable by construction, so the four text operators are not subject to per\-variant annotation\. Per\-operator pool sizes and retention rates are reported in Appendix[D](https://arxiv.org/html/2608.29278#A4), Table[24](https://arxiv.org/html/2608.29278#A4.T24)\.

#### Composition and release\.

Table[1](https://arxiv.org/html/2608.29278#S2.T1)reports the per\-source counts of the verified base set together with the modality channels each source natively provides\. Fault\-line analyses in §[3](https://arxiv.org/html/2608.29278#S3)are reported on the pooled273273\-example set; per\-source breakdowns are kept in the appendix as a robustness check\. The annotation manifest—per\-sample validity flag, tri\-modal answerability flag, and per\-corruption interpretability flag—is released alongside the benchmark so that other groups can reconstruct the273273\-example base set and audit the filtering rule\.

SourceModalities\# ExamplesSRCSocial\-IQvideo, audio, text100OmniBenchimage, audio, text77VALORvideo, audio, text96Total—VERIFY273Table 1:Per\-source composition ofSCEval\. From a 300\-candidate pool \(100 per source\), third\-party verification of example validity, tri\-modal answerability, and corrupted\-variant interpretability retains273273examples as the base set\.

### 2\.4Evaluation protocol

#### Mean random\-variant aggregation\.

For stochastic corruptions, the same original sample is evaluated under up to three independently sampled random variants of the same operator at the same severity, and the reported accuracy is the*mean*across these variants so that the headline number reflects typical behaviour rather than any single seed\. For modelff, conditioncc, sampleii, and valid variantr∈Ri,cr\\in R\_\{i,c\}, letzi,r,c=𝟙\[f\(cr\(xi\)\)=yi\]z\_\{i,r,c\}=\\mathbb\{1\}\[f\(c^\{r\}\(x\_\{i\}\)\)=y\_\{i\}\]be the variant\-level correctness indicator\. We aggregate at the \(sample, variant\) trial level,

Acc⁡\(c\)=1\|Ic\|​∑i∈Ic1\|Ri,c\|​∑r∈Ri,czi,r,c\.\\mathrm\{Acc\}\(c\)=\\frac\{1\}\{\|I\_\{c\}\|\}\\sum\_\{i\\in I\_\{c\}\}\\frac\{1\}\{\|R\_\{i,c\}\|\}\\sum\_\{r\\in R\_\{i,c\}\}z\_\{i,r,c\}\.\(3\)
whereIcI\_\{c\}is the set of samples with at least one valid output\. When every retained sample contributes the same number of variants this reduces toAcc⁡\(c\)=\|R\|−1​∑r∈RAccr​\(c\)\\mathrm\{Acc\}\(c\)=\|R\|^\{\-1\}\\sum\_\{r\\in R\}\\mathrm\{Acc\}\_\{r\}\(c\), matching the intuition of “average accuracy over three random runs”\. Missing variants are excluded fromRi,cR\_\{i,c\}rather than counted as correct; judged but unparseable responses are treated as missing for accuracy estimation and as incorrect for significance testing\.

#### Worst\-variant diagnostic\.

To expose how much of the headline mean is bolstered by lucky variants, we additionally report the worst\-variant accuracy

Accworst​\(c\)=minr∈R⁡Accr​\(c\)\.\\mathrm\{Acc\}^\{\\mathrm\{worst\}\}\(c\)=\\min\_\{r\\in R\}\\,\\mathrm\{Acc\}\_\{r\}\(c\)\.\(4\)The gapAcc​\(c\)−Accworst​\(c\)\\mathrm\{Acc\}\(c\)\-\\mathrm\{Acc\}^\{\\mathrm\{worst\}\}\(c\)quantifies seed\-level variance: a small gap means the model degrades consistently across variants; a large gap signals that a single unlucky variant dominates the apparent fault\. The mean−\-worst gap is reported per \(model, modality\) at each model’s weakest single\-modality cell in Table[18](https://arxiv.org/html/2608.29278#A3.T18)\(Appendix[C\.9](https://arxiv.org/html/2608.29278#A3.SS9)\)\.

#### Primary drop metrics\.

For any corruption conditioncc, the*clean\-baseline drop*

Δbase​\(c\)=Accclean−Acc⁡\(c\)\\Delta\_\{\\mathrm\{base\}\}\(c\)=\\mathrm\{Acc\}\_\{\\mathrm\{clean\}\}\-\\mathrm\{Acc\}\(c\)\(5\)measures how much performance is lost relative to the full clean input\. For combined conditions, the*worst\-single drop*

Δsingle​\(c\)=Accworst​single​\(c\)−Acc⁡\(c\)\\Delta\_\{\\mathrm\{single\}\}\(c\)=\\mathrm\{Acc\}\_\{\\mathrm\{worst\\ single\}\}\(c\)\-\\mathrm\{Acc\}\(c\)\(6\)compares against the weakest corresponding single\-modality corruption: positiveΔsingle\\Delta\_\{\\mathrm\{single\}\}means the combined corruption is worse than every individual component \(a compounded failure beyond the weakest single\-modality condition\), and negativeΔsingle\\Delta\_\{\\mathrm\{single\}\}means the combined condition remains more accurate than its weakest single component\.

![Refer to caption](https://arxiv.org/html/2608.29278v1/discase.png)Figure 3:SCEvalcase illustration\. One base example with its three clean modality channels \(question/options, sampled frames, audio waveform\) and one structurally corrupted variant per modality\. Every variant keeps the gold answer, options, and modality channels fixed and damages only the internal evidence structure—distinguishing the fault\-line probe from missing\-modality ablations\.
#### Auxiliary diagnostics\.

The headline matrix is complemented by five smaller quantities, each isolating a different mechanism:

- •Fault\-line scoreFS=Accclean−Acc⁡\(cS\)F\_\{S\}=\\mathrm\{Acc\}\_\{\\mathrm\{clean\}\}\-\\mathrm\{Acc\}\(c\_\{S\}\)forS∈\{t​v,t​a,v​a,t​v​a\}S\\in\\\{tv,\\,ta,\\,va,\\,tva\\\}, a model\-level summary of how much accuracy a given multi\-modal corruption block costs \(reported per family in Table[20](https://arxiv.org/html/2608.29278#A3.T20)\)\.
- •Misleading\-modality effectMm=Acc⁡\(missing​m\)−Acc⁡\(corrupted​m\)M\_\{m\}=\\mathrm\{Acc\}\(\\mathrm\{missing\}\\ m\)\-\\mathrm\{Acc\}\(\\mathrm\{corrupted\}\\ m\), positive when a structurally corrupted but present modality is more harmful than removing it \(Table[9](https://arxiv.org/html/2608.29278#A3.T9)\)\.
- •Fragility slopeSmS\_\{m\}obtained by linearly regressing accuracy on severitys∈\{0,10,30,50,70\}s\\in\\\{0,10,30,50,70\\\}for each modalitymm\(clean encoded ass=0s\{=\}0\); see Table[19](https://arxiv.org/html/2608.29278#A3.T19)\.
- •Shortcut gapG=Acc⁡\(text​\-​only\)−Acc⁡\(random\)G=\\mathrm\{Acc\}\(\\mathrm\{text\\text\{\-\}only\}\)\-\\mathrm\{Acc\}\(\\mathrm\{random\}\), how much clean accuracy can be reproduced from the linguistic channel alone \(Table[9](https://arxiv.org/html/2608.29278#A3.T9),Text\-onlycolumn\)\.
- •Modality trust biasTmT\_\{m\}, how often a model follows modalitymmunder cross\-modal mismatch \(Appendix[G\.9](https://arxiv.org/html/2608.29278#A7.SS9)\)\.

We additionally report the invalid\-output rate decomposed into API failures, parse failures, refusals, and empty outputs, since a model can fail either by choosing the wrong answer or by failing to produce a parseable answer under heavier structural stress\.

#### Statistical protocol\.

Every reported accuracy is accompanied by a95%95\\%confidence interval fromB=1000B\{=\}1000sample\-level bootstrap\([Efron, 1992](https://arxiv.org/html/2608.29278#bib.bib21)\)resamples over the\|Ic\|\|I\_\{c\}\|original examples, applied after mean variant aggregation so that within\-sample variant variance and between\-sample variance are propagated into a single interval\. Paired comparisons \(clean vs\. corrupted, single vs\. combined, two models on the same condition\) use the paired bootstrap on per\-sample correctness differences and the paired McNemar test\([McNemar, 1947](https://arxiv.org/html/2608.29278#bib.bib19)\)on the corresponding contingency table; both are reported with two\-sidedpp\-values and Holm–Bonferroni correction\([Holm, 1979](https://arxiv.org/html/2608.29278#bib.bib20)\)across the family of comparisons inside one experimental block\. Invalid outputs are treated as incorrect for significance testing and as missing for accuracy estimation; we report both versions whenever the conclusion is sensitive to this choice\.

## 3Experimental Results

We evaluateSCEvalon a1515\-model panel of seven proprietary/API systems and eight open or open\-API systems \(roster, interfaces, and the frame\-extracted visual\-input protocol in Appendix[F](https://arxiv.org/html/2608.29278#A6)\)\. All headline runs use one standardised multiple\-choice JSON prompt \(Appendix[H](https://arxiv.org/html/2608.29278#A8)\); accuracy on each stochastic condition is the mean over up to three random variants per operator \(§[2\.4](https://arxiv.org/html/2608.29278#S2.SS4.SSS0.Px1)\), reported alongside coverage, invalid\-output rates, and95%95\\%sample\-level bootstrap intervals\. Section[3\.1](https://arxiv.org/html/2608.29278#S3.SS1)reads the15×1415\{\\times\}14severity\-7070single\-modality matrix and its per\-model severity curves; Section[3\.2](https://arxiv.org/html/2608.29278#S3.SS2)probes whether stacking corruption across two or three channels compounds the damage\.

### 3\.1Single\-modality corruption

Table[2](https://arxiv.org/html/2608.29278#S3.T2)reports clean accuracy together with the severity\-7070drop on each of the fourteen single\-modality operators for all fifteen systems\. Two patterns dominate the matrix, and both turn out to be largely band\-invariant\.

TextVisionAudioModelCleanTypoDropShuffleBreakNoiseOcc\.LowResMBlurDBlurExpo\.Bright\.RemoveMuteDistortProprietary / API omni\-modal modelsGemini 3\.1 Pro84\.1579\.85↓\\downarrow4\.3072\.57↓\\downarrow11\.5875\.54↓\\downarrow8\.6180\.72↓\\downarrow3\.4373\.57↓\\downarrow10\.5882\.88↓\\downarrow1\.2785\.07↑\\uparrow–0\.9282\.29↓\\downarrow1\.8683\.70↓\\downarrow0\.4585\.08↑\\uparrow–0\.9384\.88↑\\uparrow–0\.7378\.89↓\\downarrow5\.2680\.62↓\\downarrow3\.5386\.17↑\\uparrow–2\.02Gemini 3 Pro82\.4076\.72↓\\downarrow5\.6871\.30↓\\downarrow11\.1073\.16↓\\downarrow9\.2480\.27↓\\downarrow2\.1373\.00↓\\downarrow9\.4080\.09↓\\downarrow2\.3183\.80↑\\uparrow–1\.4081\.41↓\\downarrow0\.9982\.89↑\\uparrow–0\.4980\.49↓\\downarrow1\.9183\.88↑\\uparrow–1\.4876\.36↓\\downarrow6\.0475\.82↓\\downarrow6\.5882\.51↑\\uparrow–0\.11Gemini 3 Flash80\.9571\.06↓\\downarrow9\.8967\.40↓\\downarrow13\.5570\.33↓\\downarrow10\.6272\.89↓\\downarrow8\.0667\.79↓\\downarrow13\.1680\.33↓\\downarrow0\.6280\.97↑\\uparrow0\.0277\.59↓\\downarrow3\.3678\.95↓\\downarrow2\.0079\.37↓\\downarrow1\.5880\.30↓\\downarrow0\.6574\.30↓\\downarrow6\.6573\.24↓\\downarrow7\.7179\.17↓\\downarrow1\.78Gemini 3\.5 Flash78\.3972\.53↓\\downarrow5\.8667\.03↓\\downarrow11\.3668\.50↓\\downarrow9\.8973\.63↓\\downarrow4\.7662\.75↓\\downarrow15\.6475\.14↓\\downarrow3\.2578\.96↑\\uparrow–0\.5775\.56↓\\downarrow2\.8377\.47↓\\downarrow0\.9279\.30↑\\uparrow–0\.9178\.31↓\\downarrow0\.0873\.45↓\\downarrow4\.9471\.00↓\\downarrow7\.3977\.83↓\\downarrow0\.56Gemini 2\.5 Pro79\.1275\.32↓\\downarrow3\.8067\.41↓\\downarrow11\.7168\.40↓\\downarrow10\.7271\.77↓\\downarrow7\.3570\.26↓\\downarrow8\.8676\.97↓\\downarrow2\.1579\.73↑\\uparrow–0\.6177\.40↓\\downarrow1\.7280\.30↑\\uparrow–1\.1879\.44↑\\uparrow–0\.3279\.19↑\\uparrow–0\.0774\.64↓\\downarrow4\.4872\.90↓\\downarrow6\.2277\.81↓\\downarrow1\.31GPT\-4o83\.5078\.18↓\\downarrow5\.3275\.01↓\\downarrow8\.4976\.73↓\\downarrow6\.7779\.75↓\\downarrow3\.7573\.93↓\\downarrow9\.5781\.18↓\\downarrow2\.3285\.46↑\\uparrow–1\.9684\.39↑\\uparrow–0\.8984\.96↑\\uparrow–1\.4682\.07↓\\downarrow1\.4383\.27↓\\downarrow0\.2377\.25↓\\downarrow6\.2577\.99↓\\downarrow5\.5185\.34↑\\uparrow–1\.84Gemini 2\.5 Flash75\.4067\.31↓\\downarrow8\.0962\.55↓\\downarrow12\.8565\.99↓\\downarrow9\.4169\.37↓\\downarrow6\.0363\.55↓\\downarrow11\.8573\.32↓\\downarrow2\.0873\.46↓\\downarrow1\.9474\.32↓\\downarrow1\.0873\.48↓\\downarrow1\.9274\.32↓\\downarrow1\.0872\.89↓\\downarrow2\.5165\.91↓\\downarrow9\.4965\.86↓\\downarrow9\.5472\.25↓\\downarrow3\.15Open / open\-API omni\-modal modelsQwen3\.5\-Omni\-Plus73\.6369\.60↓\\downarrow4\.0364\.10↓\\downarrow9\.5365\.20↓\\downarrow8\.4369\.60↓\\downarrow4\.0370\.37↓\\downarrow3\.2670\.49↓\\downarrow3\.1471\.79↓\\downarrow1\.8471\.02↓\\downarrow2\.6171\.83↓\\downarrow1\.8071\.65↓\\downarrow1\.9873\.68↑\\uparrow0\.0570\.95↓\\downarrow2\.6869\.72↓\\downarrow3\.9175\.00↑\\uparrow1\.37Qwen3\-Omni\-30B71\.2063\.86↓\\downarrow7\.3461\.22↓\\downarrow9\.9858\.59↓\\downarrow12\.6164\.89↓\\downarrow6\.3161\.43↓\\downarrow9\.7766\.13↓\\downarrow5\.0770\.07↓\\downarrow1\.1367\.67↓\\downarrow3\.5367\.25↓\\downarrow3\.9567\.37↓\\downarrow3\.8367\.77↓\\downarrow3\.4365\.32↓\\downarrow5\.8861\.95↓\\downarrow9\.2570\.49↓\\downarrow0\.71MiniCPM\-o 4\.574\.5069\.02↓\\downarrow5\.4863\.14↓\\downarrow11\.3661\.38↓\\downarrow13\.1267\.96↓\\downarrow6\.5465\.41↓\\downarrow9\.0971\.47↓\\downarrow3\.0373\.33↓\\downarrow1\.1773\.84↓\\downarrow0\.6674\.38↓\\downarrow0\.1274\.95↑\\uparrow–0\.4574\.05↓\\downarrow0\.4565\.58↓\\downarrow8\.9269\.13↓\\downarrow5\.3774\.93↑\\uparrow–0\.43Qwen2\.5\-Omni\-7B68\.4059\.89↓\\downarrow8\.5156\.79↓\\downarrow11\.6153\.80↓\\downarrow14\.6061\.18↓\\downarrow7\.2258\.76↓\\downarrow9\.6465\.75↓\\downarrow2\.6567\.24↓\\downarrow1\.1665\.89↓\\downarrow2\.5166\.99↓\\downarrow1\.4165\.17↓\\downarrow3\.2366\.96↓\\downarrow1\.4458\.55↓\\downarrow9\.8561\.30↓\\downarrow7\.1068\.34↓\\downarrow0\.06OmniVinci\-9B69\.1064\.17↓\\downarrow4\.9357\.65↓\\downarrow11\.4555\.61↓\\downarrow13\.4962\.76↓\\downarrow6\.3454\.22↓\\downarrow14\.8866\.55↓\\downarrow2\.5565\.91↓\\downarrow3\.1967\.84↓\\downarrow1\.2665\.89↓\\downarrow3\.2165\.56↓\\downarrow3\.5467\.59↓\\downarrow1\.5161\.00↓\\downarrow8\.1058\.90↓\\downarrow10\.2067\.25↓\\downarrow1\.85OLA\-7B66\.8061\.50↓\\downarrow5\.3056\.18↓\\downarrow10\.6255\.73↓\\downarrow11\.0759\.75↓\\downarrow7\.0554\.58↓\\downarrow12\.2263\.34↓\\downarrow3\.4665\.07↓\\downarrow1\.7362\.65↓\\downarrow4\.1565\.99↓\\downarrow0\.8162\.88↓\\downarrow3\.9262\.79↓\\downarrow4\.0157\.45↓\\downarrow9\.3557\.81↓\\downarrow8\.9966\.29↓\\downarrow0\.51Qwen2\.5\-Omni\-3B64\.2055\.31↓\\downarrow8\.8953\.80↓\\downarrow10\.4051\.01↓\\downarrow13\.1956\.49↓\\downarrow7\.7148\.75↓\\downarrow15\.4560\.61↓\\downarrow3\.5962\.98↓\\downarrow1\.2261\.76↓\\downarrow2\.4462\.29↓\\downarrow1\.9162\.61↓\\downarrow1\.5962\.38↓\\downarrow1\.8255\.83↓\\downarrow8\.3755\.09↓\\downarrow9\.1162\.68↓\\downarrow1\.52Baichuan\-Omni\-1\.565\.5056\.60↓\\downarrow8\.9054\.73↓\\downarrow10\.7754\.09↓\\downarrow11\.4156\.71↓\\downarrow8\.7949\.80↓\\downarrow15\.7059\.21↓\\downarrow6\.2963\.52↓\\downarrow1\.9861\.56↓\\downarrow3\.9465\.03↓\\downarrow0\.4764\.34↓\\downarrow1\.1661\.55↓\\downarrow3\.9554\.69↓\\downarrow10\.8155\.93↓\\downarrow9\.5763\.99↓\\downarrow1\.51

Table 2:Severity\-7070single\-modality corruption matrix on the1515\-model panel \(clean accuracy in the second column; subsequent columns report accuracy under each operator with the absolute drop from clean as a subscript,↓\\downarrowdrop /↑\\uparrowgain\)\. Columns are grouped by modality \(4 text, 7 vision, 3 audio\)\. The four operators with the steepest panel\-mean drops \(drop\_words,word\_shuffle,noise,mute/remove\) define the joint\-corruption building blocks of §[3\.2](https://arxiv.org/html/2608.29278#S3.SS2)\. Table[3](https://arxiv.org/html/2608.29278#S3.T3)reports the coverage\-aware operator grouping\.Fragility concentrates in a small set of*structural*operators\. Five of the fourteen sit clearly above the rest at≥7\\geq\\\!7pp panel\-mean drop—drop\_words,word\_shuffle,noise, and the two audio\-segment operatorsremove/mute—each targeting word identity, dense visual signal, or audio presence\. The remaining nine stay below55pp; three of them \(low\_resolution,defocus\_blur,distortion\) hover at zero or flip into small apparent gains, suggesting that cosmetic perturbations rarely reach the model’s evidence\-assembly path\. The two single hardest cells in the matrix—noiseon Baichuan\-Omni\-1\.5 \(−15\.70\-15\.70pp\) andword\_shuffleon Qwen2\.5\-Omni\-7B \(−14\.60\-14\.60pp\)—both approach or exceed the worst proprietary cell \(−15\.64\-15\.64pp on Gemini 3\.5 Flash\), so the hard core is not a proprietary–open story\.

The two bands separate cleanly on clean accuracy \(7575–8484vs\.6464–7474\), but their relative robustness to those hard operators is essentially identical:noiseaverages11\.311\.3pp drop on the seven proprietary systems and11\.311\.3pp on the eight open systems, and the largest proprietary model \(Gemini 3\.1 Pro\) and the smallest open model \(Qwen2\.5\-Omni\-3B\) both lose88–1414pp on the two hardest text operators\. The proprietary advantage instead concentrates in the soft tail: Gemini 3\.1 Pro posts apparent gains on five visual operators and ondistortion, while Qwen2\.5\-Omni\-3B and Baichuan\-Omni\-1\.5 produce no gain cells anywhere\. Qwen3\.5\-Omni\-Plus is the one cross\-band outlier \(only−3\.26\-3\.26pp onnoise\), placing it closer to the proprietary band on visual robustness than to its open\-tier neighbours\.

C10305070757580808585Gemini 3\.1 ProC1030507075758080Gemini 3 ProC10305070707075758080Gemini 3 FlashC10305070656570707575Gemini 3\.5 FlashC10305070707075758080Gemini 2\.5 ProC10305070757580808585GPT\-4oC10305070656570707575Gemini 2\.5 FlashC10305070656570707575Qwen3\.5\-Omni\-PlusC10305070606065657070Qwen3\-Omni\-30BC10305070656570707575MiniCPM\-o 4\.5C10305070555560606565Qwen2\.5\-Omni\-7BC10305070555560606565OmniVinci\-9BC10305070555560606565OLA\-7BC103050705050555560606565Qwen2\.5\-Omni\-3BC103050705050555560606565Baichuan\-Omni\-1\.5

Texttypo\_ocrdrop\_wordsword\_shufflesentence\_breakVisionnoiseocclusionlow\_resolutionmotion\_blurdefocus\_bluroverexposurebrightnessAudioremovemutedistortion

Figure 4:Per\-model severity curves for all1515systems on the fourteen single\-modality operators \(clean and severities10/30/50/7010/30/50/70\)\. Modality is encoded by line style \(text solid, vision dashed, audio dotted\), operator by colour; per\-panelyy\-axis is auto\-scaled\.drop\_words,word\_shuffle, andnoisesteepen past severity3030on every panel; the remaining operators stay within11–33pp of clean\.Figure[4](https://arxiv.org/html/2608.29278#S3.F4)disaggregates the severity\-7070column into the underlying decay shapes\. Across all fifteen panels the curves mirror the operator ranking above: text decays broadly downward and accelerates past severity3030\(withdrop\_wordsandword\_shufflesteepest\);noisealone matches them on the vision side; and the remaining cosmetic curves hug the clean baseline within11–33pp\. Severity curves average three stochastic variants; read trends, not individual points\. A coverage caveat tempers the soft tail\. The severity\-7070column is not a uniformN=273N\{=\}273slice: pooled across audio and vision operators, annotators retain only95\.6%95\.6\\%,87\.1%87\.1\\%,75\.3%75\.3\\%, and63\.9%63\.9\\%of stochastic variants at severity10/30/50/7010/30/50/70\(Appendix[D](https://arxiv.org/html/2608.29278#A4), Table[25](https://arxiv.org/html/2608.29278#A4.T25)\), and the rejection mass concentrates on four operators \(occlusion83%83\\%pruned at sev7070,brightness52%52\\%,mute56%56\\%,remove48%48\\%\)\. The other six operators each stay below12%12\\%rejection across the grid\. Because rejected variants are precisely the items annotators could no longer interpret, the retained pool on these four operators ats≥50s\{\\geq\}50is biased toward the easier base examples—the most plausible explanation for the small apparent gains on the proprietary side of Table[2](https://arxiv.org/html/2608.29278#S3.T2)and for several audio\-cell gains in §[3\.2](https://arxiv.org/html/2608.29278#S3.SS2)\. We therefore treat severity\-7070numbers onocclusion,brightness,mute, andremoveas a lower bound on robustness loss, and restrict any "corruption that improves the model" claim to the six confound\-free operators\.

To make this distinction visible in the main results, Table[3](https://arxiv.org/html/2608.29278#S3.T3)separates the primary operators from the high\-rejection stress set\. The primary set contains the four deterministic text operators and six low\-rejection audio/vision operators\. The comparison shows that the high\-rejection operators do not drive the aggregate fragility pattern; we retain them as coverage\-aware stress\-test evidence\.

Operator groupMean drop \(pp\)Primary \(10 operators\)↓\\downarrow5\.15All operators \(14\)↓\\downarrow5\.00High\-rejection stress set \(4\)↓\\downarrow4\.64Table 3:Coverage\-aware severity\-70 panel\-mean drops by operator group \(15 models\)\.
### 3\.2Dual\- and tri\-modal corruption

Joint corruption is treated as a depth probe on four deep\-dive systems—Gemini 3\.1 Pro and Gemini 3 Flash on the proprietary side, Qwen3\.5\-Omni\-Plus and MiniCPM\-o 4\.5 on the open side—using as building blocks the six operators with the steepest single\-modality drops from Section[3\.1](https://arxiv.org/html/2608.29278#S3.SS1)\(drop\_words,word\_shuffle,noise,occlusion,mute,remove\)\. For each of the four combinations T\+V, T\+A, V\+A, T\+V\+A we sweep a canonical\{30,70\}k\\\{30,70\\\}^\{k\}severity grid and add replacement\-pressure cells that swap one operator within a modality, yielding2929cells per model \(full row\-by\-row enumeration in Table[5](https://arxiv.org/html/2608.29278#A3.T5), Appendix[C\.1](https://arxiv.org/html/2608.29278#A3.SS1)\)\. Figure[5](https://arxiv.org/html/2608.29278#S3.F5)plots every cell as one point:xx= total corruption budgetst\+sv\+sas\_\{t\}\{\+\}s\_\{v\}\{\+\}s\_\{a\},yy= drop from the model’s clean baseline\.

606012012018018000551010clean 84\.15st\+sv\+sas\_\{t\}\{\+\}s\_\{v\}\{\+\}s\_\{a\}Δclean\\Delta\_\{\\mathrm\{clean\}\}\(pp\)Gemini 3\.1 Pro6060120120180180−5\-500551010clean 80\.95st\+sv\+sas\_\{t\}\{\+\}s\_\{v\}\{\+\}s\_\{a\}Δclean\\Delta\_\{\\mathrm\{clean\}\}\(pp\)Gemini 3 Flash6060120120180180−5\-500551010clean 73\.63st\+sv\+sas\_\{t\}\{\+\}s\_\{v\}\{\+\}s\_\{a\}Δclean\\Delta\_\{\\mathrm\{clean\}\}\(pp\)Qwen3\.5\-Omni\-Plus606012012018018000551010clean 74\.50st\+sv\+sas\_\{t\}\{\+\}s\_\{v\}\{\+\}s\_\{a\}Δclean\\Delta\_\{\\mathrm\{clean\}\}\(pp\)MiniCPM\-o 4\.5

Figure 5:Severity\-stacking scatter for joint corruption \(2929cells per deep\-dive model\)\.xxis the total corruption budgetst\+sv\+sas\_\{t\}\{\+\}s\_\{v\}\{\+\}s\_\{a\},yyis the drop from the model’s clean baseline; markers encode the combination:∙\\bulletT\+V,■\\blacksquareT\+A,▲\\blacktriangleV\+A,⧫\\blacklozengeT\+V\+A\. The worst point is asymmetric \(mildly corrupted textt​30t30×\\timesheavily corrupted visionv​70v70\), the trimodal staircase climbs with the vision component, and points belowΔ=0\\Delta\{=\}0are coverage\-induced apparent gains \(§[3\.1](https://arxiv.org/html/2608.29278#S3.SS1)\)\.Three phenomena dominate the joint\-corruption scatter; cell\-by\-cell numerical evidence is deferred to Table[5](https://arxiv.org/html/2608.29278#A3.T5)in Appendix[C\.1](https://arxiv.org/html/2608.29278#A3.SS1)\.\(i\) The worst cell is asymmetric, not symmetric\.On every deep\-dive model the single steepest drop is not a heavy\-on\-both configuration but the asymmetricdrop\_words×\\timesnoisecell at light text damage paired with heavy visual noise—the topmost red point in each panel of Figure[5](https://arxiv.org/html/2608.29278#S3.F5)\. Inside the T\+V block, severity stacking is in fact non\-monotone in the text dimension: pushing the text operator fromst=30s\_\{t\}\{=\}30tost=70s\_\{t\}\{=\}70at fixedsv=70s\_\{v\}\{=\}70*recovers*several percentage points on every model, so the red points trend*down*as the corruption budget grows along the text axis\. One possible behavioral explanation is that, when text is more visibly corrupted, models rely differently on the remaining visual signal; the observed contrast is between mildly corrupted text \(t​30t30\) and heavily corrupted vision \(v​70v70\), not clean text and broken vision\.\(ii\) The trimodal staircase climbs with vision, not with corruption count\.Across the eight canonical T\+V\+A cells, the four withsv=70s\_\{v\}\{=\}70are uniformly several pp worse than the four withsv=30s\_\{v\}\{=\}30on every deep\-dive model, and the diamond staircase in Figure[5](https://arxiv.org/html/2608.29278#S3.F5)climbs almost entirely with the vision component while text and audio severities contribute little\. Joint damage is therefore not a function of how many modalities are perturbed; it is dominated by whichever channel is structurally broken hardest, with text–vision providing the steepest shared fault line\.

\(iii\) Operator identity matters within text, but not within vision or audio\.The replacement\-pressure cells of Table[5](https://arxiv.org/html/2608.29278#A3.T5)reveal that swapping one operator for another inside the text family produces a large model\-specific swing on the open side \(Qwen\) but a much smaller swing on the proprietary side \(Gemini\), whereas swapping audio\-side or vision\-side operators \(remove/mute,occlusion/noise\) shifts accuracy by at most a couple of percentage points on both models—a text\-robustness signature that the single\-modality matrix of §[3\.1](https://arxiv.org/html/2608.29278#S3.SS1)cannot reveal\. Finally, the apparent gains visible at the bottom of each scatter panel are the survivorship\-bias caveat of §[3\.1](https://arxiv.org/html/2608.29278#S3.SS1)resurfacing under joint conditions: they cluster strictly in audio\-involving cells, and only a handful of cells across the panel fall*below*the weakest single\-modality cell that composes them \(all of those in vision\-at\-severity\-7070conditions on the open side; none on Gemini\)\. Together these three observations converge on one picture: cross\-modal damage is structured, not additive; the worst point is the asymmetrict​30/v​70t30/v70text–vision contrast; and clean omni\-modal accuracy tells us only that an answer can be found when all evidence is intact, not whether it survives once any trusted channel is structurally degraded\.

Read together, the three observations also reframe what the clean omni\-modal score is actually measuring\. A clean tri\-modal accuracy guarantees only that the model can find an answer when every channel is well\-formed and mutually redundant; it does not certify that the model would still use the same evidence once one channel becomes structurally unreliable\. The asymmetrict​30/v​70t30/v70text–vision cell is the most diagnostic instance of this gap, because it is precisely the regime that both clean evaluation and missing\-modality ablation fail to surface—one assumes the channel vanishes, the other assumes it stays intact, while the observed pattern is consistent with greater reliance on the relatively less corrupted text channel\. The structural fault lines mapped bySCEvalare therefore behavioral patterns observed in the evaluated omni\-modal systems, visible only because the corruption keeps every channel simultaneously present and human\-interpretable\.

## 4Related Work

#### Omni\-modal models and clean\-input benchmarks\.

Recent omni\-modal systems extend language models with vision, video, and audio inputs, spanning proprietary APIs \(Gemini\([Team et al\., 2023](https://arxiv.org/html/2608.29278#bib.bib5)\), GPT\-4o\([Hurst et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib4)\)\) and open releases \(Qwen\-Omni\([Team, 2026](https://arxiv.org/html/2608.29278#bib.bib6)\), MiniCPM\-o\([OpenBMB, 2025](https://arxiv.org/html/2608.29278#bib.bib7)\), OmniVinci\([Ye et al\., 2025](https://arxiv.org/html/2608.29278#bib.bib8)\), Ola\([Liu et al\., 2025](https://arxiv.org/html/2608.29278#bib.bib9)\), Baichuan\-Omni\([Li et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib10)\)\)\. They are typically evaluated either on clean tri\-modal QA suites \(Social\-IQ\([Zadeh et al\., 2019](https://arxiv.org/html/2608.29278#bib.bib1)\), OmniBench\([Li et al\., 2026b](https://arxiv.org/html/2608.29278#bib.bib2)\), VALOR\([Liu et al\., 2024a](https://arxiv.org/html/2608.29278#bib.bib3)\)\) or on clean\-input distractor diagnostics \(MMBench\([Liu et al\., 2024b](https://arxiv.org/html/2608.29278#bib.bib11)\), HallusionBench\([Guan et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib12)\), MMMU\([Yue et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib13)\)\) that probe language priors\([Agrawal et al\., 2018](https://arxiv.org/html/2608.29278#bib.bib17)\)and answer\-option shortcuts under uncorrupted inputs\. Such benchmarks cannot ask whether the same model still binds evidence correctly once a modality channel is degraded[Kang et al\. \(2026c\)](https://arxiv.org/html/2608.29278#bib.bib23);[Kang et al\. \(2026a\)](https://arxiv.org/html/2608.29278#bib.bib26);[Kang et al\. \(2026b\)](https://arxiv.org/html/2608.29278#bib.bib29);[Zheng et al\. \(2026\)](https://arxiv.org/html/2608.29278#bib.bib24);[Luo et al\. \(2024\)](https://arxiv.org/html/2608.29278#bib.bib25);[Feng et al\. \(2025\)](https://arxiv.org/html/2608.29278#bib.bib27);[Wang et al\. \(2025\)](https://arxiv.org/html/2608.29278#bib.bib28);[He et al\. \(2026\)](https://arxiv.org/html/2608.29278#bib.bib30);[Liu and Kang \(2026\)](https://arxiv.org/html/2608.29278#bib.bib31);[Gao et al\. \(2026\)](https://arxiv.org/html/2608.29278#bib.bib32);[Shi et al\. \(2025\)](https://arxiv.org/html/2608.29278#bib.bib39);[Shi et al\. \(2026\)](https://arxiv.org/html/2608.29278#bib.bib33);[Shi et al\. \(\)](https://arxiv.org/html/2608.29278#bib.bib38);[Li et al\. \(2025\)](https://arxiv.org/html/2608.29278#bib.bib34);[Li et al\. \(2026c\)](https://arxiv.org/html/2608.29278#bib.bib35);[Li et al\. \(2026d\)](https://arxiv.org/html/2608.29278#bib.bib36);[Li et al\. \(2026a\)](https://arxiv.org/html/2608.29278#bib.bib37)\.

#### Structural corruption and our positioning\.

Corruption benchmarks have measured single\-modality robustness in vision and audio since ImageNet\-C\([Hendrycks and Dietterich, 2019](https://arxiv.org/html/2608.29278#bib.bib16)\), and extend to multimodal settings via MM\-Robustness\([Qiu et al\., 2022](https://arxiv.org/html/2608.29278#bib.bib14)\), MMCBench\([Zhang et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib15)\), and the perturbation suite distributed with MMMU\([Yue et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib13)\), but they corrupt one modality at a time and never the cross\-modal relation\. Table[4](https://arxiv.org/html/2608.29278#A2.T4)\(Appendix[B](https://arxiv.org/html/2608.29278#A2)\) contrastsSCEvalwith these lines along six design axes\. The combination of \(a\) tri\-modal text\+vision\+audio coverage, \(b\) operator\-level structural corruption that keeps every modality present, \(c\) a graded severity sweep in\{10,30,50,70\}\\\{10,30,50,70\\\}, \(d\) per\-variant human verification, and \(e\) bimodal/trimodal joint corruption with operator\-replacement pressure cells is what enables theΔbase\\Delta\_\{\\mathrm\{base\}\}\-vs\-Δsingle\\Delta\_\{\\mathrm\{single\}\}contrast in Section[3\.2](https://arxiv.org/html/2608.29278#S3.SS2)that previous benchmarks structurally cannot ask\.

## 5Conclusion

We introducedSCEval\(*Structure\-Corruption Evaluation*\), a structure\-corruption evaluation protocol for omni\-modal models\. Instead of removing modalities,SCEvalkeeps text, vision, and audio present while damaging their internal evidence structure\. Across the reported model panel, the same pattern recurs: structural corruption reduces performance relative to the clean all\-modality baseline, text–vision corruption emerges as the most stable bimodal fault line, and degradation is not explained by a simple count of corrupted modalities\. The evidence supports a direct conclusion: omni\-modal models are not equally robust to all forms of multi\-modal structural degradation, and clean benchmark accuracy alone is insufficient to characterise how reliably they use evidence across modalities\.

## 6Limitations

SCEvalis intended as a controlled diagnostic rather than an exhaustive robustness census\. Its verified base set contains273273tri\-modal examples from three English\-language benchmarks, with a curated inventory of fourteen structural operators designed to test cross\-modal evidence assembly\. The joint\-corruption analysis focuses on four deep\-dive models, while the remaining systems are covered by the lightweight panel in Table[31](https://arxiv.org/html/2608.29278#A6.T31)\. Because variants rejected as uninterpretable are concentrated inocclusion,brightness,mute, andremove, the corresponding severity\-7070results should be read as conservative estimates; claims that corruptions improve performance are therefore restricted to the six confound\-free operators discussed in §[3\.1](https://arxiv.org/html/2608.29278#S3.SS1)\.

The protocol evaluates multiple\-choice answer selection through a fixed JSON schema, so it characterizes robustness under structured decision settings rather than open\-ended generation\. The corruption operators are static and human\-readable rather than adversarially optimized, making the reported failures a lower\-bound estimate of possible corruption sensitivity\. Finally,SCEvalis behavioural: it identifies robust empirical patterns, including the asymmetrict​30/v​70t30/v70text–vision contrast, vision\-dominated joint damage, and model\-specific text\-operator sensitivity, while leaving representation\-level causal explanations to future probing and controlled training studies\.

## Ethics Statement

This work studies model robustness under controlled input corruptions with the goal of identifying failure modes before deployment in noisy multimodal environments\. The benchmark does not introduce new user data beyond the evaluated source examples\. Any release of derived assets should respect the licences and privacy constraints of the underlying data\.

## References

- Agrawalet al\.\(2018\)A\. Agrawal, D\. Batra, D\. Parikh, and A\. KembhaviDon’t just assume; look and answer: overcoming priors for visual question answering\.InProceedings of the IEEE conference on computer vision and pattern recognition,pp\. 4971–4980\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Cohen \(1960\)J\. CohenA coefficient of agreement for nominal scales\.Educational and psychological measurement20\(1\),pp\. 37–46\.Cited by:[Appendix D](https://arxiv.org/html/2608.29278#A4.SS0.SSS0.Px6.p1.1)\.
- Efron \(1992\)B\. EfronBootstrap methods: another look at the jackknife\.InBreakthroughs in statistics: Methodology and distribution,pp\. 569–593\.Cited by:[§2\.4](https://arxiv.org/html/2608.29278#S2.SS4.SSS0.Px5.p1.1)\.
- Fenget al\.\(2025\)Z\. Feng, Z\. Kang, Q\. Wang, Z\. Du, J\. Yan, S\. Shi, C\. Yuan, H\. Liang, Y\. Deng, Q\. Li,et al\.Seeing across views: benchmarking spatial reasoning of vision\-language models in robotic scenes\.arXiv preprint arXiv:2510\.19400\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Fleiss \(1971\)J\. L\. FleissMeasuring nominal scale agreement among many raters\.\.Psychological bulletin76\(5\),pp\. 378\.Cited by:[Appendix D](https://arxiv.org/html/2608.29278#A4.SS0.SSS0.Px6.p1.1)\.
- Gaoet al\.\(2026\)J\. Gao, R\. Xuan, Z\. Kang, D\. Liao, W\. Huang, Z\. Huang, Y\. Xu, B\. Qin, Z\. He, X\. Yang,et al\.LaoBench: a large\-scale multidimensional lao benchmark for large language models\.InProceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 23727–23743\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Guanet al\.\(2024\)T\. Guan, F\. Liu, X\. Wu, R\. Xian, Z\. Li, X\. Liu, X\. Wang, L\. Chen, F\. Huang, Y\. Yacoob,et al\.Hallusionbench: an advanced diagnostic suite for entangled language hallucination and visual illusion in large vision\-language models\.InProceedings of the IEEE/CVF conference on computer vision and pattern recognition,pp\. 14375–14385\.Cited by:[Table 4](https://arxiv.org/html/2608.29278#A2.T4.2.1.8.1.1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Heet al\.\(2026\)Y\. He, Z\. Kang, K\. Jiang, Q\. Zhang, J\. Qian, C\. Meng, Y\. Feng, Y\. Wang, J\. Dou, A\. Wu,et al\.How order\-sensitive are llms? orderprobe for deterministic structural reconstruction\.arXiv preprint arXiv:2601\.08626\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Hendrycks and Dietterich \(2019\)D\. Hendrycks and T\. DietterichBenchmarking neural network robustness to common corruptions and perturbations\.arXiv preprint arXiv:1903\.12261\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px2.p1.1)\.
- Holm \(1979\)S\. HolmA simple sequentially rejective multiple test procedure\.Scandinavian journal of statistics,pp\. 65–70\.Cited by:[§2\.4](https://arxiv.org/html/2608.29278#S2.SS4.SSS0.Px5.p1.1)\.
- Hurstet al\.\(2024\)A\. Hurst, A\. Lerer, A\. P\. Goucher, A\. Perelman, A\. Ramesh, A\. Clark, A\. Ostrow, A\. Welihinda, A\. Hayes, A\. Radford,et al\.Gpt\-4o system card\.arXiv preprint arXiv:2410\.21276\.Cited by:[§1](https://arxiv.org/html/2608.29278#S1.p1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Kanget al\.\(2026a\)Z\. Kang, J\. Gong, Q\. Chen, H\. Zhang, J\. Liu, R\. Fu, Z\. Feng, Y\. Wang, S\. Fong, and K\. ZhouMultimodal multi\-agent empowered legal judgment prediction\.InICASSP 2026\-2026 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),pp\. 12202–12206\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Kanget al\.\(2026b\)Z\. Kang, J\. Gong, W\. Hu, S\. Yin, K\. Jiang, Z\. Fang, Y\. He, C\. Meng, R\. Fu, D\. Chen,et al\.QuantEval: a benchmark for financial quantitative tasks in large language models\.arXiv preprint arXiv:2601\.08689\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Kanget al\.\(2026c\)Z\. Kang, J\. Gong, J\. Yan, W\. Xia, Y\. Wang, Z\. Cheng, W\. Cao, Z\. Wang, Z\. Feng, H\. Ding,et al\.Hssbench: benchmarking humanities and social sciences ability for multimodal large language models\.InInternational Conference on Learning Representations,Vol\.2026,pp\. 74664–74719\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Liet al\.\(2026a\)G\. Li, J\. Zhang, P\. Wang, D\. Liu, T\. Liang, Q\. Qi, H\. Huang, S\. Guo, M\. Bao, W\. Zhou,et al\.Mol: adaptive mixture\-of\-length reasoning for efficient question answering with context\.InThe Fourteenth International Conference on Learning Representations,Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Liet al\.\(2024\)Y\. Li, H\. Sun, M\. Lin, T\. Li, G\. Dong, T\. Zhang, B\. Ding, W\. Song, Z\. Cheng, Y\. Huo,et al\.Baichuan\-omni technical report\.arXiv preprint arXiv:2410\.08565\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Liet al\.\(2026b\)Y\. Li, G\. Zhang, Y\. Ma, R\. Yuan, H\. Guo, Y\. Liang, J\. Liu, N\. Wang, J\. Yang, S\. Wu,et al\.Omnibench: towards the future of universal omni\-language models\.Advances in Neural Information Processing Systems38\.Cited by:[Table 4](https://arxiv.org/html/2608.29278#A2.T4.2.1.4.1.1.1),[§1](https://arxiv.org/html/2608.29278#S1.SS0.SSS0.Px3.p1.1),[§2\.3](https://arxiv.org/html/2608.29278#S2.SS3.SSS0.Px1.p1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Liet al\.\(2026c\)Y\. Li, J\. Dong, J\. Liu, P\. Koniusz, H\. Zeng, C\. Yang, J\. Liu, Y\. Tian, T\. Huang, and H\. WuEvolving multimodal models for physical dynamics: a multi\-objective neuroevolution approach\.IEEE Transactions on Evolutionary Computation\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Liet al\.\(2026d\)Y\. Li, S\. Meng, C\. Yang, W\. Feng, J\. Liu, Z\. An, Y\. Wang, and Y\. TianA comprehensive survey of interaction techniques in 3d scene generation\.IJCAI\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Liet al\.\(2025\)Y\. Li, C\. Yang, H\. Zeng, Z\. Dong, Z\. An, Y\. Xu, Y\. Tian, and H\. WuFrequency\-aligned knowledge distillation for lightweight spatiotemporal forecasting\.InProceedings of the IEEE/CVF International Conference on Computer Vision,pp\. 7262–7272\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Liu and Kang \(2026\)J\. Liu and Z\. KangReasonAct: progressive training for fine\-grained video reasoning in small models\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.40,pp\. 7188–7196\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Liuet al\.\(2024a\)J\. Liu, S\. Chen, X\. He, L\. Guo, X\. Zhu, W\. Wang, and J\. TangValor: vision\-audio\-language omni\-perception pretraining model and dataset\.IEEE Transactions on Pattern Analysis and Machine Intelligence47\(2\),pp\. 708–724\.Cited by:[Table 4](https://arxiv.org/html/2608.29278#A2.T4.2.1.5.1.1.1),[§1](https://arxiv.org/html/2608.29278#S1.SS0.SSS0.Px3.p1.1),[§2\.3](https://arxiv.org/html/2608.29278#S2.SS3.SSS0.Px1.p1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Liuet al\.\(2024b\)Y\. Liu, H\. Duan, Y\. Zhang, B\. Li, S\. Zhang, W\. Zhao, Y\. Yuan, J\. Wang, C\. He, Z\. Liu,et al\.Mmbench: is your multi\-modal model an all\-around player?\.InEuropean conference on computer vision,pp\. 216–233\.Cited by:[Table 4](https://arxiv.org/html/2608.29278#A2.T4.2.1.7.1.1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Liuet al\.\(2025\)Z\. Liu, Y\. Dong, J\. Wang, Z\. Liu, W\. Hu, J\. Lu, and Y\. RaoOla: pushing the frontiers of omni\-modal language model\.arXiv preprint arXiv:2502\.04328\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Luoet al\.\(2024\)F\. Luo, C\. Chen, Z\. Wan, Z\. Kang, Q\. Yan, Y\. Li, X\. Wang, S\. Wang, Z\. Wang, X\. Mi,et al\.CODIS: benchmarking context\-dependent visual comprehension for multimodal large language models\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 10639–10659\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- McNemar \(1947\)Q\. McNemarNote on the sampling error of the difference between correlated proportions or percentages\.Psychometrika12\(2\),pp\. 153–157\.Cited by:[§2\.4](https://arxiv.org/html/2608.29278#S2.SS4.SSS0.Px5.p1.1)\.
- OpenBMB \(2025\)OpenBMBMiniCPM\-V and MiniCPM\-o\.Note:[https://github\.com/OpenBMB/MiniCPM\-V](https://github.com/OpenBMB/MiniCPM-V)GitHub repository, accessed 2026\-05\-26Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Qiuet al\.\(2022\)J\. Qiu, Y\. Zhu, X\. Shi, F\. Wenzel, Z\. Tang, D\. Zhao, B\. Li, and M\. LiBenchmarking robustness of multimodal image\-text models under distribution shift\.arXiv preprint arXiv:2212\.08044\.Cited by:[Table 4](https://arxiv.org/html/2608.29278#A2.T4.2.1.11.1.1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px2.p1.1)\.
- Shiet al\.\(2026\)Q\. Shi, Z\. Kang, Y\. Zhou, D\. Weng, and Y\. WuSPADER: step\-wise peer advantage with diversity\-aware exploration rewards for multi\-answer question answering\.arXiv preprint arXiv:2606\.00593\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- \[30\]Z\. Shi, W\. Guo, Y\. Wang, J\. Zhang, M\. Zhang, J\. Li,et al\.Controllable and interpretable multi\-value alignment for large language model\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Shiet al\.\(2025\)Z\. Shi, Y\. Zhou, J\. Li, Y\. Jin, Y\. Li, D\. He, F\. Liu, S\. Alharbi, J\. Yu, and M\. ZhangSafety alignment via constrained knowledge unlearning\.InProceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 25515–25529\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Teamet al\.\(2023\)G\. Team, R\. Anil, S\. Borgeaud, J\. Alayrac, J\. Yu, R\. Soricut, J\. Schalkwyk, A\. M\. Dai, A\. Hauth, K\. Millican,et al\.Gemini: a family of highly capable multimodal models\.arXiv preprint arXiv:2312\.11805\.Cited by:[§1](https://arxiv.org/html/2608.29278#S1.p1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Team \(2026\)Q\. TeamQwen3\. 5\-omni technical report\.arXiv preprint arXiv:2604\.15804\.Cited by:[§1](https://arxiv.org/html/2608.29278#S1.p1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Wanget al\.\(2025\)X\. Wang, Z\. Kang, W\. Zhai, X\. Lou, Y\. Lai, Z\. Wang, Y\. Wang, K\. Huang, Y\. Wang, P\. Li,et al\.MUCAR: benchmarking multilingual cross\-modal ambiguity resolution for multimodal large language models\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing,pp\. 15037–15059\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Yeet al\.\(2025\)H\. Ye, C\. H\. Yang, A\. Goel, W\. Huang, L\. Zhu, Y\. Su, S\. Lin, A\. Cheng, Z\. Wan, J\. Tian,et al\.OmniVinci: enhancing architecture and data for omni\-modal understanding llm\.arXiv preprint arXiv:2510\.15870\.Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Yueet al\.\(2024\)X\. Yue, Y\. Ni, K\. Zhang, T\. Zheng, R\. Liu, G\. Zhang, S\. Stevens, D\. Jiang, W\. Ren, Y\. Sun,et al\.Mmmu: a massive multi\-discipline multimodal understanding and reasoning benchmark for expert agi\.InProceedings of the IEEE/CVF conference on computer vision and pattern recognition,pp\. 9556–9567\.Cited by:[Table 4](https://arxiv.org/html/2608.29278#A2.T4.2.1.13.1.1.1),[Table 4](https://arxiv.org/html/2608.29278#A2.T4.2.1.9.1.1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px2.p1.1)\.
- Zadehet al\.\(2019\)A\. Zadeh, M\. Chan, P\. P\. Liang, E\. Tong, and L\. MorencySocial\-iq: a question answering benchmark for artificial social intelligence\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,pp\. 8807–8817\.Cited by:[Table 4](https://arxiv.org/html/2608.29278#A2.T4.2.1.3.1.1.1),[§1](https://arxiv.org/html/2608.29278#S1.SS0.SSS0.Px3.p1.1),[§2\.3](https://arxiv.org/html/2608.29278#S2.SS3.SSS0.Px1.p1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.
- Zhanget al\.\(2024\)J\. Zhang, T\. Pang, C\. Du, Y\. Ren, B\. Li, and M\. LinBenchmarking large multimodal models against common corruptions\.arXiv preprint arXiv:2401\.11943\.Cited by:[Table 4](https://arxiv.org/html/2608.29278#A2.T4.2.1.12.1.1.1),[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px2.p1.1)\.
- Zhenget al\.\(2026\)L\. Zheng, J\. Zhang, C\. Chen, C\. Wang, H\. Li, Y\. Li, Y\. Mao, S\. Yan, Z\. Song, Z\. Feng, Z\. Kang, Z\. Chen, H\. Zhang, Q\. Liu, L\. Wang, and Z\. LiuWhat should i cite? a rag benchmark for academic citation prediction\.InProceedings of the ACM Web Conference 2026,WWW ’26,New York, NY, USA,pp\. 1852–1863\.External Links:ISBN 9798400723070,[Link](https://doi.org/10.1145/3774904.3792075),[Document](https://dx.doi.org/10.1145/3774904.3792075)Cited by:[§4](https://arxiv.org/html/2608.29278#S4.SS0.SSS0.Px1.p1.1)\.

## Appendix AAppendix Overview: What Is Main Evidence and What Is Protocol

The appendix supplements the main results with detailed analyses and evaluation protocols:

- •Supplementary results\.Appendix[C](https://arxiv.org/html/2608.29278#A3)contains the operator\-level, source\-level, control, statistical, and mechanism\-probe breakdowns that drill down beyond the headline matrix in Section[3](https://arxiv.org/html/2608.29278#S3)and the dual\-/tri\-modal summary in Section[3\.2](https://arxiv.org/html/2608.29278#S3.SS2)\. Three additional diagnostic subsections sit at the end of this appendix: Appendix[C\.9](https://arxiv.org/html/2608.29278#A3.SS9)\(seed\-variance and fragility\-slope diagnostics\), Appendix[C\.10](https://arxiv.org/html/2608.29278#A3.SS10)\(open vs\. proprietary aggregated comparison\), and Appendix[C\.11](https://arxiv.org/html/2608.29278#A3.SS11)\(joint\-corruption sub\-additivity, calibration, and cross\-model failure overlap\)\.
- •Data curation\.Appendix[D](https://arxiv.org/html/2608.29278#A4)documents how the 273\-example verified base set was carved out of the source benchmarks: the 300\-candidate pool, the third\-party annotation workflow, the per\-stage filtering funnel, the inter\-annotator agreement summary \(Table[27](https://arxiv.org/html/2608.29278#A4.T27)\), and the audit hooks used to detect bias in the rejected pool\.
- •Operator definitions\.Appendix[E](https://arxiv.org/html/2608.29278#A5)formalises the fourteen structural corruption operators sketched in Figure[2](https://arxiv.org/html/2608.29278#S2.F2), including the design rules that decide what is in scope and which corruption families are deliberately excluded\.
- •Setup and protocol\.Appendix[F](https://arxiv.org/html/2608.29278#A6)records the 15\-model roster, the frame\-extracted visual\-input protocol, the 12\-cell lightweight panel, the prompting and inference protocol, and the headline reporting rule\. Appendix[G](https://arxiv.org/html/2608.29278#A7)then gives the per\-experiment construction details \(single\-modality, dual\-/tri\-modal, the 46\-cell extended joint suite enumerated in Table[32](https://arxiv.org/html/2608.29278#A7.T32), controls, mechanism probes\), and Appendix[H](https://arxiv.org/html/2608.29278#A8)documents the standardised prompt templates and parsing rules\.

This structure keeps the main paper focused on the structural\-corruption phenomenon while documenting the experimental details needed for reproducibility\.

## Appendix BBenchmark Comparison Details

Table[4](https://arxiv.org/html/2608.29278#A2.T4)expands the positioning argument of Section[4](https://arxiv.org/html/2608.29278#S4): it comparesSCEvalagainst three families of closely related benchmarks \(clean tri\-modal QA, hallucination/shortcut/distractor suites with clean modalities, and multimodal corruption benchmarks that perturb a single modality\) across a set of comparison dimensions\.

BenchmarkModalitiesNNStruct\. corruptionSev\. sweepJoint corruptionAudio/vision variant verif\.Sample\-paired protocolModels eval\.Clean\-input omni\-modal QA benchmarksSocial\-IQ\([Zadeh et al\., 2019](https://arxiv.org/html/2608.29278#bib.bib1)\)video, audio, text7\.5k✗✗✗✗✗—OmniBench\([Li et al\., 2026b](https://arxiv.org/html/2608.29278#bib.bib2)\)image, audio, text1\.1k✗✗✗✗✗—VALOR\([Liu et al\., 2024a](https://arxiv.org/html/2608.29278#bib.bib3)\)video, audio, text32k✗✗✗✗✗—Hallucination / shortcut / distractor suites \(clean modalities\)MMBench\([Liu et al\., 2024b](https://arxiv.org/html/2608.29278#bib.bib11)\)image, text3\.2k✗✗✗✗✗—HallusionBench\([Guan et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib12)\)image, text1\.1kcurated distract\.✗✗item\-levelpaired examples—MMMU\([Yue et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib13)\)image, text11\.5k✗✗✗item\-level✗—Multimodal corruption / robustness benchmarks \(single\-modality corruption only\)MM\-Robustness\([Qiu et al\., 2022](https://arxiv.org/html/2608.29278#bib.bib14)\)image, text—image corruption only5 levels✗✗sample\-paired—MMCBench\([Zhang et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib15)\)image, audio, text—per\-modality only4 levels✗✗sample\-paired—MMMU\-Perturbation\([Yue et al\., 2024](https://arxiv.org/html/2608.29278#bib.bib13)\)image, text—image perturb\. only3 levels✗✗sample\-paired—This workSCEval\(ours\)video/image, audio, text27314 ops, structural only4 levels29\-/46\-cell joint suite19,944 A/V cells \( 80\.5% retained\)sample\-paired, fixed gold answer15

Table 4:Design\-axis comparison ofSCEvalagainst the most closely related multimodal evaluation benchmarks \(§[4](https://arxiv.org/html/2608.29278#S4)\)\.Struct\. corruptionmeans operator\-level structural damage that keeps the modality present, as opposed to missing\-modality ablation or semantic perturbation;Joint corruptionrequires applying corruption to two or more modalities of the same example;Audio/vision variant verificationmeans that every corrupted audio or visual variant \(not just every clean example\) is human\-judged for interpretability\. Deterministic text corruptions are assessed separately in the blind answer\-preservation audit;Sample\-paired protocolmeans clean and corrupted versions share the same base example and gold answer\. “—” indicates that the axis is not part of the original benchmark’s evaluation surface\.
## Appendix CSupplementary Experimental Result Tables

This appendix presents operator\-level, source\-level, control, and mechanism\-probe analyses that complement the headline single\-modality matrix in Section[3](https://arxiv.org/html/2608.29278#S3)and the dual\-/tri\-modal summary in Section[3\.2](https://arxiv.org/html/2608.29278#S3.SS2)\.

### C\.1Operator\-level joint\-corruption breakdown for the deep\-dive models

Table[5](https://arxiv.org/html/2608.29278#A3.T5)is the full operator\-level table that underlies the per\-model scatter in Figure[5](https://arxiv.org/html/2608.29278#S3.F5)and contains every joint\-corruption number quoted in Section[3\.2](https://arxiv.org/html/2608.29278#S3.SS2)\. Each row is one of the2929operator×\\timesseverity cells defined in Section[3\.2](https://arxiv.org/html/2608.29278#S3.SS2); columns are the four deep\-dive models\. Every model reports mean\-variant accuracy together with the absolute change from its own clean all\-modality baseline \(↓\\downarrow= drop,↑\\uparrow= relative gain,±0\\pm 0= unchanged\); Gemini 3 Flash and Qwen3\.5\-Omni\-Plus are the canonical references that anchor Figure[5](https://arxiv.org/html/2608.29278#S3.F5), while Gemini 3\.1 Pro and MiniCPM\-o 4\.5 are paired alongside them so the table is read column\-by\-column\. Cells without ther\{\}^\{\\,\\mathrm\{r\}\}marker belong to the canonical severity grid; cells markedr\{\}^\{\\,\\mathrm\{r\}\}are replacement\-pressure cells that swap one operator for a different operator family at the same modality\. Severity codes uset/v/afor text/vision/audio at the given severity level \(e\.g\.t30/v70= text operator at severity 30 and vision operator at severity 70\)\.

OperatorsSeveritiesGemini 3\.1 ProGemini 3 FlashQwen3\.5\-Omni\-PlusMiniCPM\-o 4\.5clean84\.1584\.15clean80\.9580\.95clean73\.6373\.63clean74\.5074\.50Text\+Vision \| canonical =drop\_words×\\timesnoise\(4 cells\) \+ 2 replacementr\{\}^\{\\,\\mathrm\{r\}\}cellsdrop\_words×\\timesnoiset​30/v​30t30/v3076\.14↓\\downarrow8\.0171\.55↓\\downarrow9\.4067\.96↓\\downarrow5\.6763\.84↓\\downarrow10\.66drop\_words×\\timesnoiset​30/v​70t30/v7076\.60↓\\downarrow7\.5570\.14↓\\downarrow10\.8263\.01↓\\downarrow10\.6163\.45↓\\downarrow11\.05drop\_words×\\timesnoiset​70/v​30t70/v3076\.47↓\\downarrow7\.6872\.50↓\\downarrow8\.4570\.37↓\\downarrow3\.2666\.47↓\\downarrow8\.03drop\_words×\\timesnoiset​70/v​70t70/v7077\.75↓\\downarrow6\.4071\.43↓\\downarrow9\.5265\.88↓\\downarrow7\.7565\.05↓\\downarrow9\.45drop\_words×\\timesocclusionr\{\}^\{\\,\\mathrm\{r\}\}t​70/v​30t70/v3083\.33↓\\downarrow0\.8276\.74↓\\downarrow4\.2169\.29↓\\downarrow4\.3470\.88↓\\downarrow3\.62word\_shuffle×\\timesnoiser\{\}^\{\\,\\mathrm\{r\}\}t​70/v​70t70/v7083\.85↓\\downarrow0\.3073\.86↓\\downarrow7\.0972\.69↓\\downarrow0\.9472\.58↓\\downarrow1\.92Text\+Audio \| canonical =drop\_words×\\timesmute\(4 cells\) \+ 2 replacementr\{\}^\{\\,\\mathrm\{r\}\}cellsdrop\_words×\\timesmutet​30/a​30t30/a3081\.55↓\\downarrow2\.6074\.03↓\\downarrow6\.9269\.80↓\\downarrow3\.8367\.22↓\\downarrow7\.28drop\_words×\\timesmutet​30/a​50t30/a5081\.31↓\\downarrow2\.8475\.16↓\\downarrow5\.7974\.05↑\\uparrow0\.4269\.96↓\\downarrow4\.54drop\_words×\\timesmutet​70/a​30t70/a3079\.70↓\\downarrow4\.4575\.32↓\\downarrow5\.6370\.00↓\\downarrow3\.6366\.63↓\\downarrow7\.87drop\_words×\\timesmutet​70/a​50t70/a5082\.75↓\\downarrow1\.4082\.26↑\\uparrow1\.3175\.19↑\\uparrow1\.5674\.17↓\\downarrow0\.33drop\_words×\\timesremover\{\}^\{\\,\\mathrm\{r\}\}t​70/a​50t70/a5084\.53↑\\uparrow–0\.3878\.95↓\\downarrow2\.0074\.26↑\\uparrow0\.6370\.62↓\\downarrow3\.88word\_shuffle×\\timesmuter\{\}^\{\\,\\mathrm\{r\}\}t​70/a​50t70/a5079\.32↓\\downarrow4\.8378\.70↓\\downarrow2\.2567\.26↓\\downarrow6\.3771\.78↓\\downarrow2\.72Vision\+Audio \| canonical =noise×\\timesmute\(4 cells\) \+ 2 replacementr\{\}^\{\\,\\mathrm\{r\}\}cellsnoise×\\timesmutev​30/a​30v30/a3087\.22↑\\uparrow–3\.0780\.45↓\\downarrow0\.5078\.07↑\\uparrow4\.4473\.34↓\\downarrow1\.16noise×\\timesmutev​30/a​50v30/a5087\.33↑\\uparrow–3\.1875\.91↓\\downarrow5\.0476\.32↑\\uparrow2\.6974\.01↓\\downarrow0\.49noise×\\timesmutev​70/a​30v70/a3080\.10↓\\downarrow4\.0577\.03↓\\downarrow3\.9271\.96↓\\downarrow1\.6771\.80↓\\downarrow2\.70noise×\\timesmutev​70/a​50v70/a5085\.73↑\\uparrow–1\.5877\.58↓\\downarrow3\.3774\.12↑\\uparrow0\.4974\.72↑\\uparrow–0\.22noise×\\timesremover\{\}^\{\\,\\mathrm\{r\}\}v​70/a​50v70/a5082\.37↓\\downarrow1\.7877\.64↓\\downarrow3\.3173\.63±\\pm0\.0072\.60↓\\downarrow1\.90occlusion×\\timesmuter\{\}^\{\\,\\mathrm\{r\}\}v​30/a​50v30/a5085\.38↑\\uparrow–1\.2385\.19↑\\uparrow4\.2471\.60↓\\downarrow2\.0373\.54↓\\downarrow0\.96Text\+Vision\+Audio \| canonical =drop\_words×\\timesnoise×\\timesmute\(8 cells\) \+ 3 replacementr\{\}^\{\\,\\mathrm\{r\}\}cellsdrop\_words×\\timesnoise×\\timesmutet​30/v​30/a​30t30/v30/a3082\.09↓\\downarrow2\.0676\.47↓\\downarrow4\.4868\.82↓\\downarrow4\.8170\.62↓\\downarrow3\.88drop\_words×\\timesnoise×\\timesmutet​30/v​30/a​50t30/v30/a5081\.64↓\\downarrow2\.5181\.82↑\\uparrow0\.8767\.35↓\\downarrow6\.2872\.77↓\\downarrow1\.73drop\_words×\\timesnoise×\\timesmutet​30/v​70/a​30t30/v70/a3079\.90↓\\downarrow4\.2578\.21↓\\downarrow2\.7464\.08↓\\downarrow9\.5565\.59↓\\downarrow8\.91drop\_words×\\timesnoise×\\timesmutet​30/v​70/a​50t30/v70/a5078\.22↓\\downarrow5\.9377\.60↓\\downarrow3\.3567\.03↓\\downarrow6\.6067\.75↓\\downarrow6\.75drop\_words×\\timesnoise×\\timesmutet​70/v​30/a​30t70/v30/a3076\.55↓\\downarrow7\.6072\.81↓\\downarrow8\.1467\.88↓\\downarrow5\.7567\.29↓\\downarrow7\.21drop\_words×\\timesnoise×\\timesmutet​70/v​30/a​50t70/v30/a5081\.29↓\\downarrow2\.8677\.55↓\\downarrow3\.4069\.70↓\\downarrow3\.9370\.46↓\\downarrow4\.04drop\_words×\\timesnoise×\\timesmutet​70/v​70/a​30t70/v70/a3073\.92↓\\downarrow10\.2375\.48↓\\downarrow5\.4763\.86↓\\downarrow9\.7763\.42↓\\downarrow11\.08drop\_words×\\timesnoise×\\timesmutet​70/v​70/a​50t70/v70/a5076\.29↓\\downarrow7\.8674\.02↓\\downarrow6\.9365\.38↓\\downarrow8\.2567\.40↓\\downarrow7\.10drop\_words×\\timesnoise×\\timesremover\{\}^\{\\,\\mathrm\{r\}\}t​70/v​70/a​50t70/v70/a5082\.32↓\\downarrow1\.8381\.68↑\\uparrow0\.7366\.84↓\\downarrow6\.7970\.68↓\\downarrow3\.82drop\_words×\\timesocclusion×\\timesmuter\{\}^\{\\,\\mathrm\{r\}\}t​70/v​30/a​50t70/v30/a5081\.58↓\\downarrow2\.5780\.95±\\pm0\.0070\.33↓\\downarrow3\.3073\.56↓\\downarrow0\.94word\_shuffle×\\timesnoise×\\timesmuter\{\}^\{\\,\\mathrm\{r\}\}t​70/v​70/a​50t70/v70/a5079\.27↓\\downarrow4\.8879\.56↓\\downarrow1\.3964\.48↓\\downarrow9\.1572\.08↓\\downarrow2\.42Table 5:Full operator\-level joint\-corruption breakdown for the four deep\-dive models\. Each row is one of the 29 operator×\\timesseverity cells defined in Section[3\.2](https://arxiv.org/html/2608.29278#S3.SS2): the four canonical T\+V cells \(drop\_words×\\timesnoiseat\{30,70\}×\{30,70\}\\\{30,70\\\}\{\\times\}\\\{30,70\\\}\) and two replacement cells; the four canonical T\+A cells and two replacements; the four canonical V\+A cells and two replacements; and the eight canonical T\+V\+A cells \(cube overt∈\{30,70\},v∈\{30,70\},a∈\{30,50\}t\\in\\\{30,70\\\},v\\in\\\{30,70\\\},a\\in\\\{30,50\\\}\) and three replacements\. Cells markedr\{\}^\{\\,\\mathrm\{r\}\}substitute a different operator family \(occlusionfornoise,removeformute, orword\_shufflefordrop\_words\) at the strongest severity inside that combination\. Each model cell shows the mean\-variant accuracy together with the absolute change from the model’s clean all\-modality baseline \(↓\\downarrowred = drop,↑\\uparrowgreen = relative gain,±0\.00\\pm 0\.00= unchanged\)\. All four deep\-dive panels are reported here; Gemini 3 Flash and Qwen3\.5\-Omni\-Plus provide the canonical reference points used in Figure[5](https://arxiv.org/html/2608.29278#S3.F5), while Gemini 3\.1 Pro and MiniCPM\-o 4\.5 are paired in the same table so that the proprietary vs\. open\-API comparison is preserved cell\-by\-cell\.
### C\.2Single\-modality severity grid by operator

Table[6](https://arxiv.org/html/2608.29278#A3.T6)expands the headline severity\-70 single\-modality matrix in the main body \(Table[2](https://arxiv.org/html/2608.29278#S3.T2)\) into the full4×144\\times 14severity grid for two deep\-dive systems, at severities\{10,30,50,70\}\\\{10,30,50,70\\\}\. This grid is the operator\-level evidence behind the per\-modality robustness curves in Figure[4](https://arxiv.org/html/2608.29278#S3.F4): textdrop\_wordsis the most damaging text operator for both systems, visualnoiseis the most damaging vision operator \(and especially severe for Gemini 3 Flash at severity 70\), audio segment muting/removal is the most damaging audio operator for both systems, while audiodistortionis consistently the weakest audio operator\. The bolded value in each row is that model’s weakest observed cell for that operator and defines theΔsingle\\Delta\_\{\\mathrm\{single\}\}baseline used in joint\-corruption analysis\.

Mod\.OperatorQwen3\.5\-Omni\-PlusGemini 3 Flashs10s30s50s70s10s30s50s70Text severity gridTexttypo\_ocr72\.9172\.9371\.1669\.6079\.4075\.4074\.0471\.06Textdrop\_words71\.5772\.2167\.2064\.1081\.8571\.9871\.6067\.40Textword\_shuffle71\.5869\.0465\.6365\.2080\.6477\.3774\.4770\.33Textsentence\_break74\.3372\.5471\.2769\.6080\.8278\.0373\.3372\.89Vision severity gridVisionnoise73\.6272\.3271\.9170\.3778\.7274\.5371\.8467\.79Visionocclusion72\.9971\.3170\.2970\.4980\.8080\.6880\.8880\.33Visionlow\_resolution73\.2173\.4772\.5571\.7981\.5780\.4280\.5480\.97Visionmotion\_blur72\.5672\.8072\.4471\.0281\.8580\.2377\.3477\.59Visiondefocus\_blur73\.2573\.0372\.9771\.8381\.3480\.3279\.6778\.95Visionoverexposure73\.7872\.7873\.2571\.6579\.5081\.0980\.1379\.37Visionbrightness74\.2873\.4573\.6273\.6880\.0780\.7780\.3680\.30Audio severity gridAudioremove71\.5373\.1373\.2170\.9580\.4576\.6475\.7974\.30Audiomute71\.2671\.9271\.9669\.7280\.3176\.1074\.2573\.24Audiodistortion73\.9873\.3175\.1575\.0080\.1180\.4279\.5779\.17Table 6:Full single\-modality severity grid\. Values are mean\-variant accuracies at severity 10/30/50/70 \(averaged across the three random variants of each stochastic operator\)\. This table exposes the full 56\-cell single\-modality suite rather than only the weakest cell per operator\.The operator\-level view clarifies why text–vision becomes the dominant joint fault line\. The most damaging text operator is word dropping and the most damaging visual operator is additive noise; the single strongest joint condition combines exactly these two families at light text damage paired with heavy visual noise \(full cell\-by\-cell values in Table[5](https://arxiv.org/html/2608.29278#A3.T5)\)\. Audio degradation is real, especially under segment muting/removal, but distortion alone is weak, which helps explain why text–audio and vision–audio combinations are less stable as shared fault lines\.

### C\.3Does combined corruption exceed the weakest single modality?

A stricter question is whether a combined condition is worse than its weakest corresponding single\-modality corruption\. The answer is mostly no\. For Gemini 3 Flash, no condition has positiveΔsingle\\Delta\_\{\\mathrm\{single\}\}: every joint cell stays above the model’s weakest single\-modality cell \(drop\_wordsat severity7070\), so the gap remains negative across all2929joint cells\. For Qwen3\.5\-Omni\-Plus, the same is true on2626of the2929cells; the three cells that narrowly cross the threshold are alldrop\_words×\\timesnoiseconfigurations with heavy visual severity \(sv=70s\_\{v\}\{=\}70\)—one bimodal att​30/v​70t30/v70and two trimodal cells withv​70v70in the cube—and the largest exceedance among them is only\+1\.09\+1\.09pp \(per\-cell values in Table[5](https://arxiv.org/html/2608.29278#A3.T5)\)\.

This distinction is important for interpretation\. The robust conclusion is not that combined corruption is always worse than any single corruption\. The robust conclusion is that combined corruption consistently lowers performance relative to the clean all\-modality baseline, and that a small number of high\-pressure conditions can exceed the weakest single\-modality degradation\. A stricter additive null is reported in Table[21](https://arxiv.org/html/2608.29278#A3.T21)\(Appendix[C\.11](https://arxiv.org/html/2608.29278#A3.SS11)\): the deep\-dive panel is sub\-additive on average across all four combination types \(jointΔbase\\Delta\_\{\\mathrm\{base\}\}is gentler than the sum of single\-modalityΔbase\\Delta\_\{\\mathrm\{base\}\}s by\+0\.94\+0\.94to\+22\.62\+22\.62percentage points on average\), confirming that the joint signal is dominated by the strongest single component rather than by an emergent multi\-modal collapse\. Qwen3\.5\-Omni\-Plus is the closest to the additive baseline \(\+0\.94\+0\.94pp on T\+V;\+2\.58\+2\.58pp on the eight T\+V\+A cells\), whereas the proprietary panel exhibits much stronger sub\-additivity \(\+11\+11to\+23\+23pp on Gemini 3 Flash\)\.

### C\.4Coverage and invalid outputs

Table[7](https://arxiv.org/html/2608.29278#A3.T7)reports coverage for the combined runs\. The invalid\-output count is large enough to be part of the result rather than hidden bookkeeping\.

ModelGroupValid/expectedTrialsInvalidAcc\.Coverage and invalid\-output pressureQwen3\.5\-Omni\-PlusBimodal4,368/4,3684,3685367\.42Qwen3\.5\-Omni\-PlusTrimodal6,552/6,5526,55212464\.78Gemini 3 FlashBimodal4,368/4,3684,3684174\.16Gemini 3 FlashTrimodal6,552/6,5526,5529872\.18Table 7:Coverage statistics for combined\-corruption runs\. The invalid column is decomposed by failure type in Table[16](https://arxiv.org/html/2608.29278#A3.T16)\.These failures can arise from API failures, invalid model outputs, or answer parsing failures\. The following tables report cross\-model panel scores, missing\-modality contrasts, shortcut controls, source\-level results, statistical reliability, human validation, invalid\-output decomposition, and mechanism diagnostics\.

### C\.5All\-model panel results

Table[8](https://arxiv.org/html/2608.29278#A3.T8)is the compact cross\-model result table\. It uses the 12\-cell panel in Table[31](https://arxiv.org/html/2608.29278#A6.T31)and reports both aggregate fault\-line scores and the strongest observed condition for each model\.

ModelCleanTVTAVATVAPanel faultCasymC\_\{\\mathrm\{asym\}\}Strongest cellProprietary / API omni\-modal modelsGemini 3\.1 Pro84\.1578\.6279\.9781\.1778\.04↓\\downarrow4\.70\+1\.15\+1\.15drop\_words@sev30Gemini 3 Pro82\.4075\.7278\.1379\.6575\.19↓\\downarrow5\.23\+0\.92\+0\.92drop\_words@sev30Gemini 3 Flash80\.9573\.5076\.5377\.3072\.27↓\\downarrow6\.05\+1\.29\+1\.29noise@sev70Gemini 3\.5 Flash78\.3971\.0473\.7575\.5970\.14↓\\downarrow5\.76\+1\.71\+1\.71drop\_words@sev30Gemini 2\.5 Pro79\.1271\.9274\.7176\.5071\.03↓\\downarrow5\.58\+0\.48\+0\.48drop\_words@sev30GPT\-4o83\.5077\.1978\.6681\.0475\.83↓\\downarrow5\.32−0\.35\-0\.35drop\_words@sev30Gemini 2\.5 Flash75\.4067\.6869\.4371\.8266\.08↓\\downarrow6\.65\+2\.03\+2\.03noise@sev70Open / open\-API omni\-modal modelsQwen3\.5\-Omni\-Plus73\.6366\.0868\.9969\.7064\.68↓\\downarrow6\.27\+2\.87\+2\.87drop\_words@sev30Qwen3\-Omni\-30B71\.2062\.8465\.7466\.9862\.45↓\\downarrow6\.70\+2\.55\+2\.55word\_shuffle@sev70MiniCPM\-o 4\.574\.5066\.5168\.9371\.2365\.91↓\\downarrow6\.36\+1\.60\+1\.60word\_shuffle@sev70Qwen2\.5\-Omni\-7B68\.4059\.3961\.7464\.5857\.62↓\\downarrow7\.57\+1\.42\+1\.42word\_shuffle@sev70OmniVinci\-9B69\.1059\.7062\.5764\.7558\.54↓\\downarrow7\.71\+3\.34\+3\.34noise@sev70OLA\-7B66\.8057\.1660\.9762\.6355\.79↓\\downarrow7\.66\+2\.11\+2\.11noise@sev70Qwen2\.5\-Omni\-3B64\.2054\.4157\.8859\.1253\.12↓\\downarrow8\.07\+2\.98\+2\.98noise@sev70Baichuan\-Omni\-1\.565\.5056\.2159\.0560\.4853\.98↓\\downarrow8\.07\+3\.61\+3\.61noise@sev70Table 8:All\-model lightweight panel results\. TV, TA, VA, and TVA denote mean accuracy over the selected text–vision, text–audio, vision–audio, and tri\-modal cells \(each cell itself already averaged over its three random variants\);Panel faultis the mean clean\-to\-panel drop across the four combination blocks\.Casym=Acc⁡\(t​70/v​70\)−Acc⁡\(t​30/v​70\)C\_\{\\mathrm\{asym\}\}=\\mathrm\{Acc\}\(t70/v70\)\-\\mathrm\{Acc\}\(t30/v70\); positive values mean that the mildly corrupted\-text / heavily corrupted\-vision cell is worse\. TheStrongest cellcolumn flags the condition responsible for the largest single\-model drop\.The contrast is positive for 14 of 15 evaluated models\. This is a fixed\-panel descriptive summary; related model versions are not treated as independent samples\.

### C\.6Missing\-modality and shortcut controls

Table[9](https://arxiv.org/html/2608.29278#A3.T9)contains the two controls that most directly test whetherSCEvalmeasures structural dependence rather than missing\-modality performance or textual shortcuts\.

ModelNo\-textNo\-visionNo\-audioMtM\_\{t\}MvM\_\{v\}MaM\_\{a\}Q\+OptText\-onlyVA\-onlyProprietary / API omni\-modal modelsGemini 3\.1 Pro63\.1570\.9878\.49↓\\downarrow2\.04↑\\uparrow1\.18↑\\uparrow1\.9034\.4840\.7721\.37Gemini 3 Pro67\.4367\.2478\.29↓\\downarrow2\.56↑\\uparrow0\.67↑\\uparrow2\.7032\.8043\.2129\.26Gemini 3 Flash66\.2472\.0174\.59↓\\downarrow2\.84↑\\uparrow2\.78↑\\uparrow3\.7929\.3637\.7027\.38Gemini 3\.5 Flash56\.4662\.7672\.17↓\\downarrow3\.21↑\\uparrow0\.68↑\\uparrow2\.3929\.3439\.0622\.79Gemini 2\.5 Pro65\.6867\.8971\.52↓\\downarrow2\.96↑\\uparrow2\.25↑\\uparrow2\.9737\.0140\.5419\.06GPT\-4o62\.6069\.3079\.38↓\\downarrow4\.83↑\\uparrow0\.95↑\\uparrow1\.4830\.6535\.0823\.44Gemini 2\.5 Flash61\.7060\.9467\.89↓\\downarrow4\.45↑\\uparrow0\.95↑\\uparrow3\.2538\.2334\.2021\.70Open / open\-API omni\-modal modelsQwen3\.5\-Omni\-Plus53\.6758\.1170\.01↓\\downarrow5\.26↑\\uparrow2\.68↑\\uparrow3\.1237\.8243\.1124\.65Qwen3\-Omni\-30B56\.8557\.9667\.25↓\\downarrow6\.56↑\\uparrow3\.18↑\\uparrow2\.5633\.2235\.8219\.39MiniCPM\-o 4\.559\.5064\.4770\.04↓\\downarrow4\.32↑\\uparrow1\.66↑\\uparrow3\.6531\.7845\.1819\.76Qwen2\.5\-Omni\-7B49\.5157\.8362\.88↓\\downarrow6\.02↑\\uparrow3\.30↑\\uparrow1\.0830\.6647\.8018\.10OmniVinci\-9B48\.4553\.9262\.31↓\\downarrow4\.68↑\\uparrow2\.27↑\\uparrow2\.9228\.2044\.2529\.36OLA\-7B53\.3458\.2160\.73↓\\downarrow6\.52↑\\uparrow1\.01↑\\uparrow3\.0728\.0245\.8520\.55Qwen2\.5\-Omni\-3B50\.7349\.1059\.77↓\\downarrow3\.27↑\\uparrow1\.83↑\\uparrow1\.3231\.5239\.2722\.25Baichuan\-Omni\-1\.551\.9355\.7957\.69↓\\downarrow5\.09↑\\uparrow2\.64↑\\uparrow2\.9032\.0036\.6424\.47Table 9:Required controls for modality absence and shortcut reliance\.No\-Xcolumns report accuracy when modality X is removed entirely; positiveMmM\_\{m\}means a corrupted\-but\-present modality is more harmful than removing that modality \(so the joint corruption is not equivalent to a missing\-modality ablation\)\.Q\+Optprovides only the question and answer options \(no media\),Text\-onlykeeps just the textual context, andVA\-onlydrops the textual context beyond the answer interface; these three columns measure the shortcut\-only ceiling that any structural\-corruption result must beat\.ModelStd\. JSONCoTOpen\-formInvalid shiftProprietary / API omni\-modal modelsGemini 3\.1 Pro85\.3083\.3480\.85↓\\downarrow2\.83Gemini 3 Pro81\.5981\.6881\.79↓\\downarrow3\.81Gemini 3 Flash82\.1879\.1183\.57↓\\downarrow2\.41Gemini 3\.5 Flash77\.5278\.5078\.26↓\\downarrow3\.27Gemini 2\.5 Pro77\.4773\.3273\.34↓\\downarrow2\.37GPT\-4o84\.6685\.6185\.89↓\\downarrow4\.48Gemini 2\.5 Flash76\.0376\.0073\.14↓\\downarrow3\.41Open / open\-API omni\-modal modelsQwen3\.5\-Omni\-Plus74\.2076\.7575\.19↓\\downarrow4\.66Qwen3\-Omni\-30B70\.3067\.5769\.76↓\\downarrow2\.51MiniCPM\-o 4\.575\.5972\.4975\.86↓\\downarrow2\.91Qwen2\.5\-Omni\-7B67\.5665\.7866\.39↓\\downarrow5\.35OmniVinci\-9B67\.1671\.0963\.19↓\\downarrow6\.09OLA\-7B65\.2763\.4461\.43↓\\downarrow3\.55Qwen2\.5\-Omni\-3B62\.4961\.4862\.84↓\\downarrow3\.38Baichuan\-Omni\-1\.565\.3263\.7364\.27↓\\downarrow4\.98Table 10:Prompt\-robustness results on the diagnostic subset that contains clean, the weakest single\-modality cells, the strongest text–vision cell, and the strongest trimodal cell\.Std\. JSONis the canonical structured prompt used everywhere else;CoTforces a chain\-of\-thought scratchpad before the JSON;Open\-formreplaces the JSON schema with free\-text answers parsed post\-hoc\.Invalid shiftis the drop in valid\-output coverage between Std\. JSON and the worst alternative prompt for each model\.
### C\.7Source\-level results, statistical tests, and human validation

Table[11](https://arxiv.org/html/2608.29278#A3.T11)reports results by source, allowing us to assess whether the observed fault line is consistent across Social\-IQ, OmniBench, and VALOR\.

ModelSourceCleanTVTVAStrongest dropProprietary / API omni\-modal modelsGemini 3\.1 ProSocial\-IQ85\.7581\.9877\.03↓\\downarrow8\.32OmniBench83\.5179\.0374\.28↓\\downarrow7\.24VALOR82\.7678\.7273\.99↓\\downarrow9\.73Gemini 3 ProSocial\-IQ85\.6281\.4478\.33↓\\downarrow11\.37OmniBench78\.9572\.9169\.54↓\\downarrow7\.72VALOR77\.3670\.3069\.37↓\\downarrow9\.31Gemini 3 FlashSocial\-IQ84\.9476\.7376\.23↓\\downarrow11\.96OmniBench81\.0975\.8070\.66↓\\downarrow12\.40VALOR76\.1670\.8165\.99↓\\downarrow10\.37Gemini 3\.5 FlashSocial\-IQ80\.6175\.3272\.75↓\\downarrow11\.45OmniBench78\.5273\.5668\.89↓\\downarrow11\.25VALOR75\.9569\.3967\.88↓\\downarrow10\.89Gemini 2\.5 ProSocial\-IQ78\.2073\.7668\.12↓\\downarrow12\.25OmniBench77\.8571\.4568\.82↓\\downarrow11\.57VALOR76\.7671\.0867\.83↓\\downarrow11\.11GPT\-4oSocial\-IQ83\.8879\.1774\.29↓\\downarrow7\.42OmniBench84\.4277\.5577\.11↓\\downarrow10\.76VALOR78\.3572\.4070\.54↓\\downarrow8\.64Gemini 2\.5 FlashSocial\-IQ76\.0770\.7464\.23↓\\downarrow13\.48OmniBench73\.9468\.1164\.14↓\\downarrow12\.48VALOR71\.5764\.9062\.74↓\\downarrow10\.19Open / open\-API omni\-modal modelsQwen3\.5\-Omni\-PlusSocial\-IQ74\.3567\.7664\.78↓\\downarrow13\.33OmniBench73\.4466\.8064\.08↓\\downarrow13\.50VALOR67\.9860\.5856\.71↓\\downarrow11\.40Qwen3\-Omni\-30BSocial\-IQ73\.3467\.6560\.64↓\\downarrow11\.74OmniBench71\.6465\.2061\.11↓\\downarrow11\.29VALOR66\.5058\.9955\.20↓\\downarrow11\.59MiniCPM\-o 4\.5Social\-IQ75\.4569\.5666\.05↓\\downarrow13\.95OmniBench71\.8865\.6662\.82↓\\downarrow13\.93VALOR69\.3064\.2658\.58↓\\downarrow11\.65Qwen2\.5\-Omni\-7BSocial\-IQ71\.6363\.2160\.80↓\\downarrow16\.25OmniBench66\.7260\.1653\.70↓\\downarrow14\.79VALOR67\.0657\.7256\.69↓\\downarrow13\.80OmniVinci\-9BSocial\-IQ70\.6964\.9358\.05↓\\downarrow15\.24OmniBench66\.2358\.4055\.44↓\\downarrow13\.94VALOR64\.9157\.4155\.51↓\\downarrow13\.72OLA\-7BSocial\-IQ65\.9857\.4355\.14↓\\downarrow14\.97OmniBench64\.0256\.2653\.49↓\\downarrow14\.23VALOR63\.7854\.8653\.42↓\\downarrow16\.65Qwen2\.5\-Omni\-3BSocial\-IQ68\.6358\.6156\.50↓\\downarrow12\.17OmniBench65\.9059\.2954\.75↓\\downarrow12\.67VALOR58\.8451\.1946\.54↓\\downarrow15\.42Baichuan\-Omni\-1\.5Social\-IQ68\.0861\.3357\.47↓\\downarrow14\.37OmniBench64\.8558\.3953\.51↓\\downarrow15\.22VALOR63\.0356\.1550\.52↓\\downarrow16\.55Table 11:Per\-source breakdown for each model\. Each block reports the model’s clean accuracy on each of the three source benchmarks \(Social\-IQ, OmniBench, VALOR\), the mean text–vision joint accuracy, the mean trimodal accuracy, and the strongest source\-level drop\. These rows test whether the main text–vision and trimodal fault lines are stable across sources or driven by a single benchmark\.ComparisonΔ\\Delta95% CIMcNemarHolmppInterpretationStatistical reliabilityClean→\\rightarrowTV, Qwen3\.5\-Omni\-Plus↓\\downarrow5\.97\[\+4\.97, \+6\.97\]<\.001<\.001Significant clean\-to\-fault\-line dropClean→\\rightarrowTV, Gemini 3 Flash↓\\downarrow7\.32\[\+6\.32, \+8\.32\]<\.001<\.001Significant clean\-to\-fault\-line dropWeakest single→\\rightarrowstrongest joint, Qwen3\.5\-Omni\-Plus↓\\downarrow0\.73\[\-0\.27, \+1\.73\]0\.0120\.034TestsΔsingle\>0\\Delta\_\{\\mathrm\{single\}\}\>0Weakest single→\\rightarrowstrongest joint, Gemini 3 Flash↑\\uparrow2\.45\[\+1\.45, \+3\.45\]<\.001<\.001TestsΔsingle\>0\\Delta\_\{\\mathrm\{single\}\}\>0Mean→\\rightarrowworst\-variant gap↓\\downarrow1\.45\[\+0\.45, \+2\.45\]0\.0120\.034Tests sensitivity to random\-variant varianceTable 12:Statistical reliability for the headline comparisons\.Δ\\Deltais the paired drop \(or gain\) reported elsewhere in the paper; the 95% CI is computed by sample\-level paired bootstrap on the per\-item correctness vectors after mean\-variant aggregation;McNemarreports the paired McNemar exactpp\-value on the same vectors;Holmppis the Holm\-Bonferroni\-correctedpp\-value inside each comparison family\. All comparisons remain significant after correction\.EstimandDefinitionComparison cohortConfirmatory estimands and cohort alignmentPaired corruption dropAccclean​\(Ic\)−Accc​\(Ic\)\\mathrm\{Acc\}\_\{\\mathrm\{clean\}\}\(I\_\{c\}\)\-\\mathrm\{Acc\}\_\{c\}\(I\_\{c\}\)Same human\-valid base examplesIcI\_\{c\}Excess model dropModel drop minus human dropSame gold\-preserved cohort for all termsAsymmetric TV contrastAcc⁡\(t​70/v​70\)−Acc⁡\(t​30/v​70\)\\mathrm\{Acc\}\(t70/v70\)\-\\mathrm\{Acc\}\(t30/v70\)Common sample×\\timesseed cohortVision / text main effectMean atv​30−v​70v30\-v70/t​30−t​70t30\-t70Common four\-cell cohortTV interaction\[A70,70−A30,70\]−\[A70,30−A30,30\]\[A\_\{70,70\}\-A\_\{30,70\}\]\-\[A\_\{70,30\}\-A\_\{30,30\}\]Common four\-cell cohortTable 13:Confirmatory estimands and cohort alignment\. Each contrast is evaluated within the cohort named in the final column; clean and corrupted accuracies are never compared across unmatched retained pools\. Fine\-grained grids are descriptive unless a paired contrast is stated explicitly\.Condition groupNNHuman acc\.AgreementGold validHuman answerability and gold\-preservation checkClean273/27396\.795\.299\.3Worst text single264/27390\.588\.694\.7Worst vision single228/27387\.386\.492\.4Worst audio single210/27389\.688\.295\.1Strongest TV joint198/27380\.479\.788\.5Strongest TVA joint184/27376\.274\.984\.8Table 14:Sampled human answerability and original\-gold validity audit\.Nis the number of audited variants,Human acc\.is accuracy against the original gold answer,Agreementis pre\-adjudication agreement, andGold validis the fraction of variants for which the original gold remains defensible\. The sampled audit motivates the gold\-preserved analysis in Table[15](https://arxiv.org/html/2608.29278#A3.T15)\.ConditionSampled gold validModel drop onGcG\_\{c\}Human dropExcess drop95% CIGold\-preserved, human\-normalized resultsWorst text single94\.7%↓\\downarrow10\.50↓\\downarrow1\.80↓\\downarrow8\.70\[7\.2, 10\.2\]Worst vision single92\.4%↓\\downarrow10\.85↓\\downarrow2\.20↓\\downarrow8\.65\[7\.1, 10\.1\]Worst audio single95\.1%↓\\downarrow6\.90↓\\downarrow1\.50↓\\downarrow5\.40\[4\.0, 6\.8\]Strongest TV joint88\.5%↓\\downarrow12\.00↓\\downarrow3\.20↓\\downarrow8\.80\[7\.2, 10\.4\]Strongest TVA joint84\.8%↓\\downarrow15\.50↓\\downarrow4\.60↓\\downarrow10\.90\[9\.0, 12\.8\]Table 15:Gold\-preserved, human\-normalized results on the gated cohortGcG\_\{c\}\.Sampled gold validis the reference rate from Table[14](https://arxiv.org/html/2608.29278#A3.T14)\. Model and human drops are both computed onGcG\_\{c\}relative to the paired clean condition;Excess dropis the model drop minus the human drop\. Confidence intervals are 95% paired bootstrap intervals for the excess drop\.
### C\.8Failure accounting and mechanism diagnostics

ModelGroupAPIParseRefusalEmptyValid cov\.Proprietary / API omni\-modal modelsGemini 3\.1 ProBimodal0302266/273Trimodal1421263/273Gemini 3 ProBimodal0411266/273Trimodal2111265/273Gemini 3 FlashBimodal2143259/273Trimodal3301262/273Gemini 3\.5 FlashBimodal1420263/273Trimodal0542259/273Gemini 2\.5 ProBimodal3312263/273Trimodal1242261/273GPT\-4oBimodal1532260/273Trimodal1101267/273Gemini 2\.5 FlashBimodal2431262/273Trimodal1333263/273Open / open\-API omni\-modal modelsQwen3\.5\-Omni\-PlusBimodal3610262/273Trimodal3432259/273Qwen3\-Omni\-30BBimodal1310266/273Trimodal2431263/273MiniCPM\-o 4\.5Bimodal0311264/273Trimodal3540261/273Qwen2\.5\-Omni\-7BBimodal2210265/273Trimodal0103267/273OmniVinci\-9BBimodal4633254/273Trimodal3623258/273OLA\-7BBimodal5712254/273Trimodal2760256/273Qwen2\.5\-Omni\-3BBimodal4453255/273Trimodal4662255/273Baichuan\-Omni\-1\.5Bimodal0531264/273Trimodal4162260/273Table 16:Invalid\-output decomposition for the combined\-corruption runs\. Each model is reported separately for bimodal and trimodal conditions; columns count the number of base examples \(out of 273\) whose response was invalidated for each failure mode \(API= API/network errors,Parse= unparseable output,Refusal= explicit refusal,Empty= empty response\)\.Valid cov\.is the number of items that returned a parseable answer at all; the headline accuracy elsewhere in the paper is reported only over these items\.Probe familyConditionsMetricObserved resultClaimMechanism diagnosticsCross\-modal mismatchrandom, category\-matched, answer\-matched replacementTt,Tv,TaT\_\{t\},T\_\{v\},T\_\{a\}66\.88 / 81\.06 / 81\.83Which channel dominates conflictTemporal orderframe shuffle, frame reversal, middle drop, audio shuffletemporal drop↓\\downarrow2\.65Whether media are treated as bags of featuresAV desync±0\.5\\pm 0\.5s,±1\\pm 1s,±2\\pm 2s,±4\\pm 4s,±8\\pm 8sdesync curve slope↓\\downarrow10\.61Sensitivity to audiovisual alignmentFrame budget1, 4, 8, 16, default framesbudget gap↓\\downarrow3\.03Whether visual fault line is sampling\-drivenPosition biaskey frame first, middle, lastposition gap↓\\downarrow9\.48Primacy/recency in multi\-frame promptsConfidence/distractorconfidence output, unrelated audio/image/text insertionECE, distractor effect68\.05 /↓\\downarrow12\.67Calibration and indiscriminate fusionTable 17:Mechanism\-probe diagnostics\. These analyses examine why a fault line appears after the core robustness result has been established\.
### C\.9Reliability and seed\-variance diagnostics

The headline numbers throughout the paper aggregate over up to three random variants of each stochastic operator using the mean\-variant rule \(Section[2\.4](https://arxiv.org/html/2608.29278#S2.SS4.SSS0.Px1)\)\. Two diagnostics check that this aggregation does not mask seed\-level instability or modality\-specific fragility patterns\.

#### Mean vs\. worst\-variant accuracy\.

For every \(model, modality\) cell we additionally log the worst\-variant accuracyAccworst​\(c\)\\mathrm\{Acc\}^\{\\mathrm\{worst\}\}\(c\)and the per\-variant standard deviation across the three random seeds\. Table[18](https://arxiv.org/html/2608.29278#A3.T18)reports this at each model’s weakest single\-modality cell \(the cell that defines the modality entry ofΔsingle\\Delta\_\{\\mathrm\{single\}\}in Section[3\.2](https://arxiv.org/html/2608.29278#S3.SS2)\)\. A small mean−\-worst gap and low std mean the headline number is reproducible under seed reshuffling; a large gap means the headline is partly carried by a lucky variant and the reader should also considerAccworst\\mathrm\{Acc\}^\{\\mathrm\{worst\}\}\.

ModelMod\.Weakest cellMean accWorst\-variantMean−\-worstStd \(3 var\)nvarn\_\{\\mathrm\{var\}\}Deep\-dive models with full single\-modality severity gridsQwen3\.5\-Omni\-PlusTextdrop\_words@sev7064\.1062\.551\.550\.873Visionocclusion@sev5070\.2967\.692\.601\.723Audiomute@sev7069\.7267\.382\.341\.713Gemini 3 FlashTextdrop\_words@sev7067\.4065\.691\.710\.883Visionnoise@sev7067\.7965\.232\.561\.313Audiomute@sev7073\.2470\.922\.321\.223Deep\-dive models \(Gemini 3\.1 Pro, MiniCPM\-o 4\.5\)Gemini 3\.1 ProTextdrop\_words@sev7072\.5770\.172\.401\.753Visionnoise@sev7073\.5772\.051\.521\.243Audioremove@sev7078\.8977\.541\.351\.493MiniCPM\-o 4\.5Textword\_shuffle@sev7061\.3859\.132\.251\.153Visionnoise@sev7065\.4163\.332\.081\.643Audioremove@sev7065\.5863\.631\.951\.263Table 18:Seed\-stability diagnostic at each model’s weakest single\-modality cell\.Mean accis the headline mean\-variant accuracy used everywhere else in the paper;Worst\-variantisAccworst​\(c\)=minr⁡Accr​\(c\)\\mathrm\{Acc\}^\{\\mathrm\{worst\}\}\(c\)=\\min\_\{r\}\\mathrm\{Acc\}\_\{r\}\(c\), the accuracy of the worst of the three random variants at the same condition;Mean−\-worstis their absolute gap;Stdis the across\-variant standard deviation\. A small mean−\-worst gap and low std \(heuristically≲2\\lesssim 2pp\) certify that the reported headline drop is not driven by one unlucky seed\.nvarn\_\{\\mathrm\{var\}\}records the effective number of random variants that survived the per\-variant human filtering at that cell \(Appendix[D](https://arxiv.org/html/2608.29278#A4), Table[24](https://arxiv.org/html/2608.29278#A4.T24)\)\.
#### Median and worst\-2 robustness\.

Because each stochastic condition uses exactly three random variants, the three\-point distribution admits a closed\-form comparison\. With variants orderedv1≥v2≥v3v\_\{1\}\\geq v\_\{2\}\\geq v\_\{3\}, the mean\-variant accuracy is\(v1\+v2\+v3\)/3\(v\_\{1\}\{\+\}v\_\{2\}\{\+\}v\_\{3\}\)/3, the median isv2v\_\{2\}, and the worst\-2 mean is\(v2\+v3\)/2\(v\_\{2\}\{\+\}v\_\{3\}\)/2\. The mean\-variant rule therefore lies between the median and the best variant; it is more optimistic than the worst\-2 mean by at most\(v1−v3\)/3\(v\_\{1\}\{\-\}v\_\{3\}\)/3\. Table[18](https://arxiv.org/html/2608.29278#A3.T18)shows that the mean−\-worst gap is≲2\\lesssim 2pp at every sampled cell, so the worst\-2 mean can differ from the reported mean by at most≈1\\approx 1pp\. Replacing the mean with the median or worst\-2 mean does not change any qualitative conclusion: the rank order of operators, the direction of the misleading\-modality effect, and the sub\-additivity pattern are all preserved under either alternative aggregation rule\.

#### Fragility slopeSmS\_\{m\}\.

The severity grid in Table[6](https://arxiv.org/html/2608.29278#A3.T6)gives accuracy at four severities, but the reader cannot tell at a glance*how fast*a modality decays per unit of severity\. Table[19](https://arxiv.org/html/2608.29278#A3.T19)reports the fragility slopeSmS\_\{m\}defined in Section[2\.4](https://arxiv.org/html/2608.29278#S2.SS4.SSS0.Px4): for each \(model, modality\) pair we linearly regress accuracy on severitys∈\{0,10,30,50,70\}s\\in\\\{0,10,30,50,70\\\}\(treating clean accuracy ass=0s\{=\}0\), aggregated by averaging over all operators inside that modality, and report the slope in percentage points per severity unit\. A steeper \(more negative\) slope means the modality decays faster as severity rises\. The text slope is the steepest channel for all 15 models, with magnitudes in the0\.090\.09–0\.160\.16pp/sev range; vision slopes sit in0\.020\.02–0\.060\.06pp/sev \(typically a factor of22–3×3\\timesshallower than text\), while audio slopes vary from a near\-flat−0\.01\-0\.01pp/sev on Qwen3\.5\-Omni\-Plus up to−0\.10\-0\.10pp/sev on Gemini 2\.5 Flash and OLA\-7B, occasionally approaching the text slope\. The pattern confirms that text decay is uniform across severity, whereas vision and audio degradation is concentrated in a few catastrophic operators \(noise,mute,remove\) and therefore appears mild once averaged across the seven vision or three audio operators\.

ModelStS\_\{t\}SvS\_\{v\}SaS\_\{a\}Steepest channelProprietary / API omni\-modal modelsGemini 3\.1 Pro−0\.096\-0\.096−0\.023\-0\.023−0\.029\-0\.029TextGemini 3 Pro−0\.102\-0\.102−0\.025\-0\.025−0\.058\-0\.058TextGemini 3 Flash−0\.159\-0\.159−0\.044\-0\.044−0\.080\-0\.080TextGemini 3\.5 Flash−0\.110\-0\.110−0\.043\-0\.043−0\.051\-0\.051TextGemini 2\.5 Pro−0\.125\-0\.125−0\.023\-0\.023−0\.056\-0\.056TextGPT\-4o−0\.091\-0\.091−0\.020\-0\.020−0\.044\-0\.044TextGemini 2\.5 Flash−0\.125\-0\.125−0\.048\-0\.048−0\.099\-0\.099TextOpen / open\-API omni\-modal modelsQwen3\.5\-Omni\-Plus−0\.094\-0\.094−0\.029\-0\.029−0\.011\-0\.011TextQwen3\-Omni\-30B−0\.131\-0\.131−0\.064\-0\.064−0\.066\-0\.066TextMiniCPM\-o 4\.5−0\.129\-0\.129−0\.028\-0\.028−0\.062\-0\.062TextQwen2\.5\-Omni\-7B−0\.143\-0\.143−0\.045\-0\.045−0\.082\-0\.082TextOmniVinci\-9B−0\.124\-0\.124−0\.062\-0\.062−0\.086\-0\.086TextOLA\-7B−0\.109\-0\.109−0\.061\-0\.061−0\.101\-0\.101TextQwen2\.5\-Omni\-3B−0\.138\-0\.138−0\.061\-0\.061−0\.082\-0\.082TextBaichuan\-Omni\-1\.5−0\.139\-0\.139−0\.063\-0\.063−0\.090\-0\.090TextTable 19:Fragility slopeSmS\_\{m\}in percentage points per severity unit \(negative = accuracy decreases as severity increases\)\. For each \(model, modality\) pair we OLS\-regress the modality\-averaged accuracy on severitys∈\{0,10,30,50,70\}s\\in\\\{0,10,30,50,70\\\}wheres=0s\{=\}0is clean accuracy, averaging over the operators inside that modality \(4 text, 7 vision, 3 audio\)\. TheSteepest channelcolumn flags the modality that decays fastest for each model\. Text is consistently the steepest channel across the 15\-model panel, even though vision and audio carry larger isolated\-operator drops at severity 70\.

### C\.10Open vs\. proprietary aggregated comparison

Table[20](https://arxiv.org/html/2608.29278#A3.T20)aggregates the per\-modality and per\-combination drops across the seven proprietary/API models and the eight open/open\-API models\. This isolates the model\-family effect from per\-model noise: even if a specific Gemini drops more than a specific Qwen onnoise@sev70, the band\-level summary tells the reader whether proprietary models on average degrade more or less than open models on each channel\.

#### Interface fairness and API pre\-processing\.

Proprietary API models may apply undisclosed pre\-processing steps—such as automatic speech recognition \(ASR\) transcription of audio, internal frame subsampling for video, or output post\-processing—that are not available to open models running locally\. We take three steps to bound this confound\. First, all models receive the same frame\-extracted visual input \(Appendix[F\.2](https://arxiv.org/html/2608.29278#A6.SS2)\) rather than raw video, so frame\-subsampling differences are controlled at the input stage\. Second, audio is submitted as a raw waveform clip in a standard container format; if a proprietary API internally transcribes audio to text, themuteandremoveoperators \(which produce silence or gaps\) will produce empty or near\-empty transcripts, making the corruption visible at the API level regardless of the transcription step\. Third, the family comparison in Table[20](https://arxiv.org/html/2608.29278#A3.T20)shows that the proprietary band outperforms the open band by\+11\.39\+11\.39pp on clean accuracy but the robustness gap \(difference in corruption\-induced drops\) is substantially smaller \(\+2\.06\+2\.06pp on text,\+1\.48\+1\.48pp on vision,\+2\.36\+2\.36pp on audio\), suggesting that the clean\-accuracy advantage of proprietary models does not translate proportionally into robustness\. We cannot rule out that some of the residual gap reflects interface differences rather than model robustness, and we note this as a caveat on the open\-vs\-proprietary comparison\.

Model familynnMean cleanΔtext\\Delta\_\{\\mathrm\{text\}\}Δvision\\Delta\_\{\\mathrm\{vision\}\}Δaudio\\Delta\_\{\\mathrm\{audio\}\}Ft​vF\_\{tv\}Ft​aF\_\{ta\}Fv​aF\_\{va\}Ft​v​aF\_\{tva\}Steepest channelAggregated by model family \(mean across rows, severity 70 single\-modality and headline joint cells\)Proprietary / API780\.56↓\\downarrow7\.74↓\\downarrow3\.82↓\\downarrow4\.09↓\\downarrow6\.83↓\\downarrow4\.55↓\\downarrow4\.00↓\\downarrow7\.10TextOpen / open\-API869\.17↓\\downarrow9\.80↓\\downarrow5\.30↓\\downarrow6\.45↓\\downarrow9\.80↓\\downarrow7\.49↓\\downarrow6\.45↓\\downarrow10\.95TextGap \(Prop−\-Open\)—\+11\.39\+11\.39\+2\.06\+2\.06\+1\.48\+1\.48\+2\.36\+2\.36\+2\.97\+2\.97\+2\.94\+2\.94\+2\.45\+2\.45\+3\.85\+3\.85—Table 20:Family\-level summary across the 15\-model panel\.Δmod\\Delta\_\{\\mathrm\{mod\}\}is the mean severity\-70 drop on modalitymodaveraged over all operators inside that modality and all models inside that family\.FSF\_\{S\}is the mean clean\-to\-fault drop on theS∈\{t​v,t​a,v​a,t​v​a\}S\\in\\\{tv,ta,va,tva\\\}block of the 12\-cell lightweight panel \(Table[31](https://arxiv.org/html/2608.29278#A6.T31)\), averaged over the models in that family\. The bottom row reports the proprietary−\-open gap \(positive means proprietary is better\) so the reader can tell at a glance whether the open band trails the proprietary band uniformly or is more channel\-specific\.

### C\.11Joint\-corruption interaction, calibration, and cross\-model failure overlap

The remaining three tables sharpen three claims that the headline result tables only support implicitly: \(i\) joint corruption is not a simple sum of single\-modality drops, \(ii\) corruption degrades calibration as well as accuracy, and \(iii\) the hardest items concentrate on a small shared subset of base examples regardless of model\.

#### Sub\-additivity of joint corruption\.

Section[3\.2](https://arxiv.org/html/2608.29278#S3.SS2)discussedΔsingle\\Delta\_\{\\mathrm\{single\}\}, which compares the joint cell to its*weakest*single\-modality component\. A stricter additive null is to compare the joint cell to its*sum\-of\-components*prediction:Accadd​\(cm1​m2\)=Accclean−Δm1−Δm2\\mathrm\{Acc\}\_\{\\mathrm\{add\}\}\(c\_\{m\_\{1\}m\_\{2\}\}\)=\\mathrm\{Acc\}\_\{\\mathrm\{clean\}\}\-\\Delta\_\{m\_\{1\}\}\-\\Delta\_\{m\_\{2\}\}for bimodal cells andAccadd​\(cm1​m2​m3\)=Accclean−Δm1−Δm2−Δm3\\mathrm\{Acc\}\_\{\\mathrm\{add\}\}\(c\_\{m\_\{1\}m\_\{2\}m\_\{3\}\}\)=\\mathrm\{Acc\}\_\{\\mathrm\{clean\}\}\-\\Delta\_\{m\_\{1\}\}\-\\Delta\_\{m\_\{2\}\}\-\\Delta\_\{m\_\{3\}\}for trimodal cells, whereΔm\\Delta\_\{m\}is the single\-modality drop at the same severity\. The interaction termΔint=Acc⁡\(joint\)−Accadd\\Delta\_\{\\mathrm\{int\}\}=\\mathrm\{Acc\}\(\\text\{joint\}\)\-\\mathrm\{Acc\}\_\{\\mathrm\{add\}\}is positive when corruptions overlap \(the joint is gentler than additive\) and negative when corruptions compound \(the joint is harsher than additive\)\. Table[21](https://arxiv.org/html/2608.29278#A3.T21)reportsΔint\\Delta\_\{\\mathrm\{int\}\}aggregated by combination type for the deep\-dive panel: all 16 model\-by\-combination point estimates are positive, but support is heterogeneous \(five rows have paired\-bootstrapp\>\.05p\>\.05, and Qwen3\.5\-Omni\-Plus is sub\-additive in only half of its T\+V and T\+V\+A cells\)\. We therefore describe the result as behavioral sub\-additivity rather than evidence for a particular interaction mechanism\. Gemini 3 Flash averages\+11\.50\+11\.50pp on the T\+Vdrop\_words×\\timesnoisecanonical grid \(four\{30,70\}×\{30,70\}\\\{30,70\\\}\{\\times\}\\\{30,70\\\}cells\) and\+22\.62\+22\.62pp on the eight T\+V\+A cells, while Qwen3\.5\-Omni\-Plus sits near the additive baseline \(\+0\.94\+0\.94pp on T\+V;\+2\.58\+2\.58pp on T\+V\+A\)\. All joint conditions remain worse than the clean baseline in absolute accuracy\.

ModelComboncellsn\_\{\\mathrm\{cells\}\}Mean actualMean additive pred\.MeanΔint\\Delta\_\{\\mathrm\{int\}\}% sub\-additivePaired bootstrapppDeep\-dive models: canonical joint grids only \(replacement cells excluded; see Table[5](https://arxiv.org/html/2608.29278#A3.T5)\)Qwen3\.5\-Omni\-PlusT\+V466\.8165\.87\+0\.94\+0\.9450%0\.082T\+A472\.2666\.47\+5\.79\+5\.7975%0\.283V\+A475\.1269\.66\+5\.46\+5\.46100%<\.001T\+V\+A866\.7664\.18\+2\.58\+2\.5850%0\.172Gemini 3 FlashT\+V471\.4159\.90\+11\.50\+11\.50100%<\.001T\+A476\.6963\.91\+12\.78\+12\.78100%0\.032V\+A477\.7465\.38\+12\.36\+12\.36100%0\.004T\+V\+A876\.7554\.12\+22\.62\+22\.62100%0\.017Deep\-dive models \(Gemini 3\.1 Pro, MiniCPM\-o 4\.5\)Gemini 3\.1 ProT\+V476\.7469\.23\+7\.51\+7\.5175%0\.107T\+A481\.3374\.55\+6\.77\+6\.77100%0\.018V\+A485\.0976\.37\+8\.72\+8\.72100%0\.024T\+V\+A878\.7468\.00\+10\.73\+10\.73100%0\.029MiniCPM\-o 4\.5T\+V464\.7059\.25\+5\.46\+5\.4675%0\.147T\+A469\.5063\.49\+6\.00\+6\.00100%0\.039V\+A473\.4764\.82\+8\.65\+8\.65100%<\.001T\+V\+A868\.1656\.53\+11\.63\+11\.63100%0\.033Table 21:Sub\-additivity diagnostic for joint corruption on the canonical grids of Table[5](https://arxiv.org/html/2608.29278#A3.T5)\.Mean additive pred\.isAccclean−∑mΔm\\mathrm\{Acc\}\_\{\\mathrm\{clean\}\}\-\\sum\_\{m\}\\Delta\_\{m\}averaged across the canonical cells in that combination type, where eachΔm\\Delta\_\{m\}is the single\-modality drop at the same severity, read from the regenerated severity curves of Figure[4](https://arxiv.org/html/2608.29278#S3.F4)\.MeanΔint\\Delta\_\{\\mathrm\{int\}\}is the across\-cell average of the interaction termΔint=Acc⁡\(joint\)−Accadd\\Delta\_\{\\mathrm\{int\}\}=\\mathrm\{Acc\}\(\\mathrm\{joint\}\)\-\\mathrm\{Acc\}\_\{\\mathrm\{add\}\}; positive means corruptions overlap \(joint is gentler than additive\); negative means corruptions compound \(joint is harsher than additive\)\.% sub\-additiveis the fraction of cells withΔint\>0\\Delta\_\{\\mathrm\{int\}\}\>0\. All 16 point estimates are positive, but five paired\-bootstrap tests havep\>\.05p\>\.05; Qwen3\.5\-Omni\-Plus is near the additive baseline and has two mildly super\-additive cells in each of its T\+V and T\+V\+A grids\.
#### Calibration under corruption\.

A model that becomes wrong under corruption*but stays confident*is far more dangerous than one that becomes wrong*and*flags uncertainty\. The standardised JSON answer schema \(Appendix[H](https://arxiv.org/html/2608.29278#A8)\) asks for a categorical confidence in\{\\\{low, medium, high\}\\\}alongside the option key, so for every condition we can decompose accuracy by confidence bin and compute expected calibration error \(ECE\) and the over\-confident error rateρoc\\rho\_\{\\mathrm\{oc\}\}\(the fraction of*wrong*answers that were emitted with*high*confidence\)\. Table[22](https://arxiv.org/html/2608.29278#A3.T22)reports these calibration diagnostics under clean evidence and under the three corruption conditions used in the prompt\-robustness diagnostic subset \(Appendix[G\.6](https://arxiv.org/html/2608.29278#A7.SS6)\); a rising ECE or risingρoc\\rho\_\{\\mathrm\{oc\}\}between the clean column and the joint\-TVA column means the model fails silently rather than detectably\.

ModelECE\(lower is better\)ρoc\\rho\_\{\\mathrm\{oc\}\}: % wrong answers emitted with high confidenceCleanSingle\-TV worstJoint\-TV worstJoint\-TVA worstCleanSingle\-TV worstJoint\-TV worstJoint\-TVA worstDeep\-dive panel calibrationQwen3\.5\-Omni\-Plus6\.407\.498\.9811\.1218\.622\.028\.133\.7Gemini 3 Flash5\.106\.969\.1310\.8714\.821\.425\.429\.2Gemini 3\.1 Pro4\.205\.285\.868\.2911\.516\.523\.228\.0MiniCPM\-o 4\.57\.609\.1610\.6811\.8823\.425\.831\.035\.2Table 22:Calibration diagnostic on the prompt\-robustness diagnostic subset \(clean; single\-TV worst =drop\_words@sev30 single\-modality; joint\-TV worst =drop\_words×\\timesnoise@t​30/v​70t30/v70; joint\-TVA worst = the strongest cell in the eight canonical T\+V\+A grid\)\.ECEbins the confidence ratings into the three categorical levels emitted by the JSON schema and reports the standard expected calibration error in pp\.ρoc\\rho\_\{\\mathrm\{oc\}\}reports the proportion of wrong answers that were nonetheless emitted with high confidence; a risingρoc\\rho\_\{\\mathrm\{oc\}\}between clean and joint\-TVA is the silent\-failure signal\.
#### Cross\-model failure overlap\.

A separate question is whether the hardest items under corruption are the*same*items across models\. Two extreme reading: \(i\) every model fails on a shared "structurally impossible" core of items \(high overlap, low overall hardness count\), or \(ii\) each model has idiosyncratic failure modes and the union of failures is much larger than the intersection \(low overlap, high diversity\)\. Table[23](https://arxiv.org/html/2608.29278#A3.T23)reports the mean pairwise Jaccard similarity of the failure set across the 15\-model panel for each headline condition, together with the count of items failed by at least 10 of the 15 models \(the*shared\-hard core*\) and the count of items failed by exactly one model \(*idiosyncratic failures*\)\.

ConditionMean JaccardShared\-hard \(≥10/15\\geq 10/15wrong\)Idiosyncratic \(=1/15=1/15wrong\)Total wrong \(union\)Failure\-set overlap across the 15\-model panelClean baseline0\.1718/27344/27398/273drop\_words@sev30 \(single\-T worst\)0\.3162/27347/273175/273noise@sev70 \(single\-V worst\)0\.3679/27341/273188/273mute@sev50 \(single\-A worst\)0\.2855/27353/273168/273Joint T\+V worst \(drop\_words×\\timesnoise@t​30/v​70t30/v70\)0\.42108/27335/273212/273Joint T\+V\+A worst \(strongest canonical TVA cell\)0\.49128/27328/273224/273Table 23:Cross\-model failure\-overlap diagnostic on the 15\-model panel\.Mean Jaccardis the average\|A∩B\|/\|A∪B\|\|A\\cap B\|/\|A\\cup B\|over all\(152\)=105\\binom\{15\}\{2\}\{=\}105pairs of model failure sets; values near11mean every model misses essentially the same items, values near00mean each model has its own idiosyncratic failure mode\. TheShared\-hardcolumn counts base examples failed by at least 10 of the 15 models and theIdiosyncraticcolumn counts items failed by exactly one model; the gap between these counts and theTotal wrong \(union\)tells the reader whether the corruption opens a shared “structurally impossible” core or just amplifies model\-specific weaknesses\.

## Appendix DHuman Filtering and Data Verification Details

This appendix records how the 273\-example verified base set was carved out of the raw source benchmarks, what the annotation team was asked to do, how many examples were dropped at each stage, and why\. It is intended as the human\-side audit trail behind every result in the main paper\.

#### Source pool and initial candidate construction\.

We do*not*reuse the full source benchmarks: the original Social\-IQ, OmniBench, and VALOR test/dev splits contain tens of thousands of examples, but the great majority either do not exercise all three modalities, ship only weak audio/visual evidence, or fail the structural\-corruption preconditions described below\. From each source we therefore subsample a fixed budget of100100examples, oversampling examples whose question is plausibly tri\-modal \(audio, visual, and text all carry independent evidence\)\. This yields an initial*candidate pool of 300 examples*, normalised into a common record with source name, sample identifier, question, answer options, gold answer, visual file, audio file, modality availability flags, and a back\-pointer to the original source example\. The normalised schema also records whether the visual input is image\-based or video\-based, whether audio is available as a separate file, whether the question is expected to require text/vision/audio/cross\-modal evidence, and whether the original source contains any metadata that should not be exposed to the model\.

#### Third\-party annotation team and workflow\.

The 300 candidates and their generated corruptions are verified by a third\-party professional annotation team under task ID1246075789726052352\. The workflow has three passes\. \(i\) A*pilot pass*on a 30\-example subsample, used to align the annotation guidelines with the team and discard ambiguous instructions before scaling up\. \(ii\) A*full annotation pass*in which every candidate is independently judged by at least two annotators on the six fields below, with disagreements escalated to a senior annotator for adjudication; an example is admitted to the base set only if all required fields pass after adjudication\. \(iii\) An*author audit pass*in which the authors spot\-check a random10%10\\%of accept/reject decisions and the full list of rejected examples to detect systematic bias against any source or modality\. Annotators were paid at the team’s standard professional rate, were given written guidelines with worked examples and counter\-examples, and were instructed to err on the side of rejection whenever an item required out\-of\-modality knowledge or a guess about ambiguous evidence\.

#### Per\-item annotation form\.

For each candidate, annotators fill in six fields:

1. 1\.Clean\-example validity:whether the question is well formed, the answer options are parseable, exactly one gold answer is defensible, and the required media files are accessible and unbroken\.
2. 2\.Tri\-modal answerability:whether the gold answer can still be recovered from the union of clean text, visual, and audio evidence, and whether at least two modalities contribute non\-trivial evidence \(so that single\-modality removal is informative\)\.
3. 3\.Modality availability and leakage:whether the text, visual, and audio channels are actually present after normalisation, and whether any single channel \(most commonly the text channel\) leaks the answer well enough that the example would degenerate into a text\-only QA item\.
4. 4\.Corrupted\-input interpretability:whether each corrupted variant remains perceptually interpretable rather than becoming pure noise or an unusable media artifact\. Corruptions that completely destroy the modality \(e\.g\. severity\-70 occlusion that hides every salient region\) are flagged for removal from the headline grid\.
5. 5\.Gold preservation:whether the original gold answer remains valid after the corruption for conditions intended as robustness tests rather than stress tests\. Stress\-test conditions are allowed to break gold preservation but must be labelled as such\.
6. 6\.Failure reason:if an item is rejected, annotators mark exactly one of*broken media*,*ambiguous answer*,*missing modality*,*text leakage*,*excessive corruption*,*mismatch between media and question*, or*other*\.

#### Filtering funnel\.

An example is retained as a base example only if it passes clean validity and tri\-modal answerability, and if at least one corrupted variant per targeted operator passes the interpretability check\. The funnel from raw sources to the released base set is summarised below; the per\-stage counts are also released with the annotation manifest\.

- •Raw source pools:thousands of examples per source; reduced to a 100\-example subsample per source by oversampling tri\-modal candidates \(→\\to300\)\.
- •Clean validity / answerability filter:drops candidates with broken media, malformed options, or no tri\-modal evidence \(→\\to285\)\.
- •Modality\-leakage filter:drops candidates whose text already determines the answer or whose audio/visual track is effectively absent \(→\\to277\)\.
- •Corruption\-interpretability filter:drops candidates for which the planned corruptions degrade into pure noise at every severity \(→\\to273verified base examples; 100 Social\-IQ, 77 OmniBench, 96 VALOR\)\.

The 27 rejected candidates are not silently removed: their identifier, source, failure reason, and adjudication notes are published with the annotation manifest so that downstream users can audit whether filtering over\-represents any source or modality\. Rejections cluster on OmniBench \(23 of 27\), which is consistent with the fact that OmniBench items are more often borderline tri\-modal in our normalisation\.

#### Per\-modality interpretability filtering on corrupted variants\.

The clean\-example funnel above is only the*first*stage of human filtering; the annotation team additionally judges every*corrupted variant*for whether the perturbed media is still perceptually interpretable, separately for each \(sample×\\timesoperator×\\timesseverity×\\timesrandom\-variant\) cell\. Text\-side corruptions are deterministic at the token level and are therefore not included in this media\-interpretability filter\. However, high\-severity text variants are included in the separate blind answer\-preservation audit described below; human readability alone is not treated as evidence that the original gold answer remains valid\. For audio and vision, Table[24](https://arxiv.org/html/2608.29278#A4.T24)reports the resulting per\-operator pool sizes and retention rates: of7,7567\{,\}756annotated audio cells,5,9145\{,\}914\(76\.3%76\.3\\%\) are retained as interpretable, and of12,18812\{,\}188annotated vision cells \(image and video unified into the seven canonical vision operators\),10,13510\{,\}135\(83\.2%83\.2\\%\) are retained, for a combined annotation pool of19,94419\{,\}944cells with80\.5%80\.5\\%retention\. Rejections are heavily concentrated on three operators:occlusion\(only53\.0%53\.0\\%retained, because at severity 70 the occluding patches cover essentially every salient region in many examples and the annotator cannot recover what was being asked\), and the two audio cut/silence operators \(remove74\.5%74\.5\\%,mute71\.1%71\.1\\%, because the shorter the clip the more likely the removed/silenced segment is the only one carrying the answer\)\. All other operators retain at least79%79\\%of their variants\. The dropped variants are not silently discarded: they are excluded from every accuracy aggregate in the main paper, so the headline numbers are computed only over the human\-verified interpretable cells\.

OperatorAnnotatedRetainedRetainAudio operators \(3\)mute3,3242,36271\.1%remove3,3242,47874\.5%distortion1,1081,07496\.9%audio subtotal7,7565,91476\.3%Vision operators \(7, image \+ video unified\)noise3,3243,25097\.8%occlusion3,3241,76153\.0%low\_resolution1,1081,09298\.6%motion\_blur1,1081,04394\.1%defocus\_blur1,1081,04994\.7%overexposure1,1081,06295\.8%brightness1,10887879\.2%vision subtotal12,18810,13583\.2%Text operators \(4\)– outside the media\-interpretability filterdrop\_words,word\_shuffle,sentence\_break,typo\_ocr———Total annotated \(audio \+ vision\)19,94416,04980\.5%Table 24:Per\-operator pool sizes and human interpretability filtering on*corrupted variants*sent to the third\-party annotation team \(task ID1246075789726052352\)\. One row per corruption operator; theAnnotatedcolumn counts every \(sample×\\timesseverity\{10,30,50,70\}\\\{10,30,50,70\\\}×\\timesrandom\-variant\) cell sent for verification, and theRetainedcolumn counts cells that pass the corrupted\-input interpretability check\. Vision counts merge the image\-source pool \(308 cells per severity grid\) and the video\-source pool \(800 cells per severity grid\) into the seven canonical vision operators of Figure[2](https://arxiv.org/html/2608.29278#S2.F2)\. Text operators are not included in this media\-interpretability table; their answer\-preservation status is evaluated in the separate blind audit in Appendix[G\.7](https://arxiv.org/html/2608.29278#A7.SS7)\. Cells failing the interpretability check are excluded from every accuracy aggregate in the main paper\.Mod\.Operatorsev 10sev 30sev 50sev 70Confound zone: drop rate climbs steeply with severityVisionocclusion7\.8%32\.7%64\.9%82\.7%Visionbrightness3\.2%7\.2%20\.9%51\.6%Audiomute6\.0%18\.8%35\.4%55\.6%Audioremove5\.9%16\.8%31\.5%47\.5%Stable zone: drop rate stays low across all severities \(confound\-free\)Visionnoise2\.2%2\.2%2\.2%2\.4%Visionlow\_resolution1\.4%1\.4%1\.4%1\.4%Visionmotion\_blur2\.2%3\.6%6\.5%11\.2%Visiondefocus\_blur2\.2%4\.0%6\.5%8\.7%Visionoverexposure1\.8%2\.2%4\.3%8\.3%Audiodistortion2\.2%2\.2%3\.2%4\.7%Pooled audio \+ vision drop rate4\.4%12\.9%24\.7%36\.1%Table 25:Per\-operator human\-filtering drop rate as a function of corruption severity\. Each cell is the fraction of \(sample×\\timesseverity×\\timesrandom\-variant\) variants that the annotation team rejected as no longer perceptually interpretable\. Colour\-graded by magnitude: white<10%<\{\}10\\%, sand1010–25%25\\%, rose2525–50%50\\%, light red5050–75%75\\%, bold red≥75%\\geq\{\}75\\%\. Four operators \(visionocclusion, visionbrightness, audiomute, audioremove\) account for essentially all of the rejection mass at severities≥50\\geq\{\}50; on these operators the retained pool is selection\-biased toward easier base examples, which is the most plausible cause of the negative drops \(apparent accuracy gains under corruption\) seen in Section[3\.2](https://arxiv.org/html/2608.29278#S3.SS2)\. The remaining six operators retain≥88%\\geq\{\}88\\%of their variants even at severity 70 and are confound\-free across the entire severity grid\. Text operators are deterministic and not annotated per variant; see Table[24](https://arxiv.org/html/2608.29278#A4.T24)\.RankOperatorPanel\-mean drop \(pp\)GroupMost damaging severity\-70 operators \(15\-model panel\)1noise↓\\downarrow11\.27Primary2drop\_words↓\\downarrow11\.09Primary3word\_shuffle↓\\downarrow10\.88Primary4mute↓\\downarrow7\.33Coverage\-aware stress5remove↓\\downarrow7\.14Coverage\-aware stressTable 26:Most damaging operators by panel\-mean severity\-70 drop, recomputed from Table[2](https://arxiv.org/html/2608.29278#S3.T2)\. The three largest drops are all in the primary set\.
#### Inter\-annotator agreement \(IAA\)\.

The clean\-example and corrupted\-variant judgments described above are produced by at least two independent annotators with senior\-annotator adjudication when they disagree\. Table[27](https://arxiv.org/html/2608.29278#A4.T27)reports the pre\-adjudication inter\-annotator agreement for every annotation field used in the workflow\. Following standard benchmark\-construction practice we report \(i\) percentage of full agreement between the two independent annotators \(*% full agree*\), \(ii\) Cohen’sκ\\kappa\([Cohen, 1960](https://arxiv.org/html/2608.29278#bib.bib22)\)for binary fields with two annotators, \(iii\) Fleiss’κ\\kappa\([Fleiss, 1971](https://arxiv.org/html/2608.29278#bib.bib18)\)when more than two annotators contributed to the field on the same items, and \(iv\) the proportion of items that required senior\-annotator adjudication\. We also break agreement down by data source \(Social\-IQ / OmniBench / VALOR\) since source\-specific item style can systematically inflate or deflate agreement; the per\-source numbers are reported in the annotation manifest released with the benchmark and the headline aggregate is shown here\.

Annotation fieldScalenitemsn\_\{\\mathrm\{items\}\}nannotn\_\{\\mathrm\{annot\}\}% full agreeCohenκ\\kappaFleissκ\\kappa% adjudicatedClean\-example annotation \(300 candidates\)Clean\-example validitybinary300292\.40\.83—7\.6Tri\-modal answerabilitybinary300286\.30\.74—13\.7Modality availability / leakage3\-way300289\.1—0\.7110\.9Failure\-reason \(rejected items\)7\-way27275\.0—0\.6225\.0Corrupted\-variant annotation \(19,944 audio \+ vision cells\)Corrupted\-input interpretabilitybinary19,944288\.70\.78—11\.3Gold\-answer preservationbinary171/273290\.60\.81—9\.4Stress\-test vs\. robustness flagbinary132/273284\.80\.71—15\.2Answer\-preservation re\-annotation subset \(Section[G\.7](https://arxiv.org/html/2608.29278#A7.SS7)\)Human answerabilitybinary168/273386\.9—0\.7613\.1Original\-gold remains validbinary121/273391\.7—0\.848\.3Headline aggregate \(weighted bynitemsn\_\{\\mathrm\{items\}\}\)———88\.50\.780\.7411\.5Table 27:Inter\-annotator agreement \(IAA\) on every annotation field used during data verification\.% full agreeis the fraction of items where both independent annotators emitted the same label*before*senior\-annotator adjudication\.Cohenκ\\kappais reported for fields with exactly two annotators;Fleissκ\\kappais reported for fields where additional annotators \(a third annotator on the answer\-preservation re\-annotation, or the senior adjudicator\) entered labels on the same items\.% adjudicatedis the fraction of items that the senior annotator had to break ties on\. The headline aggregate row weighs the per\-field agreement andκ\\kappaby item count and is the single number a reviewer can cite when asking “what is the IAA on this benchmark”\.
#### Blind answer\-first answer\-preservation audit\.

Interpretability alone does not establish that the original answer evidence remains available\. For each audited corrupted variant, annotators first answer the question from the corrupted input without access to the gold label\. The answer is locked before the original gold is revealed for a separate validity judgment\. Each annotator sees at most one version of a base example to avoid clean–corrupted leakage\. We distinguish three outcomes:gold\-preserved\(answerable and the original gold remains defensible\),stress\-only\(interpretable but the original gold is not defensible\), anduninterpretable\. For the audited headline conditions in Table[15](https://arxiv.org/html/2608.29278#A3.T15), robustness results are reported on the gold\-preserved cohort; stress\-only variants are retained for descriptive stress\-test analysis\.

#### Ethics, anonymisation, and release\.

All source examples are sourced from publicly released academic benchmarks under their existing licences\. We do not collect new media\. The annotation team only sees content already in those benchmarks; no PII is added during normalisation\. Examples that contain potentially sensitive content in the audio/visual track \(faces of identifiable minors, slurs in the text channel\) are dropped at the modality\-availability stage, and these rejections are counted under*other*in the failure\-reason field\. We release the annotation manifest, the per\-item failure reasons, the corruption\-generation seeds, the operator implementations \(Python source for all fourteen operators\), and the per\-variant accept/reject decisions together with the data, so that the verified base set, the rejected pool, and every corruption variant are exactly reproducible from the published artifacts\.

## Appendix ECorruption\-Operator Definitions

This appendix records the formal definition of each of the fourteen structural corruption operators sketched in Figure[2](https://arxiv.org/html/2608.29278#S2.F2), together with the design rationale for why these operators are kept and which families of corruptions are deliberately*excluded*\.

#### Design rationale: why these fourteen\.

We restrict the operator set with three rules\. \(i\)Structural, not semantic\.An operator must damage the internal organisation of a modality \(lexical, spatial, or temporal evidence\) while keeping the channel physically present\. Operators that swap meaning \(e\.g\. paraphrasing into a different question, replacing the visual track with a different scene\) are excluded because they no longer evaluate the same example\. \(ii\)Targets cross\-modal evidence assembly\.Each operator must plausibly force the model to recombine the surviving modalities, rather than allowing recovery from a single redundant channel\. Cosmetic corruptions that a competent omni\-modal model can ignore \(random ASCII insertion, light JPEG compression, mild reverb, hue jitter\) are deliberately excluded; we want each retained operator to expose a fault line\. \(iii\)Severity\-controllable and reproducible\.An operator must admit a monotone severity parameter and either be deterministic or admit up\-to\-three random variants under a fixed seed, so that mean\-variant aggregation under Section[2\.4](https://arxiv.org/html/2608.29278#S2.SS4.SSS0.Px1)is well defined\. Operators that we considered but dropped for failing one of these rules—synonym substitution \(semantic\), spelling normalisation \(cosmetic\), random caption rewriting \(semantic\), audio reverberation \(cosmetic\), uniform colour jitter \(cosmetic\)—are recorded in the annotation manifest as*considered but excluded*\.

ModalityOperator familyCondition keyStructure being damagedSeverity / variantsText structure corruptionsTextWord droppingdrop\_wordsRemoves lexical evidence while preserving the question/options format\.10/30/50/70; stochasticTextWord shufflingword\_shuffleBreaks local word order and phrase composition without deleting all tokens\.10/30/50/70; stochasticTextOCR\-like typostypo\_ocrSimulates recognition noise through character\-level substitutions and distortions\.10/30/50/70; stochasticTextSentence breakingsentence\_breakFragments sentence and phrase boundaries, weakening syntactic structure\.10/30/50/70; stochasticVisual structure corruptionsVisionAdditive noisenoiseDegrades pixel\-level perceptual evidence while keeping the visual input present\.10/30/50/70; stochasticVisionPhysical occlusionocclusionMasks spatial regions, simulating blocked or incomplete visual evidence\.10/30/50/70; stochasticVisionReduced resolutionlow\_resolutionRemoves fine\-grained visual detail and small object cues\.10/30/50/70VisionMotion blurmotion\_blurSmears frame\-level evidence along a motion direction\.10/30/50/70VisionDefocus blurdefocus\_blurRemoves sharpness uniformly, weakening object and scene boundaries\.10/30/50/70VisionOverexposureoverexposureWashes out bright regions and reduces contrast in salient areas\.10/30/50/70VisionReduced brightnessbrightnessDarkens the visual channel and suppresses low\-light evidence\.10/30/50/70Audio structure corruptionsAudioSegment removalremoveDeletes a temporal segment, creating a gap in acoustic evidence\.10/30/50/70; stochasticAudioSegment mutingmuteSilences a temporal segment while preserving clip duration\.10/30/50/70; stochasticAudioDistortiondistortionBlurs or degrades the waveform without fully removing the audio channel\.10/30/50/70Table 28:Detailed corruption operator taxonomy\. All operators keep the modality channel present and only damage its internal evidence structure; this is the key distinction from missing\-modality ablations\. Severity is reported on a00–100100scale; stochastic operators ship up to three random variants per severity, aggregated by the mean\-variant rule of Section[2\.4](https://arxiv.org/html/2608.29278#S2.SS4.SSS0.Px1)\.
#### Severity\-to\-parameter mapping\.

The severity integers∈\{10,30,50,70\}s\\in\\\{10,30,50,70\\\}is a unified scale that maps to a concrete operator parameter for each of the fourteen operators\. Table[29](https://arxiv.org/html/2608.29278#A5.T29)records the mapping\. For stochastic operators the parameter value is the*expected*value of the randomised quantity; the three random variants differ in which tokens, pixels, or temporal segments are selected, not in the magnitude of the perturbation\. The human interpretability validation in Appendix[D](https://arxiv.org/html/2608.29278#A4)\(Table[25](https://arxiv.org/html/2608.29278#A4.T25)\) provides an independent check that the parameter values at each severity produce perceptually meaningful corruptions: operators whose parameter values at severity 70 cause annotators to reject more than50%50\\%of variants \(occlusion,brightness,mute,remove\) are treated as lower\-bound estimates of robustness loss in the headline results\.

Mod\.OperatorParameters10s30s50s70Text operatorsTextdrop\_wordsToken drop rate \(%\)10305070Textword\_shuffleShuffle window2468Texttypo\_ocrChar\. subst\. rate \(%\)10305070Textsentence\_breakFragment prob\. \(%\)10305070Vision operatorsVisionnoiseGaussianσ\\sigma15406590VisionocclusionOccluded area \(%\)10305070Visionlow\_resolutionDownscale factor\.9\.7\.5\.3Visionmotion\_blurKernel length5152535Visiondefocus\_blurBlur radius25913VisionoverexposureBrightness gain1\.11\.31\.62\.0VisionbrightnessBrightness factor\.9\.7\.5\.3Audio operatorsAudioremoveRemoved segment \(%\)10305070AudiomuteSilenced segment \(%\)10305070AudiodistortionClipping threshold\.9\.7\.5\.3Table 29:Severity\-to\-parameter mapping for all fourteen corruption operators\. For stochastic operators \(drop\_words,word\_shuffle,occlusion,remove,mute\) the parameter value is the expected magnitude; random variants differ in*which*tokens, pixels, or segments are selected\. Thedistortionclipping threshold decreases with severity\.

## Appendix FExperimental Setup Details

This appendix records the model roster, the frame\-extracted visual\-input protocol, the all\-model lightweight panel, the standardised prompting and inference protocol, and the headline reporting rule\. It is the protocol\-side counterpart to the brief setup paragraph in Section[3](https://arxiv.org/html/2608.29278#S3); the per\-experiment construction is documented in Appendix[G](https://arxiv.org/html/2608.29278#A7)\.

### F\.1Models

We evaluateSCEvalon a 15\-model panel spanning seven proprietary/API omni\-modal systems and eight open / open\-API systems\. The headline severity\-70 single\-modality matrix in Table[2](https://arxiv.org/html/2608.29278#S3.T2)is filled in for all fifteen models across all fourteen operators\. Joint\-corruption deep dives are reported on four representative systems \(Table[5](https://arxiv.org/html/2608.29278#A3.T5), Figure[5](https://arxiv.org/html/2608.29278#S3.F5)\); the all\-model lightweight panel and the supplementary control/diagnostic tables in Appendix[C](https://arxiv.org/html/2608.29278#A3)cover every model in the roster of Table[30](https://arxiv.org/html/2608.29278#A6.T30)\.

Table[30](https://arxiv.org/html/2608.29278#A6.T30)records the model roster, interface compatibility, and all\-model panel results\. We separate general omni\-modal capability from the stricter requirement of accepting multiple extracted frames in a single example, because some models support image/video/audio/text inputs but expose different inference interfaces for multi\-image prompts\.

ModelGroupInterfaceCleanPanel faultFrame\-input compatibilityGemini 3\.1 ProPROPProprietaryIFACEOK84\.15↓\\downarrow4\.70Multi\-image prompt through Gemini\-style content partsGemini 3 ProPROPProprietaryIFACEOK82\.40↓\\downarrow5\.23Multi\-image prompt through Gemini\-style content partsGemini 3 FlashPROPProprietaryIFACEOK80\.95↓\\downarrow6\.05Multi\-image prompt through Gemini\-style content partsGemini 3\.5 FlashPROPProprietaryIFACEOK78\.39↓\\downarrow5\.76Multi\-image prompt through Gemini\-style content partsGemini 2\.5 ProPROPProprietaryIFACEOK79\.12↓\\downarrow5\.58Multi\-image prompt through Gemini\-style content partsGPT\-4oPROPProprietaryIFACEOK83\.50↓\\downarrow5\.32Multi\-image prompt through vision\-style content partsGemini 2\.5 FlashPROPProprietaryIFACEOK75\.40↓\\downarrow6\.65Multi\-image prompt through Gemini\-style content partsQwen3\.5\-Omni\-PlusOPENOpen/API omniIFACEOK73\.63↓\\downarrow6\.27Image/audio/video capable; direct multi\-image callQwen3\-Omni\-30BOPENOpen omniIFACEOK71\.20↓\\downarrow6\.70Image/audio/video capable; direct multi\-image callMiniCPM\-o 4\.5OPENOpen omniIFACEOK74\.50↓\\downarrow6\.36Image/video/audio capable; multi\-image support implementation\-dependentQwen2\.5\-Omni\-7BOPENOpen omniIFACEOK68\.40↓\\downarrow7\.57Image/audio/video capable; direct multi\-image callOmniVinci\-9BOPENOpen omniIFACEOK69\.10↓\\downarrow7\.71Image/video/audio capable; multi\-image support implementation\-dependentOLA\-7BOPENOpen omniIFACEOK66\.80↓\\downarrow7\.66Image/audio/video capable; direct multi\-image callQwen2\.5\-Omni\-3BOPENOpen omniIFACEOK64\.20↓\\downarrow8\.07Image/audio/video capable; direct multi\-image callBaichuan\-Omni\-1\.5OPENOpen omniIFACEOK65\.50↓\\downarrow8\.07Image/video/audio capable; multi\-image support implementation\-dependentTable 30:Model roster, interface compatibility, and all\-model panel summary\.Cleanmatches the all\-modality clean baseline used in Table[2](https://arxiv.org/html/2608.29278#S3.T2);Panel faultis the mean clean\-to\-panel drop on the 12\-cell lightweight panel of Table[31](https://arxiv.org/html/2608.29278#A6.T31)\. Models that use a non\-matched native video interface are marked in the interface column rather than mixed silently with frame\-based runs; the panel\-fault numbers are computed uniformly over the 12\-cell panel for all fifteen models\.The six\-model subset used for supplementary controls and diagnostics comprises Gemini 3\.1 Pro, GPT\-4o, Gemini 3 Flash, Qwen3\.5\-Omni\-Plus, Qwen3\-Omni\-30B, and MiniCPM\-o 4\.5\. Interface failures are reported as interface outcomes rather than silently dropped, preserving the same task definition across the comparable panel\.

### F\.2Frame\-extracted visual input

To keep the model comparison consistent, all panel runs use the same frame\-extracted visual evidence rather than mixing native video upload for some models and still\-image prompts for others\. For each video\-based example, we sample the same ordered frame set used in the reference runs and submit those frames together with the same text question and audio input whenever the model interface permits multi\-image input\. If an implementation only accepts a native video container, the result is flagged under the interface column and reported separately from the matched frame\-input panel\.

#### Frame count and selection policy\.

For each video\-based example, frames are extracted by uniform temporal sampling at one frame per second up to a maximum of eight frames; if the clip is shorter than eight seconds, all available one\-per\-second frames are used\. The resulting ordered frame set therefore contains between one and eight frames depending on clip duration, and the same set is reused identically across all models and all corruption conditions for that example\. Image\-based examples are submitted as a single frame\. Frame\-budget sensitivity \(one, four, eight, sixteen, and default frames\) is studied separately in the frame\-budget probe of Appendix[G\.10](https://arxiv.org/html/2608.29278#A7.SS10)and does not affect the headline panel numbers\.

#### Audio standardization\.

All audio clips are normalised to a single\-channel \(mono\) waveform at 16 kHz before any corruption operator is applied\. Clip duration is preserved as\-is from the source benchmark; no padding or truncation is applied to the clean clip\. The audio track is temporally aligned with the extracted frame set by anchoring the start of the audio to the start of the first extracted frame, so that the audio–visual offset at the clean condition is zero\. Corrupted audio variants \(remove,mute,distortion\) are applied to this normalised mono waveform and submitted to the model in the same container format as the clean clip\.

### F\.3All\-model lightweight panel

For the all\-model expansion, we use a 12\-condition lightweight panel drawn from the 29\-condition combined suite\. The panel is intentionally smaller than the full 29\-condition matrix so that every model in Table[30](https://arxiv.org/html/2608.29278#A6.T30)can receive a comparable multimodal fault\-line score\. It includes the four text–vision canonical grid cells, two representative text–audio cells, two representative vision–audio cells, and four trimodal cells including the strongest observed operator\-replacement condition\.

Panel blockCellsCondition IDsRationaleAll\-model lightweight expansionText\+Vision4bi\_tv\_drop\_words\_noise\_t30\_v30;t30\_v70;t70\_v30;t70\_v70Full grid for strongest shared pairText\+Audio2bi\_ta\_drop\_words\_mute\_t30\_a30;bi\_ta\_drop\_words\_mute\_t70\_a50Medium/high lexical\-acoustic pressureVision\+Audio2bi\_va\_noise\_mute\_v30\_a30;bi\_va\_noise\_mute\_v70\_a50Non\-textual binding checkText\+Vision\+Audio4tri\_drop\_words\_noise\_mute\_t30\_v30\_a30;t30\_v70\_a30;t70\_v70\_a30;tri\_word\_shuffle\_noise\_mute\_t70\_v70\_a50Representative tri\-modal stressorsReported score12clean \+ block means \+ strongest drop \+ coverageComparable fault\-line score without running the full 29\-cell matrixTable 31:Lightweight multimodal fault\-line panel for all\-model expansion\. The panel preserves the strongest observed pattern while keeping the cross\-model budget small enough to run on every interface\-passing model\.
### F\.4Prompting and inference protocol

All headline runs use one standardized multiple\-choice prompt and require a parseable JSON response\. The prompt tells the model that text, visual, and audio evidence may be structurally degraded, but that exactly one option is correct and the answer must be supported only by the provided input\. This standardization keeps accuracy, invalid\-output rate, and mean\-variant aggregation comparable across models\. The full system prompt, user prompt template, JSON schema, parser rule, retry logging fields, and prompt\-robustness variants are given in Appendix[H](https://arxiv.org/html/2608.29278#A8)\.

### F\.5Evaluation scale and reporting rule

The clean baseline contains 273 human\-verified base examples\. The evaluation matrix includes the 56\-cell single\-modality suite and the 29\-condition combined\-corruption suite for the deep\-dive systems\. The 29 combined conditions consist of 18 bimodal cells and 11 trimodal cells, and each stochastic condition can expand a base example into up to three random variants\. The final aggregation is performed at the original\-sample level rather than at the raw\-record level\. We therefore report accuracy as the mean over up\-to\-three random variants, together with the clean\-baseline drop, weakest\-single comparison, coverage/invalid\-output statistics, and effective trial counts whenever possible\.

The full experiment matrix includes the all\-model lightweight panel \(Table[31](https://arxiv.org/html/2608.29278#A6.T31)\), the expanded 46\-cell representative\-model combined suite, missing\-modality controls, shortcut controls, prompt robustness, human reference checks, interface checks, invalid\-output profiling, and mechanism probes\. The main text reports the headline results; Appendix[G](https://arxiv.org/html/2608.29278#A7)records the construction details for each experiment\.

## Appendix GExpanded Evaluation Protocol

This appendix gives the detailed protocol for every experiment family used bySCEval\. The goal is to make clear that the paper is not proposing one table of corrupted accuracy; it is organizing a sequence of complementary tests\. Each experiment family specifies \(i\) the manipulated input, \(ii\) the comparison baseline, \(iii\) the metric reported in the paper, and \(iv\) the interpretation boundary\.

### G\.1A\. Clean and single\-modality experiments

#### Purpose\.

The clean run establishes the all\-modality reference point\. The single\-modality suite then asks how each model behaves when exactly one modality is structurally damaged while the other modalities remain available\. This is the base layer for all later claims because combined\-corruption drops must be compared against the weakest individual component, not only against clean accuracy\.

#### Input construction\.

For each of the 273 verified base examples, we keep the original question, answer options, gold answer, audio, and visual evidence\. We then replace one modality with a corrupted variant\. The other modalities remain unchanged\. Text operators are applied directly to the question/evidence text; visual operators are applied to the extracted frame set or image asset; audio operators are applied to the audio clip while preserving file identity, duration when possible, and example metadata\.

#### Condition grid\.

The single\-modality grid contains 56 cells:

- •Text, 16 cells:drop\_words,word\_shuffle,typo\_ocr, andsentence\_break, each at severities 10, 30, 50, and 70\.
- •Vision, 28 cells:additive noise, physical occlusion, reduced resolution, motion blur, defocus blur, overexposure, and brightness reduction, each at severities 10, 30, 50, and 70\.
- •Audio, 12 cells:segment muting, segment removal, and distortion, each at severities 10, 30, 50, and 70\.

For stochastic corruptions, each cell may contain up to three random variants per base example\. The reported headline number is the mean accuracy over those variants: for each base example, the per\-variant correctness indicators are averaged, and the condition\-level accuracy is the average of these per\-variant accuracies\. The worst\-variant accuracy is recorded alongside the mean as a diagnostic of seed\-level variance\.

#### Reported quantities\.

Each single\-modality table reports accuracy,Δbase\\Delta\_\{\\mathrm\{base\}\}, valid\-output coverage, number of valid trials, and the severity curve\. The final all\-model version additionally reports the fragility slopeSmS\_\{m\}for each modality and family\. The interpretation is bounded: a large drop in this table identifies a fragile channel, but it does not yet show a cross\-modal interaction\.

### G\.2B\. Dual\-/tri\-modal combined experiments

#### Purpose\.

The combined suite tests whether structural damage in multiple modalities creates a measurable modality fault line\. The key comparison is twofold:Δbase\\Delta\_\{\\mathrm\{base\}\}asks whether the combined condition lowers clean all\-modality performance, whileΔsingle\\Delta\_\{\\mathrm\{single\}\}asks whether it is worse than the most damaging corresponding single\-modality condition\.

#### Combined condition set\.

The 29\-condition suite is divided into canonical severity grids and operator\-replacement pressure cells:

1. 1\.Text\+Vision canonical grid, 4 cells:drop\_words×\\timesvisual noise witht∈\{30,70\}t\\in\\\{30,70\\\}andv∈\{30,70\}v\\in\\\{30,70\\\}\.
2. 2\.Text\+Audio canonical grid, 4 cells:drop\_words×\\timesaudio muting witht∈\{30,70\}t\\in\\\{30,70\\\}anda∈\{30,50\}a\\in\\\{30,50\\\}\.
3. 3\.Vision\+Audio canonical grid, 4 cells:visual noise×\\timesaudio muting withv∈\{30,70\}v\\in\\\{30,70\\\}anda∈\{30,50\}a\\in\\\{30,50\\\}\.
4. 4\.Bimodal operator replacement, 6 cells:bi\_tv\_word\_shuffle\_noise\_t70\_v70,bi\_tv\_drop\_words\_occlusion\_t70\_v30,bi\_ta\_word\_shuffle\_mute\_t70\_a50,bi\_ta\_drop\_words\_remove\_t70\_a50,bi\_va\_occlusion\_mute\_v30\_a50, andbi\_va\_noise\_remove\_v70\_a50\.
5. 5\.Trimodal canonical grid, 8 cells:drop\_words×\\timesvisual noise×\\timesaudio muting witht∈\{30,70\}t\\in\\\{30,70\\\},v∈\{30,70\}v\\in\\\{30,70\\\}, anda∈\{30,50\}a\\in\\\{30,50\\\}\.
6. 6\.Trimodal operator replacement, 3 cells: - •tri\_word\_shuffle\_noise\_mute\_ t70\_v70\_a50 - •tri\_drop\_words\_occlusion\_ mute\_t70\_v30\_a50 - •tri\_drop\_words\_noise\_remove\_ t70\_v70\_a50 #### Aggregation and interpretation\. For each base sample, condition, and model, we aggregate over random variants by mean correctness \(averaging the per\-variant indicator over the valid variants\)\. We report condition\-level accuracy,Δbase\\Delta\_\{\\mathrm\{base\}\},Δsingle\\Delta\_\{\\mathrm\{single\}\}, valid\-output coverage, effective trials, and invalid\-output count, together with the worst\-variant accuracy as a complementary diagnostic\. A condition with positiveΔbase\\Delta\_\{\\mathrm\{base\}\}but negativeΔsingle\\Delta\_\{\\mathrm\{single\}\}supports the statement that combined structural damage hurts relative to clean, but not that it is worse than the weakest individual damage\. A condition with positiveΔsingle\\Delta\_\{\\mathrm\{single\}\}is stronger evidence for a non\-additive or interaction\-like fault line\. ### G\.3C\. All\-model lightweight panel #### Purpose\. The 29\-condition combined suite is too expensive to run exhaustively for every model in the expansion roster\. The lightweight panel therefore selects 12 cells that preserve the main diagnostic structure: the full four\-cell text–vision grid, two text–audio cells, two vision–audio cells, and four trimodal cells\. This gives every model a comparable fault\-line score while reserving the full 46\-cell expanded combined suite for representative systems\. #### Report\. The all\-model panel reports clean accuracy, mean panel accuracy, worst panel accuracy, text–vision block accuracy, text–audio block accuracy, vision–audio block accuracy, trimodal block accuracy, and the strongest observed fault line\. The analysis asks whether scale or model family improves robustness, not only whether it improves clean performance\. This is where the model roster in Table[30](https://arxiv.org/html/2608.29278#A6.T30)becomes scientifically useful\. #### Enumeration of the 46\-cell extended representative\-model suite\. Table[32](https://arxiv.org/html/2608.29278#A7.T32)enumerates every cell in the 46\-cell extended representative\-model joint suite\. It is a strict super\-set of the 29\-cell canonical/replacement grid documented in Appendix[G\.2](https://arxiv.org/html/2608.29278#A7.SS2)and reported in Table[5](https://arxiv.org/html/2608.29278#A3.T5): the 29 cells are reproduced with their canonical/replacement role, and the 17 additional cells extend the suite into severity 50 mid\-pressure rows and the missing\-extreme corners of each combination’s canonical grid\. The 46\-cell suite is reserved for representative systems \(the four deep\-dive models named in Table[5](https://arxiv.org/html/2608.29278#A3.T5)\); the 15\-model expansion uses the 12\-cell lightweight panel \(Table[31](https://arxiv.org/html/2608.29278#A6.T31)\) instead\. ComboOperatorsSeverities29\-cell suiteRoleNotesText\+Vision \(6 canonical\+\+2 replacement\+\+4 extended = 12 cells\)T\+Vdrop\_words×\\timesnoiset​30/v​30t30/v30yescanonicalcorner of canonical gridT\+Vdrop\_words×\\timesnoiset​30/v​70t30/v70yescanonicalstrongest TV cell for both deep\-dive modelsT\+Vdrop\_words×\\timesnoiset​70/v​30t70/v30yescanonicalcorner of canonical gridT\+Vdrop\_words×\\timesnoiset​70/v​70t70/v70yescanonicalsymmetric heavy\-on\-both cornerT\+Vdrop\_words×\\timesocclusiont​70/v​30t70/v30yesreplacement \(vision\)swap vision operator familyT\+Vword\_shuffle×\\timesnoiset​70/v​70t70/v70yesreplacement \(text\)swap text operator familyT\+Vdrop\_words×\\timesnoiset​50/v​50t50/v50noextended mid\-pressureseverity\-50 diagonalT\+Vdrop\_words×\\timesnoiset​10/v​70t10/v70noextended \(light T, heavy V\)isolates whethert​30t30is theΔsingle\\Delta\_\{\\mathrm\{single\}\}\-positive thresholdT\+Vdrop\_words×\\timesnoiset​70/v​10t70/v10noextended \(heavy T, light V\)mirror of the previous rowT\+Vdrop\_words×\\timesnoiset​50/v​70t50/v70noextendedfills the canonical grid into a3×23\{\\times\}2T\-gridText\+Audio \(6 canonical/replacement\+\+4 extended = 10 cells\)T\+Adrop\_words×\\timesmutet​30/a​30t30/a30yescanonicalcorner of canonical gridT\+Adrop\_words×\\timesmutet​30/a​50t30/a50yescanonicalstrongest TA mid\-grid cellT\+Adrop\_words×\\timesmutet​70/a​30t70/a30yescanonicalcorner of canonical gridT\+Adrop\_words×\\timesmutet​70/a​50t70/a50yescanonicalsymmetric heavy\-on\-both cornerT\+Adrop\_words×\\timesremovet​70/a​50t70/a50yesreplacement \(audio\)swap audio operator familyT\+Aword\_shuffle×\\timesmutet​70/a​50t70/a50yesreplacement \(text\)swap text operator familyT\+Adrop\_words×\\timesmutet​50/a​30t50/a30noextendedseverity\-50 diagonalT\+Adrop\_words×\\timesmutet​10/a​50t10/a50noextended \(light T, heavy A\)light\-text/heavy\-audio fault lineT\+Adrop\_words×\\timesmutet​70/a​10t70/a10noextended \(heavy T, light A\)mirror of the previous rowT\+Adrop\_words×\\timesremovet​30/a​50t30/a50noextended replacementvision\-style robustness check for audioVision\+Audio \(6 canonical/replacement\+\+3 extended = 9 cells\)V\+Anoise×\\timesmutev​30/a​30v30/a30yescanonicalcorner of canonical gridV\+Anoise×\\timesmutev​30/a​50v30/a50yescanonicalvision\-light / audio\-heavy cornerV\+Anoise×\\timesmutev​70/a​30v70/a30yescanonicalvision\-heavy / audio\-light cornerV\+Anoise×\\timesmutev​70/a​50v70/a50yescanonicalsymmetric heavy\-on\-both cornerV\+Anoise×\\timesremovev​70/a​50v70/a50yesreplacement \(audio\)swap audio operator familyV\+Aocclusion×\\timesmutev​30/a​50v30/a50yesreplacement \(vision\)swap vision operator familyV\+Anoise×\\timesmutev​50/a​30v50/a30noextendedseverity\-50 diagonalV\+Anoise×\\timesmutev​10/a​50v10/a50noextended \(light V, heavy A\)isolates audio fault line under mild vision noiseV\+Anoise×\\timesmutev​70/a​10v70/a10noextended \(heavy V, light A\)mirror of the previous rowText\+Vision\+Audio \(11 canonical/replacement\+\+4 extended = 15 cells\)TVAdrop\_words×\\timesnoise×\\timesmutet​30/v​30/a​30t30/v30/a30yescanonicallight\-on\-all cornerTVAdrop\_words×\\timesnoise×\\timesmutet​30/v​30/a​50t30/v30/a50yescanonicalaudio\-heavier cornerTVAdrop\_words×\\timesnoise×\\timesmutet​30/v​70/a​30t30/v70/a30yescanonicalvision\-heavy cornerTVAdrop\_words×\\timesnoise×\\timesmutet​30/v​70/a​50t30/v70/a50yescanonicalvision and audio heavyTVAdrop\_words×\\timesnoise×\\timesmutet​70/v​30/a​30t70/v30/a30yescanonicaltext\-heavy cornerTVAdrop\_words×\\timesnoise×\\timesmutet​70/v​30/a​50t70/v30/a50yescanonicaltext and audio heavyTVAdrop\_words×\\timesnoise×\\timesmutet​70/v​70/a​30t70/v70/a30yescanonicaltext and vision heavyTVAdrop\_words×\\timesnoise×\\timesmutet​70/v​70/a​50t70/v70/a50yescanonicalheavy\-on\-all cornerTVAdrop\_words×\\timesnoise×\\timesremovet​70/v​70/a​50t70/v70/a50yesreplacement \(audio\)audio operator swapTVAdrop\_words×\\timesocclusion×\\timesmutet​70/v​30/a​50t70/v30/a50yesreplacement \(vision\)vision operator swapTVAword\_shuffle×\\timesnoise×\\timesmutet​70/v​70/a​50t70/v70/a50yesreplacement \(text\)text operator swapTVAdrop\_words×\\timesnoise×\\timesmutet​50/v​50/a​30t50/v50/a30noextended mid\-pressureall\-severity\-50 cube interiorTVAdrop\_words×\\timesnoise×\\timesmutet​50/v​50/a​50t50/v50/a50noextended mid\-pressuresymmetric mid\-grid TVA cornerTVAdrop\_words×\\timesnoise×\\timesmutet​10/v​70/a​30t10/v70/a30noextended \(light T\)light\-text TVA fault lineTVAdrop\_words×\\timesnoise×\\timesmutet​10/v​30/a​50t10/v30/a50noextended \(light T, heavy A\)combines the two strongest non\-text fault linesTVAdrop\_words×\\timesnoise×\\timesmutet​30/v​50/a​30t30/v50/a30noextended \(vision mid\-pressure\)connects canonical T\+V\+A to mid\-pressure visionTVAdrop\_words×\\timesnoise×\\timesmutet​70/v​50/a​50t70/v50/a50noextended \(heavy T, mid V, heavy A\)balances the heaviest non\-vision fault linesTable 32:Full enumeration of the 46\-cell extended representative\-model joint suite\. The29\-cell\-suitecolumn indicates whether a cell is part of the canonical/replacement grid in Table[5](https://arxiv.org/html/2608.29278#A3.T5)\(yes, 29 cells\) or one of the 17 additional extended cells \(no, 17 cells: 4 T\+V, 4 T\+A, 3 V\+A, 6 T\+V\+A\)\. The extended rows fill in the severity\-50 mid\-pressure row and the light/heavy asymmetric corners of each combination’s severity grid, so the 46\-cell suite covers \(i\) every canonical\{30,70\}×\{30,70\}\\\{30,70\\\}\{\\times\}\\\{30,70\\\}grid corner, \(ii\) every operator\-replacement cell at the strongest severity, \(iii\) every severity\-50 mid\-pressure cell, and \(iv\) every\{10,70\}×\{30/50/70\}\\\{10,70\\\}\{\\times\}\\\{30/50/70\\\}light/heavy asymmetric cell\. Reading:29\+17=4629\+17=46\.### G\.4D\. Missing\-modality controls Missing\-modality controls are included as contrastive baselines, not as the primary diagnostic setting\. They answer what happens when a channel disappears entirely, whereasSCEvalasks what happens when the channel remains present but its internal evidence structure becomes unreliable\. For each base example, we define: - •No\-text:remove or mask the textual evidence beyond the question/options required to ask the task\. The visual frames and audio remain unchanged\. - •No\-image:replace the visual evidence with a neutral blank frame set of the same interface type\. The question/options and audio remain unchanged\. - •No\-audio:replace the audio track with silence of matched duration\. The question/options and visual evidence remain unchanged\. These controls are reported on the same base examples as the corresponding corruption conditions\. The main comparison is Mm=Acc⁡\(missing​m\)−Acc⁡\(corrupted​m\),M\_\{m\}=\\mathrm\{Acc\}\(\\mathrm\{missing\}\\ m\)\-\\mathrm\{Acc\}\(\\mathrm\{corrupted\}\\ m\),\(7\)where positive values indicate that a corrupted\-but\-present modality is more harmful than removing that modality entirely\. This directly tests whether structural corruption is more diagnostic than standard leave\-one\-modality\-out ablation\. ### G\.5E\. Shortcut and language\-prior controls Shortcut controls estimate how much performance can be recovered without full cross\-modal binding\. We use the following settings: - •Question/options only:remove all media evidence and keep only the question and answer choices\. - •Text\-only evidence:keep the full text channel but remove visual and audio evidence\. - •Visual\+audio only:keep visual and audio input while replacing task text beyond the required answer interface with a generic instruction\. - •Options only:retain only the four option strings, with no question or media, to measure answer\-text priors\. - •Option order \(Latin square\):keep the input unchanged while presenting all four option orders, with the gold key remapped for each order\. The question/options\-only setting estimates language and answer\-prior behavior; the options\-only and option\-order controls test answer\-text and positional shortcuts; partial\-input controls separate modality reliance from structural robustness\. The primary metric is the shortcut gapGG, supplemented by accuracy under each partial\-input condition\. #### Panel\-level summary statistics\. Across the 15\-model panel, the misleading\-modality effectMmM\_\{m\}averages−4\.31\-4\.31pp for text \(Mt<0M\_\{t\}<0: corrupted text is less harmful than absent text, confirming that even degraded text provides useful signal\),\+1\.87\+1\.87pp for vision \(Mv\>0M\_\{v\}\>0: corrupted vision actively misleads more than absent vision\), and\+2\.61\+2\.61pp for audio \(Ma\>0M\_\{a\}\>0: same misleading pattern\)\. The positiveMvM\_\{v\}andMaM\_\{a\}values hold for 13 of 15 models on vision and 12 of 15 models on audio, confirming that the misleading\-modality effect is not driven by a single outlier\. The text\-only shortcut gapG=Acc⁡\(text\-only\)−25%G=\\mathrm\{Acc\}\(\\text\{text\-only\}\)\-25\\%ranges from\+9\.20\+9\.20pp to\+22\.80\+22\.80pp across the panel \(mean\+15\.57\+15\.57pp\), with proprietary models averaging\+13\.65\+13\.65pp and open models averaging\+17\.24\+17\.24pp\. The positive gap confirms that all models exploit text\-channel language priors beyond random guessing, but the gap is well below the clean accuracy advantage \(≈45\\approx 45–5555pp above random\), so text\-only shortcuts account for a minority of clean performance\. #### Additional task\-format controls\. The following controls separate output formatting, option shortcuts, and transfer beyond fixed answer options\. All comparisons use the same clean/corrupted items within a control regime, so they test changes under corruption rather than absolute accuracy across different task formats\. ControlSetupPurposeTask\-format and option\-shortcut controlsNo\-option generationRemove answer options; the model writes a short answer and evidence\. Two blinded scorers assess correctness, partial correctness, and answerability after clean and corrupted items are verified as answerable and gold\-valid\.Transfer beyond fixed optionsOption order \(Latin square\)Evaluate all four option orders, with every option occupying every position once and the gold key remapped\. Conditions include clean,drop\_words@70,noise@70, TVt​30/v​70t30/v70, TVt​70/v​70t70/v70, and TVAt​30/v​70/a​30t30/v70/a30\.Position bias and parser stabilityOptions onlyProvide only the four option strings, with no question or media\.Answer\-text priorTable 33:Additional controls for task format and option shortcuts\. The no\-option control is evaluated only on a shared gold\-preserved subset; option manipulation is never mixed into headline accuracy tables\.ControlMetricValueOption\-shortcut resultsOptions onlyPanel accuracy29\.80Option order \(clean\)Mean\-order accuracy73\.80Option order \(clean\)Worst\-order accuracy71\.50Option order \(clean\)Prediction consistency94\.2%Option order \(noise@70\)Mean–worst\-order gap3\.15 ppTable 34:Options\-only baseline and option\-order sensitivity\. Prediction consistency is the fraction of examples with the same remapped answer across all four orders\.### G\.6F\. Prompt robustness The headline protocol uses the standard JSON answer\-only prompt in Appendix[H](https://arxiv.org/html/2608.29278#A8)\. Prompt robustness evaluates whether the fault\-line pattern survives alternative prompting styles\. We use three variants: the standard JSON prompt, a chain\-of\-thought prompt that asks the model to reason before selecting an option, and an open\-form prompt that does not require JSON\. The diagnostic subset contains the clean condition, the worst single\-modality text/vision/audio cells, the strongest text–vision condition, and the strongest trimodal condition\. We report whether CoT or open\-form prompting changes accuracy, invalid\-output rate, or the rank order of damaging conditions\. The open\-form condition removes the JSON schema but retains the answer options, so it is a formatting control\. Table[35](https://arxiv.org/html/2608.29278#A7.T35)separately evaluates transfer to no\-option generation\. ConditionExisting MC drop \(pp\)No\-option drop \(pp\)TransferΔ\\Delta\(pp\)Clean\-to\-corrupted drop on the shared gold\-preserved subsetdrop\_words@7011\.0913\.45\+2\.36\+2\.36noise@7011\.2714\.10\+2\.83\+2\.83TVt​30/v​70t30/v7010\.0112\.25\+2\.24\+2\.24TVt​70/v​70t70/v708\.289\.80\+1\.52\+1\.52TVAt​30/v​70/a​30t30/v70/a306\.367\.95\+1\.59\+1\.59Table 35:No\-option generation control\. The model produces a short answer rather than selecting an option; two blinded scorers evaluate the output on the shared gold\-preserved subset\. Existing multiple\-choice drops for the single\-modality rows are 15\-model panel means; the joint rows are means over the four deep\-dive models\.TransferΔ\\Deltais the no\-option drop minus the multiple\-choice drop\.### G\.7G\. Human reference and answer\-preservation checks The human reference distinguishes model failure from task impossibility\. Annotators answer the clean input, the worst single\-modality cell for each modality, the strongest text–vision cell, and the strongest trimodal cell using the same answer options\. The blind answer\-first audit and its gold\-preserved cohort are described in Appendix[D](https://arxiv.org/html/2608.29278#A4); variants that do not preserve the original gold are reported as stress tests rather than as headline robustness evidence\. ### G\.8H\. Interface, coverage, and invalid\-output profiling Because omni\-modal systems expose heterogeneous interfaces, every new model first runs a 10\-example smoke test\. The smoke test records whether the endpoint accepts the ordered frame set, whether audio is actually consumed, whether the output parser recovers an option key, and whether the model produces refusals or empty responses\. For full runs, invalid responses are decomposed into API failures, parse failures, refusals, and empty outputs\. Accuracy tables are paired with coverage tables whenever coverage differs across conditions, so the reader can separate reasoning failure from missing valid outputs\. ### G\.9I\. Cross\-modal mismatch and trust\-bias probes Mismatch probes keep every modality structurally clean but make one channel semantically inconsistent with the others\. We use three sampling tiers: random mismatch, category\-matched mismatch, and answer\-matched mismatch\. Random mismatch tests coarse conflict detection; category\-matched mismatch keeps surface distribution similar; answer\-matched mismatch controls for answer\-label leakage\. For each replacement modality, we record whether the model follows the replaced channel, the unchanged channels, or an unsupported prior\. The trust\-bias scoreTmT\_\{m\}is the fraction of mismatched cases in which the answer follows modalitymm\. These are behavioral controls: they help distinguish the observed patterns from answer\-prior, missing\-modality, and prompt\-format explanations, but they do not identify a representation\-level fusion mechanism\. ### G\.10J\. Temporal, audio–visual, frame\-budget, and position probes Temporal probes test whether the model uses event order rather than treating media as unordered feature bags\. Visual temporal probes shuffle frames, reverse frame order, and drop middle frames\. Audio temporal probes shuffle audio segments or insert local gaps\. Audio–visual desynchronization shifts the audio stream by±0\.5\\pm 0\.5,±1\\pm 1,±2\\pm 2,±4\\pm 4, and±8\\pm 8seconds relative to the visual frame sequence\. Frame\-budget probes rerun representative examples with one, four, eight, sixteen, and default frame budgets\. Position probes place the most informative frame first, middle, or last while keeping the frame set fixed\. Together these tests separate true temporal binding from interface\-level sampling and position artifacts\. #### Scope of audio operators and ASR\-like noise\. The three audio operators \(remove,mute,distortion\) target structural properties of the waveform—temporal completeness and signal fidelity—rather than phonetic or lexical content\. Temporal desynchronisation is covered by the audio–visual desynchronisation probe described above \(±0\.5\\pm 0\.5–88seconds\)\. ASR\-like noise \(homophone substitutions, partial word deletions at the phoneme level\) was considered but excluded under design rule \(i\) of Appendix[E](https://arxiv.org/html/2608.29278#A5): such operators require a phoneme\-level transcription of the audio track, which is not available for all source benchmarks, and would introduce a semantic transformation \(changing the spoken word\) rather than a purely structural one\. Thedistortionoperator approximates the effect of low\-quality recording or transmission artefacts, which is the closest structural analogue to ASR\-degraded input without requiring phoneme\-level manipulation\. Probing audio\-text\-vision binding under phoneme\-level noise is a natural extension and is noted as future work\. ### G\.11K\. Confidence, abstention, and distractor\-modality probes Confidence probes ask representative models to output both an option and a scalar confidence level under clean and corrupted conditions\. We report average confidence on correct and incorrect answers, expected calibration error when possible, and the rate of overconfident wrong answers\. Abstentions and refusals are analyzed together with the invalid\-output profile\. Distractor\-modality probes insert an unrelated but structurally clean modality into otherwise sufficient inputs: unrelated audio into text–visual examples, unrelated frames into text–audio examples, or misleading text into visual–audio examples\. The distractor effect measures whether the model indiscriminately fuses every available channel or selectively downweights irrelevant evidence\. #### Calibration under corruption and logit unavailability\. The confidence probe collects self\-reported confidence labels \(low/medium/high\) from the model’s JSON output, which are available for all models regardless of whether token\-level logits are exposed\. We compute expected calibration error \(ECE\) by binning the three confidence levels and comparing mean confidence to mean accuracy within each bin, and we report the overconfident error rateρoc\\rho\_\{\\mathrm\{oc\}\}\(fraction of incorrect answers assignedhighconfidence\)\. For the six deep\-dive models, ECE increases from a clean\-condition mean of0\.090\.09to0\.170\.17at severity 70 across the three modalities, andρoc\\rho\_\{\\mathrm\{oc\}\}rises from0\.210\.21to0\.340\.34, confirming that corruption degrades calibration as well as accuracy\. For API models that do not expose logits, the self\-reported confidence label is the only available proxy; we note that self\-reported confidence may be less reliable than logit\-derived probabilities and treat the ECE andρoc\\rho\_\{\\mathrm\{oc\}\}estimates for those models as approximate\. Generative likelihood proxies \(e\.g\. scoring each option by its generation probability under a forced\-choice prompt\) are not uniformly available across the API panel and are left for future work\. ## Appendix HPrompt Templates and Parsing Rules #### System prompt\. > You are a careful multimodal assistant\. You will receive one question, one visual input \(image or video\), and one audio input\. Exactly one option is correct\. Use the provided multimodal evidence\. If some evidence is degraded, still answer based only on what can be supported by the input\. Respond with one JSON object and nothing else\. #### User prompt template\. > \[Task\]Answer the multiple\-choice question using the visual input \(image or video\) and the audio input\. Some of the question text, visual input, or audio input may be structurally corrupted or degraded\. Interpret the available evidence carefully, and do not rely on any hidden metadata\. \[Visual input\]Attached as a\{image/video\}\. \[Audio input\]Attached as an audio clip\. \[Question\]\{question\} \[Options\]\{formatted options\} Output JSON schema:\{"answer": "<option key\>", "confidence": "<low \| medium \| high\>", "reasoning": "<one or two short sentences\>"\}\. Do not output Markdown\. Do not output any text outside the JSON object\. #### Parsing rule\. The parser first attempts to read a JSON object\. If this fails, it applies a conservative fallback that accepts a single option key or an answer string exactly matching one option\. Responses are marked invalid when no option key can be recovered, when the model refuses to answer without selecting an option, or when the output is empty\. Invalid responses are counted separately in coverage tables and treated as incorrect for significance testing\. #### Prompt variants\. The standard prompt is used for all headline accuracy tables\. Chain\-of\-thought prompting is used only in the prompt\-robustness diagnostic subset; the model may reason internally or output a short rationale, but the parser still extracts a final option\. Open\-form prompting removes the JSON requirement and is used to test whether JSON formatting itself creates parse failures\. Prompt variants are never mixed inside a headline table; each table specifies a prompt ID\. #### Option formatting and corruption scope\. The formatted options string passed to the model uses plain letter keys \(A,B,C,D\) with no brackets, checkmarks, or positional markers\. The\[x\]notation appearing in illustrative examples in the paper is used only in figures and tables for human readability and is never present in the actual model prompt\. Option text is drawn verbatim from the source benchmark and is not modified by any corruption operator: all four text corruption operators \(drop\_words,word\_shuffle,typo\_ocr,sentence\_break\) are applied exclusively to the question stem, leaving option punctuation, capitalisation, and letter keys intact\. This design ensures that the parser can always recover a valid option key from the options field regardless of question\-stem corruption severity, and that no asymmetric surface cue in the options field can serve as a positional shortcut\. #### Inference and logging settings\. For deterministic comparability, runs use the lowest available sampling temperature, no intentional top\-ppdiversification, and a fixed prompt template\. When an endpoint fails, the runner records retry count and final failure category rather than silently dropping the example\. Each JSONL record stores model name, prompt ID, sample ID, source dataset, condition ID, modality operators, severity values, random variant, media URLs or local paths, raw response, parsed answer, gold answer, correctness, latency, retry count, and invalid\-output category\. These fields are required to reproduce coverage\-aware tables\.