Where Detectors Fail: Closing the Tail-Domain Gap with Expert-Guided Mutual Distillation
Summary
This paper proposes Expert-Guided Mutual Distillation (EGMD) to address domain bias and semantic misalignment in multimodal fake news detection, achieving state-of-the-art accuracy and reducing domain bias by up to 57.3% across four datasets.
View Cached Full Text
Cached at: 07/30/26, 09:58 AM
# Where Detectors Fail: Closing the Tail-Domain Gap with Expert-Guided Mutual Distillation
Source: [https://arxiv.org/html/2607.26555](https://arxiv.org/html/2607.26555)
Xuan Feng1,3, Guihong Liu2, Tianlong Gu1\\corresponding, Shuai Zhao3, Xuemin Wang2, Chenzhong Bin2, Yang Liu4, Bo An3
###### Abstract
Multimodal fake news detectors often generalize poorly across domains because they learn to trust unreliable evidence: domain\-specific shortcuts amplified by imbalanced data and semantically inconsistent text–image pairs that make cross\-modal evidence unreliable\. We propose Expert\-Guided Mutual Distillation \(EGMD\), which learns what evidence to trust across the prediction pipeline\. At the input level, input\-level calibration encodes pair\-level coherence as a shared gain before fusion\. At the representation level, an expert\-guided teacher aligns domain statistics and encourages domain\-specific patterns to concentrate in specialized experts\. At the decision level, prototype\-anchored domain\-specific students use mutual learning and dual\-channel distillation to inherit the teacher’s feature geometry and calibrated predictions while discouraging local domain priors\. We further constructWeibo\_Balanced, a domain\-balanced benchmark that isolates the effect of imbalance on generalization\. Across four datasets in two languages,EGMDachieves state\-of\-the\-art accuracy while reducing domain bias by up to 57\.3%\.
## 1Introduction
The rapid proliferation of digital media has made fake news detection an indispensable task for safeguarding public trust\(Zeng et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib38); Guo et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib9)\)\. Recently, multimodal learning has achieved superior performance in this domain, leveraging cross\-modal correlations to significantly outperform unimodal counterparts\(Qi et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib26); Ma et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib21); Yang et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib36); Liu et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib18); Zhao et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib41)\)\. Despite this progress, current methods exhibit poor cross\-domain generalization, primarily due to two factors:*domain bias*and*semantic misalignment*\. Domain bias typically originates from imbalanced data distributions and occurs when models rely on spurious domain\-specific correlations rather than learning event\-invariant semantics\(Li et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib12)\)\. Moreover, multimodal frameworks encounter a unique challenge absent in unimodal settings known as semantic misalignment\(Cai et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib1)\)\. This issue stems from intrinsic cross\-modal heterogeneity and manifests as semantic conflicts between modalities, significantly undermining the reliability of the detection process\. Therefore, jointly addressing domain bias and semantic misalignment is essential for reliable cross\-domain fake news detection\.
However, the precise impact of these impediments on generalization remains underexplored\. To disentangle and quantify these failure modes, we conducted a targeted empirical study to provide concrete evidence of these deficiencies:
❶Domain Bias via Imbalanced Data Distributions\.Domain imbalance causes aggregate training objectives to be dominated by data\-rich domains, encouraging models to learn majority\-domain shortcuts while leaving decision boundaries for tail domains insufficiently estimated\. This issue is particularly pronounced in Weibo21\(Nan et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib24)\), where theSocietydomain contains 2,615 instances, compared with only 236 inScience, resulting in an 11\.08×\\timesvolume gap\. Consistent with this imbalance, MMDFND\(Tong et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib31)\)and MiMOE\-FND\(Liu et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib19)\)perform competitively in high\-resource domains but exhibit substantial accuracy degradation in underrepresented domains such asMilitaryandScience\. Complete domain statistics and additional analysis are provided in the Supplementary Material\.
❷Susceptibility to Semantic Misalignment\.Our error analysis revealed recurring prediction instability when textual and visual evidence was semantically inconsistent\. To make this failure mode explicit, FigureLABEL:fig:semantic\_misalignmentreconstructs a pronounced example by retaining the same Health\-domain text and replacing its matched image with an unrelated Politics image\. The figure reports changes inP\(Fake\)P\(\\mathrm\{Fake\}\)rather than classification correctness: MMDFND and MiMOE\-FND move toward the decision boundary \(0\.4948 and 0\.5864\), whereasEGMDexhibits a clearer response to the introduced conflict \(0\.7623\)\. This reconstruction illustrates model sensitivity under deliberate semantic conflict, but does not establish that mismatch alone determines veracity\. In practice, legitimate news may use stock or weakly related images; semantic mismatch is therefore neither a necessary nor a sufficient condition for fake news\. A broader construct\-validity evaluation would require separate annotations for deceptive mismatch and benign visual relevance\. Within this illustrative setting, the weaker response of existing models is consistent with a potential generalization bottleneck: cross\-modal compatibility is introduced only*after*fusion, when conflicting signals may already have contaminated the joint representation\. This observation motivates our input\-level calibration design, while the main performance claims remain grounded in the naturally labeled benchmark evaluations rather than this constructed example\.
In this paper, we identify a shared error\-propagation path: unreliable cross\-modal evidence contaminates representations, entangles with domain statistics, and biases decisions\. We therefore propose Expert\-Guided Mutual Distillation \(EGMD\) with three dependent innovations\.*Input\-Level Calibration*encodes pair\-level coherence as a shared gain before fusion\.*Representation\-Level Debiasing*constructs an Expert\-Guided Teacher whose Dynamic Domain\-specific Normalization \(DDN\) aligns domain\-conditioned statistics before the MoE organizes residual domain patterns across experts\.*Decision\-Level Generalization*builds a Mutual Distillation Student that combines domain prototypes and mutual learning with feature\- and logit\-level transfer\. Each stage thus refines the preceding output rather than acting as an additive regularizer\. The teacher\-side modules are training\-only, leaving one lightweight student branch for inference\.
Our main contributions are summarized as follows:
- •We reveal that domain imbalance and cross\-modal semantic misalignment jointly encourage multimodal detectors to learn domain\-specific shortcuts, leading to uneven performance across domains\.
- •We proposeEGMDfor cross\-domain uniformity\. Its domain\-normalized teacher aligns domain statistics and encourages domain\-specific patterns to concentrate in specialized experts, while prototype\-anchored mutual distillation discourages local priors\.
- •We isolate how domain imbalance contributes to domain bias by constructingWeibo\_Balanced, which reduces the imbalance ratio from11\.08×11\.08\\timesto1\.27×1\.27\\times\. Under this control,EGMD’sTotalfalls by 37\.7%, supporting domain imbalance as an important driver of domain bias\.
- •Experiments on four datasets confirm consistent gains, especially in vulnerable domains\.
## 2Related Work
### 2\.1Multimodal Fake News Detection\.
Multimodal technology has gained widespread recognition across diverse domains\(Cui et al\.[2025a](https://arxiv.org/html/2607.26555#bib.bib3),[b](https://arxiv.org/html/2607.26555#bib.bib4); Li et al\.[2025a](https://arxiv.org/html/2607.26555#bib.bib13),[b](https://arxiv.org/html/2607.26555#bib.bib14),[c](https://arxiv.org/html/2607.26555#bib.bib15),[d](https://arxiv.org/html/2607.26555#bib.bib16)\),with applications extending to fake news detection\(Qiao et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib27); Shen et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib29); Zhang et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib39)\)\.While early works focused on unimodal text analysis\(Dou et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib7); Zhu et al\.[2022](https://arxiv.org/html/2607.26555#bib.bib45)\), recent research has shifted toward multimodal approaches that leverage both textual and visual information\(Wang, Yan, and Ding[2024](https://arxiv.org/html/2607.26555#bib.bib34); Zhou et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib43)\)\. State\-of\-the\-art methods predominantly focus on improving cross\-modal fusion mechanisms\. For instance, COOLANT\(Wang et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib33)\)utilizes contrastive learning for alignment, FSRU\(Lao et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib11)\)explores frequency domain interactions, and MTS\(Sun et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib30)\)captures high\-order correlations via Taylor series expansion\. Despite their success in extracting joint representations, these methods often overlook the critical issue ofdomain bias, assuming independent and identically distributed \(i\.i\.d\.\) data, which compromises their generalization to unseen domains\.
### 2\.2Domain Adaptation and MoE Architectures\.
Recent work addresses domain shift with Mixture\-of\-Experts \(MoE\) and distillation\. DTDBD\(Li et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib12)\)uses dual\-teacher distillation but is limited to unimodal inputs\. In multimodal detection, BMR\(Ying et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib37)\), MiMoE\-FND\(Liu et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib19)\), and MMDFND\(Tong et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib31)\)use experts for representation fusion, while MemiMoE\-FND\(Meng et al\.[2026](https://arxiv.org/html/2607.26555#bib.bib22)\)adds memory slots to hierarchical experts\. ADOSE\(Chen et al\.[2026](https://arxiv.org/html/2607.26555#bib.bib2)\)instead performs active multi\-source adaptation by labeling a target\-domain subset\. These methods focus on fusion or supervised adaptation;EGMDjointly targets domain\-level error disparity and semantic misalignment without target\-domain veracity labels, using training\-time expert guidance and mutual distillation\.
A broader review of traditional and multimodal methods is provided in the Supplementary Material\.
## 3Problem Formulation and Dataset Construction
### 3\.1Problem Formulation
We study cross\-domain multimodal fake news detection under imbalanced domain distributions\. The training set𝒟=⋃d=1K𝒟d\\mathcal\{D\}=\\bigcup\_\{d=1\}^\{K\}\\mathcal\{D\}\_\{d\}coversKKdomains with unequal sample countsnd=\|𝒟d\|n\_\{d\}=\|\\mathcal\{D\}\_\{d\}\|\. Each news item𝐱=\(T,V\)∈𝒳=𝒯×𝒱\\mathbf\{x\}=\(T,V\)\\in\\mathcal\{X\}=\\mathcal\{T\}\\times\\mathcal\{V\}contains textTTand an imageVV, has a binary veracity labely∈\{0,1\}y\\in\\\{0,1\\\}, wherey=1y=1denotes fake news, and belongs to a domaind∈\{1,…,K\}d\\in\\\{1,\\ldots,K\\\}\. The detectorfθ:𝒳→\[0,1\]f\_\{\\theta\}:\\mathcal\{X\}\\rightarrow\[0,1\]estimates the probability that an item is fake\.
LetPdP\_\{d\}denote the data distribution of domainddandℓ\\ellthe binary classification loss\. To give every domain equal importance, our task\-level objective targets the uniformly weighted domain risk
minθ1K∑d=1K𝔼\(𝐱,y\)∼Pd\[ℓ\(fθ\(𝐱\),y\)\],\\min\_\{\\theta\}\\;\\frac\{1\}\{K\}\\sum\_\{d=1\}^\{K\}\\mathbb\{E\}\_\{\(\\mathbf\{x\},y\)\\sim P\_\{d\}\}\\left\[\\ell\\\!\\left\(f\_\{\\theta\}\(\\mathbf\{x\}\),y\\right\)\\right\],\(1\)which prevents performance in data\-rich domains from defining the objective alone\. Accordingly, the goal is not only high aggregate accuracy, but also strong tail\-domain performance and low cross\-domain error disparity\.
Table 1:Domain statistics before and after balancing\. R and F denote real and fake instances, respectively\.DomainOriginalBalanced \(Ours\)RFSizeRFSizeFinance9593621,3211,0334301,463Health4855151,0006628621,524Military1172223391,0573251,382Science143932361,0232591,282Politics3045468507928221,614Disaster1845917757218671,588Edu\.2432484919285451,473Society1,1981,4172,6157149131,627Ent\.1,0074401,4471,0074401,447Sum4,6404,4349,0747,9375,46313,400Imbalance Ratio \(Max/Min\):Original:11\.08×\\timesvs\. Ours:1\.27×\\times
### 3\.2Weibo\_Balanced: Examining the Effect of Domain Imbalance
To examine whether unequal domain volumes contribute to cross\-domain performance disparities, we constructWeibo\_Balanced, a more evenly distributed extension of Weibo21\. It retains the original task and nine\-domain taxonomy while making the number of instances across domains comparable\. This setting provides a complementary benchmark for evaluating whether domain disparities persist after the long\-tailed distribution is substantially reduced\. Table[1](https://arxiv.org/html/2607.26555#S3.T1)summarizes the resulting statistics\.
#### Dataset Construction
We expand underrepresented domains through targeted keyword\-based collection and reduce overrepresented domains through stratified downsampling\. Following the Weibo21 collection protocol\(Nan et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib24)\), ten domain experts independently annotate each newly collected instance\. A domain label is retained when at least eight annotators agree; cases with lower agreement undergo further review\.
#### Resulting Distribution
The resulting dataset contains 13,400 instances, with domain sizes ranging from 1,282 to 1,627\. The maximum\-to\-minimum domain\-size ratio decreases from11\.08×11\.08\\timesin Weibo21 to1\.27×1\.27\\times\. This substantially reduces variation in domain volume and enables a more direct examination of its relationship with domain\-level performance disparities\.
## 4Methodology
Figure[1](https://arxiv.org/html/2607.26555#S4.F1)presentsEGMDas a three\-stage pipeline\. Input\-Level Calibration exposes pairwise compatibility before fusion \(§[4\.1](https://arxiv.org/html/2607.26555#S4.SS1)\); Representation\-Level Debiasing aligns domain statistics and organizes residual domain patterns through conditional experts \(§[4\.2](https://arxiv.org/html/2607.26555#S4.SS2)\); and Decision\-Level Generalization transfers teacher knowledge through prototype\-anchored mutual and dual\-channel distillation \(§[4\.3](https://arxiv.org/html/2607.26555#S4.SS3)\)\.
Figure 1:TheEGMDframework comprises three stages: Input\-Level Calibration \(§[4\.1](https://arxiv.org/html/2607.26555#S4.SS1)\), Representation\-Level Debiasing via Dynamic Domain\-specific Normalization and Mixture\-of\-Experts \(§[4\.2](https://arxiv.org/html/2607.26555#S4.SS2)\), and Decision\-Level Generalization via a prototype\-anchored Mutual Distillation Student \(§[4\.3](https://arxiv.org/html/2607.26555#S4.SS3)\)\. Teacher\-student transfer uses feature\- and logit\-level distillation losses \(ℒfeat\\mathcal\{L\}\_\{\\text\{feat\}\},ℒlogit\\mathcal\{L\}\_\{\\text\{logit\}\}\)\.### 4\.1Input\-Level Calibration
The first stage exposes cross\-modal compatibility to the fusion network before feature interaction\. Standard multimodal fusion presupposes that text and image convey coherent semantics, yet this assumption is frequently violated in cross\-domain settings: a health\-related headline may be paired with an unrelated political photograph, or a manipulated image may accompany factual text\. Fusion without an explicit compatibility cue cannot distinguish these cases before their features interact\.
We introduce a coherence\-aware gating mechanism before feature interaction\. Content representations𝐡𝒯∈ℝd𝒯\\mathbf\{h\}\_\{\\mathcal\{T\}\}\\in\\mathbb\{R\}^\{d\_\{\\mathcal\{T\}\}\}and𝐡𝒱∈ℝd𝒱\\mathbf\{h\}\_\{\\mathcal\{V\}\}\\in\\mathbb\{R\}^\{d\_\{\\mathcal\{V\}\}\}are extracted by BERT\(Devlin et al\.[2019](https://arxiv.org/html/2607.26555#bib.bib5)\)and MAE\(He et al\.[2022](https://arxiv.org/html/2607.26555#bib.bib10)\), whileℓ2\\ell\_\{2\}\-normalized CLIP references𝐜𝒯,𝐜𝒱∈ℝdc\\mathbf\{c\}\_\{\\mathcal\{T\}\},\\mathbf\{c\}\_\{\\mathcal\{V\}\}\\in\\mathbb\{R\}^\{d\_\{c\}\}provide a shared semantic coordinate system\(Radford et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib28)\)\. Their pair\-level compatibility is the scalar cosine similarityρ=𝐜𝒯⊤𝐜𝒱∈\[−1,1\]\\rho=\\mathbf\{c\}\_\{\\mathcal\{T\}\}^\{\\top\}\\mathbf\{c\}\_\{\\mathcal\{V\}\}\\in\[\-1,1\]\. We map it to a sample\-dependent shared gains∈\(0,1\)s\\in\(0,1\):
s=sigm\(wsρ/τc\+bs\),s=\\operatorname\{sigm\}\\\!\\left\(w\_\{s\}\\,\\rho/\\tau\_\{c\}\+b\_\{s\}\\right\),\(2\)whereτc\>0\\tau\_\{c\}\>0is the coherence temperature andws,bs∈ℝw\_\{s\},b\_\{s\}\\in\\mathbb\{R\}are learnable scalars\. The conditioned representation is
𝐳0=ℱfuse\(concat\(\(1\+s\)𝐡𝒯,\(1\+s\)𝐡𝒱\)\),\\mathbf\{z\}\_\{0\}=\\mathcal\{F\}\_\{\\text\{fuse\}\}\\\!\\left\(\\operatorname\{concat\}\\\!\\left\(\(1\{\+\}s\)\\mathbf\{h\}\_\{\\mathcal\{T\}\},\(1\{\+\}s\)\\mathbf\{h\}\_\{\\mathcal\{V\}\}\\right\)\\right\),\(3\)
whereconcat\(⋅,⋅\)∈ℝd𝒯\+d𝒱\\operatorname\{concat\}\(\\cdot,\\cdot\)\\in\\mathbb\{R\}^\{d\_\{\\mathcal\{T\}\}\+d\_\{\\mathcal\{V\}\}\}andℱfuse:ℝd𝒯\+d𝒱→ℝdz\\mathcal\{F\}\_\{\\text\{fuse\}\}:\\mathbb\{R\}^\{d\_\{\\mathcal\{T\}\}\+d\_\{\\mathcal\{V\}\}\}\\rightarrow\\mathbb\{R\}^\{d\_\{z\}\}\. Equation[3](https://arxiv.org/html/2607.26555#S4.E3)applies the same gain to both modalities\. It therefore conditions the pair as a whole and does not identify, suppress, or reweight one modality relative to the other\. In particular,1\+s∈\(1,2\)1\+s\\in\(1,2\)is strictly amplificatory: coherent pairs receive a larger gain, whereas low\-coherence pairs remain near their original magnitude rather than being attenuated\. We adopt this conservative operation because low CLIP similarity can also arise from benign abstraction or stock imagery\. Accordingly, this component should be interpreted as an explicit compatibility cue, not as a modality\-denoising gate; representation debiasing is handled by the subsequent teacher\. Unlike the post\-fusion similarity weighting in MMDFND\(Tong et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib31)\), the compatibility signal enters our fusion network with the unimodal features\.
### 4\.2Representation\-Level Debiasing: Expert\-Guided Teacher
Given the compatibility\-conditioned representation𝐳0\\mathbf\{z\}\_\{0\}, the second stage addresses domain\-dependent variation in feature statistics\. Under imbalanced training data, a single shared transformation can be dominated by head domains and preserve correlations that transfer poorly to tail domains\. The Expert\-Guided Teacher therefore combines two operations\. DDN standardizes batch\-level feature statistics and applies domain\-conditioned affine parameters, reducing raw statistical variation before routing\. A domain\-conditioned MoE then models the remaining heterogeneity through conditional expert specialization\. Together, these operations produce the teacher representation used for decision\-level distillation\.
#### Step 1: Aligning Domain Distributions via DDN
The first manifestation of domain bias is variation in feature statistics across domains, which can make a shared representation favor data\-rich domains\. We address this through Dynamic Domain\-specific Normalization \(DDN\), which reduces differences in batch\-level feature statistics before expert routing\.
Concretely, we standardize𝐳0\\mathbf\{z\}\_\{0\}using batch\-level statistics\(𝝁ℬ,𝝈ℬ\)\(\\bm\{\\mu\}\_\{\\mathcal\{B\}\},\\,\\bm\{\\sigma\}\_\{\\mathcal\{B\}\}\)and recover domain\-appropriate structure via a learnable affine transformation\(𝜸k,𝜷k\)\(\\bm\{\\gamma\}\_\{k\},\\,\\bm\{\\beta\}\_\{k\}\)conditioned on domain identitykk:
𝐳~k=𝜸k⊙𝐳0−𝝁ℬ𝝈ℬ2\+ϵ\+𝜷k,\\tilde\{\\mathbf\{z\}\}\_\{k\}=\\bm\{\\gamma\}\_\{k\}\\odot\\frac\{\\mathbf\{z\}\_\{0\}\-\\bm\{\\mu\}\_\{\\mathcal\{B\}\}\}\{\\sqrt\{\\bm\{\\sigma\}\_\{\\mathcal\{B\}\}^\{2\}\+\\epsilon\}\}\+\\bm\{\\beta\}\_\{k\},\(4\)whereϵ\\epsilonis a small constant added for numerical stability\. DDN serves a different purpose from the AdaIN module in MMDFND\(Tong et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib31)\)\. AdaIN reweights the relative importance of cross\-domain versus domain\-specific knowledge after extraction; DDN operates proactively, standardizing the feature space before expert routing so that the subsequent MoE can focus on conditional specialization rather than compensating for distributional mismatch\.
DDN removes a gain exactly only when that gain is constant across the entire mini\-batch\. Heresis\_\{i\}is sample dependent\. Even under the simplifying assumption thatℱfuse\\mathcal\{F\}\_\{\\mathrm\{fuse\}\}is positively homogeneous, so that𝐳0,i=ai𝐮i\\mathbf\{z\}\_\{0,i\}=a\_\{i\}\\mathbf\{u\}\_\{i\}withai=1\+sia\_\{i\}=1\+s\_\{i\}, normalization uses𝝁ℬ=\|ℬ\|−1∑jaj𝐮j\\bm\{\\mu\}\_\{\\mathcal\{B\}\}=\|\\mathcal\{B\}\|^\{\-1\}\\sum\_\{j\}a\_\{j\}\\mathbf\{u\}\_\{j\}and the corresponding feature\-wise variance\. Henceaia\_\{i\}cannot be factored out unless allaia\_\{i\}are equal\. DDN may nevertheless attenuate magnitude information, so we do not claim that the gain is preserved unchanged; it provides lightweight pre\-fusion conditioning, whereas DDN targets batch\-level domain statistics\.
#### Step 2: Concentrating Domain\-Specific Patterns via MoE
Even following distributional alignment, the representation may continue to encode domain\-specific shortcuts, which are statistical patterns that correlate with veracity labels within a single domain but fail to generalize\. We employ a MoE layer with domain\-conditioned routing to encourage these patterns to concentrate in specialized experts while allowing shared experts to model recurring veracity cues\.
The gating network𝒢\\mathcal\{G\}routes each sample based on both the aligned feature𝐳~k∈ℝdz\\tilde\{\\mathbf\{z\}\}\_\{k\}\\in\\mathbb\{R\}^\{d\_\{z\}\}and an explicit learnable domain embedding𝐞k∈ℝde\\mathbf\{e\}\_\{k\}\\in\\mathbb\{R\}^\{d\_\{e\}\}:
𝜶=Softmax\(𝐖g⋅ReLU\(\[𝐳~k;𝐞k\]\)\),\\bm\{\\alpha\}=\\mathrm\{Softmax\}\\\!\\left\(\\mathbf\{W\}\_\{g\}\\cdot\\mathrm\{ReLU\}\\\!\\left\(\[\\tilde\{\\mathbf\{z\}\}\_\{k\}\\;;\\;\\mathbf\{e\}\_\{k\}\]\\right\)\\right\),\(5\)whereNeN\_\{e\}is the number of experts and𝐖g∈ℝNe×\(dz\+de\)\\mathbf\{W\}\_\{g\}\\in\\mathbb\{R\}^\{N\_\{e\}\\times\(d\_\{z\}\+d\_\{e\}\)\}is the learned weight matrix of the gating network\. The teacher’s output is the expert\-weighted aggregate:
𝐳moe=∑iαiEi\(𝐳~k\),\\mathbf\{z\}\_\{\\text\{moe\}\}=\\textstyle\\sum\_\{i\}\\alpha\_\{i\}\\,E\_\{i\}\(\\tilde\{\\mathbf\{z\}\}\_\{k\}\),\(6\)where each expertEiE\_\{i\}is a feed\-forward network\. Through domain\-conditioned routing, the weighted aggregation encourages domain\-specific patterns to concentrate in specialized experts, while shared experts model recurring veracity signals\.
### 4\.3Decision\-Level Generalization: Mutual Distillation Student
The final stage transfers the teacher’s knowledge to the student’s decision process\. Even with the teacher representation, a student trained via standard supervision can still overfit to domain\-specific priors if its decision boundaries are not explicitly constrained\. We address this through two complementary mechanisms, namely geometric anchoring and mutual consensus, and connect the teacher to the student via dual\-channel distillation\.
#### Geometric Anchoring via Domain Prototypes
Without explicit constraints, domain\-specific student branches may diverge into isolated clusters\. To prevent this, we introduce domain\-specific prototype memories\. For each domainkk, a prototype𝐩k\\mathbf\{p\}\_\{k\}tracks the moving centroid of the feature distribution:
𝐩k←λ𝐩k\+\(1−λ\)⋅𝔼𝐡∈ℬk\[𝐡\],\\mathbf\{p\}\_\{k\}\\leftarrow\\lambda\\,\\mathbf\{p\}\_\{k\}\+\(1\-\\lambda\)\\cdot\\mathbb\{E\}\_\{\\mathbf\{h\}\\in\\mathcal\{B\}\_\{k\}\}\[\\mathbf\{h\}\],\(7\)whereλ\\lambdais a momentum coefficient andℬk\\mathcal\{B\}\_\{k\}denotes the mini\-batch samples from domainkk\. These prototypes function as geometric anchors: they exert a centripetal force on each branch’s feature distribution, implicitly restricting manifold divergence\.
#### Enforcing Cross\-Domain Consensus via Mutual Distillation
Beyond geometric anchoring, we further smooth the decision surface through mutual knowledge distillation\. Each student branchSkS\_\{k\}specializes in domainkk, but we require all branches to reach a consensus on veracity prediction\. We enforce this by minimizing the pairwise KL divergence between branches:
ℒmutual=∑k≠jKL\(P\(Y\|Sk\)∥P\(Y\|Sj\)\)\.\\mathcal\{L\}\_\{\\text\{mutual\}\}=\\sum\_\{k\\neq j\}\\mathrm\{KL\}\\\!\\left\(P\(Y\|S\_\{k\}\)\\,\\\|\\,P\(Y\|S\_\{j\}\)\\right\)\.\(8\)
#### Bridging Teacher and Student via Dual Distillation
We close the gap between the teacher and student through dual\-channel distillation that transfers knowledge at two complementary levels\. First, feature\-level alignment synchronizes the student’s feature topology with the teacher’s representation space via an InfoNCE\-based contrastive objective:
ℒfeat=−logexp\(sim\(𝐳s,𝐳t\)/τf\)∑jexp\(sim\(𝐳s,𝐳j\)/τf\),\\mathcal\{L\}\_\{\\text\{feat\}\}=\-\\log\\frac\{\\exp\\\!\\left\(\\mathrm\{sim\}\(\\mathbf\{z\}\_\{s\},\\mathbf\{z\}\_\{t\}\)/\\tau\_\{f\}\\right\)\}\{\\sum\_\{j\}\\exp\\\!\\left\(\\mathrm\{sim\}\(\\mathbf\{z\}\_\{s\},\\mathbf\{z\}\_\{j\}\)/\\tau\_\{f\}\\right\)\},\(9\)where𝐳s\\mathbf\{z\}\_\{s\}and𝐳t\\mathbf\{z\}\_\{t\}denote student and teacher features for the same instance, and𝐳j\\mathbf\{z\}\_\{j\}are negative samples within the batch\. Second, logit\-level calibration distills the teacher’s soft probability distribution into the student:
ℒlogit=KL\(softmax\(ℓt/Td\)∥softmax\(ℓs/Td\)\),\\mathcal\{L\}\_\{\\text\{logit\}\}=\\mathrm\{KL\}\\\!\\left\(\\operatorname\{softmax\}\(\\bm\{\\ell\}\_\{t\}/T\_\{d\}\)\\,\\\|\\,\\operatorname\{softmax\}\(\\bm\{\\ell\}\_\{s\}/T\_\{d\}\)\\right\),\(10\)whereℓt,ℓs∈ℝ2\\bm\{\\ell\}\_\{t\},\\bm\{\\ell\}\_\{s\}\\in\\mathbb\{R\}^\{2\}are the teacher and student logits for the two veracity classes, andTd\>0T\_\{d\}\>0is the logit\-distillation temperature\.
### 4\.4Joint Optimization
The entire framework is optimized end\-to\-end with a composite objective:
ℒtotal=ℒCE⏟veracity\+αℒmutual⏟consensus\+β\(ℒlogit\+ℒfeat\)⏟distillation,\\mathcal\{L\}\_\{\\text\{total\}\}=\\underbrace\{\\mathcal\{L\}\_\{\\text\{CE\}\}\}\_\{\\text\{veracity\}\}\+\\;\\alpha\\,\\underbrace\{\\mathcal\{L\}\_\{\\text\{mutual\}\}\}\_\{\\text\{consensus\}\}\+\\;\\beta\\,\\underbrace\{\(\\mathcal\{L\}\_\{\\text\{logit\}\}\+\\mathcal\{L\}\_\{\\text\{feat\}\}\)\}\_\{\\text\{distillation\}\},\(11\)whereℒCE\\mathcal\{L\}\_\{\\text\{CE\}\}is the standard binary cross\-entropy loss for veracity classification, andα,β\\alpha,\\betabalance the contributions of mutual distillation and dual\-channel distillation, respectively\.
#### Training and Inference
EGMDis jointly optimized usingℒtotal\\mathcal\{L\}\_\{\\text\{total\}\}, with training\-time domain labels routing instances to domain\-specific components\. When domain labels are unavailable at inference, prototype similarity selects one source\-domain student branch\. Detailed training settings and routing robustness are provided in the Supplementary Material\.
Figure 2:Per\-domain accuracy ranges on Weibo21 and FineFake\. Triangles mark worst\-domain accuracy; dashed lines indicate theEGMDlower bound\.Table 2:Performance comparison on Chinese datasets\. Worst Acc\. denotes the minimum domain accuracy, and Total is FNED\+FPED\. The proposedEGMDis highlighted in light gray\.Table 3:Performance comparison on FineFake\. Worst Acc\. denotes the minimum domain accuracy, and Total is FNED\+FPED\.
## 5Experiment
### 5\.1Experiment Setup
Datasets\.We evaluate on three public multimodal fake\-news benchmarks: the ChineseWeibo\(Wang et al\.[2018](https://arxiv.org/html/2607.26555#bib.bib35)\)andWeibo21\(Nan et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib24)\)datasets, and the EnglishFineFake\(Zhou et al\.[2026](https://arxiv.org/html/2607.26555#bib.bib44)\)dataset\. We additionally use the constructedWeibo\_Balancedbenchmark \(Section[3\.2](https://arxiv.org/html/2607.26555#S3.SS2)\) as a controlled setting for examining the effect of domain imbalance\. Together, these four datasets cover two languages and diverse news domains\.
Baselines\.We selectMFAN\(Zheng et al\.[2022](https://arxiv.org/html/2607.26555#bib.bib42)\),MRML\(Peng et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib25)\),COOLANT\(Wang et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib33)\),BMR\(Ying et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib37)\),FSRU\(Lao et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib11)\),MMDFND\(Tong et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib31)\),MiMOE\-FND\(Liu et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib19)\), andDAMMFND\(Lu, Tong, and Ye[2025](https://arxiv.org/html/2607.26555#bib.bib20)\)as baselines that can be evaluated under the same data splits and supervision protocol\. The protocol differences of concurrent methods are documented in the Supplementary Material\.
Metrics\.We report aggregate Accuracy, worst\-domain accuracyWorst=mind∈𝒟Accuracyd\\text\{Worst\}=\\min\_\{d\\in\\mathcal\{D\}\}\\text\{Accuracy\}\_\{d\}, and cross\-domain error disparityTotal=FNED\+FPED\\text\{Total\}=\\text\{FNED\}\+\\text\{FPED\}\(Liu et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib17); Li et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib12); Feng et al\.[2026](https://arxiv.org/html/2607.26555#bib.bib8); Dixon et al\.[2018](https://arxiv.org/html/2607.26555#bib.bib6)\)\. We also provide the Performance Fairness Synergistic Score \(PFS\):
PFS=θ⋅ACC\+\(1−θ\)⋅e−2⋅TotalPFS=\\theta\\cdot\\text\{ACC\}\+\(1\-\\theta\)\\cdot e^\{\-2\\cdot\\text\{Total\}\}\(12\)We fixθ=0\.8\\theta=0\.8to prioritize accuracy and use the exponential term as a bounded penalty for disparity\. Because this scalarization is preference\-dependent, PFS is auxiliary; our conclusions rely primarily on Accuracy, Worst, andTotal\.
For a fair comparison, all baselines use identical settings\. Results are averaged over five independent runs; att\-test against the runner\-up determines significance \(p<0\.05p<0\.05\), marked by†\. Full implementation, dataset, baseline, and metric details are provided in the Supplementary Material\.
### 5\.2Aggregate Accuracy Masks Domain Failures
Aggregate accuracy conceals substantial domain\-level variation \(Figure[2](https://arxiv.org/html/2607.26555#S4.F2); Tables[2](https://arxiv.org/html/2607.26555#S4.T2)and[3](https://arxiv.org/html/2607.26555#S4.T3)\)\. On Weibo21, DAMMFND andEGMDappear nearly tied in average accuracy \(91\.58% versus 91\.63%\)\. Their least accurate domains, however, differ by 2\.70 points \(86\.96% versus 89\.66%\), and theirTotaldisparities differ by 41\.8% \(0\.9301 versus 0\.5415\)\. MMDFND illustrates the masking effect more sharply: its 88\.65% average hides a 22\.37\-point range betweenMilitary\(97\.37%\) andScience\(75\.00%\)\. The pattern persists on FineFake, where DAMMFND averages 85\.79% but falls to 76\.36% in its weakest domain;EGMDraises these figures to 87\.33% and 84\.07%, respectively\. Thus, a similar mean can conceal materially different deployment risk\. We consequently interpret average Accuracy together with Worst Acc\. andTotal, rather than treating the mean as the headline result\.
### 5\.3Tail\-Domain Performance
The per\-domain breakdown locates where the improvement occurs\. In the low\-resource Weibo21Sciencedomain,EGMDreaches 96\.43%, 2\.31 points above the best competing result from DAMMFND\. On FineFakeConflict, it reaches 89\.09%, improving over FSRU’s 84\.18% by 4\.91 points\.Militaryprovides an informative exception: MMDFND remains 2\.63 points higher thanEGMD\(97\.37% versus 94\.74%\)\. The result is therefore not a uniform gain in every domain\. Rather,EGMDcompresses the lower tail: it obtains the highest Worst Acc\. on Weibo, Weibo21, and FineFake, exceeding the strongest competing worst\-domain values by 1\.17, 2\.70, and 6\.54 points, respectively\. This concentration at the lower end explains why the small change in mean accuracy in Section[5\.2](https://arxiv.org/html/2607.26555#S5.SS2)corresponds to a substantially more uniform detector\.
Figure 3:Overall Accuracy and PFS on \(a\) cross\-dataset generalization \(train on Weibo, test on Weibo21\) and \(b\) theWeibo\_Balancedbenchmark\.EGMDachieves the best Accuracy and PFS in both settings\. Per\-domain results are provided in the Supplementary Material\.
### 5\.4Does Domain Imbalance Drive Domain Bias?
We useWeibo\_Balancedas a controlled intervention on domain volume, reducing the imbalance ratio from11\.08×11\.08\\timesto1\.27×1\.27\\times\. Under this intervention \(Figure[3](https://arxiv.org/html/2607.26555#S5.F3)b\),EGMD’s accuracy rises from 91\.63% to 92\.80%, whileTotalfalls from 0\.5415 to 0\.3376, a further 37\.7% reduction\. Balancing alone does not produce the same behavior in the strongest baseline: DAMMFND changes from 91\.58%/0\.9301 to 91\.34%/0\.9293 in Accuracy/Total\. MMDFND’s disparity decreases from 1\.5860 to 1\.1511 but remains more than three times that ofEGMD\. These contrasts support domain imbalance as a major driver of the domain bias exposed in Section[5\.2](https://arxiv.org/html/2607.26555#S5.SS2), while showing that balanced volume must interact with a model capable of preventing domain\-specific shortcuts\. The simultaneous improvement in Accuracy andTotalalso shows that lower disparity is not obtained by sacrificing aggregate detection performance\. More broadly, the differing responses across models indicate that domain volume is a contributing factor rather than a sufficient explanation; model design determines whether balanced evidence yields stable domain\-wise decisions\. The cross\-dataset result in Figure[3](https://arxiv.org/html/2607.26555#S5.F3)a provides a complementary stress test:EGMDalso retains the highest Accuracy and PFS when trained on Weibo and evaluated on Weibo21\.
### 5\.5What Reduces Domain Disparity?
Figure[4](https://arxiv.org/html/2607.26555#S5.F4)evaluates two levels ofEGMD\. At the representation level, removing DDN raisesTotalfrom 0\.5511 to 0\.9425 on Weibo and from about 0\.54 to 0\.65 on Weibo21, while accuracy falls by only 1\.3 points in each case\. This difference between disparity and accuracy indicates that statistical alignment redistributes performance across domains rather than merely increasing average capacity\. At the decision level, removing dual\-channel distillation increases disparity, whereas removing domain\-specific prototypes yields the largest accuracy losses: 3\.0 points on Weibo and 3\.8 points on Weibo21\. Together, representation\-level debiasing reduces domain variation, and decision\-level generalization converts aligned representations into accurate, stable predictions\.
Figure 4:Ablation study on Weibo and Weibo21\. DDN: Dynamic Domain\-specific Normalization; DDL: Dual Distillation Losses; DSP: Domain\-Specific Prototypes\.
### 5\.6Parameter Sensitivity
Figure[5](https://arxiv.org/html/2607.26555#S5.F5)examines the loss weightsα\\alphaandβ\\beta, coherence temperatureτc\\tau\_\{c\}, and prototype momentumλ\\lambda;τf\\tau\_\{f\}andTdT\_\{d\}remain fixed\. The model is more sensitive toα\\alphathan toβ\\beta\. Settingα=0\.3\\alpha=0\.3gives the highest accuracy \(0\.881\) withTotal=0\.49\\textit\{Total\}=0\.49, whereasα=0\.5\\alpha=0\.5increases disparity to 0\.57 without improving accuracy\. By contrast,Totalvaries only from 0\.35 to 0\.38 acrossβ\\beta, indicating that the method is comparatively robust to this weight\. The representation\-level parameters show clearer optima\. Atτc=0\.1\\tau\_\{c\}=0\.1, the model reaches 0\.912 Accuracy and 0\.800 PFS with the lowestTotalof 0\.54; larger temperatures weaken this balance\. Similarly,λ=0\.9\\lambda=0\.9maximizes Accuracy and PFS while minimizing disparity, whereas values on either side increaseTotal\. We therefore useα=β=0\.3\\alpha=\\beta=0\.3,τc=0\.1\\tau\_\{c\}=0\.1, andλ=0\.9\\lambda=0\.9throughout\.
Figure 5:Parameter sensitivity ofα\\alpha,β\\beta,τc\\tau\_\{c\}, andλ\\lambdain terms of detection performance and cross\-domain disparity\.
## 6Conclusion
We propose Expert\-Guided Mutual Distillation \(EGMD\), a unified teacher–student framework for domain bias and semantic misalignment in multimodal fake news detection\. Its key innovation is a dependent pipeline that conditions fusion on pair\-level coherence, organizes domain\-conditioned variation through a normalized expert teacher, and transfers feature geometry and predictions to lightweight students via prototype\-anchored dual\-channel distillation\.Weibo\_Balancedfurther isolates the effect of data imbalance\. Across four datasets,EGMDimproves aggregate and tail\-domain accuracy while achieving the lowest cross\-domain error disparity\.
#### Acknowledgments\.
This work was supported in part by the National Natural Science Foundation of China under Grant U22A2099 and Grant 62336003, and in part by the Fundamental Research Funds for the Central Universities under Grant 88022124\.
## References
- Cai et al\. \(2023\)Cai, Y\.; Xi, M\.; Shang, Y\.; and Yin, J\. 2023\.Exploring High\-Correlation Source Domain Information for Multi\-Source Domain Adaptation in Semantic Segmentation\.In*Proceedings of the 31st ACM International Conference on Multimedia*, 2148–2158\.
- Chen et al\. \(2026\)Chen, Y\.; Shi, W\.; Li, M\.; Cui, Y\.; Li, J\.; Zhang, R\.; Chen, H\.; Guo, H\.; Di, S\.; Liu, Z\.; Zhu, J\.; and Xu, J\. 2026\.Active Multi\-Source Domain Adaptation for Multimodal Fake News Detection\.In*Proceedings of the AAAI Conference on Artificial Intelligence*, volume 40, 20363–20371\.
- Cui et al\. \(2025a\)Cui, X\.; Lu, W\.; Tong, Y\.; Li, Y\.; and Zhao, Z\. 2025a\.Diffusion\-Based Multi\-Modal Synergy Interest Network for Click\-Through Rate Prediction\.In*Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval*, 581–591\.
- Cui et al\. \(2025b\)Cui, X\.; Lu, W\.; Tong, Y\.; Li, Y\.; and Zhao, Z\. 2025b\.Multi\-Modal Multi\-Behavior Sequential Recommendation with Conditional Diffusion\-Based Feature Denoising\.In*Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval*, 1593–1602\.
- Devlin et al\. \(2019\)Devlin, J\.; Chang, M\.\-W\.; Lee, K\.; and Toutanova, K\. 2019\.BERT: Pre\-Training of Deep Bidirectional Transformers for Language Understanding\.In*Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies*, 4171–4186\.
- Dixon et al\. \(2018\)Dixon, L\.; Li, J\.; Sorensen, J\.; Thain, N\.; and Vasserman, L\. 2018\.Measuring and Mitigating Unintended Bias in Text Classification\.In*Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society*, 67–73\.
- Dou et al\. \(2021\)Dou, Y\.; Shu, K\.; Xia, C\.; Yu, P\. S\.; and Sun, L\. 2021\.User Preference\-Aware Fake News Detection\.In*Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval*, 2051–2055\.
- Feng et al\. \(2026\)Feng, X\.; An, B\.; Gu, T\.; Chang, L\.; Hao, F\.; Yu, P\.; and Zhao, S\. 2026\.C2PO: Diagnosing and Disentangling Bias Shortcuts in LLMs\.In*Findings of the Association for Computational Linguistics: ACL 2026*, 24496–24515\.
- Guo et al\. \(2025\)Guo, H\.; Ma, Z\.; Zeng, Z\.; Luo, M\.; Zeng, W\.; Tang, J\.; and Zhao, X\. 2025\.Each Fake News Is Fake in Its Own Way: An Attribution Multi\-Granularity Benchmark for Multimodal Fake News Detection\.In*Proceedings of the AAAI Conference on Artificial Intelligence*, volume 39, 228–236\.
- He et al\. \(2022\)He, K\.; Chen, X\.; Xie, S\.; Li, Y\.; Dollár, P\.; and Girshick, R\. 2022\.Masked Autoencoders Are Scalable Vision Learners\.In*Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition*, 16000–16009\.
- Lao et al\. \(2024\)Lao, A\.; Zhang, Q\.; Shi, C\.; Cao, L\.; Yi, K\.; Hu, L\.; and Miao, D\. 2024\.Frequency Spectrum Is More Effective for Multimodal Representation and Fusion: A Multimodal Spectrum Rumor Detector\.In*Proceedings of the AAAI Conference on Artificial Intelligence*, volume 38, 18426–18434\.
- Li et al\. \(2024\)Li, J\.; Feng, X\.; Gu, T\.; and Chang, L\. 2024\.Dual\-Teacher De\-biasing Distillation Framework for Multi\-Domain Fake News Detection\.In*IEEE 40th International Conference on Data Engineering*, 3627–3639\.
- Li et al\. \(2025a\)Li, Y\.; Dong, J\.; Dong, Z\.; Yang, C\.; An, Z\.; and Xu, Y\. 2025a\.SRKD: Towards Efficient 3D Point Cloud Segmentation via Structure\- and Relation\-Aware Knowledge Distillation\.*arXiv preprint arXiv:2506\.17290*\.
- Li et al\. \(2025b\)Li, Y\.; Lin, X\.; Zhang, K\.; Yang, C\.; Guo, Z\.; Gou, J\.; and Li, Y\. 2025b\.FedKD\-Hybrid: Federated Hybrid Knowledge Distillation for Lithography Hotspot Detection\.*arXiv preprint arXiv:2501\.04066*\.
- Li et al\. \(2025c\)Li, Y\.; Long, Q\.; Zhou, Y\.; Zhang, R\.; Ning, Z\.; Zhu, Z\.; Zhou, Y\.; Wang, X\.; and Xiao, M\. 2025c\.ComAE: Comprehensive Attribute Exploration for Zero\-Shot Hashing\.In*Proceedings of the 2025 International Conference on Multimedia Retrieval*, 733–742\.
- Li et al\. \(2025d\)Li, Y\.; Yang, C\.; Zeng, H\.; Dong, Z\.; An, Z\.; Xu, Y\.; Tian, Y\.; and Wu, H\. 2025d\.Frequency\-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting\.In*Proceedings of the IEEE/CVF International Conference on Computer Vision*, 7262–7272\.
- Liu et al\. \(2021\)Liu, H\.; Jin, W\.; Karimi, H\.; Liu, Z\.; and Tang, J\. 2021\.The Authors Matter: Understanding and Mitigating Implicit Bias in Deep Text Classification\.In*Findings of the Association for Computational Linguistics: ACL\-IJCNLP 2021*, 74–85\.
- Liu et al\. \(2024\)Liu, H\.; Wang, W\.; Li, H\.; and Li, H\. 2024\.TELLER: A Trustworthy Framework for Explainable, Generalizable and Controllable Fake News Detection\.In*Findings of the Association for Computational Linguistics: ACL 2024*, 15556–15583\.
- Liu et al\. \(2025\)Liu, Y\.; Liu, Y\.; Li, Z\.; Yao, R\.; Zhang, Y\.; and Wang, D\. 2025\.Modality Interactive Mixture\-of\-Experts for Fake News Detection\.In*Proceedings of the ACM on Web Conference*, 5139–5150\.
- Lu, Tong, and Ye \(2025\)Lu, W\.; Tong, Y\.; and Ye, Z\. 2025\.DAMMFND: Domain\-Aware Multimodal Multi\-View Fake News Detection\.In*Proceedings of the AAAI Conference on Artificial Intelligence*, volume 39, 559–567\.
- Ma et al\. \(2024\)Ma, Z\.; Luo, M\.; Guo, H\.; Zeng, Z\.; Hao, Y\.; and Zhao, X\. 2024\.Event\-RADAR: Event\-Driven Multi\-View Learning for Multimodal Fake News Detection\.In*Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics*, 5809–5821\.
- Meng et al\. \(2026\)Meng, Y\.; Wang, H\.; Zhao, J\.; Sun, Y\.; and Shao, M\. 2026\.Dynamic Hierarchical Memory Improved Mixture\-of\-Experts for Multimodal Fake News Detection\.*Information Processing & Management*, 63\(2\): 104479\.
- Mosallanezhad et al\. \(2022\)Mosallanezhad, A\.; Karami, M\.; Shu, K\.; Mancenido, M\. V\.; and Liu, H\. 2022\.Domain adaptive fake news detection via reinforcement learning\.In*Proceedings of the ACM Web Conference*, 3632–3640\.
- Nan et al\. \(2021\)Nan, Q\.; Cao, J\.; Zhu, Y\.; Wang, Y\.; and Li, J\. 2021\.MDFEND: Multi\-Domain Fake News Detection\.In*Proceedings of the 30th ACM International Conference on Information & Knowledge Management*, 3343–3347\.
- Peng et al\. \(2023\)Peng, L\.; Jian, S\.; Li, D\.; and Shen, S\. 2023\.MRML: Multimodal Rumor Detection by Deep Metric Learning\.In*IEEE International Conference on Acoustics, Speech and Signal Processing*, 1–5\.
- Qi et al\. \(2021\)Qi, P\.; Cao, J\.; Li, X\.; Liu, H\.; Sheng, Q\.; Mi, X\.; He, Q\.; Lv, Y\.; Guo, C\.; and Yu, Y\. 2021\.Improving Fake News Detection by Using an Entity\-Enhanced Framework to Fuse Diverse Multimodal Clues\.In*Proceedings of the 29th ACM international conference on multimedia*, 1212–1220\.
- Qiao et al\. \(2025\)Qiao, J\.; Li, X\.; Gao, C\.; Wu, L\.; Feng, J\.; and Wang, Z\. 2025\.Improving Multimodal Fake News Detection by Leveraging Cross\-Modal Content Correlation\.*Information Processing & Management*, 62\(5\): 104120\.
- Radford et al\. \(2021\)Radford, A\.; Kim, J\. W\.; Hallacy, C\.; Ramesh, A\.; Goh, G\.; Agarwal, S\.; Sastry, G\.; Askell, A\.; Mishkin, P\.; Clark, J\.; et al\. 2021\.Learning Transferable Visual Models from Natural Language Supervision\.In*International Conference on Machine Learning*, 8748–8763\. PmLR\.
- Shen et al\. \(2025\)Shen, L\.; Long, Y\.; Cai, X\.; Razzak, I\.; Chen, G\.; Liu, K\.; and Jameel, S\. 2025\.GAMED: Knowledge\-Adaptive Multi\-Experts Decoupling for Multimodal Fake News Detection\.In*Proceedings of the Eighteenth ACM International Conference on Web Search and Data Mining*, 586–595\.
- Sun et al\. \(2025\)Sun, J\.; Chen, C\.; Hou, C\.; Wu, Y\.; and Yuan, X\. 2025\.Multimodal Taylor Series Network for Misinformation Detection\.In*Proceedings of the ACM on Web Conference*, 2540–2548\.
- Tong et al\. \(2024\)Tong, Y\.; Lu, W\.; Zhao, Z\.; Lai, S\.; and Shi, T\. 2024\.MMDFND: Multi\-Modal Multi\-Domain Fake News Detection\.In*Proceedings of the 32nd ACM International Conference on Multimedia*, 1178–1186\.
- van der Maaten and Hinton \(2008\)van der Maaten, L\.; and Hinton, G\. 2008\.Visualizing Data using t\-SNE\.*Journal of Machine Learning Research*, 9\(86\): 2579–2605\.
- Wang et al\. \(2023\)Wang, L\.; Zhang, C\.; Xu, H\.; Xu, Y\.; Xu, X\.; and Wang, S\. 2023\.Cross\-Modal Contrastive Learning for Multimodal Fake News Detection\.In*Proceedings of the 31st ACM International Conference on Multimedia*, 5696–5704\.
- Wang, Yan, and Ding \(2024\)Wang, Q\.; Yan, K\.; and Ding, S\. 2024\.Bilateral Adaptive Cross\-Modal Fusion Prompt Learning for CLIP\.In*Proceedings of the 32nd ACM International Conference on Multimedia*, 9001–9009\.
- Wang et al\. \(2018\)Wang, Y\.; Ma, F\.; Jin, Z\.; Yuan, Y\.; Xun, G\.; Jha, K\.; Su, L\.; and Gao, J\. 2018\.EANN: Event adversarial neural networks for multi\-modal fake news detection\.In*Proceedings of the 24th Acm SIGKDD International Conference on Knowledge Discovery & Data Mining*, 849–857\.
- Yang et al\. \(2024\)Yang, R\.; Gao, W\.; Ma, J\.; Lin, H\.; and Wang, B\. 2024\.Reinforcement Tuning for Detecting Stances and Debunking Rumors Jointly with Large Language Models\.In*Findings of the Association for Computational Linguistics: ACL 2024*, 13423–13439\.
- Ying et al\. \(2023\)Ying, Q\.; Hu, X\.; Zhou, Y\.; Qian, Z\.; Zeng, D\.; and Ge, S\. 2023\.Bootstrapping Multi\-View Representations for Fake News Detection\.In*Proceedings of the AAAI conference on Artificial Intelligence*, volume 37, 5384–5392\.
- Zeng et al\. \(2024\)Zeng, Z\.; Luo, M\.; Kong, X\.; Liu, H\.; Guo, H\.; Yang, H\.; Ma, Z\.; and Zhao, X\. 2024\.Mitigating World Biases: A Multimodal Multi\-View Debiasing Framework for Fake News Video Detection\.In*Proceedings of the 32nd ACM international conference on multimedia*, 6492–6500\.
- Zhang et al\. \(2025\)Zhang, L\.; Zhang, X\.; Zhou, Z\.; Zhang, X\.; Yu, P\. S\.; and Li, C\. 2025\.Knowledge\-Aware Multimodal Pre\-Training for Fake News Detection\.*Information Fusion*, 114: 102715\.
- Zhao et al\. \(2024\)Zhao, S\.; Jia, M\.; Tuan, L\. A\.; Pan, F\.; and Wen, J\. 2024\.Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In\-context Learning\.In*Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing*, 11507–11522\.
- Zhao et al\. \(2025\)Zhao, S\.; Wu, X\.; Nguyen, C\.\-D\. T\.; Jia, Y\.; Jia, M\.; Yichao, F\.; and Tuan, L\. A\. 2025\.Unlearning Backdoor Attacks for LLMs with Weak\-to\-Strong Knowledge Distillation\.In*Findings of the Association for Computational Linguistics: ACL 2025*, 4937–4952\.
- Zheng et al\. \(2022\)Zheng, J\.; Zhang, X\.; Guo, S\.; Wang, Q\.; Zang, W\.; and Zhang, Y\. 2022\.MFAN: Multi\-Modal Feature\-Enhanced Attention Networks for Rumor Detection\.In*Proceedings of the 31st International Joint Conference on Artificial Intelligence*, 2413–2419\.
- Zhou et al\. \(2023\)Zhou, Y\.; Yang, Y\.; Ying, Q\.; Qian, Z\.; and Zhang, X\. 2023\.Multi\-Modal Fake News Detection on Social Media via Multi\-Grained Information Fusion\.In*Proceedings of the 2023 ACM International Conference on Multimedia Retrieval*, 343–352\.
- Zhou et al\. \(2026\)Zhou, Z\.; Zhang, X\.; Zhang, L\.; Liu, J\.; Cambria, E\.; and Li, C\. 2026\.FineFake: A Knowledge\-Enriched Dataset for Fine\-Grained Multi\-Domain Fake News Detection\.*Information Fusion*, 132: 104253\.
- Zhu et al\. \(2022\)Zhu, Y\.; Sheng, Q\.; Cao, J\.; Li, S\.; Wang, D\.; and Zhuang, F\. 2022\.Generalizing to the Future: Mitigating Entity Bias in Fake News Detection\.In*Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval*, 2120–2125\.
- Zhu et al\. \(2023\)Zhu, Y\.; Sheng, Q\.; Cao, J\.; Nan, Q\.; Shu, K\.; Wu, M\.; Wang, J\.; and Zhuang, F\. 2023\.Memory\-Guided Multi\-View Multi\-Domain Fake News Detection\.*IEEE Transactions on Knowledge and Data Engineering*, 35\(7\): 7178–7191\.
Appendix
Appendix organization\.Sections A–E provide reproducibility details and extended background, including implementation, datasets, baselines, metrics, and related work\. Sections F–J present supplementary evidence on domain bias, the construction ofWeibo\_Balanced, efficiency and deployment robustness, cross\-dataset generalization, and feature visualization\.
## Appendix AImplementation Details
### A\.1Training Configuration
Environment and reproducibility\.The proposed method is implemented in PyTorch, and all experiments are conducted on an NVIDIA GeForce RTX 4090 GPU\. All reported results are averaged over five independent runs using five distinct, pre\-specified random seeds\. The same seed set is used for every method and dataset\.
Feature extraction\.The text branch uses pretrained BERT\(Devlin et al\.[2019](https://arxiv.org/html/2607.26555#bib.bib5)\)and CLIP\(Radford et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib28)\)text encoders\. BERT produces a frozen 768\-dimensional representation\. The visual branch resizes each image to224×224224\\times 224pixels and extracts features with pretrained MAE and CLIP encoders\. Multimodal features are projected through a single\-layer MLP with a hidden dimension of 384 and dropout of 0\.2\.
Optimization\.We use an initial learning rate of1×10−41\\times 10^\{\-4\}, a batch size of 64, and a maximum of 50 epochs\. Training stops early when validation performance does not improve for five consecutive epochs\.
Joint training\.The teacher and collaborative students are optimized jointly using the composite objectiveℒtotal\\mathcal\{L\}\_\{\\text\{total\}\}; the teacher receives no separate pretraining\. The cross\-entropy veracity loss is applied to both teacher and student predictions\. During training, ground\-truth domain labels route instances to the corresponding domain\-specific experts and student branches, following the supervision available in standard multi\-domain benchmarks\.
## Appendix BDataset Details
We evaluate on three public multimodal benchmarks, Weibo\(Wang et al\.[2018](https://arxiv.org/html/2607.26555#bib.bib35)\), Weibo21\(Nan et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib24)\), and FineFake\(Zhou et al\.[2026](https://arxiv.org/html/2607.26555#bib.bib44)\), together with the constructedWeibo\_Balancedbenchmark detailed in Appendix[G](https://arxiv.org/html/2607.26555#A7)\. All datasets contain paired text\-image news and binary veracity labels across multiple domains\.
FineFake\(Zhou et al\.[2026](https://arxiv.org/html/2607.26555#bib.bib44)\)is a multimodal, knowledge\-enhanced benchmark for cross\-domain fake news detection, covering six themes across eight platforms\. We exclude corrupted instances and report the retained subset in Table[4](https://arxiv.org/html/2607.26555#A2.T4)\.
Table 4:Statistics of the FineFake dataset, where Bus\., Pol\., Soc\., Heal\., Ent\., and Con\. represent Business, Politics, Society, Health, Entertainment, and Conflict, respectively\.Weibo\(Wang et al\.[2018](https://arxiv.org/html/2607.26555#bib.bib35)\)is a Chinese multi\-domain fake news detection dataset collected from Sina Weibo\. It covers finance, health, military, science, politics, international, education, society, and entertainment\. Table[5](https://arxiv.org/html/2607.26555#A2.T5)reports its domain and label distribution\.
Table 5:Statistics of the Weibo dataset, where Int\., Edu\., Soc\., and Ent\. represent international, education, society, and entertainment, respectively\.
Weibo21\(Nan et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib24)\)is another Chinese multi\-domain benchmark collected from Sina Weibo\. It covers finance, health, military, science, politics, disaster, education, society, and entertainment\. Its long\-tailed domain distribution is reported in Table[6](https://arxiv.org/html/2607.26555#A2.T6)and analyzed further in Appendix[F](https://arxiv.org/html/2607.26555#A6)\.
Table 6:Statistics of the original Weibo21 dataset\. Dis\., Edu\., Soc\., and Ent\. denote disaster, education, society, and entertainment\.
## Appendix CBaselines
We compareEGMDwith eight representative multimodal fake news detectors spanning general multimodal fusion, cross\-modal alignment, frequency\-domain modeling, domain adaptation, and MoE architectures\.
### C\.1General Multimodal Detection
MFAN\(Zheng et al\.[2022](https://arxiv.org/html/2607.26555#bib.bib42)\)proposed a multimodal graph structure that fuses text, images, and social graphs to boost detection performance\.
MRML\(Peng et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib25)\)investigated intra\-modal and cross\-modal relationships through triplet and contrastive learning techniques\.
COOLANT\(Wang et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib33)\)enhanced text\-image alignment by applying cross\-modal contrastive learning alongside consistency\-driven tasks\.
### C\.2Cross\-Domain and Expert\-Based Detection
BMR\(Ying et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib37)\)modeled news features from multiple views through bootstrap multi\-view representations and utilized the Mixture of Experts network for multi\-view fusion\.
FSRU\(Lao et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib11)\)converted spatial features into frequency spectrum features using Fourier transforms, extracting effective information through single\-modality spectrum compression and cross\-modality spectrum collaborative selection modules\.
MMDFND\(Tong et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib31)\)employed a hierarchical extraction network with fused domain embeddings and attention mechanisms to achieve domain\-adaptive modeling, fully integrating information from different modalities and domains via pivot transformations and adaptive normalization\.
MiMOE\-FND\(Liu et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib19)\)extended the MoE architecture by incorporating an interaction gating mechanism, which allowed the model to capture complex interactions and dependencies between modalities\.
DAMMFND\(Lu, Tong, and Ye[2025](https://arxiv.org/html/2607.26555#bib.bib20)\)addressed negative transfer in cross\-domain settings via domain information decoupling\. By incorporating domain\-aware multi\-view discrimination and a domain\-augmented weighted decision strategy, it adaptively captured the heterogeneous contributions of multimodal features across domains, leading to more accurate and robust cross\-domain fake news detection\.
### C\.3Scope of Concurrent 2026 Methods
We also examine two concurrent methods but do not copy their published numbers into our tables because the required supervision or reported outputs are not directly comparable\. ADOSE\(Chen et al\.[2026](https://arxiv.org/html/2607.26555#bib.bib2)\)is an active adaptation method that labels 10% of the target\-domain samples and evaluates leave\-one\-domain\-out transfer over four selected Weibo domains; this additional supervision is unavailable to all methods in our setting\. MemiMoE\-FND\(Meng et al\.[2026](https://arxiv.org/html/2607.26555#bib.bib22)\)evaluates standard multimodal detection on Weibo, Pheme, and PolitiFact without reporting domain\-wise predictions for disparity evaluation\. We therefore cite both methods as closely related work while restricting the quantitative comparison to methods rerun under identical splits, target\-label access, and metrics\.
## Appendix DEvaluation Metrics
Following prior work\(Liu et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib17); Li et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib12)\), we adopt accuracy to evaluate overall performance, False Positive Equality Difference \(FPED\), and False Negative Equality Difference \(FNED\)\(Dixon et al\.[2018](https://arxiv.org/html/2607.26555#bib.bib6); Zhao et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib40)\)to assess fairness\.
Predictive performance\.Accuracy is the fraction of correctly classified samples over the complete evaluation set\.
Cross\-domain disparity\.FPED sums the absolute differences between each domain\-specific false\-positive rate and the global false\-positive rate\. FNED is defined analogously using false\-negative rates:
FPED=∑d∈K\|FPR−FPRd\|FPED=\\sum\_\{d\\in K\}\\left\|FPR\-FPR\_\{d\}\\right\|\(13\)FNED=∑d∈K\|FNR−FNRd\|FNED=\\sum\_\{d\\in K\}\\left\|FNR\-FNR\_\{d\}\\right\|\(14\)whereKKdenotes the set of domains\. We defineTotal=FPED\+FNED\\text\{Total\}=\\text\{FPED\}\+\\text\{FNED\}, with lower values indicating smaller cross\-domain error disparities\.
Joint performance\-fairness score\.PFS provides a secondary scalar summary of Accuracy and Total:
PFS=θ⋅ACC\+\(1−θ\)⋅e−2⋅Total,PFS=\\theta\\cdot\\text\{ACC\}\+\(1\-\\theta\)\\cdot e^\{\-2\\cdot\\text\{Total\}\},\(15\)whereθ=0\.8\\theta=0\.8encodes an accuracy\-prioritized reporting preference\. Its partial derivatives,∂PFS/∂ACC=θ\>0\\partial\\mathrm\{PFS\}/\\partial\\mathrm\{ACC\}=\\theta\>0and∂PFS/∂Total=−2\(1−θ\)e−2Total<0\\partial\\mathrm\{PFS\}/\\partial\\mathrm\{Total\}=\-2\(1\-\\theta\)e^\{\-2\\mathrm\{Total\}\}<0, make the intended directions explicit\. The factor 2 fixes the curvature of the bounded disparity term\. Neither constant is claimed to be theoretically optimal, and a scalar score may obscure cases in which Accuracy and disparity move in opposite directions\. Accordingly, all tables report Accuracy, FPED, FNED, and Total separately; PFS is used only as a supplementary summary rather than as standalone evidence of superiority\.
## Appendix EExtended Related Work
This section provides a detailed review of traditional unimodal approaches and the evolution of multimodal fake news detection architectures\.
### E\.1Traditional Fake News Detection
Traditional methods primarily rely on unimodal information such as text or propagation structures\.
- •Generalization Strategies:ENDEF\(Zhu et al\.[2022](https://arxiv.org/html/2607.26555#bib.bib45)\)applied causal inference to mitigate entity bias\. REAL\-FND\(Mosallanezhad et al\.[2022](https://arxiv.org/html/2607.26555#bib.bib23)\)introduced reinforcement learning to adjust feature representations across domains based on user\-news interactions\.
- •Complex Modeling:UPFD\(Dou et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib7)\)incorporated user posting histories, while M³FEND\(Zhu et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib46)\)addressed label scarcity through multi\-view modeling and memory mechanisms\.
- •Debiasing Frameworks:Notably, DTDBD\(Li et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib12)\)provided a dual\-teacher distillation framework to enhance cross\-domain performance\. However, as these methods are designed for unimodal inputs, they lack the flexibility to generalize to complex multimodal scenarios where visual context is crucial\.
### E\.2Multimodal Fake News Detection
Multimodal detection integrates text and images to improve accuracy, with research focusing on intra\- and cross\-modal dynamics\.
- •Fusion Mechanisms:MFAN\(Zheng et al\.[2022](https://arxiv.org/html/2607.26555#bib.bib42)\)proposed a graph\-based fusion of text, images, and social networks\. MRML\(Peng et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib25)\)and COOLANT\(Wang et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib33)\)utilized triplet and contrastive learning to enhance alignment\. More recently, FSRU\(Lao et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib11)\)introduced spectrum\-based fusion using Fourier transforms, and MTS\(Sun et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib30)\)leveraged Taylor series expansion for scalable interaction modeling\.
- •Domain Adaptation:MMDFND\(Tong et al\.[2024](https://arxiv.org/html/2607.26555#bib.bib31)\)employs fused domain embeddings and attention mechanisms for domain\-adaptive modeling, whereas ADOSE\(Chen et al\.[2026](https://arxiv.org/html/2607.26555#bib.bib2)\)actively acquires labels from a target domain for multi\-source adaptation\.
- •Mixture\-of\-Experts \(MoE\):To handle heterogeneity, BMR\(Ying et al\.[2023](https://arxiv.org/html/2607.26555#bib.bib37)\)uses MoE for reweighted fusion, MiMOE\-FND\(Liu et al\.[2025](https://arxiv.org/html/2607.26555#bib.bib19)\)models modality interactions, and MemiMoE\-FND\(Meng et al\.[2026](https://arxiv.org/html/2607.26555#bib.bib22)\)introduces learnable memory slots and hierarchical expert fusion\.
Despite these advances, existing multimodal MoE methods typically focus on fusion efficacy\. In contrast,EGMDuses expert guidance to reduce domain\-specific bias while preserving shared semantic cues\.
## Appendix FDomain Bias Analysis in Weibo21
Figure 6:Performance comparison between head and tail domains on Weibo21, illustrating cross\-domain disparity in multimodal fake news detection\.This section provides a statistical examination of the domain imbalances in the Weibo21 dataset\(Nan et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib24)\), as visualized in Figure[6](https://arxiv.org/html/2607.26555#A6.F6)\.
#### Data Volume Discrepancy\.
The dataset exhibits an11\.08×11\.08\\timesdisparity in data volume between the most represented domain \(Society,28\.8%28\.8\\%\) and the least represented domain \(Science,2\.6%2\.6\\%\)\. The top three domains \(Society, Entertainment, and Finance\) collectively account for 59\.3% of the data, whereas the bottom three account for 11\.7%\. This long\-tailed distribution can bias optimization toward majority domains and confounds domain shift with unequal sample size\.
#### Distributional Independence\.
Crucially, the prevalence of fake news varies significantly across domains \(ranging from27\.4%27\.4\\%inFinanceto76\.1%76\.1\\%inDisaster\) but shows a weak negative correlation \(r=−0\.179r=\-0\.179\) with data volume\. This finding indicates that the volume imbalance is not a sampling artifact but a structural property\. Consequently, simple volumetric heuristics fail; effective detection requires learning robust, domain\-invariant semantics rather than relying on domain\-specific statistics\.
#### Implications for Fairness\.
The severe imbalance makes global accuracy insufficient because errors in small domains contribute little to the aggregate score\. On Weibo21,EGMDachieves a Total bias of 0\.5415, compared with 1\.5860 for MMDFND, while maintaining the strongest overall accuracy\. This result motivates reporting domain\-level performance and disparity metrics together\.
## Appendix GWeibo\_Balanced: Construction and Full Results
In this section, we provide a comprehensive description of the construction, statistics, and validation of theWeibo\_Balanceddataset\.
### G\.1Motivation: Controlling Data\-Volume Imbalance
The original Weibo21 dataset exhibits severe domain imbalance \(Table[6](https://arxiv.org/html/2607.26555#A2.T6)\)\. Consequently, results on the original benchmark reflect both domain shift and unequal data volume\. We constructWeibo\_Balancedto reduce this confounding effect and provide a more controlled evaluation of cross\-domain performance\.
### G\.2Data Collection and Quality Assurance
Collection strategy\.We follow the collection pipeline of Weibo21\(Nan et al\.[2021](https://arxiv.org/html/2607.26555#bib.bib24)\)\. Seed keywords are derived from high\-frequency terms in underrepresented domains and used for targeted crawling\. For the dominantSocietydomain, we apply random downsampling to retain a representative subset while reducing its prevalence\.
Annotation protocol\.Ten domain experts independently annotate each newly collected instance\. A domain label is accepted when at least eight experts agree\. Instances below this threshold undergo further review until consensus is reached\.
### G\.3Dataset Statistics
Table[7](https://arxiv.org/html/2607.26555#A7.T7)reports the resulting distribution\. Relative to Weibo21, the balanced benchmark adds 5,314 instances and removes 988, yielding a net increase of 4,326 instances\. Domain totals range from 1,282 to 1,627, reducing the maximum ratio to1\.27×1\.27\\times\.
Table 7:Statistics of the constructedWeibo\_Balanceddataset\. Dis\., Edu\., Soc\., and Ent\. denote disaster, education, society, and entertainment\.
### G\.4Per\-Domain Results
Table[8](https://arxiv.org/html/2607.26555#A7.T8)reports the per\-domain results underlying theWeibo\_Balancedcomparison summarized in the main paper\.
Table 8:Results onWeibo\_Balanced\. Best and second\-best values are bold and underlined\.
Results\.EGMDobtains the highest overall Accuracy \(0\.9280\) and PFS \(0\.8442\), improving over the strongest competing values by 0\.0124 and 0\.0823, respectively\. It also reduces Total bias to 0\.3376, which is 0\.4521 below the next\-lowest value\. These results confirm that the gains summarized in the main paper persist after substantially reducing domain\-size imbalance\.
## Appendix HAdditional Ablation, Robustness, and Efficiency Results
This section supplements the main ablation with progressive component construction, deployment without ground\-truth domain labels, and computational efficiency\.
### H\.1Progressive Component Construction
Starting from the coherence\-aware gating mechanism alone gives an Accuracy of 0\.8906, aTotalscore of 0\.9332, and a PFS of 0\.7434\. Adding DDN yields the largest early reduction inTotal, lowering it to 0\.7725\. The MoE teacher and mutual distillation then reduceTotalto 0\.6983 and 0\.5938, respectively, before the complete model reaches 0\.5415\. This bottom\-up trend complements the leave\-one\-component\-out ablation in the main paper\.
### H\.2Robustness to Missing Domain Labels
Evaluation protocol\.When domain labels are unavailable at inference,EGMDassigns each instance to a domain using the learned prototypes described in the main paper’s joint\-optimization section\. We compare this practical setting with two references: an oracle using ground\-truth domain labels and a lower bound using random domain assignment\. This comparison isolates the effect of routing quality without changing the trained model\.
Table 9:Robustness to missing domain labels on Weibo21 under oracle, prototype\-inferred, and random routing\.Results\.As shown in Table[9](https://arxiv.org/html/2607.26555#A8.T9), prototype\-inferred routing reaches 0\.9063 Accuracy and 0\.6137 Total\. Relative to the oracle, it decreases Accuracy by 0\.0100 and increases Total by 0\.0722\. Nevertheless, it remains substantially stronger than random routing, improving Accuracy by 0\.0136 and reducing Total by 0\.1093\. These results show that accurate domain routing remains beneficial, while learned prototypes provide a reliable fallback when explicit domain labels are unavailable\. This fallback performs closed\-set routing among theKKsource\-domain branches; it does not create a branch for a novel or redefined domain taxonomy\.
### H\.3Computational Efficiency
The teacher, prototype updates, mutual learning, and both distillation losses supervise training, whereas inference activates only one student branch\. Table[10](https://arxiv.org/html/2607.26555#A8.T10)therefore reports both resource cost and Weibo21 effectiveness\. Relative to MMDFND,EGMDuses 17\.3M more parameters \(15\.9%\), adds 11\.2 seconds per epoch \(24\.8%\), and increases single\-instance latency by 3\.1 milliseconds \(18\.8%\)\. This increase accompanies a 0\.0832 gain in PFS and a 1\.0445 reduction in Total bias\.
Table 10:Efficiency and effectiveness on Weibo21\. Training time is measured per epoch on an NVIDIA RTX 4090; latency is measured per instance\.
## Appendix ICross\-Dataset Generalization: Per\-Domain Results
This section provides the full per\-domain breakdown underlying the cross\-dataset comparison summarized in the main paper\.
Table 11:Per\-domain and overall results when training on Weibo and testing on Weibo21\.
Results\.EGMDachieves the highest accuracy in six of the nine target domains and improves overall Accuracy from 0\.7674 to 0\.7944 relative to DAMMFND\. It also reduces Total bias from 0\.6284 to 0\.4628 and raises PFS from 0\.6708 to 0\.7148\. The simultaneous improvement in domain\-level accuracy and aggregate disparity supports the cross\-dataset conclusion in the main paper\.
## Appendix JFeature Visualization
Purpose and setup\.We use t\-SNE\(van der Maaten and Hinton[2008](https://arxiv.org/html/2607.26555#bib.bib32)\)to compare raw multimodal features with representations learned by MMDFND andEGMDon Weibo\. The top row is colored by veracity label to assess class separation, and the bottom row is colored by domain to inspect domain\-dependent structure\. Because t\-SNE is projection\-dependent, this analysis is treated as qualitative supporting evidence\.
\(a\)Original
\(b\)MMDFND
\(c\)EGMD
\(d\)Original
\(e\)MMDFND
\(f\)EGMD
Figure 7:t\-SNE visualization of feature distributions on Weibo\. The top row is colored by veracity label and the bottom row by news domain\.Results\.As shown in Figure[7](https://arxiv.org/html/2607.26555#A10.F7), raw features exhibit substantial overlap under both colorings\. MMDFND improves local grouping but retains mixed regions\.EGMDproduces more compact veracity clusters while reducing the visually dominant domain\-specific grouping, consistent with the quantitative disparity results\.Similar Articles
MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion
Proposes M2GDT, a novel MKGC framework that uses an MLLM-guided diffusion transformer with relation-adaptive mixture-of-experts to align and denoise multimodal features, outperforming baselines on three benchmark datasets.
MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Text
This paper introduces MELD, a detector for AI-generated text that uses multi-task learning with auxiliary heads for generator family, attack type, and source domain to improve robustness. MELD achieves strong performance on the RAID benchmark and maintains low false-positive rates under adversarial attacks.
Mitigating Manifold Departure: Uncertainty-Aware Subspace Rectification for Trustworthy MLLM Decoding
This paper introduces MGAP, a training-free decoding method that reduces hallucinations in Multimodal Large Language Models by adaptively suppressing only the harmful parts of language priors while preserving the model's semantic manifold. The method outperforms prior baselines on POPE and CHAIR benchmarks.
Post-Trained MoE Can Skip Half Experts via Self-Distillation
ZEDA is a low-cost framework that converts post-trained static MoE models into dynamic ones by injecting zero-output experts and using self-distillation, achieving over 50% expert FLOP reduction with marginal accuracy loss on benchmarks.
Spectral Gradient Surgery for Domain-Generalizable Dataset Distillation
This paper introduces Domain Generalizable Dataset Distillation (DGDD), a new problem setting that targets out-of-distribution generalization of distilled datasets, and proposes Spectral Gradient Surgery (SGS) to disentangle class-discriminative and domain-specific information by leveraging cross-domain gradient agreement in the spectral domain.