KITE: A Tri-Modal Transformer Integrating Text, Images, and Knowledge Graphs for Fake News Detection
Summary
Introduces KITE, a tri-modal transformer framework that jointly models text, images, and knowledge graphs for fake news detection, outperforming unimodal and bimodal baselines on benchmark datasets.
View Cached Full Text
Cached at: 06/09/26, 08:52 AM
# KITE: A Tri-Modal Transformer Integrating Text, Images, and Knowledge Graphs for Fake News Detection Source: [https://arxiv.org/abs/2606.07651](https://arxiv.org/abs/2606.07651) [View PDF](https://arxiv.org/pdf/2606.07651) > Abstract:Traditional fake news detection methods are falling behind as multimodal misinformation grows more advanced, seamlessly blending deceptive text, manipulated visuals, and factually incorrect claims\. Most prior work focuses on text\-image fusion or applies external knowledge only as a post\-processing step, limiting their ability to detect deeper semantic inconsistencies\. In this paper, we introduce KITE \(Knowledge\-Integrated Text\-Image Encoder\), a tri\-modal fake news detection framework that jointly models textual, visual, and factual knowledge representations\. KITE leverages Roberta \[23,14\] and CLIP \[24\] for linguistic and visual encoding, while a Graph Attention Network \(GAT\) processes structured facts retrieved from Wikidata\. KITE uses cross\-modal attention \[9\] within a multimodal transformer to integrate text, visual, and knowledge features, helping it understand how each modality relates to one another\. Modality\-specific confidence scores are generated alongside the final prediction, offering interpretability by indicating which input type most influenced the decision\. Evaluations on benchmark datasets demonstrate that KITE significantly outperforms unimodal and bimodal baselines, particularly in scenarios involving image\-text mismatches or contradictions with external knowledge\. ## Submission history From: Shashi Bhushan Jha \[[view email](https://arxiv.org/show-email/0ef97bd3/2606.07651)\] **\[v1\]**Tue, 2 Jun 2026 18:03:17 UTC \(680 KB\)
Similar Articles
F2IND-IT! -- Multimodal Fuzzy Fake Indian News Detection using Images and Text
Proposes FIND-IT!, a multimodal fake news detection framework for Indian news using ResNet-50 for visual features, DistilBERT for text, and ANFIS with attention fusion to classify news as fake or real.
Can Multimodal Large Language Models Generate and Detect Multimodal Social Media Fake News?
An EMNLP Findings 2026 paper introduces a multi-agent framework (story, image, and critic agents) that generates over 9,000 multimodal fake news posts and benchmarks 16 open- and closed-source MLLMs, finding they fall short of human-level detection accuracy, especially at judging image authenticity.
Mind the Gap: A Dual Knowledge Graph Framework for Unified Multi-task User Intent Inference
This paper proposes DKG-MTI, a dual knowledge graph framework that augments LLM-based inference with structure-aware knowledge alignment to jointly predict aspect ratings and generate user intent statements from online travel reviews.
Echoes of Unrest: A Multimodal NLP Framework for Early Warning of Fake News and Violence-Driven Mob Activity
This paper presents a multimodal NLP framework that fuses XLM-RoBERTa and CLIP with geospatial and sarcasm features to detect fake news and predict violence-driven mob activity, achieving 98% test accuracy on a 138,256-sample Bangla/English dataset.
@itarutomy: A paper that rebuilds the "knowledge infrastructure" for AI agent research from the ground up (https://arxiv[.]org/html…
This paper introduces Agents-K1, a knowledge graph system built from 2.46 million papers that improves AI agent research by incorporating text, figures, tables, and equations, along with a five-level citation classification. It significantly boosts performance of top models like Gemini-3 and GPT-5.2 on benchmarks, demonstrating that refining knowledge structure can be more effective than scaling model size.