multimodal-alignment

Tag

Cards List
#multimodal-alignment

Semantic Alignment of EEG and Text: A Contrastive Learning Framework for Decoding Imagined Speech

arXiv cs.LG ↗ · 4d ago Cached

该论文提出一个对比学习框架,将EEG信号与冻结的预训练文本编码器的嵌入空间对齐,用于解码想象言语,并在Chisco数据集上验证了其在固定意图解码、相似度检索和语义结构探针方面的能力。

0 favorites 0 likes
#multimodal-alignment

CliQ-RRG: Clinical-Knowledge Guided Disease-aware Visual-Textual Alignment for QA-Style Radiology Report Generation

arXiv cs.CL ↗ · 2026-10-12 Cached

CliQ-RRG is a two-stage framework for QA-style radiology report generation that uses disease-aware visual-textual alignment, prior-guided attention across scans, and GraphRAG-augmented LLM restructuring to produce clinically grounded reports, outperforming prior methods on two chest X-ray benchmarks.

0 favorites 0 likes
#multimodal-alignment

3D Masked Autoencoders are Robust Learners of Volumetric and Multimodal Cellular Representations for Microscopy

arXiv cs.LG ↗ · 2026-06-24 Cached

This paper presents 3D masked autoencoders for volumetric microscopy data, demonstrating that 3D modeling outperforms 2D max-projection and slice-based variants on downstream single-cell tasks, with cross-modal alignment to a protein language model further improving performance.

0 favorites 0 likes
← Back to home

Submit Feedback