cross-attention

Tag

Cards List
#cross-attention

Multimodal Ambivalence and Hesitancy Recognition with Bidirectional Audio--Text Cross-Attention

arXiv cs.CL ↗ · 2026-10-21 Cached

该论文提出一种基于双向音频-文本交叉注意力的多模态框架,用于视频级别的矛盾与犹豫状态识别,在BAH数据集上取得77.95%的A/H F1分数。

0 favorites 0 likes
#cross-attention

HierDTA: Hierarchical Structure-Aware Representation Learning for Drug--Target Affinity Prediction

arXiv cs.LG ↗ · 2026-10-21 Cached

HierDTA 是一个层次结构感知的药物-靶点亲和力预测框架,将药物表示为原子-基团异构图并结合蛋白质残基交互图与交叉注意力机制,在 Davis 和 KIBA 数据集上取得领先性能,并在冷启动场景下展现出良好泛化能力。

0 favorites 0 likes
#cross-attention

Joints, Camera, Action! Co-Generating 3D Motion and Video for Arbitrary Rigs

Hugging Face Daily Papers ↗ · 2026-10-20 Cached

NVIDIA 的论文提出一种通过交叉注意力连接轻量 3D 运动模型与预训练视频生成器的方法,可为任意骨骼骨架同步生成视频与可回放的 3D 运动,并估计相机以实现运动与场景配准,支持视频与运动的双向转换。

0 favorites 0 likes
#cross-attention

Gen4P: Video Generators are 4D Perceivers

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

Gen4P 将预训练视频生成器改造为前馈式 4D 感知器,通过单次编码与按需交叉注意力解码,从单目视频中预测几何与运动,并在 3D 点跟踪、视频深度和相机位姿估计上达到 SOTA 或有竞争力的性能。

0 favorites 0 likes
#cross-attention

BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queries

Hugging Face Daily Papers ↗ · 2026-10-10 Cached

BridgeWAM 通过潜在桥接查询(LBQs)解耦视频与动作专家,提升世界行动模型的动作预测效率与泛化能力,在 LIBERO 上达到 98.25% 成功率,同时将推理 FLOPs 降低 28.72%。

0 favorites 0 likes
#cross-attention

Leveraging LLM-Generated Explanations for Detecting Emotionally Rewritten Fake News

arXiv cs.CL ↗ · 2026-10-08 Cached

This paper introduces a Gated Cross Attention (GCA) framework that leverages LLM-generated explanations as stable background knowledge to detect fake news that has been rewritten under different emotional framings while preserving the underlying factual claims, showing improvements on PolitiFact, GossipCop, and LUN datasets.

0 favorites 0 likes
#cross-attention

Learning Jazz Pianist Style with Cross-Attention Conditioning

Hacker News Top ↗ · 2026-10-05 Cached

A research project that fine-tunes the Aria piano transformer on twelve jazz pianists using gated cross-attention conditioning on learned pianist embeddings, achieving 70% intended-pianist attribution on generated continuations versus 37% without conditioning. The work, inspired by Dick Hyman's 'In the Styles of… The Great Jazz Pianists', is presented at ISMIR 2026 in Abu Dhabi.

0 favorites 0 likes
#cross-attention

GATE-ST: Gene-Aware Text-image Encoder for Spatial Transcriptomics

arXiv cs.AI ↗ · 2026-10-01 Cached

GATE-ST proposes a gene-aware text-image encoder that integrates text-encoded gene summaries with histology image embeddings via cross-attention to improve spatial gene expression prediction, outperforming image-only and random-embedding baselines in pathology imaging benchmarks.

0 favorites 0 likes
#cross-attention

SMILESGNN: Interpretable Clinical Toxicity Prediction via SMILES-Graph Cross-Attention Fusion

arXiv cs.LG ↗ · 2026-09-25 Cached

SMILESGNN introduces a multimodal architecture combining SMILES transformers and graph neural networks with cross-attention for interpretable drug toxicity prediction, achieving competitive performance on benchmarks like ClinTox and Tox21 with minimal parameters.

0 favorites 0 likes
#cross-attention

Learning Where to Look: A Shared Relative-Alignment Module for Time-Series Forecasting and PPG-to-Vital-Sign Reconstruction

arXiv cs.LG ↗ · 2026-09-24 Cached

ROOSTER is a shared module that learns alignment between condition and target sequences for time-series forecasting and PPG-to-vital-sign reconstruction, achieving superior performance across multiple benchmarks.

0 favorites 0 likes
#cross-attention

All modalities are equal, but video is more equal: Closing the Cross-Attention Gap in Joint Video Generation

Hugging Face Daily Papers ↗ · 2026-09-23 Cached

The paper introduces RecCAR, a regularization method to address the reciprocal correspondence gap in joint multimodal diffusion transformers, improving performance in video generation tasks.

0 favorites 0 likes
#cross-attention

EnSol: an environment-aware graph neural network for molecular solubility prediction

arXiv cs.LG ↗ · 2026-09-21 Cached

EnSol is an environment-aware graph neural network that predicts molecular solubility by representing solutes and solvents as graphs and using cross-attention to model interactions, with probabilistic outputs to capture temperature effects and experimental uncertainty. It achieves state-of-the-art performance on benchmark datasets, validated experimentally.

0 favorites 0 likes
#cross-attention

@ProfTomYeh: Self-Attention vs Cross-Attention interactive diagram. Open https://byhand.ai/self-vs-cross

X AI KOLs Timeline ↗ · 2026-09-20 Cached

An interactive diagram comparing self-attention and cross-attention mechanisms in AI models, published as part of an educational library on attention.

0 favorites 0 likes
#cross-attention

QueryFormer: Winning Solution for KDD Cup 2026 Tencent UniRec Challenge

arXiv cs.AI ↗ · 2026-09-16 Cached

QueryFormer is a unified transformer architecture that won the KDD Cup 2026 Tencent UniRec Challenge for post-click conversion rate prediction, focusing on query generation and efficient scaling.

0 favorites 0 likes
#cross-attention

Time-Frequency Geometric Cross-Attention for Chunked Vision-Language-Action Models

arXiv cs.AI ↗ · 2026-09-11 Cached

This paper proposes Time–Frequency Geometric Cross-Attention (TFGCA), a drop-in module for chunked vision-language-action models that improves action trajectory prediction by decomposing chunks into time-frequency representations and capturing geometric relationships, resulting in significant performance gains on benchmarks and real-robot tasks.

0 favorites 0 likes
#cross-attention

RelightFormer: Feed-forward Generative Transformer for Multiview Object Relighting

Hugging Face Daily Papers ↗ · 2026-09-07 Cached

RelightFormer introduces a feed-forward generative Transformer for direct single- and multi-view image relighting, using cross-attention for illumination injection and permutation-invariant encodings for unordered views, trained on a massive synthetic dataset to achieve state-of-the-art visual quality.

0 favorites 0 likes
#cross-attention

The Attention Triangle in Audio-Video Models

arXiv cs.AI ↗ · 2026-09-04 Cached

This paper investigates semantic leakage in audio-video diffusion models through the 'attention triangle' of cross-attention mechanisms, and presents methods to enhance semantic grounding during generation.

0 favorites 0 likes
#cross-attention

Designing a Good Virtual Node: Addressable and Cardinality-Preserving Global Memory for Message Passing Architectures

arXiv cs.LG ↗ · 2026-08-05 Cached

This paper introduces addressable and cardinality-preserving global memory for message-passing neural networks via cross-attention slots, addressing the finite-capacity bottleneck of virtual nodes and improving performance on multiplicity-aware tasks.

0 favorites 0 likes
#cross-attention

Generic Vision and Cross-Attention for Reaction Yield Prediction

arXiv cs.LG ↗ · 2026-08-04 Cached

This paper proposes a dual-modal Vision Cross-Attention architecture for reaction yield prediction, fusing tabular physical-organic data with 2D molecular topologies, and demonstrates that a generic computer vision backbone can outperform purely quantum-based baselines.

0 favorites 0 likes
#cross-attention

SyRuP: Enhancing System-Prompt Following via Reward-Guided Prediction in LLM Decoding

arXiv cs.CL ↗ · 2026-07-28 Cached

Introduces SyRuP, a decoding-time framework that trains a cross-attention reward head to produce token-level adherence scores for system prompts, improving LLM following of complex prompts without model tuning.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback