MKGR: Multimodal Knowledge-Graph Representation Learning for Cold-Start Protein-Protein Interaction Prediction

arXiv cs.LG Papers

Summary

MKGR is a multimodal framework that combines protein sequence encoding with four biomedical knowledge graphs to improve cold-start protein-protein interaction prediction, outperforming baselines on benchmark datasets.

arXiv:2607.01627v1 Announce Type: new Abstract: Accurate protein-protein interaction (PPI) prediction is central to functional genomics, disease mechanism discovery, and drug development. A difficult setting arises when candidate interactions include proteins that have no observed PPI edges during training, where models relying on network topology alone often lose useful context. This paper presents \method, a multimodal representation framework for cold-start PPI prediction. \method\ combines region-aware protein sequence encoding with four protein-centered biomedical knowledge graphs, including protein-drug, protein-disease, protein-miRNA, and protein-lncRNA associations. The sequence branch extracts contextual representations from structurally informed sequence regions, while graph attention encoders learn modality-specific protein embeddings from sparse biomedical associations. A bridge reconstruction objective regularizes graph learning by recovering shared protein-entity associations, and a pair-level gating module adaptively integrates sequence and graph evidence for each candidate protein pair. Experiments on two benchmark datasets under novel-old and novel-novel cold-start settings show that \method\ consistently outperforms competitive sequence, network, and knowledge-graph baselines across ACC, F1, AUC, AUPR, and MCC.
Original Article
View Cached Full Text

Cached at: 07/03/26, 05:42 AM

# MKGR: Multimodal Knowledge-Graph Representation Learning for Cold-Start Protein-Protein Interaction Prediction
Source: [https://arxiv.org/html/2607.01627](https://arxiv.org/html/2607.01627)
Wenbo Zhang College of Computer and Information Science, Southwest University, Chongqing Chongqing, China z13996091260@email\.swu\.edu\.cn

###### Abstract

Accurate protein\-protein interaction \(PPI\) prediction is central to functional genomics, disease mechanism discovery, and drug development\. A difficult setting arises when candidate interactions include proteins that have no observed PPI edges during training, where models relying on network topology alone often lose useful context\. This paper presents MKGR, a multimodal representation framework for cold\-start PPI prediction\. MKGR combines region\-aware protein sequence encoding with four protein\-centered biomedical knowledge graphs, including protein\-drug, protein\-disease, protein\-miRNA, and protein\-lncRNA associations\. The sequence branch extracts contextual representations from structurally informed sequence regions, while graph attention encoders learn modality\-specific protein embeddings from sparse biomedical associations\. A bridge reconstruction objective regularizes graph learning by recovering shared protein\-entity associations, and a pair\-level gating module adaptively integrates sequence and graph evidence for each candidate protein pair\. Experiments on two benchmark datasets under novel\-old and novel\-novel cold\-start settings show that MKGR consistently outperforms competitive sequence, network, and knowledge\-graph baselines across ACC, F1, AUC, AUPR, and MCC\.

*K*eywordsProtein\-protein interaction prediction⋅\\cdotCold\-start learning⋅\\cdotMultimodal knowledge graph⋅\\cdotGraph neural network⋅\\cdotProtein sequence representation

## 1Introduction

Protein\-protein interactions organize many cellular processes, including signal transduction, transcriptional regulation, immune response, and metabolic control\. Experimental assays such as yeast two\-hybrid screening and affinity purification followed by mass spectrometry have produced large interaction resources, but they remain costly, condition\-dependent, and incomplete\. Computational PPI prediction therefore plays an important role in prioritizing candidate interactions and expanding biological networks beyond experimentally verified edges\.

Recent deep learning models have improved PPI prediction by encoding amino\-acid sequences, protein structures, and interaction networks\. Sequence\-based models benefit from pretrained protein language models and convolutional or attention\-based encoders, while graph models exploit relational structure among proteins or between proteins and biomedical entities\. However, the cold\-start case remains challenging: for a newly introduced protein, observed PPI edges are unavailable or sparse, so a predictor must transfer information from intrinsic sequence patterns and external biomedical associations\. Relying on only one evidence source is often fragile\. Sequence encoders may miss disease\-, drug\-, or RNA\-related context, whereas graph encoders may suffer when a protein has limited coverage in a particular biomedical modality\.

This paper studies cold\-start PPI prediction with a multimodal sequence\-graph design\. We propose MKGR, a representation learning framework that models both intrinsic protein sequence signals and extrinsic biomedical graph signals\. In the sequence branch, each protein is divided into structural regions and encoded with a pretrained protein language model followed by a Transformer encoder\. In the graph branch, four modality\-specific protein\-entity graphs are modeled with graph attention networks\. To make sparse graph learning more robust, MKGR introduces a bridge reconstruction task that encourages protein and entity embeddings to preserve shared biomedical associations\. Finally, pair\-level gated fusion combines sequence and graph representations in a candidate\-specific manner, allowing the model to adjust the contribution of each modality for each protein pair\.

The main contributions are as follows\. First, we formulate a cold\-start PPI model that jointly uses protein sequences and multimodal biomedical knowledge graphs\. Second, we design a bridge reconstruction objective for graph\-regularized protein representation learning under sparse protein\-entity associations\. Third, we introduce pair\-level gated fusion to adaptively integrate heterogeneous modalities\. Fourth, experiments on two datasets and two cold\-start tasks demonstrate consistent gains over representative baselines\.

## 2Related Work

Computational PPI prediction\.Early computational PPI methods used protein descriptors, kernels, matrix factorization, or network propagation to infer missing interactions from biological features and known interaction networks\. Recent deep models have shifted toward end\-to\-end representation learning over sequences, structures, and interaction neighborhoods\. TAGPPI integrates sequence features with structural contact maps, while HNSPPI combines sequence and network evidence for supervised PPI prediction\[[1](https://arxiv.org/html/2607.01627#bib.bib1),[2](https://arxiv.org/html/2607.01627#bib.bib2)\]\. EResCNN uses ensemble residual convolution over sequence descriptors, and BaPPI studies balanced learning for interaction classification\[[3](https://arxiv.org/html/2607.01627#bib.bib3),[4](https://arxiv.org/html/2607.01627#bib.bib4)\]\. Sequence\-based PPI predictors such as PIPR and D\-SCRIPT further show that protein sequences can support interaction inference when structure or network information is incomplete\[[5](https://arxiv.org/html/2607.01627#bib.bib5),[6](https://arxiv.org/html/2607.01627#bib.bib6)\]\. Protein resources and structure predictors, including UniProt, ESM, ESMFold, and AlphaFold, have also strengthened sequence\-centered protein representation learning\[[7](https://arxiv.org/html/2607.01627#bib.bib7),[8](https://arxiv.org/html/2607.01627#bib.bib8),[9](https://arxiv.org/html/2607.01627#bib.bib9),[10](https://arxiv.org/html/2607.01627#bib.bib10)\]\. These methods provide powerful protein representations, but they still face difficulty when test proteins have no observed PPI links during training\.

Protein sequence and biomedical graph evidence\.Sequence\-only models capture intrinsic amino\-acid patterns, whereas graph\-based models can exploit external biomedical associations that are not directly available from the PPI network\. Graph neural networks provide a general mechanism for neighborhood aggregation and inductive node representation learning\[[11](https://arxiv.org/html/2607.01627#bib.bib11),[12](https://arxiv.org/html/2607.01627#bib.bib12)\]\. Attention\-based and expressive message\-passing variants further improve local relation modeling in heterogeneous or sparse graphs\[[13](https://arxiv.org/html/2607.01627#bib.bib13),[14](https://arxiv.org/html/2607.01627#bib.bib14)\], and graph benchmarks support systematic evaluation of such methods\[[15](https://arxiv.org/html/2607.01627#bib.bib15)\]\. In biomedical settings, resources such as STRING, DrugBank, CTD, miRTarBase, and LncTarD connect proteins to interaction partners, chemicals, diseases, miRNAs, and lncRNAs\[[16](https://arxiv.org/html/2607.01627#bib.bib16),[17](https://arxiv.org/html/2607.01627#bib.bib17),[18](https://arxiv.org/html/2607.01627#bib.bib18),[19](https://arxiv.org/html/2607.01627#bib.bib19),[20](https://arxiv.org/html/2607.01627#bib.bib20)\]\. Interaction and ontology resources such as IntAct and the Gene Ontology provide additional curated biological context\[[21](https://arxiv.org/html/2607.01627#bib.bib21),[22](https://arxiv.org/html/2607.01627#bib.bib22)\]\. Larger biomedical knowledge graphs such as Hetionet and PrimeKG show that integrating heterogeneous biomedical entities can support downstream discovery tasks\[[23](https://arxiv.org/html/2607.01627#bib.bib23),[24](https://arxiv.org/html/2607.01627#bib.bib24)\]\. Multi\-relational embedding and relational GCN models provide general tools for knowledge\-graph representation\[[25](https://arxiv.org/html/2607.01627#bib.bib25),[26](https://arxiv.org/html/2607.01627#bib.bib26)\], and graph models have also been used for biomedical relation prediction such as polypharmacy side\-effect modeling\[[27](https://arxiv.org/html/2607.01627#bib.bib27)\]\. Knowledge\-graph\-enhanced PPI models, including KGF\-GNN and HEENN, demonstrate the value of protein\-associated graph context\[[28](https://arxiv.org/html/2607.01627#bib.bib28),[29](https://arxiv.org/html/2607.01627#bib.bib29)\]\. Multimodal knowledge graph fusion has also been used for related biomedical relation prediction problems such as drug\-drug interaction prediction\[[30](https://arxiv.org/html/2607.01627#bib.bib30)\]\.

Sparse and incomplete\-data representation\.Cold\-start PPI prediction can be viewed as a sparse representation problem in which different proteins have uneven information coverage across modalities\. Latent factor models and graph\-regularized factorization methods have long studied how to learn compact representations from sparse and incomplete observations\[[31](https://arxiv.org/html/2607.01627#bib.bib31),[32](https://arxiv.org/html/2607.01627#bib.bib32),[33](https://arxiv.org/html/2607.01627#bib.bib33),[34](https://arxiv.org/html/2607.01627#bib.bib34),[35](https://arxiv.org/html/2607.01627#bib.bib35),[36](https://arxiv.org/html/2607.01627#bib.bib36)\]\. Adaptive regularization, non\-negative latent factor modeling, and dynamic sparse tensor estimation further improve robustness when data are high\-dimensional or partially observed\[[37](https://arxiv.org/html/2607.01627#bib.bib37),[38](https://arxiv.org/html/2607.01627#bib.bib38),[39](https://arxiv.org/html/2607.01627#bib.bib39),[40](https://arxiv.org/html/2607.01627#bib.bib40),[41](https://arxiv.org/html/2607.01627#bib.bib41)\]\. Federated latent factor learning, differential\-evolution\-enhanced latent factor analysis, multi\-metric autoencoders, and adaptive regularization all show how auxiliary optimization or structural constraints can be integrated into representation learning\.

Latent factor learning and streaming features\.Several studies by Luo and collaborators investigate sparse matrix representation, service QoS prediction, and non\-negative latent factor learning from complementary viewpoints\. Prediction\-sampling and double\-space modeling provide two additional examples of robust latent representation under sparse observations\[[42](https://arxiv.org/html/2607.01627#bib.bib42),[43](https://arxiv.org/html/2607.01627#bib.bib43),[44](https://arxiv.org/html/2607.01627#bib.bib44),[45](https://arxiv.org/html/2607.01627#bib.bib45)\]\. Online feature selection is another relevant line because cold\-start biological data often arrive with changing or incomplete feature sets\. Tensor compression and related low\-rank representation studies also support robust representation learning for sparse or incomplete observations\[[46](https://arxiv.org/html/2607.01627#bib.bib46),[47](https://arxiv.org/html/2607.01627#bib.bib47)\]\. Time\-dependent incomplete data studies further motivate designs that adapt to changing observations\.

High\-order, tensor, and graph representation\.Auxiliary relational structure is often useful when target labels are sparse\. Tensor and high\-order graph models are closely related to multimodal biomedical learning because multiple entity types naturally induce high\-order relations\. Adaptive Tucker decomposition, tensor low\-rank compression, and neural Tucker factorization provide representative examples of high\-order representation learning\[[46](https://arxiv.org/html/2607.01627#bib.bib46),[47](https://arxiv.org/html/2607.01627#bib.bib47),[48](https://arxiv.org/html/2607.01627#bib.bib48)\]\. Multi\-aspect self\-attending neural Tucker factorization and multi\-projection self\-attending Tucker models further extend tensor learning to spatiotemporal and incomplete data\[[49](https://arxiv.org/html/2607.01627#bib.bib49),[50](https://arxiv.org/html/2607.01627#bib.bib50)\]\. Graph convolutional and modular graph models provide additional strategies for propagating information over structured data\[[51](https://arxiv.org/html/2607.01627#bib.bib51),[52](https://arxiv.org/html/2607.01627#bib.bib52)\]\. Graph\-incorporated factor analysis and multi\-metric latent feature analysis also connect sparse representation learning with graph or metric structure\[[53](https://arxiv.org/html/2607.01627#bib.bib53),[54](https://arxiv.org/html/2607.01627#bib.bib54),[55](https://arxiv.org/html/2607.01627#bib.bib55),[56](https://arxiv.org/html/2607.01627#bib.bib56)\]\. Broader surveys and tensor\-based causal or spatiotemporal models show the continuing development of high\-order representation learning\[[57](https://arxiv.org/html/2607.01627#bib.bib57),[58](https://arxiv.org/html/2607.01627#bib.bib58),[59](https://arxiv.org/html/2607.01627#bib.bib59)\]\.

Recent multimodal applications\.Recent representation\-learning studies have explored cross\-modal medical learning, semantic segmentation distillation, scalable sentiment analysis, mixture\-of\-experts learning, and neural community search\[[60](https://arxiv.org/html/2607.01627#bib.bib60),[61](https://arxiv.org/html/2607.01627#bib.bib61),[62](https://arxiv.org/html/2607.01627#bib.bib62),[63](https://arxiv.org/html/2607.01627#bib.bib63),[64](https://arxiv.org/html/2607.01627#bib.bib64)\]\. Other works study robust optimization, contrastive distillation for electricity\-theft detection, knowledge\-driven multiple\-instance learning, dynamic optimization, and precise latent factor analysis\[[65](https://arxiv.org/html/2607.01627#bib.bib65),[66](https://arxiv.org/html/2607.01627#bib.bib66),[67](https://arxiv.org/html/2607.01627#bib.bib67),[68](https://arxiv.org/html/2607.01627#bib.bib68),[69](https://arxiv.org/html/2607.01627#bib.bib69)\]\. Contrastive and collaborative distillation approaches have also been used for medical, graph\-structured, and service data representation\[[70](https://arxiv.org/html/2607.01627#bib.bib70),[71](https://arxiv.org/html/2607.01627#bib.bib71),[72](https://arxiv.org/html/2607.01627#bib.bib72),[73](https://arxiv.org/html/2607.01627#bib.bib73)\]\. Industrial and educational applications, including distributed optimization, student emotion analysis, PID\-enhanced factor analysis, robot calibration, and traffic\-data imputation, illustrate the breadth of multimodal representation learning under heterogeneous observations\[[74](https://arxiv.org/html/2607.01627#bib.bib74),[75](https://arxiv.org/html/2607.01627#bib.bib75),[76](https://arxiv.org/html/2607.01627#bib.bib76),[77](https://arxiv.org/html/2607.01627#bib.bib77),[78](https://arxiv.org/html/2607.01627#bib.bib78),[79](https://arxiv.org/html/2607.01627#bib.bib79)\]\. Biomedical and healthcare\-oriented studies, including drug repositioning, medical image representation, large language models for healthcare, organoid classification, and larynx pathological grading, are particularly close to the multimodal biomedical motivation of this work\[[80](https://arxiv.org/html/2607.01627#bib.bib80),[81](https://arxiv.org/html/2607.01627#bib.bib81),[82](https://arxiv.org/html/2607.01627#bib.bib82),[72](https://arxiv.org/html/2607.01627#bib.bib72),[67](https://arxiv.org/html/2607.01627#bib.bib67)\]\. Additional studies on matrix factorization review, deep latent factor learning, graph convolution enhancement, robot calibration, posterior\-neighborhood regularization, traffic prediction, learning\-error refinement, and hash\-factor representation show that robust representation learning remains broadly useful across domains\[[83](https://arxiv.org/html/2607.01627#bib.bib83),[84](https://arxiv.org/html/2607.01627#bib.bib84),[85](https://arxiv.org/html/2607.01627#bib.bib85),[86](https://arxiv.org/html/2607.01627#bib.bib86),[87](https://arxiv.org/html/2607.01627#bib.bib87),[88](https://arxiv.org/html/2607.01627#bib.bib88),[77](https://arxiv.org/html/2607.01627#bib.bib77),[89](https://arxiv.org/html/2607.01627#bib.bib89)\]\. MKGR follows this broad representation\-learning view but specializes it for cold\-start PPI prediction by combining modality\-specific graph encoders, bridge reconstruction, and adaptive fusion across sequence and biomedical graph branches\.

## 3Preliminaries

Cold\-start PPI setting\.Let𝒫\\mathcal\{P\}be the protein universe and letΩ⊆𝒫×𝒫\\Omega\\subseteq\\mathcal\{P\}\\times\\mathcal\{P\}be the set of candidate pairs with binary labelsyi​j∈\{0,1\}y\_\{ij\}\\in\\\{0,1\\\}\. Proteins are split into an observed subset𝒫o\\mathcal\{P\}\_\{o\}and a disjoint novel subset𝒫n\\mathcal\{P\}\_\{n\}\. The learner is fitted only on labeled pairs from𝒫o×𝒫o\\mathcal\{P\}\_\{o\}\\times\\mathcal\{P\}\_\{o\}and is evaluated on two transfer regimes:𝒫n×𝒫o\\mathcal\{P\}\_\{n\}\\times\\mathcal\{P\}\_\{o\}and𝒫n×𝒫n\\mathcal\{P\}\_\{n\}\\times\\mathcal\{P\}\_\{n\}\. Thus, the prediction function must infer an interaction probability

y^i​j=FΘ​\(xi,xj,𝒢i,𝒢j\),\\hat\{y\}\_\{ij\}=F\_\{\\Theta\}\(x\_\{i\},x\_\{j\},\\mathcal\{G\}\_\{i\},\\mathcal\{G\}\_\{j\}\),\(1\)wherexix\_\{i\}denotes sequence\-derived information ofpip\_\{i\},𝒢i\\mathcal\{G\}\_\{i\}denotes its biomedical graph context, andΘ\\Thetadenotes trainable parameters\.

Protein views\.Each protein is represented from two complementary views\. The sequence view is an ordered set of region\-level inputsxi=\{xi​1,…,xi​Li\}x\_\{i\}=\\\{x\_\{i1\},\\ldots,x\_\{iL\_\{i\}\}\\\}obtained from amino\-acid segments\. The graph view is built fromMMprotein\-entity bipartite graphs𝒢m=\(𝒫,ℰm,ℛm\)\\mathcal\{G\}^\{m\}=\(\\mathcal\{P\},\\mathcal\{E\}^\{m\},\\mathcal\{R\}^\{m\}\), whereℰm\\mathcal\{E\}^\{m\}is a modality\-specific entity set andℛm\\mathcal\{R\}^\{m\}records observed protein\-entity links\. In this work,M=4M=4and the modalities correspond to drugs, diseases, miRNAs, and lncRNAs\.

Learning objective\.The central difficulty is information imbalance: a novel protein may have no PPI links, incomplete biomedical associations, or uneven coverage across graph modalities\. MKGR therefore learns one sequence embedding and multiple graph embeddings for each protein, then estimates a pair label by adaptively weighting these views\. The model is trained with binary PPI supervision and an auxiliary graph reconstruction signal that encourages proteins sharing biomedical entities to occupy compatible graph neighborhoods\.

## 4Proposed Method

Overview\.Figure[1](https://arxiv.org/html/2607.01627#S4.F1)summarizes MKGR\. The framework first obtains a sequence representation from region\-level protein language model features and obtains graph representations from modality\-specific protein\-entity graphs\. It then regularizes graph embeddings with bridge reconstruction and predicts PPI labels through pair\-level gated fusion\.

![Refer to caption](https://arxiv.org/html/2607.01627v1/figures/model_sturcture.png)Figure 1:Overview of MKGR\. The model combines a region\-aware protein sequence branch, multimodal knowledge\-graph branches, bridge reconstruction, and pair\-level gated fusion for cold\-start PPI prediction\.### 4\.1Sequence and Graph Encoding

For the sequence view, region features generated by a frozen ESM2 encoder are passed to a Transformer encoder\. Given contextual region vectors\{ui​1,…,ui​Li\}\\\{u\_\{i1\},\\ldots,u\_\{iL\_\{i\}\}\\\}, MKGR forms a protein sequence embedding by soft region aggregation:

si=∑t=1Liαi​t​ui​t,αi​t=softmaxt⁡\(qs⊤​tanh⁡\(Ws​ui​t\)\)\.s\_\{i\}=\\sum\_\{t=1\}^\{L\_\{i\}\}\\alpha\_\{it\}u\_\{it\},\\quad\\alpha\_\{it\}=\\operatorname\{softmax\}\_\{t\}\\left\(q\_\{s\}^\{\\top\}\\tanh\(W\_\{s\}u\_\{it\}\)\\right\)\.\(2\)This aggregation compresses variable\-length region sequences into a fixed\-dimensional representation while retaining region\-level context\.

For the graph view, each modality graph𝒢m\\mathcal\{G\}^\{m\}is encoded independently\. Lethum,ℓh\_\{u\}^\{m,\\ell\}be the representation of nodeuuat layerℓ\\ell\. A graph attention update can be written compactly as

hum,ℓ\+1=σ​\(∑v∈𝒩m​\(u\)au​vm,ℓ​Wmℓ​hvm,ℓ\),au​vm,ℓ=softmaxv⁡\(ρm⊤​\[Wmℓ​hum,ℓ∥Wmℓ​hvm,ℓ\]\)\.h\_\{u\}^\{m,\\ell\+1\}=\\sigma\\left\(\\sum\_\{v\\in\\mathcal\{N\}\_\{m\}\(u\)\}a\_\{uv\}^\{m,\\ell\}W\_\{m\}^\{\\ell\}h\_\{v\}^\{m,\\ell\}\\right\),\\quad a\_\{uv\}^\{m,\\ell\}=\\operatorname\{softmax\}\_\{v\}\\left\(\\rho\_\{m\}^\{\\top\}\[W\_\{m\}^\{\\ell\}h\_\{u\}^\{m,\\ell\}\\\|W\_\{m\}^\{\\ell\}h\_\{v\}^\{m,\\ell\}\]\\right\)\.\(3\)After the final layer, the modality\-specific protein representation is denoted bygimg\_\{i\}^\{m\}\.

### 4\.2Bridge\-Regularized Pair Learning

Biomedical graph links are sparse, especially for proteins appearing in cold\-start evaluation\. To regularize graph representations, MKGR reconstructs whether two proteins share an entity in a modality graph\. For sampled triples\(pi,pj,ek\)\(p\_\{i\},p\_\{j\},e\_\{k\}\), define

ri​j​km=I​\[ek∈𝒩m​\(pi\)∩𝒩m​\(pj\)\],r^i​j​km=MLPm⁡\(\[gim​‖gjm‖​hekm\]\)\.r\_\{ijk\}^\{m\}=I\[e\_\{k\}\\in\\mathcal\{N\}\_\{m\}\(p\_\{i\}\)\\cap\\mathcal\{N\}\_\{m\}\(p\_\{j\}\)\],\\quad\\hat\{r\}\_\{ijk\}^\{m\}=\\operatorname\{MLP\}\_\{m\}\(\[g\_\{i\}^\{m\}\\\|g\_\{j\}^\{m\}\\\|h\_\{e\_\{k\}\}^\{m\}\]\)\.\(4\)This objective encourages proteins connected to similar biomedical contexts to obtain compatible modality embeddings, providing a transfer signal when direct PPI observations are absent\.

### 4\.3Adaptive Fusion and Objective

For each branchb∈\{s​e​q,1,…,M\}b\\in\\\{seq,1,\\ldots,M\\\}, MKGR constructs a symmetric pair vector

di​jb=\[\|hib−hjb\|∥hib⊙hjb\],d\_\{ij\}^\{b\}=\[\|h\_\{i\}^\{b\}\-h\_\{j\}^\{b\}\|\\\|h\_\{i\}^\{b\}\\odot h\_\{j\}^\{b\}\],\(5\)wherehis​e​q=sih\_\{i\}^\{seq\}=s\_\{i\}andhim=gimh\_\{i\}^\{m\}=g\_\{i\}^\{m\}for graph modalitymm\. A gate then assigns pair\-specific branch weights and produces the final predictor:

λi​j=softmax⁡\(Wg​\[di​js​e​q​‖di​j1‖​⋯∥di​jM\]\),y^i​j=σ​\(Wo​\[λi​js​e​q​di​js​e​q​‖λi​j1​di​j1‖​⋯∥λi​jM​di​jM\]\)\.\\lambda\_\{ij\}=\\operatorname\{softmax\}\(W\_\{g\}\[d\_\{ij\}^\{seq\}\\\|d\_\{ij\}^\{1\}\\\|\\cdots\\\|d\_\{ij\}^\{M\}\]\),\\quad\\hat\{y\}\_\{ij\}=\\sigma\\left\(W\_\{o\}\[\\lambda\_\{ij\}^\{seq\}d\_\{ij\}^\{seq\}\\\|\\lambda\_\{ij\}^\{1\}d\_\{ij\}^\{1\}\\\|\\cdots\\\|\\lambda\_\{ij\}^\{M\}d\_\{ij\}^\{M\}\]\\right\)\.\(6\)The complete training criterion is

ℒ=1\|𝒟\|​∑\(i,j\)∈𝒟ℓbce​\(y^i​j,yi​j\)\+η​∑m=1M1\|𝒮m\|​∑\(i,j,k\)∈𝒮mℓbce​\(r^i​j​km,ri​j​km\),\\mathcal\{L\}=\\frac\{1\}\{\|\\mathcal\{D\}\|\}\\sum\_\{\(i,j\)\\in\\mathcal\{D\}\}\\ell\_\{\\mathrm\{bce\}\}\(\\hat\{y\}\_\{ij\},y\_\{ij\}\)\+\\eta\\sum\_\{m=1\}^\{M\}\\frac\{1\}\{\|\\mathcal\{S\}^\{m\}\|\}\\sum\_\{\(i,j,k\)\\in\\mathcal\{S\}^\{m\}\}\\ell\_\{\\mathrm\{bce\}\}\(\\hat\{r\}\_\{ijk\}^\{m\},r\_\{ijk\}^\{m\}\),\(7\)where𝒟\\mathcal\{D\}is the supervised PPI training set,𝒮m\\mathcal\{S\}^\{m\}is the sampled bridge set of modalitymm, andη\\etabalances PPI supervision and bridge reconstruction\.

## 5Experiments

### 5\.1Experimental Settings

Datasets\.We evaluate MKGR on two PPI benchmark datasets with multimodal protein knowledge graphs\. Dataset1 is derived from MTV\-PPI, and Dataset2 is constructed from public biological databases including STRING, DrugBank, LncTarD, miRTarBase, and CTD\. Both datasets contain protein sequences and four types of protein\-associated biomedical entities: drugs, diseases, miRNAs, and lncRNAs\. For each dataset, proteins are split at protein level into old and novel groups\. Old\-old pairs are used for training, with 10% held out for validation, while novel\-old and novel\-novel pairs are used for cold\-start testing\.

Metrics and baselines\.We report Accuracy \(ACC\), Sensitivity \(SEN\), Precision \(PRE\), F1\-score \(F1\), ROC\-AUC \(AUC\), PR\-AUC \(AUPR\), and Matthews Correlation Coefficient \(MCC\)\. MKGR is compared with TAGPPI\[[1](https://arxiv.org/html/2607.01627#bib.bib1)\], HNSPPI\[[2](https://arxiv.org/html/2607.01627#bib.bib2)\], EResCNN\[[3](https://arxiv.org/html/2607.01627#bib.bib3)\], BaPPI\[[4](https://arxiv.org/html/2607.01627#bib.bib4)\], KGF\-GNN\[[28](https://arxiv.org/html/2607.01627#bib.bib28)\], HEENN\[[29](https://arxiv.org/html/2607.01627#bib.bib29)\], and ESM2\_AMP\[[90](https://arxiv.org/html/2607.01627#bib.bib90)\]\. Training uses 100 epochs, batch size 1024, learning rate6×10−46\\times 10^\{\-4\}, and 256\-dimensional embeddings\. The sequence and graph encoders use a 6\-layer Transformer and a 2\-layer GAT, respectively\.

### 5\.2Comparative Performance

DatasetMetricTAGPPIHNSPPIEResCNNBaPPIKGFHEENNESM2\-AMPMKGRDataset1Acc59\.39±1\.1859\.39\{\\pm\}1\.1863\.38±0\.4163\.38\{\\pm\}0\.4165\.38±1\.7665\.38\{\\pm\}1\.7666\.40±1\.4166\.40\{\\pm\}1\.4156\.71±4\.3856\.71\{\\pm\}4\.3862\.81±1\.4662\.81\{\\pm\}1\.4677\.99±0\.8177\.99\{\\pm\}0\.8181\.31±1\.28\\mathbf\{81\.31\{\\pm\}1\.28\}Sen38\.17±3\.7638\.17\{\\pm\}3\.7663\.72±0\.9163\.72\{\\pm\}0\.9144\.13±5\.7444\.13\{\\pm\}5\.7473\.06±1\.6273\.06\{\\pm\}1\.6222\.54±2\.9022\.54\{\\pm\}2\.9051\.83±25\.5351\.83\{\\pm\}25\.5377\.02±2\.5777\.02\{\\pm\}2\.5778\.41±3\.10\\mathbf\{78\.41\{\\pm\}3\.10\}Pre66\.80±3\.0166\.80\{\\pm\}3\.0163\.56±0\.7863\.56\{\\pm\}0\.7877\.14±2\.1777\.14\{\\pm\}2\.1764\.78±2\.6964\.78\{\\pm\}2\.6979\.52±0\.4979\.52\{\\pm\}0\.4970\.50±7\.6470\.50\{\\pm\}7\.6478\.67±1\.1078\.67\{\\pm\}1\.1083\.61±1\.40\\mathbf\{83\.61\{\\pm\}1\.40\}F148\.42±2\.5948\.42\{\\pm\}2\.5963\.39±0\.4063\.39\{\\pm\}0\.4055\.92±4\.3255\.92\{\\pm\}4\.3268\.62±1\.0668\.62\{\\pm\}1\.0635\.08±3\.5735\.08\{\\pm\}3\.5756\.18±8\.9556\.18\{\\pm\}8\.9577\.80±0\.9677\.80\{\\pm\}0\.9680\.89±1\.40\\mathbf\{80\.89\{\\pm\}1\.40\}Auc62\.60±2\.0362\.60\{\\pm\}2\.0368\.23±0\.7968\.23\{\\pm\}0\.7975\.39±1\.2475\.39\{\\pm\}1\.2471\.96±0\.7171\.96\{\\pm\}0\.7175\.16±2\.8175\.16\{\\pm\}2\.8173\.98±1\.7173\.98\{\\pm\}1\.7185\.68±0\.7185\.68\{\\pm\}0\.7188\.79±0\.98\\mathbf\{88\.79\{\\pm\}0\.98\}Aupr65\.11±1\.3565\.11\{\\pm\}1\.3568\.23±0\.6368\.23\{\\pm\}0\.6374\.77±1\.1474\.77\{\\pm\}1\.1469\.08±1\.6969\.08\{\\pm\}1\.6972\.39±2\.0672\.39\{\\pm\}2\.0671\.12±1\.0071\.12\{\\pm\}1\.0084\.90±0\.7584\.90\{\\pm\}0\.7588\.38±0\.54\\mathbf\{88\.38\{\\pm\}0\.54\}Mcc21\.02±2\.3621\.02\{\\pm\}2\.3627\.24±0\.8127\.24\{\\pm\}0\.8134\.18±2\.6634\.18\{\\pm\}2\.6633\.12±2\.3933\.12\{\\pm\}2\.3924\.51±1\.9624\.51\{\\pm\}1\.9630\.43±3\.7830\.43\{\\pm\}3\.7856\.04±1\.5756\.04\{\\pm\}1\.5762\.83±2\.35\\mathbf\{62\.83\{\\pm\}2\.35\}Dataset2Acc68\.52±1\.3768\.52\{\\pm\}1\.3757\.20±0\.5057\.20\{\\pm\}0\.5055\.38±0\.4755\.38\{\\pm\}0\.4762\.95±3\.1862\.95\{\\pm\}3\.1862\.80±0\.7962\.80\{\\pm\}0\.7966\.33±3\.6766\.33\{\\pm\}3\.6758\.72±0\.8658\.72\{\\pm\}0\.8684\.61±0\.53\\mathbf\{84\.61\{\\pm\}0\.53\}Sen57\.90±5\.7157\.90\{\\pm\}5\.7157\.18±0\.7757\.18\{\\pm\}0\.7784\.91±0\.64\\mathbf\{84\.91\{\\pm\}0\.64\}62\.95±2\.8862\.95\{\\pm\}2\.8842\.88±3\.4242\.88\{\\pm\}3\.4248\.72±12\.7548\.72\{\\pm\}12\.7567\.97±10\.5667\.97\{\\pm\}10\.5677\.44±0\.9677\.44\{\\pm\}0\.96Pre73\.83±1\.9673\.83\{\\pm\}1\.9657\.23±0\.6557\.23\{\\pm\}0\.6553\.41±0\.5253\.41\{\\pm\}0\.5246\.10±3\.1146\.10\{\\pm\}3\.1171\.39±1\.1971\.39\{\\pm\}1\.1976\.36±6\.0376\.36\{\\pm\}6\.0357\.57±2\.3857\.57\{\\pm\}2\.3890\.43±0\.54\\mathbf\{90\.43\{\\pm\}0\.54\}F164\.66±2\.9564\.66\{\\pm\}2\.9557\.20±0\.5057\.20\{\\pm\}0\.5065\.57±0\.3365\.57\{\\pm\}0\.3353\.18±2\.5853\.18\{\\pm\}2\.5853\.49±2\.5153\.49\{\\pm\}2\.5158\.34±7\.9958\.34\{\\pm\}7\.9961\.95±2\.9361\.95\{\\pm\}2\.9383\.43±0\.51\\mathbf\{83\.43\{\\pm\}0\.51\}Auc77\.12±1\.1177\.12\{\\pm\}1\.1161\.39±0\.7961\.39\{\\pm\}0\.7955\.34±0\.5055\.34\{\\pm\}0\.5068\.67±2\.0068\.67\{\\pm\}2\.0069\.88±0\.8769\.88\{\\pm\}0\.8775\.24±3\.5075\.24\{\\pm\}3\.5062\.71±0\.7662\.71\{\\pm\}0\.7692\.27±0\.45\\mathbf\{92\.27\{\\pm\}0\.45\}Aupr75\.42±1\.0775\.42\{\\pm\}1\.0763\.42±0\.5163\.42\{\\pm\}0\.5153\.19±0\.5653\.19\{\\pm\}0\.5651\.78±0\.9051\.78\{\\pm\}0\.9069\.01±0\.8669\.01\{\\pm\}0\.8675\.41±3\.6875\.41\{\\pm\}3\.6864\.26±0\.5064\.26\{\\pm\}0\.5092\.72±0\.25\\mathbf\{92\.72\{\\pm\}0\.25\}Mcc38\.15±2\.0438\.15\{\\pm\}2\.0414\.40±1\.0114\.40\{\\pm\}1\.0113\.30±1\.0613\.30\{\\pm\}1\.0624\.56±5\.3424\.56\{\\pm\}5\.3427\.97±1\.1127\.97\{\\pm\}1\.1135\.34±6\.4235\.34\{\\pm\}6\.4218\.27±0\.4718\.27\{\\pm\}0\.4769\.95±0\.95\\mathbf\{69\.95\{\\pm\}0\.95\}

Table 1:Performance comparison on Task 1, where test pairs contain one novel protein and one old protein\.DatasetMetricTAGPPIHNSPPIEResCNNBaPPIKGFHEENNESM2\-AMPMKGRDataset1Acc54\.73±2\.5654\.73\{\\pm\}2\.5650\.22±1\.3150\.22\{\\pm\}1\.3152\.75±1\.8952\.75\{\\pm\}1\.8957\.48±2\.2857\.48\{\\pm\}2\.2853\.33±3\.6353\.33\{\\pm\}3\.6353\.41±3\.3553\.41\{\\pm\}3\.3559\.23±1\.6059\.23\{\\pm\}1\.6074\.40±1\.85\\mathbf\{74\.40\{\\pm\}1\.85\}Sen46\.04±18\.4446\.04\{\\pm\}18\.4450\.25±1\.8750\.25\{\\pm\}1\.878\.18±1\.618\.18\{\\pm\}1\.6159\.91±6\.3359\.91\{\\pm\}6\.3316\.48±15\.2216\.48\{\\pm\}15\.2218\.36±6\.8618\.36\{\\pm\}6\.8679\.36±9\.69\\mathbf\{79\.36\{\\pm\}9\.69\}68\.47±7\.8368\.47\{\\pm\}7\.83Pre56\.94±7\.3556\.94\{\\pm\}7\.3549\.73±2\.6349\.73\{\\pm\}2\.6379\.16±5\.12\\mathbf\{79\.16\{\\pm\}5\.12\}57\.24±5\.0057\.24\{\\pm\}5\.0053\.97±5\.4453\.97\{\\pm\}5\.4460\.46±5\.2460\.46\{\\pm\}5\.2456\.24±2\.9856\.24\{\\pm\}2\.9877\.43±3\.7977\.43\{\\pm\}3\.79F149\.47±7\.5849\.47\{\\pm\}7\.5849\.92±1\.0549\.92\{\\pm\}1\.0514\.78±2\.6914\.78\{\\pm\}2\.6958\.22±3\.1258\.22\{\\pm\}3\.1222\.86±17\.6022\.86\{\\pm\}17\.6027\.46±7\.9627\.46\{\\pm\}7\.9665\.59±0\.3665\.59\{\\pm\}0\.3672\.34±3\.75\\mathbf\{72\.34\{\\pm\}3\.75\}Auc57\.60±3\.3157\.60\{\\pm\}3\.3150\.53±1\.9150\.53\{\\pm\}1\.9163\.56±2\.5463\.56\{\\pm\}2\.5459\.23±2\.7359\.23\{\\pm\}2\.7352\.59±5\.2052\.59\{\\pm\}5\.2056\.07±2\.8556\.07\{\\pm\}2\.8564\.14±2\.5564\.14\{\\pm\}2\.5582\.15±2\.75\\mathbf\{82\.15\{\\pm\}2\.75\}Aupr57\.43±5\.1757\.43\{\\pm\}5\.1750\.07±3\.7550\.07\{\\pm\}3\.7563\.82±2\.8763\.82\{\\pm\}2\.8752\.24±10\.2652\.24\{\\pm\}10\.2649\.28±1\.1049\.28\{\\pm\}1\.1054\.51±1\.4554\.51\{\\pm\}1\.4559\.47±13\.4059\.47\{\\pm\}13\.4082\.00±2\.61\\mathbf\{82\.00\{\\pm\}2\.61\}Mcc10\.90±4\.9310\.90\{\\pm\}4\.930\.53±2\.600\.53\{\\pm\}2\.6013\.54±1\.8913\.54\{\\pm\}1\.8914\.56±4\.7414\.56\{\\pm\}4\.742\.86±3\.922\.86\{\\pm\}3\.928\.36±4\.148\.36\{\\pm\}4\.1420\.44±2\.8220\.44\{\\pm\}2\.8248\.85±3\.59\\mathbf\{48\.85\{\\pm\}3\.59\}Dataset2Acc59\.05±3\.0359\.05\{\\pm\}3\.0351\.47±0\.5451\.47\{\\pm\}0\.5454\.84±0\.9054\.84\{\\pm\}0\.9059\.29±2\.1559\.29\{\\pm\}2\.1553\.39±1\.0353\.39\{\\pm\}1\.0355\.79±0\.7155\.79\{\\pm\}0\.7158\.29±2\.0058\.29\{\\pm\}2\.0079\.56±1\.85\\mathbf\{79\.56\{\\pm\}1\.85\}Sen53\.77±8\.7853\.77\{\\pm\}8\.7851\.48±0\.6951\.48\{\\pm\}0\.6983\.79±2\.34\\mathbf\{83\.79\{\\pm\}2\.34\}51\.67±2\.4651\.67\{\\pm\}2\.4649\.47±12\.4449\.47\{\\pm\}12\.4415\.11±4\.9015\.11\{\\pm\}4\.9066\.76±9\.9066\.76\{\\pm\}9\.9067\.53±4\.0167\.53\{\\pm\}4\.01Pre60\.54±2\.9160\.54\{\\pm\}2\.9151\.28±1\.7851\.28\{\\pm\}1\.7852\.96±1\.3952\.96\{\\pm\}1\.3940\.11±0\.8640\.11\{\\pm\}0\.8652\.86±2\.4452\.86\{\\pm\}2\.4486\.21±4\.9486\.21\{\\pm\}4\.9455\.53±3\.1855\.53\{\\pm\}3\.1888\.78±1\.11\\mathbf\{88\.78\{\\pm\}1\.11\}F156\.62±5\.4656\.62\{\\pm\}5\.4651\.37±0\.9551\.37\{\\pm\}0\.9564\.87±0\.8364\.87\{\\pm\}0\.8345\.15±1\.4445\.15\{\\pm\}1\.4450\.74±7\.8450\.74\{\\pm\}7\.8425\.40±6\.8425\.40\{\\pm\}6\.8460\.13±2\.2960\.13\{\\pm\}2\.2976\.65±2\.42\\mathbf\{76\.65\{\\pm\}2\.42\}Auc62\.74±4\.7462\.74\{\\pm\}4\.7452\.66±0\.6752\.66\{\\pm\}0\.6754\.69±0\.8354\.69\{\\pm\}0\.8358\.14±1\.7258\.14\{\\pm\}1\.7253\.28±1\.9553\.28\{\\pm\}1\.9569\.29±1\.3469\.29\{\\pm\}1\.3460\.82±1\.8260\.82\{\\pm\}1\.8289\.09±1\.57\\mathbf\{89\.09\{\\pm\}1\.57\}Aupr61\.31±4\.0761\.31\{\\pm\}4\.0752\.42±1\.1452\.42\{\\pm\}1\.1452\.89±1\.3152\.89\{\\pm\}1\.3136\.74±4\.0836\.74\{\\pm\}4\.0852\.19±3\.4252\.19\{\\pm\}3\.4270\.66±1\.2470\.66\{\\pm\}1\.2454\.76±10\.0854\.76\{\\pm\}10\.0889\.15±1\.34\\mathbf\{89\.15\{\\pm\}1\.34\}Mcc18\.35±5\.8718\.35\{\\pm\}5\.872\.97±1\.092\.97\{\\pm\}1\.0912\.19±2\.4412\.19\{\\pm\}2\.4413\.84±3\.4713\.84\{\\pm\}3\.476\.21±2\.296\.21\{\\pm\}2\.2921\.74±1\.9221\.74\{\\pm\}1\.9215\.19±2\.6415\.19\{\\pm\}2\.6460\.90±2\.74\\mathbf\{60\.90\{\\pm\}2\.74\}

Table 2:Performance comparison on Task 2, where both proteins in each test pair are novel proteins\.Tables[1](https://arxiv.org/html/2607.01627#S5.T1)and[2](https://arxiv.org/html/2607.01627#S5.T2)show that MKGR achieves the strongest overall performance in both cold\-start settings\. On Task 1, MKGR obtains the best score for all metrics on Dataset1 and for six of seven metrics on Dataset2\. The only exception is SEN on Dataset2, where EResCNN reaches higher recall but has substantially lower PRE, F1, AUC, AUPR, and MCC\. This pattern suggests that MKGR provides a more balanced decision boundary rather than only increasing positive predictions\.

Task 2 is more difficult because neither protein in the candidate pair has observed PPI edges during training\. MKGR still obtains the best ACC, F1, AUC, AUPR, and MCC on both datasets\. The gains are especially clear for AUC, AUPR, and MCC, which are sensitive to ranking quality and balanced binary prediction\. These results support the central design of MKGR: sequence information supplies intrinsic protein features, biomedical knowledge graphs provide external relational context, and gated fusion adjusts the use of each modality for the candidate pair\.

## 6Conclusion

This paper presented MKGR, a multimodal sequence\-graph framework for cold\-start PPI prediction\. MKGR combines region\-aware sequence representation, modality\-specific graph attention encoders, bridge reconstruction, and pair\-level gated fusion\. Experiments on two datasets under novel\-old and novel\-novel cold\-start settings show consistent improvements over representative PPI prediction baselines\. Future work will extend MKGR to additional biomedical modalities and evaluate its transferability across species and disease\-specific interaction networks\.

## References

- \[1\]Bosheng Song, Xiaoyan Luo, Xiaoli Luo, Yuansheng Liu, Zhangming Niu, and Xiangxiang Zeng\.Learning spatial structures of proteins improves protein–protein interaction prediction\.Briefings in Bioinformatics, 23\(2\):bbab558, 2022\.
- \[2\]Shijie Xie, Xiaojun Xie, Xin Zhao, Fei Liu, Yiming Wang, Jihui Ping, and Zhiwei Ji\.Hnsppi: a hybrid computational model combing network and sequence information for predicting protein–protein interaction\.Briefings in Bioinformatics, 24\(5\):bbad261, 2023\.
- \[3\]Hongli Gao, Cheng Chen, Shuangyi Li, Congjing Wang, Weifeng Zhou, and Bin Yu\.Prediction of protein\-protein interactions based on ensemble residual convolutional neural network\.Computers in Biology and Medicine, 152:106471, 2023\.
- \[4\]Tao Tang, Tianyang Li, Weizhuo Li, Xiaofeng Cao, Yuansheng Liu, and Xiangxiang Zeng\.Anti\-symmetric framework for balanced learning of protein–protein interactions\.Bioinformatics, 40\(10\):btae603, 2024\.
- \[5\]Muhao Chen, Chelsea J\.\-T\. Ju, Guangyu Zhou, Xiangnan Chen, Tianran Zhang, Kai\-Wei Chang, Carlo Zaniolo, and Wei Wang\.Multifaceted protein\-protein interaction prediction based on siamese residual rcnn\.Bioinformatics, 35\(14\):i305–i314, 2019\.
- \[6\]Samuel Sledzieski, Rohit Singh, Lenore Cowen, and Bonnie Berger\.D\-script translates genome to phenome with sequence\-based, structure\-aware, genome\-scale predictions of protein\-protein interactions\.Cell Systems, 12\(10\):969–982\.e6, 2021\.
- \[7\]The UniProt Consortium\.Uniprot: the universal protein knowledgebase in 2021\.Nucleic Acids Research, 49\(D1\):D480–D489, 2021\.
- \[8\]Alexander Rives, Joshua Meier, Tom Sercu, Siddharth Goyal, Zeming Lin, Jason Liu, Demi Guo, Myle Ott, C\. Lawrence Zitnick, Jerry Ma, and Rob Fergus\.Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences\.Proceedings of the National Academy of Sciences, 118\(15\):e2016239118, 2021\.
- \[9\]Zeming Lin, Halil Akin, Roshan Rao, Brian Hie, Zhongkai Zhu, Wenting Lu, Nikita Smetanin, Robert Verkuil, Ori Kabeli, Yaniv Shmueli, et al\.Evolutionary\-scale prediction of atomic\-level protein structure with a language model\.Science, 379\(6637\):1123–1130, 2023\.
- \[10\]John Jumper, Richard Evans, Alexander Pritzel, Tim Green, Michael Figurnov, Olaf Ronneberger, Kathryn Tunyasuvunakool, Russ Bates, Augustin Zidek, Anna Potapenko, et al\.Highly accurate protein structure prediction with alphafold\.Nature, 596\(7873\):583–589, 2021\.
- \[11\]Thomas N\. Kipf and Max Welling\.Semi\-supervised classification with graph convolutional networks\.InInternational Conference on Learning Representations, 2017\.
- \[12\]William L\. Hamilton, Rex Ying, and Jure Leskovec\.Inductive representation learning on large graphs\.InAdvances in Neural Information Processing Systems, pages 1024–1034, 2017\.
- \[13\]Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio\.Graph attention networks\.InInternational Conference on Learning Representations, 2018\.
- \[14\]Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka\.How powerful are graph neural networks?InInternational Conference on Learning Representations, 2019\.
- \[15\]Weihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong, Hongyu Ren, Bowen Liu, Michele Catasta, and Jure Leskovec\.Open graph benchmark: Datasets for machine learning on graphs\.InAdvances in Neural Information Processing Systems, volume 33, pages 22118–22133, 2020\.
- \[16\]Damian Szklarczyk, Annika L\. Gable, David Lyon, Alexander Junge, Stefan Wyder, Jaime Huerta\-Cepas, Milan Simonovic, Nadezhda T\. Doncheva, John H\. Morris, Peer Bork, et al\.String v11: protein\-protein association networks with increased coverage, supporting functional discovery in genome\-wide experimental datasets\.Nucleic Acids Research, 47\(D1\):D607–D613, 2019\.
- \[17\]David S\. Wishart, Yannick D\. Feunang, An C\. Guo, Elvis J\. Lo, Ana Marcu, Jason R\. Grant, Tanvir Sajed, Daniel Johnson, Carin Li, Zinat Sayeeda, et al\.Drugbank 5\.0: a major update to the drugbank database for 2018\.Nucleic Acids Research, 46\(D1\):D1074–D1082, 2018\.
- \[18\]Allan Peter Davis, Thomas C\. Wiegers, Robin J\. Johnson, Daniela Sciaky, Jolene Wiegers, and Carolyn J\. Mattingly\.Comparative toxicogenomics database \(ctd\): update 2021\.Nucleic Acids Research, 49\(D1\):D1138–D1143, 2021\.
- \[19\]Hsi\-Yuan Huang, Yu\-Chen\-Da Lin, Jing Li, Kai\-Yao Huang, Sirjana Shrestha, Hsin\-Chang Hong, Yi Tang, Yu\-Gang Chen, Chun\-Nan Jin, Yang Yu, et al\.mirtarbase 2020: updates to the experimentally validated microrna\-target interaction database\.Nucleic Acids Research, 48\(D1\):D148–D154, 2020\.
- \[20\]Hongqiang Zhao, Jing Shi, Yijie Zhang, Aimei Xie, Liang Yu, Chunquan Zhang, Jianjun Lei, Huixiao Xu, Zhiguang Leng, Tianqi Li, et al\.Lnctard: a manually\-curated database of experimentally\-supported functional lncrna\-target regulations in human diseases\.Nucleic Acids Research, 48\(D1\):D118–D126, 2020\.
- \[21\]Sandra Orchard, Mais Ammari, Bruno Aranda, Lionel Breuza, Leonardo Briganti, Fiona Broackes\-Carter, Nancy H\. Campbell, Gayatri Chavali, Carol Chen, Noemi del Toro, et al\.The mintact project–intact as a common curation platform for 11 molecular interaction databases\.Nucleic Acids Research, 42\(D1\):D358–D363, 2014\.
- \[22\]The Gene Ontology Consortium\.The gene ontology resource: enriching a gold mine\.Nucleic Acids Research, 49\(D1\):D325–D334, 2021\.
- \[23\]Daniel Scott Himmelstein, Antoine Lizee, Christine Hessler, Leo Brueggeman, Sabrina L\. Chen, Dexter Hadley, Ari Green, Pouya Khankhanian, and Sergio E\. Baranzini\.Systematic integration of biomedical knowledge prioritizes drugs for repurposing\.eLife, 6:e26726, 2017\.
- \[24\]Payal Chandak, Kexin Huang, and Marinka Zitnik\.A knowledge graph to interpret clinical proteomics data\.Nature Biotechnology, 41:754–764, 2023\.
- \[25\]Antoine Bordes, Nicolas Usunier, Alberto Garcia\-Duran, Jason Weston, and Oksana Yakhnenko\.Translating embeddings for modeling multi\-relational data\.InAdvances in Neural Information Processing Systems, pages 2787–2795, 2013\.
- \[26\]Michael Schlichtkrull, Thomas N\. Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, and Max Welling\.Modeling relational data with graph convolutional networks\.InThe Semantic Web, pages 593–607\. Springer, 2018\.
- \[27\]Marinka Zitnik, Monica Agrawal, and Jure Leskovec\.Modeling polypharmacy side effects with graph convolutional networks\.Bioinformatics, 34\(13\):i457–i466, 2018\.
- \[28\]Jie Yang, Yapeng Li, Guoyin Wang, Zhong Chen, and Di Wu\.An end\-to\-end knowledge graph fused graph neural network for accurate protein\-protein interactions prediction\.IEEE/ACM Transactions on Computational Biology and Bioinformatics, 21\(6\):2518–2530, 2024\.
- \[29\]Jie Yang, Xijie Lan, Guoyin Wang, Zhong Chen, Yuwen Chen, and Di Wu\.A hybrid ensemble end\-to\-end neural network for accurate protein\-protein interactions prediction\.IEEE Transactions on Computational Biology and Bioinformatics, 22\(6\):2540–2553, 2025\.
- \[30\]Di Wu, Wu Sun, Yi He, Zhong Chen, and Xin Luo\.Mkg\-fenn: A multimodal knowledge graph fused end\-to\-end neural network for accurate drug\-drug interaction prediction\.InProceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 10216–10224, 2024\.
- \[31\]Chengjun Yu, Di Wu, Yi He, Jia Chen, and Xin Luo\.Federated latent factor learning for privacy\-preserving spatio\-temporal signal recovery\.InWWW, pages 2905–2916, 2026\.
- \[32\]Di Wu, Xin Luo, Mingsheng Shang, Yi He, Guoyin Wang, and Xindong Wu\.A data\-characteristic\-aware latent factor model for web service qos prediction\.IEEE Transactions on Knowledge and Data Engineering, 34\(6\):2525–2538, 2022\.
- \[33\]Jia Chen, Renfang Wang, Di Wu, and Xin Luo\.A differential evolution\-enhanced position\-transitional approach to latent factor analysis\.IEEE Trans\. Emerg\. Top\. Comput\. Intell\., 7\(2\):389–401, 2023\.
- \[34\]Ruiyang Xu, Di Wu, and Xin Luo\.Recursion\-and\-fuzziness reinforced online sparse streaming feature selection\.IEEE Trans\. Fuzzy Syst\., 33\(8\):2574–2586, 2025\.
- \[35\]Cheng Liang, Di Wu, Yi He, Teng Huang, Zhong Chen, and Xin Luo\.Mma: Multi\-metric\-autoencoder for analyzing high\-dimensional and incomplete data\.InECML/PKDD \(5\), pages 3–19, 2023\.
- \[36\]Ruiyang Xu, Di Wu, Renfang Wang, and Xin Luo\.A highly\-accurate three\-way decision\-incorporated online sparse streaming features selection model\.IEEE Trans\. Syst\. Man Cybern\. Syst\., 55\(6\):4258–4272, 2025\.
- \[37\]Xin Luo, Ye Yuan, and Di Wu\.Adaptive regularization\-incorporated latent factor analysis\.InICKG, pages 481–488, 2020\.
- \[38\]Xin Luo, Mengchu Zhou, Shuai Li, Di Wu, Zhigang Liu, and Mingsheng Shang\.Algorithms of unconstrained non\-negative latent factor analysis for recommender systems\.IEEE Trans\. Big Data, 7\(1\):227–240, 2021\.
- \[39\]Ye Yuan, Xin Luo, Mingsheng Shang, and Di Wu\.A generalized and fast\-converging non\-negative latent factor model for predicting user preferences in recommender systems\.InWWW, pages 498–507, 2020\.
- \[40\]Wenqiang Li, Mingwei Lin, Xiuqin Xu, Ling Lin, Zeshui Xu, and Xin Luo\.Neural nonnegative latent factorization of tensors model with acceleration and unconstraint\.IEEE Trans\. Syst\. Man Cybern\. Syst\., 56\(1\):164–178, 2026\.
- \[41\]Xiuqin Xu, Mingwei Lin, Zeshui Xu, and Xin Luo\.A sampling\-neighborhood\-regularized latent factorization of tensor for dynamic qos estimation\.IEEE Trans\. Netw\. Serv\. Manag\., 23:1707–1722, 2026\.
- \[42\]Ruiyang Xu, Di Wu, and Xin Luo\.Online sparse streaming feature selection via decision risk\.InSMC, pages 4190–4195, 2023\.
- \[43\]Di Wu, Xin Luo, Yi He, and MengChu Zhou\.A prediction\-sampling\-based multilayer\-structured latent factor model for accurate representation to high\-dimensional and sparse data\.IEEE Transactions on Neural Networks and Learning Systems, 35\(3\):3845–3858, 2024\.
- \[44\]Liping Zhang, Di Wu, and Xin Luo\.An error correction mid\-term electricity load forecasting model based on seasonal decomposition\.InSMC, pages 2415–2420, 2023\.
- \[45\]Di Wu, Peng Zhang, Yi He, and Xin Luo\.A double\-space and double\-norm ensembled latent factor model for highly accurate web service qos prediction\.IEEE Transactions on Services Computing, 16\(2\):802–814, 2023\.
- \[46\]Yaping He, Hao Wu, and Xin Luo\.Adaptive tucker decomposition\-based progressive model compression for convolutional neural networks\.Expert Syst\. Appl\., 308:131153, 2026\.
- \[47\]Yaping He and Xin Luo\.Tensor low\-rank orthogonal compression for convolutional neural networks\.IEEE CAA J\. Autom\. Sinica, 13\(1\):227–229, 2026\.
- \[48\]Peng Tang and Xin Luo\.Neural tucker factorization\.IEEE CAA J\. Autom\. Sinica, 12\(2\):475–477, 2025\.
- \[49\]Yikai Hou, Peng Tang, and Xin Luo\.Multi\-aspect self\-attending neural tucker factorization for spatiotemporal representation learning\.IEEE CAA J\. Autom\. Sinica, 13\(4\):986–988, 2026\.
- \[50\]Peng Tang, Yikai Hou, and Xin Luo\.Mpsant: A novel multi\-projection self\-attending neural tucker factorization model for high\-dimensional and incomplete data representation learning\.Inf\. Fusion, 135:104449, 2026\.
- \[51\]Longlong Lin and Xin Luo\.Dual channel graph convolutional networks via personalized pagerank\.IEEE CAA J\. Autom\. Sinica, 13\(1\):221–223, 2026\.
- \[52\]Tiantian He, Zhixuan Duan, and Xin Luo\.Modularized graph convolutional network\.IEEE CAA J\. Autom\. Sinica, 13\(3\):737–739, 2026\.
- \[53\]Ling Wang, Ye Yuan, and Xin Luo\.Advanced high\-order graph convolutional networks with assorted time\-frequency transforms\.IEEE CAA J\. Autom\. Sinica, 13\(2\):394–408, 2026\.
- \[54\]Di Wu, Yi He, and Xin Luo\.A graph\-incorporated latent factor analysis model for high\-dimensional and sparse data\.IEEE Transactions on Emerging Topics in Computing, 11\(4\):907–917, 2023\.
- \[55\]Ling Wang, Ye Yuan, and Xin Luo\.Graph tensor convolutional network\.IEEE Trans\. Syst\. Man Cybern\. Syst\., 56\(5\):3008–3024, 2026\.
- \[56\]Di Wu, Peng Zhang, Yi He, and Xin Luo\.Mmlf: multi\-metric latent feature analysis for high\-dimensional and incomplete data\.IEEE Transactions on Services Computing, 17\(2\):575–588, 2024\.
- \[57\]Yaping He, Hao Wu, Weibo Liu, and Xin Luo\.A survey of latent factorization of tensor\-based model compression: Algorithms, toolboxes and future directions\.Neurocomputing, 682:133455, 2026\.
- \[58\]Xin Liao, Hao Wu, and Xin Luo\.A novel tensor causal convolution network model for highly\-accurate representation to spatio\-temporal data\.IEEE Trans Autom\. Sci\. Eng\., 22:19525–19537, 2025\.
- \[59\]Minzhi Chen, Li Tao, Jungang Lou, and Xin Luo\.Latent\-factorization\-of\-tensors\-incorporated battery cycle life prediction\.IEEE CAA J\. Autom\. Sinica, 12\(3\):633–635, 2025\.
- \[60\]Libin Lan, Hongxing Li, Zunhui Xia, Juan Zhou, Xiaofei Zhu, Yongmei Li, Eugene Yu\-Dong Zhang, and Xin Luo\.Cm\-cgns: Cross\-modal clustering\-guided negative sampling for self\-supervised joint learning from medical images and reports\.Expert Syst\. Appl\., 325:132577, 2026\.
- \[61\]Jianping Gou, Kaijie Chen, Cheng Chen, Weihua Ou, Xin Luo, and Zhang Yi\.Layer\-wise correlation and attention discrepancy distillation for semantic segmentation\.Pattern Recognit\., 172:112438, 2026\.
- \[62\]Jun Liu, Xiang Li, Mingwei Lin, and Xin Luo\.A scalable multichannel sentiment analysis model with enhanced semantic understanding and redundancy reduction\.IEEE Trans\. Comput\. Soc\. Syst\., 13\(2\):1513–1528, 2026\.
- \[63\]Xun Deng, Pengwei Hu, Thomas Herget, Feng Tan, Xiaobo Zhu, Jun Zhang, Yuan Huang, Lun Hu, Zhuhong You, and Xin Luo\.Fuzzy mixture\-of\-experts aggregation for organoid identification with multiscale state space features\.IEEE Trans\. Fuzzy Syst\., 34\(1\):324–335, 2026\.
- \[64\]Longlong Lin, Quanao Li, Miao Qiao, Zeli Wang, Jin Zhao, Rong\-Hua Li, Xin Luo, and Tao Jia\.Ncsac: Effective neural community search via attribute\-augmented conductance\.IEEE Trans\. Knowl\. Data Eng\., 38\(2\):1221–1235, 2026\.
- \[65\]Weiyi Yang, Shuai Li, and Xin Luo\.An intelligent optimization\-based residual negative magnitude shaping scheme for vibration control\.IEEE Trans\. Ind\. Electron\., 73\(2\):3349–3360, 2026\.
- \[66\]Wen Qin, Yuting Ding, and Xin Luo\.A robust approach to electricity theft detection via tensor representation\-driven contrastive distillation\.IEEE Trans\. Ind\. Informatics, 22\(5\):4561–4570, 2026\.
- \[67\]Chentao Li, Pan Huang, Harry Qin, and Xin Luo\.Knowledge\-driven multiple instance learning with hierarchical cluster\-incorporated aware filtering for larynx pathological grading\.IEEE J\. Biomed\. Health Informatics, 30\(4\):2973–2985, 2026\.
- \[68\]Chao Lyu, Ziwen Ma, Xin Luo, and Yuhui Shi\.Dynamic stochastic reorientation particle swarm optimization for adaptive latent factor analysis in high\-dimensional sparse matrices\.IEEE Trans\. Knowl\. Data Eng\., 38\(1\):222–234, 2026\.
- \[69\]Chao Lyu, Jingna Cheng, Xin Luo, and Yuhui Shi\.Genetic algorithm\-based two\-step optimization for precise latent factor analysis\.IEEE Trans\. Neural Networks Learn\. Syst\., 37\(5\):2294–2306, 2026\.
- \[70\]Jianping Gou, Youhui Cheng, Benteng Ma, Lan Du, Xin Luo, and Zhang Yi\.Multi\-scale collaborative distillation graph neural networks for session\-based recommendation\.IEEE Trans\. Serv\. Comput\., 19\(1\):504–517, 2026\.
- \[71\]Ningning Han, Siyang Lu, Zaichao Lin, Bin Li, Nan Wang, and Xin Luo\.Tracehg: An unsupervised dual\-view framework for microservice anomaly detection\.IEEE Trans\. Serv\. Comput\., 19\(2\):1633–1646, 2026\.
- \[72\]Yafang Wei, Pengwei Hu, Xun Deng, Feng Tan, Thomas Herget, Mei Gao, Lun Hu, and Xin Luo\.Clorg: A contrastive learning\-based framework for morphological representation and classification of organoids\.Array, 27:100446, 2025\.
- \[73\]Yantong Qiao, Lun Hu, Jun Zhang, Pengwei Hu, and Xin Luo\.Identifying novel therapeutic targets of natural compounds in traditional chinese medicine herbs with hypergraph representation learning\.Briefings Bioinform\., 26\(Supplement\_1\), 2025\.
- \[74\]Xin Liao, Khoi Hoang, and Xin Luo\.Local search\-based anytime algorithms for continuous distributed constraint optimization problems\.IEEE CAA J\. Autom\. Sinica, 12\(1\):288–290, 2025\.
- \[75\]Zhenzhen Luo, Xiaolu Jin, Yong Luo, Qiangqiang Zhou, and Xin Luo\.Analysis of students’ positive emotion and smile intensity using sequence\-relative key\-frame labeling and deep\-asymmetric convolutional neural network\.IEEE CAA J\. Autom\. Sinica, 12\(4\):806–820, 2025\.
- \[76\]Ye Yuan, Siyang Lu, and Xin Luo\.A proportional integral controller\-enhanced non\-negative latent factor analysis model\.IEEE CAA J\. Autom\. Sinica, 12\(6\):1246–1259, 2025\.
- \[77\]Tinghui Chen, Weiyi Yang, Shuai Li, and Xin Luo\.Data\-driven calibration of industrial robots: A comprehensive survey\.IEEE CAA J\. Autom\. Sinica, 12\(8\):1544–1567, 2025\.
- \[78\]Mingwei Lin, Jiaqi Liu, Hong Chen, Xiuqin Xu, Xin Luo, and Zeshui Xu\.A 3d convolution\-incorporated dimension preserved decomposition model for traffic data prediction\.IEEE Trans\. Intell\. Transp\. Syst\., 26\(1\):673–690, 2025\.
- \[79\]Hengshuo Yang, Mingwei Lin, Hong Chen, Xin Luo, and Zeshui Xu\.Latent factor analysis model with temporal regularized constraint for road traffic data imputation\.IEEE Trans\. Intell\. Transp\. Syst\., 26\(1\):724–741, 2025\.
- \[80\]Bo\-Wei Zhao, Xiao\-Rui Su, Yue Yang, Dong\-Xu Li, Guo\-Dong Li, Peng\-Wei Hu, Zhu\-Hong You, Xin Luo, and Lun Hu\.Regulation\-aware graph learning for drug repositioning over heterogeneous biological network\.Inf\. Sci\., 686:121360, 2025\.
- \[81\]Pan Huang and Xin Luo\.Fdts: A feature disentangled transformer for interpretable squamous cell carcinoma grading\.IEEE CAA J\. Autom\. Sinica, 12\(11\):2365–2367, 2025\.
- \[82\]Zhenlin Hu, Zhizhi Peng, Zhen Bi, Qing Shen, Zhenfang Liu, Jungang Lou, and Xin Luo\.Advancing healthcare with large language models: Techniques and application\.IEEE CAA J\. Autom\. Sinica, 12\(12\):2371–2398, 2025\.
- \[83\]Qicong Hu, Hao Wu, and Xin Luo\.A comprehensive review of parallel optimization algorithms for high\-dimensional and incomplete matrix factorization\.IEEE CAA J\. Autom\. Sinica, 12\(12\):2399–2426, 2025\.
- \[84\]Di Wu, Xin Luo, Mingsheng Shang, Yi He, Guoyin Wang, and MengChu Zhou\.A deep latent factor model for high\-dimensional and sparse matrices in recommender systems\.IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51\(7\):4285–4296, 2021\.
- \[85\]Jiufang Chen, Xin Luo, Ye Yuan, and Zidong Wang\.Enhancing graph convolutional networks with an efficient k\-hop neighborhood approach\.Inf\. Fusion, 124:103297, 2025\.
- \[86\]Zhibin Li, Xun Deng, Tinghui Chen, Yuhang Yang, Linlin Chen, Xiwen Yang, Zhenzhen Hu, Lun Hu, Pengwei Hu, Shuai Li, and Xin Luo\.Searching for an accurate robot calibration via improved levenberg\-marquardt and radial basis function system\.J\. Field Robotics, 42\(6\):2691–2700, 2025\.
- \[87\]Di Wu, Qiang He, Xin Luo, Mingsheng Shang, Yi He, and Guoyin Wang\.A posterior\-neighborhood\-regularized latent factor model for highly accurate web service qos prediction\.IEEE Transactions on Services Computing, 15\(2\):793–805, 2022\.
- \[88\]Jinli Li, Ye Yuan, and Xin Luo\.Learning error refinement in stochastic gradient descent\-based latent factor analysis via diversified pid controllers\.IEEE Trans\. Emerg\. Top\. Comput\. Intell\., 9\(5\):3582–3597, 2025\.
- \[89\]Di Wu, Shihui Li, Yi He, Xin Luo, and Xinbo Gao\.Non\-gradient hash factor learning for high\-dimensional and incomplete data representation learning\.IEEE Transactions on Pattern Analysis and Machine Intelligence, 48\(5\):5811–5826, 2026\.
- \[90\]Yawen Sun, Rui Wang, Zeyu Luo, Lejia Tan, Junhao Liu, Ruimeng Li, Dongqing Wei, and Yu\-Juan Zhang\.Esm2\_amp: an interpretable framework for protein–protein interactions prediction and biological mechanism discovery\.Briefings in Bioinformatics, 26\(4\):bbaf434, 2025\.

Similar Articles

GLACIER: A Multimodal Student-Teacher Foundation Model for Molecular Property Prediction

arXiv cs.LG

This paper introduces GLACIER, a multimodal student-teacher foundation model that integrates molecular graphs, SMILES strings, and physicochemical descriptors to predict molecular properties efficiently. It leverages Finsler geometry-aware fusion and knowledge distillation from larger teacher models (MiniMol, MolFormer) to achieve high performance with a lightweight architecture.