Time-Aligned Evolving Concept Graphs for Scientific Relation Forecasting

arXiv cs.AI Papers

Summary

This paper proposes a time-aligned evolving concept graph framework that jointly models semantic and structural evolution for forecasting scientific relations, achieving significant improvements in prediction accuracy over existing methods.

arXiv:2609.18163v1 Announce Type: new Abstract: Forecasting scientific relations can guide discovery by identifying promising connections before they emerge. Existing approaches often model concept semantics and graph structure separately or summarize semantics over coarse historical snapshots, leaving semantic representations potentially misaligned with rapidly evolving graph evidence. We propose a time-aligned evolving concept graph framework that jointly models semantic and structural evolution. Its core idea is to treat dated papers as shared update events, reconstructing semantic and structural states from the same publication history through each prediction time. Pair-level fusion combines these states to forecast first co-occurrence, relation formation, and conditional relation type. Holding architecture and training fixed, refreshing context alongside graph updates improves mean relation AUPRC by 16.6% over frozen context. On a graph built from 187,848 papers with 270,687 concepts and 7.45 million co-occurrence links, the complete framework improves mean relation AUROC from 0.9290 for the strongest evaluated baseline to 0.9722, with mean population-weighted AUPRC 0.005778.
Original Article
View Cached Full Text

Cached at: 09/17/26, 09:34 AM

# Time-Aligned Evolving Concept Graphsfor Scientific Relation Forecasting
Source: [https://arxiv.org/html/2609.18163](https://arxiv.org/html/2609.18163)
Jingze WangMinkun XuShangqi Guo††thanks:\*Equal contribution\.†Corresponding author\.

###### Abstract

Forecasting scientific relations can guide discovery by identifying promising connections before they emerge\. Existing approaches often model concept semantics and graph structure separately or summarize semantics over coarse historical snapshots, leaving semantic representations potentially misaligned with rapidly evolving graph evidence\. We propose a time\-aligned evolving concept graph framework that jointly models semantic and structural evolution\. Its core idea is to treat dated papers as shared update events, reconstructing semantic and structural states from the same publication history through each prediction time\. Pair\-level fusion combines these states to forecast first co\-occurrence, relation formation, and conditional relation type\. Holding architecture and training fixed, refreshing context alongside graph updates improves mean relation AUPRC by 16\.6% over frozen context\. On a graph built from 187,848 papers with 270,687 concepts and 7\.45 million co\-occurrence links, the complete framework improves mean relation AUROC from 0\.9290 for the strongest evaluated baseline to 0\.9722, with mean population\-weighted AUPRC 0\.005778\.

###### Index Terms:

scientific relation forecasting, time\-aligned concept graphs, evolving semantics, temporal graphs

††address:1Center for Brain\-Inspired Computing Research,
Department of Precision Instrument, Tsinghua University, Beijing, China
2Guangdong Institute of Intelligence Science and Technology, Zhuhai, China## 1Introduction

Scientific advances often connect separate lines of work: a method enters a new application, techniques are combined, or evidence challenges an established approach\. Forecasting these connections can reveal promising directions before findings appear\. Concept\-graph methods predict future co\-occurrences from historical literature\[[9](https://arxiv.org/html/2609.18163#bib.bib2),[8](https://arxiv.org/html/2609.18163#bib.bib3),[10](https://arxiv.org/html/2609.18163#bib.bib1)\]\. A scientific relation gives a connection a specific meaning, such as one method*using*,*combining with*, or*replacing*another\. Co\-discussion alone does not establish these roles\. We therefore forecast both whether a scientific relation will form and its type\. These forecasts draw on concept usage and observed connections\. When a method enters a new application, its recent contexts and emerging graph neighborhood describe the same development\. Combining earlier concept usage with newer graph events mixes different stages of that development\. Both sources should therefore be reconstructed at the same prediction time\.

Figure 1:Time\-aligned evolving concept graphs\. Dated papers provide contextual occurrences and graph events through query timett\. Reconstructed semantic and structural states are fused at the concept\-pair level to forecast first co\-occurrence, relation formation, and conditional relation type\.Literature\-based discovery and scientific embeddings provide evidence for unobserved connections\[[13](https://arxiv.org/html/2609.18163#bib.bib9),[15](https://arxiv.org/html/2609.18163#bib.bib10)\]\. Marwitz et al\.\[[10](https://arxiv.org/html/2609.18163#bib.bib1)\]average contextual embeddings across abstracts before a cutoff year and combine them with graph information for link prediction\. Temporal graph models\[[11](https://arxiv.org/html/2609.18163#bib.bib6),[16](https://arxiv.org/html/2609.18163#bib.bib7),[2](https://arxiv.org/html/2609.18163#bib.bib12),[17](https://arxiv.org/html/2609.18163#bib.bib13)\]and text\-attributed dynamic graphs\[[18](https://arxiv.org/html/2609.18163#bib.bib17)\]motivate the representation of evolving interactions\. Diachronic embeddings\[[4](https://arxiv.org/html/2609.18163#bib.bib15)\]examine semantic change, while temporal knowledge\-graph models forecast future relations\[[7](https://arxiv.org/html/2609.18163#bib.bib11)\]\.

We propose a time\-aligned evolving concept graph framework \(Fig\.[1](https://arxiv.org/html/2609.18163#S1.F1)\)\. Dated papers serve as shared update events for concept usage and graph connections\. At each query, semantic and structural states are reconstructed through the same publication date, pairing current concept usage with its corresponding graph evidence\. A context\-sensitive update tracks usage; graph encoders and a recent\-event pathway capture established connections and current activity\. Pair\-level fusion forecasts first co\-occurrence, relation formation, and conditional relation type\. With architecture and training held fixed, refreshing semantic context alongside graph updates improves mean relation AUPRC by16\.6%16\.6\\%over frozen context\. The complete framework improves relation population\-AUPRC by70\.7%70\.7\\%over the strongest evaluated baseline\.

## 2Proposed Framework

### 2\.1Dated papers as shared update events

We extract concept mentions from abstracts and consolidate aliases through retrieval and verification\. The concept inventory extends chronologically: newly observed names receive existing or new node IDs, while prior assignments remain fixed\. A corpus\-wide acronym\-ambiguity check filters candidate merges\. Each paper supplies contextual occurrences, co\-occurrences, and full\-text evidence for typed, directed relations:*uses*,*combines*,*replaces*, and*contradicts*\. A generator–discriminator teacher pipeline distills local relation extractors\. Student confidence is calibrated on the extractor development split\. Trusted instances have teacher evidence, agreement of at least two student extractors, or confidence≥0\.95\\geq 0\.95\. Relation records retain the paper, date, type, direction, confidence, and supporting text\. An expert audit of 10,000 accepted relation instances yielded 93\.4% relation validity, 90\.7% type correctness, and 89\.9% direction correctness\.

For each query datett, reconstruction of semantic states and graph statistics uses no publications after that date\. Only names observed byttare activated, and papers published onttare included\. The co\-occurrence graph aggregates supporting\-paper counts; the relation graph preserves types, directions, and evidence strength\. We filter paper events by the query date before accumulating edge weights and relation statistics\.

We forecast a first trusted scientific relation during the following\-year window\(t,t\+H\]\(t,t\+H\];H=365H=365days for the test window\. Eligible pairs have no prior scientific relation and involve only concepts observed bytt; prior co\-occurrence is allowed\. A negative label indicates no observed relation during the window\. Queries without complete future observation are excluded\.*First co\-occurrence forecasting*considers pairs never previously observed together\.*Relation type prediction*classifies the first relation of a relation\-positive pair\. We merge*replaces*and*contradicts*and exclude conflicting first\-day categories\. The graph retains direction; formation and type targets are invariant to endpoint order\. Within the window, relations entail co\-occurrence; type is conditional on formation\.

### 2\.2Reconstructing concept semantics

For each concept surface form in a paper, SciDeBERTa\[[6](https://arxiv.org/html/2609.18163#bib.bib16)\]provides contextual token representations\. Averaging over the concept’s tokens and repeated mentions yields one 768\-dimensional occurrence vector\. The retained record contains the surface form, paper identifier, publication day, and vector\.

To combine accumulated usage with recent adaptation, we initialize the state from the mean of earlier occurrences and sequentially update over the latestK=20K=20visible occurrences\. For histories of at mostKKoccurrences, the first initializes the state and the remainder are replayed\. Letxkx\_\{k\}denote thekk\-th visible occurrence, withkkcounting the full history\. Each replay step is

mk\\displaystyle m\_\{k\}=mk−1\+gk​\(xk−mk−1\),\\displaystyle=m\_\{k\-1\}\+g\_\{k\}\(x\_\{k\}\-m\_\{k\-1\}\),\(1\)gk\\displaystyle g\_\{k\}=max⁡\{1/k,σ⁡\(α⁡\[1−cos⁡\(mk−1,xk\)\]\+β\)\}\.\\displaystyle=\\max\\\{1/k,\\ \\sigma\(\\alpha\[1\-\\cos\(m\_\{k\-1\},x\_\{k\}\)\]\+\\beta\)\\\}\.The1/k1/kaveraging rate provides a lower bound, emphasizing early observations while decreasing as history grows\. The sigmoid term maintains a persistent response to new contexts, withβ\\betasetting the baseline andα\\alphacontrolling sensitivity to contextual discrepancy\. We fixα=4\\alpha=4andβ=−2\.5\\beta=\-2\.5: the sigmoid rate is0\.0760\.076at zero cosine discrepancy and0\.1090\.109at similarity0\.90\.9\. Multiplication byxk−mk−1x\_\{k\}\-m\_\{k\-1\}makes updates small when observations already resemble the state, while departures from accumulated usage receive more weight\.

The historical mean retains older evidence, while recent replay adapts to current usage with at mostKKsequential updates per surface form\. At the test cutoff,96\.7%96\.7\\%of surface forms with contextual observations have at most 20 occurrences, so their histories are replayed in full\. Reconstructing the state at each query ties semantic adaptation to the graph’s publication cutoff\.

We pool aliases observed byttusing their mention counts throughtt, then normalize to obtain contextual semanticscv​\(t\)c\_\{v\}\(t\)\. A separate 256\-dimensional identity representationiv​\(t\)i\_\{v\}\(t\)averages embeddings of names observed bytt\. New contexts update usage, while new aliases can update identity\.

### 2\.3Forecasting from time\-aligned states

*Contextual usage and concept identity\.*Letav=fc​\(cv​\(t\)\)a\_\{v\}=f\_\{c\}\(c\_\{v\}\(t\)\)andbv=fi​\(iv​\(t\)\)b\_\{v\}=f\_\{i\}\(i\_\{v\}\(t\)\)be learned projections\. A gate combines their dimensions into the semantic state:

γv\\displaystyle\\gamma\_\{v\}=σ⁡\(fg​\(\[av,bv\]\)\),\\displaystyle=\\sigma\(f\_\{g\}\(\[a\_\{v\},b\_\{v\}\]\)\),hv​\(t\)\\displaystyle h\_\{v\}\(t\)=Norm⁡\(γv⊙av\+\(1−γv\)⊙bv\)\.\\displaystyle=\\operatorname\{Norm\}\\bigl\(\\gamma\_\{v\}\\odot a\_\{v\}\+\(1\-\\gamma\_\{v\}\)\\odot b\_\{v\}\\bigr\)\.\(2\)The gate balances concept identity and current usage in each feature dimension\. This semantic state enters pair\-level fusion alongside graph evidence from the same query date\.

*Accumulated structure and recent interactions\.*Two layers of weighted GraphSAGE\[[5](https://arxiv.org/html/2609.18163#bib.bib5)\]encode co\-occurrence neighborhoods\. Two layers of basis\-decomposed relational graph convolution\[[12](https://arxiv.org/html/2609.18163#bib.bib8)\]encode typed relation neighborhoods, retaining direction and relation\-specific evidence\.

Each endpoint also contributes its latest 20 co\-occurrence and relation events\. Tokens contain event type, age, intensity, and validity, with fixed time encodings\. Two temporal MLP\-Mixer layers\[[14](https://arxiv.org/html/2609.18163#bib.bib18),[2](https://arxiv.org/html/2609.18163#bib.bib12)\]summarize the sequence\. This pathway describes recent activity alongside the accumulated neighborhoods\.

*Fusion and hierarchical outputs\.*For endpoint embeddingsa,ba,b, we use\[a\+b,\|a−b\|,a⊙b\]\[a\+b,\|a\-b\|,a\\odot b\]to form an order\-invariant pair representation\. Task\-specific gates combine semantic, graph, and event representations with pair\-history statistics\. The relation score contains a base prediction and gated ranking and interaction residuals\. These contributions enter the relation logit before the three\-outcome softmax:

\(pnone,pco​only,prel\)\\displaystyle\(p\_\{\\mathrm\{none\}\},p\_\{\\mathrm\{co\\ only\}\},p\_\{\\mathrm\{rel\}\}\)=softmax⁡\(0,zco,zrel\),\\displaystyle=\\operatorname\{softmax\}\(0,z\_\{\\mathrm\{co\}\},z\_\{\\mathrm\{rel\}\}\),\(3\)P⁡\(co\-occurrence\)\\displaystyle P\(\\text\{co\-occurrence\}\)=pco​only\+prel,\\displaystyle=p\_\{\\mathrm\{co\\ only\}\}\+p\_\{\\mathrm\{rel\}\},P⁡\(relation\)\\displaystyle P\(\\text\{relation\}\)=prel≤P⁡\(co\-occurrence\)\.\\displaystyle=p\_\{\\mathrm\{rel\}\}\\leq P\(\\text\{co\-occurrence\}\)\.\(4\)The outcomes describe no co\-occurrence, co\-occurrence without a relation, and relation formation within the target window\. Here co\-occurrence includes renewed co\-occurrence of a previously observed pair; the inequality holds by construction\.

First co\-occurrence uses a direct binary output and a gated event correction\. Relation type uses a conditional classifier mixing two frozen semantic\-and\-relation predictors selected for ROC and precision–recall, with a bounded semantic and graph residual\. These task\-specific outputs respect their different candidate sets\.

### 2\.4Training for rare relation formation

For relation formation, training combines population samples, positives paired with broadly sampled negatives, and high\-scoring difficult negatives\. Inverse\-probability weights correct the sampled label distribution\. The objective combines weighted three\-outcome negative log\-likelihood, co\-occurrence ranking, relation ranking, and conditional relation binary cross\-entropy, with respective weights11,0\.20\.2,0\.80\.8, and0\.10\.1\. The ranking loss usessoftplus⁡\(s−−s\+\)\\operatorname\{softplus\}\(s^\{\-\}\-s^\{\+\}\)for positive–negative score pairs; gathering candidates across devices enlarges the ranking pool\.

We train from random initialization and select checkpoints on validation\. Within the Pareto frontier of AUROC and AUPRC, we retain the highest AUPRC subject to relation AUROC≥0\.9700\\geq 0\.9700\. The selected checkpoint is frozen before testing\.

## 3Experiments

Figure 2:ROC curves: \(a,b\) population weighted; \(c\) mean of three one\-vs\-rest curves\. Our relation curve is the mean ROC from the three refreshed checkpoints in Tables[1](https://arxiv.org/html/2609.18163#S3.T1)and[2](https://arxiv.org/html/2609.18163#S3.T2); other curves show representative runs\. Insets magnify low false\-positive rates\.Table 1:Relation formation on the population\-weighted test \(mean±\\pmsample SD, three seeds\)\.### 3\.1Data, protocol, and comparisons

The computer\-vision corpus contains 187,848 papers from January 2017 to June 2026, 270,687 concepts, 7,452,716 co\-occurrence pairs, and 580,615 distinct pairs with scientific relations\. We train on the 2022–2023 and 2023–2024 windows, validate on 2024–2025, and test on 2025–2026, with June 25 cutoffs\. The test query is June 25, 2025; all methods share the concept inventory and use names and paper evidence observed through that date\.

At the test cutoff, the population comprises 24\.90 billion eligible concept pairs, with relation prevalence1\.9×10−61\.9\\times 10^\{\-6\}\. We form the test view from all target\-window co\-occurring pairs and uniformly sampled eligible pairs\. From this view, we retain all 47,433 relation positives and uniformly sample 202,567 negatives\. All models use this fixed 250,000\-pair sample and inverse\-probability weights accounting for both sampling stages\. We report weighted AUROC and average precision \(AUPRC\)\. First co\-occurrence uses its corresponding weighted view; relation type uses all 46,466 unambiguous relation\-positive pairs and macro\-averaged metrics\.

Marwitz’s combined predictor\[[10](https://arxiv.org/html/2609.18163#bib.bib1)\]provides a scientific\-link comparison; DyGFormer and GraphMixer provide temporal graph comparisons\. Figure[2](https://arxiv.org/html/2609.18163#S3.F2)also includes semantic and relational predictors, such as RecB\[[3](https://arxiv.org/html/2609.18163#bib.bib14)\]and SciBERT pair embeddings\[[1](https://arxiv.org/html/2609.18163#bib.bib4)\]\.

Our relation model uses hidden dimension 96, semantic and task widths 192, and dropout 0\.2\. AdamW runs for 1,600 steps with global batch size 24,576, learning rate2×10−42\\times 10^\{\-4\}, 120 warmup steps, cosine decay, and weight decay 0\.01\. Validation runs every 200 steps\. Both tables report means and sample standard deviations over seeds 17/23/42\. The main result and refreshed row reuse identical checkpoints; the frozen comparison pairs the same seeds and training schedule\.

### 3\.2Forecasting scientific connections

The complete framework achieves relation AUPRC0\.0057780\.005778and AUROC0\.97220\.9722\(Table[1](https://arxiv.org/html/2609.18163#S3.T1)\), improving AUPRC by70\.7%70\.7\\%over GraphMixer, the strongest evaluated baseline\. The gain in population\-weighted AUPRC reflects improved retrieval of rare future relations among previously unrelated concepts\.

Figure[2](https://arxiv.org/html/2609.18163#S3.F2)compares ROC profiles across the three tasks\. First co\-occurrence achieves AUROC0\.93990\.9399\. For relation type, the frozen teacher mixture selected on validation reaches macro\-AUROC0\.78380\.7838and macro\-AUPRC0\.5464910\.546491\. These complementary tasks distinguish detecting new shared usage from identifying the scientific role of a connection once it forms\.

Table 2:Context\-refresh ablation for relation formation \(mean±\\pmsample SD, three paired seeds\)\. Refreshed uses the Ours checkpoints from Table[1](https://arxiv.org/html/2609.18163#S3.T1)\.
### 3\.3The value of refreshing concept semantics

The refresh experiment tests whether updating concept semantics adds predictive value when graph evidence already follows the query date\. The frozen variant retains each concept’s context from the first benchmark query at which the concept is available\. The refreshed variant reconstructs it at each query from the newly available paper history\. Identity, graph, and event inputs follow the query date in both variants\.

Both variants use the same architecture, fixed semantic update rule, replay budget, trainable modules, and training schedule\. Only access to subsequent contexts changes, isolating the value of keeping semantic evidence current as the graph evolves\. All six checkpoints are selected on validation and locked before the common population\-weighted test\.

Refreshing context raises relation population\-AUPRC from0\.0049550\.004955to0\.0057780\.005778, a16\.6%16\.6\\%improvement, and AUROC from0\.97090\.9709to0\.97220\.9722\(Table[2](https://arxiv.org/html/2609.18163#S3.T2)\)\. Both metrics improve in all three paired seeds\. AUROC measures overall ranking; population\-weighted AUPRC emphasizes precision when retrieving rare future relations\. The frozen variant already receives new connections and recent interactions; refreshing context adds useful evidence about concept usage beyond these structural updates\. The gain supports aligning concept usage with graph evidence at the prediction time\.

## 4Conclusion

We presented a time\-aligned evolving concept graph framework that uses dated papers as shared update events for semantic and structural states\. With architecture and training held fixed, refreshing context yields16\.6%16\.6\\%higher AUPRC than frozen context, with both relation metrics improving across three paired seeds\. Newly observed concept usage adds forecasting evidence beyond updated graph structure and recent interactions\. The complete framework improves relation population\-AUPRC by70\.7%70\.7\\%over the strongest evaluated baseline\.

## References

- \[1\]I\. Beltagy, K\. Lo, and A\. Cohan\(2019\)SciBERT: a pretrained language model for scientific text\.InProceedings of the 2019 Conference on Empirical Methods in Natural Language Processing \(EMNLP\-IJCNLP\),pp\. 3615–3620\.Cited by:[§3\.1](https://arxiv.org/html/2609.18163#S3.SS1.p3.1)\.
- \[2\]W\. Cong, S\. Zhang, J\. Kang, B\. Yuan, H\. Wu, X\. Zhou, H\. Tong, and M\. Mahdavi\(2023\)Do we really need complicated model architectures for temporal networks?\.InInternational Conference on Learning Representations \(ICLR\),Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p2.1),[§2\.3](https://arxiv.org/html/2609.18163#S2.SS3.p3.1),[Table 1](https://arxiv.org/html/2609.18163#S3.T1.5.4.1.1)\.
- \[3\]J\. Gastinger, C\. Meilicke, F\. Errica, T\. Sztyler, A\. Schuelke, and H\. Stuckenschmidt\(2024\)History repeats itself: a baseline for temporal knowledge graph forecasting\.InProceedings of the Thirty\-Third International Joint Conference on Artificial Intelligence \(IJCAI\),pp\. 4016–4024\.External Links:[Document](https://dx.doi.org/10.24963/ijcai.2024/444)Cited by:[§3\.1](https://arxiv.org/html/2609.18163#S3.SS1.p3.1)\.
- \[4\]W\. L\. Hamilton, J\. Leskovec, and D\. Jurafsky\(2016\)Diachronic word embeddings reveal statistical laws of semantic change\.InProceedings of the 54th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),Berlin, Germany,pp\. 1489–1501\.External Links:[Document](https://dx.doi.org/10.18653/v1/P16-1141)Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p2.1)\.
- \[5\]W\. L\. Hamilton, R\. Ying, and J\. Leskovec\(2017\)Inductive representation learning on large graphs\.Advances in Neural Information Processing Systems \(NeurIPS\)30,pp\. 1024–1034\.Cited by:[§2\.3](https://arxiv.org/html/2609.18163#S2.SS3.p2.1)\.
- \[6\]Y\. Jeong and E\. Kim\(2022\)SciDeBERTa: learning DeBERTa for science technology documents and fine\-tuning information extraction tasks\.IEEE Access10,pp\. 60805–60813\.External Links:[Document](https://dx.doi.org/10.1109/ACCESS.2022.3180830)Cited by:[§2\.2](https://arxiv.org/html/2609.18163#S2.SS2.p1.1)\.
- \[7\]W\. Jin, M\. Qu, X\. Jin, and X\. Ren\(2020\)Recurrent event network: autoregressive structure inference over temporal knowledge graphs\.InProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing \(EMNLP\),pp\. 6669–6683\.Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p2.1)\.
- \[8\]M\. Krenn, L\. Buffoni, B\. Coutinho, S\. Eppel, J\. G\. Foster, A\. Gritsevskiy, H\. Lee, Y\. Lu, J\. P\. Moutinho, N\. Sanjabi, R\. Sonthalia, N\. M\. Tran, F\. Valente, Y\. Xie, R\. Yu, and M\. Kopp\(2023\)Forecasting the future of artificial intelligence with machine learning\-based link prediction in an exponentially growing knowledge network\.Nature Machine Intelligence5\(11\),pp\. 1326–1335\.Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p1.1)\.
- \[9\]M\. Krenn and A\. Zeilinger\(2020\)Predicting research trends with semantic and neural networks with an application in quantum physics\.Proceedings of the National Academy of Sciences117\(4\),pp\. 1910–1916\.Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p1.1)\.
- \[10\]T\. Marwitz, A\. Colsmann, B\. Breitung,et al\.\(2026\)Predicting new research directions in materials science using large language models and concept graphs\.Nature Machine Intelligence8,pp\. 535–544\.External Links:[Document](https://dx.doi.org/10.1038/s42256-026-01206-y)Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p1.1),[§1](https://arxiv.org/html/2609.18163#S1.p2.1),[§3\.1](https://arxiv.org/html/2609.18163#S3.SS1.p3.1),[Table 1](https://arxiv.org/html/2609.18163#S3.T1.5.2.1.1)\.
- \[11\]E\. Rossi, B\. Chamberlain, F\. Frasca, D\. Eynard, F\. Monti, and M\. Bronstein\(2020\)Temporal graph networks for deep learning on dynamic graphs\.External Links:2006\.10637Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p2.1)\.
- \[12\]M\. Schlichtkrull, T\. N\. Kipf, P\. Bloem, R\. van den Berg, I\. Titov, and M\. Welling\(2018\)Modeling relational data with graph convolutional networks\.InThe Semantic Web – ESWC 2018,pp\. 593–607\.Cited by:[§2\.3](https://arxiv.org/html/2609.18163#S2.SS3.p2.1)\.
- \[13\]D\. R\. Swanson\(1986\)Undiscovered public knowledge\.The Library Quarterly56\(2\),pp\. 103–118\.Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p2.1)\.
- \[14\]I\. O\. Tolstikhin, N\. Houlsby, A\. Kolesnikov, L\. Beyer, X\. Zhai, T\. Unterthiner, J\. Yung, A\. Steiner, D\. Keysers, J\. Uszkoreit, M\. Lucic, and A\. Dosovitskiy\(2021\)MLP\-Mixer: an all\-MLP architecture for vision\.InAdvances in Neural Information Processing Systems \(NeurIPS\),Vol\.34\.Cited by:[§2\.3](https://arxiv.org/html/2609.18163#S2.SS3.p3.1)\.
- \[15\]V\. Tshitoyan, J\. Dagdelen, L\. Weston, A\. Dunn, Z\. Rong, O\. Kononova, K\. A\. Persson, G\. Ceder, and A\. Jain\(2019\)Unsupervised word embeddings capture latent knowledge from materials science literature\.Nature571\(7763\),pp\. 95–98\.Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p2.1)\.
- \[16\]D\. Xu, C\. Ruan, E\. Korpeoglu, S\. Kumar, and K\. Achan\(2020\)Inductive representation learning on temporal graphs\.External Links:2002\.07962Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p2.1)\.
- \[17\]L\. Yu, L\. Sun, B\. Du, and W\. Lv\(2023\)Towards better dynamic graph learning: new architecture and unified library\.InAdvances in Neural Information Processing Systems \(NeurIPS\),Vol\.36\.Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p2.1),[Table 1](https://arxiv.org/html/2609.18163#S3.T1.5.3.1.1)\.
- \[18\]J\. Zhang, J\. Chen, M\. Yang, A\. Feng, S\. Liang, J\. Shao, and R\. Ying\(2024\)DTGB: a comprehensive benchmark for dynamic text\-attributed graphs\.InAdvances in Neural Information Processing Systems \(NeurIPS\), Datasets and Benchmarks Track,Vol\.37\.Cited by:[§1](https://arxiv.org/html/2609.18163#S1.p2.1)\.

Similar Articles

Graph-Native Reinforcement Learning Enables Traceable Scientific Hypothesis Generation through Conceptual Recombination

arXiv cs.AI

This paper introduces Graph-PRefLexOR, a family of graph-native reasoning models fine-tuned with group relative policy optimization (GRPO) to generate traceable scientific hypotheses through explicit reasoning phases. The method achieves 40-65% improvements over base models in reasoning traceability and demonstrates enhanced semantic diversity and conceptual recombination.

Dynamic Link Prediction with Temporally Enhanced Signed Graph Neural Networks

arXiv cs.LG

This paper proposes a modular temporal enhancement framework for signed graph neural networks that integrates historical context via a Historical Context Integration Module (HCIM) with LSTM and multi-head temporal attention, achieving consistent improvements on real-world temporal signed networks for dynamic link prediction.