PluRel-to-RDB-PFN: Schema-Guided Synthetic Relational Pretraining
摘要
This paper explores using the PluRel synthetic relational database generator as an external data source for pretraining RDB-PFN, a relational in-context learner, demonstrating that schema-guided curriculum design can recover most of the original performance with far fewer pretraining tasks.
查看缓存全文
缓存时间: 2026/08/03 07:36
# PluRel-to-RDB-PFN: Schema-Guided Synthetic Relational Pretraining
Source: [https://arxiv.org/html/2607.29129](https://arxiv.org/html/2607.29129)
> Abstract\.Relational Foundation Models \(RFMs\) require large\-scale synthetic relational databases for pretraining, but existing approaches tightly couple data generation with the model training pipeline\. We study whether PluRel, a general\-purpose synthetic relational database generator, can serve as an external data source for RDB\-PFN,a relational in\-context learner originally pretrained with a 600K\-task single\-table warm\-up followed by a∼1\.8\{\\sim\}1\.8M\-task adaptation stage\. We build a conversion pipeline that maps PluRel\-generated databases—including externally constructed binary prediction tasks—into the RDB\-PFN training format and evaluate three curriculum strategies:Schema\-Guided First\(real\-world schema then fully synthetic\),Fully Synthetic\(diverse synthetic schemas throughout\), andSchema\-Guided Last\(fully synthetic then real\-world schema\)\. Using only∼5,500\{\\sim\}5\{,\}500relational databases \(∼33\{\\sim\}33K tasks\)—roughly55×55\\timesfewer tasks than the original protocol—and no single\-table warm\-up, our best curriculum \(Schema\-Guided First\) achieves0\.63460\.6346average ROC\-AUC across 19 real benchmark tasks at 1024\-shot context, recovering 87\.6% of the published RDB\-PFN performance \(0\.72450\.7245\)\. At 64\-shot context, the gap narrows to 93\.8% \(0\.61160\.6116vs\.0\.65170\.6517\)\. Our results demonstrate that external synthetic generators can provide useful pretraining signals for RFMs when combined with appropriate curriculum design and that exposure to a real\-world schema early in training is substantially more effective than late\-stage schema adaptation\.
## 1Introduction
Relational databases are the dominant data substrate in modern enterprises, yet building foundation models for relational prediction remains difficult\. The natural pretraining corpus—large, diverse, real\-world databases—is rarely available due to privacy, sensitivity, and schema heterogeneity\. Recent work on Relational Foundation Models \(RFMs\) has therefore turned to synthetic data generation to bypass this bottleneck\.
RDB\-PFN\(Wanget al\.,[2026](https://arxiv.org/html/2607.29129#bib.bib1)\)demonstrates that a lightweight in\-context learner can be trained entirely on synthetic relational tasks generated from a structured prior\. Its pipeline generates databases using a learned relational prior \(LayerDAG schemas, selective SCMs, bidirectional GNN content\), linearizes them via Deep Feature Synthesis \(DFS\), and trains a Transformer to perform relational binary classification without gradient updates at test time\. Separately, PluRel\(Kothapalliet al\.,[2026](https://arxiv.org/html/2607.29129#bib.bib2)\)proposes a general\-purpose framework for generating synthetic multi\-table databases by sampling schemas via graph models, foreign\-key connectivity via hierarchical stochastic block models, and row\-level features via structural causal models\. A key practical distinction is that RDB\-PFN’s generator jointly produces databases, features,*and*prediction tasks, but does not accept user\-specified schemas\. PluRel generates only databases—task construction must be added externally—but it can generate data under any user\-provided SQL schema\.
This paper studies whether these two systems can be connected\. We ask two practical questions:
> *\(1\) Can PluRel\-generated relational databases, converted into the RDB\-PFN training format, provide useful pretraining signals for relational in\-context learning?* *\(2\) Does the schema flexibility of PluRel — in particular, the ability to generate data under a fixed real\-world schema — reduce the need for the massive pretraining corpus used in the original RDB\-PFN protocol?*
To make this possible, we build a conversion pipeline that maps PluRel\-generated databases into the RDB\-PFN preprocessing stack\. Since PluRel generates data but not prediction tasks, a critical component of our pipeline is the external construction of binary classification tasks from each synthetic database\. We then apply the official RDB\-PFN DFS preprocessing and train the RDB\-PFN architecture on the resulting relational tasks\.
Our experiments investigate three curriculum strategies that differ in whether and where a fixed real\-world schema \(derived from an enterprise system\) is introduced during training\. This design allows us to ask:*Does exposure to a real\-world schema help at all? Is it more effective at the beginning or at the end of training? Or is a fully synthetic curriculum sufficient?*We also train the RDB\-PFN architecture independently on each data pool \(standalone pretraining\) to isolate the contribution of individual curriculum stages\.
The scale difference is substantial: the original RDB\-PFN protocol trains on∼600\{\\sim\}600K single\-table tasks followed by∼1\.2\{\\sim\}1\.2M relational tasks \(∼1\.8\{\\sim\}1\.8M total\)\.
Our experiments use only∼5,500\{\\sim\}5\{,\}500relational databases producing∼33\{\\sim\}33K tasks—roughly55×55\\timesfewer—with no single\-table warm\-up\. Despite this, our best curriculum recovers 87\.6% of the published performance at 1024\-shot context and 93\.8% at 64\-shot context, suggesting that schema\-guided synthetic generation can partially compensate for scale\.
#### Contributions\.
1. 1\.A PluRel\-to\-RDB\-PFN pretraining pipelinethat converts PluRel\-generated relational databases into the RDB\-PFN training format, including external binary task construction, DFS linearization, and HDF5 assembly\.
2. 2\.A curriculum study on schema realism and synthetic diversity,comparing three strategies \(Schema\-Guided First, Fully Synthetic, Schema\-Guided Last\) and four standalone baselines\. Our results show that beginning with a real\-world schema anchor and then progressing to diverse synthetic schemas is substantially more effective than the reverse order or fully synthetic training alone\.
3. 3\.Empirical evaluation on 19 real\-world relational tasksdemonstrates that∼55×\{\\sim\}55\\timesless training data can recover 87\.6–93\.8% of the published RDB\-PFN performance when curriculum order and schema realism are appropriately designed\.
## 2Background
#### Relational foundation models and synthetic pretraining\.
Recent work extends the synthetic\-data paradigm of tabular foundation models such as TabPFN\(Hollmannet al\.,[2022](https://arxiv.org/html/2607.29129#bib.bib4)\)to relational databases\. RDB\-PFN\(Wanget al\.,[2026](https://arxiv.org/html/2607.29129#bib.bib1)\)frames relational prediction as in\-context learning: each synthetic RDB is linearized with DFS into a fixed\-width table, and a lightweight bidirectional Transformer with column\-wise and row\-wise attention predicts query labels from labeled context rows without gradient updates\. Its full protocol is substantially larger than ours: a 600K\-task single\-table warm\-up followed by a Stage\-2 corpus of roughly 1\.8M tasks, including about 600K additional single\-table tasks and 1\.2M relational tasks\. Our work keeps the RDB\-PFN architecture and preprocessing pipeline, but replaces its native relational generator with PluRel\-generated RDBs and removes the single\-table warm\-up\.
#### Synthetic relational database generation\.
PluRel\(Kothapalliet al\.,[2026](https://arxiv.org/html/2607.29129#bib.bib2)\)generates synthetic RDBs from scratch through schema sampling, primary–foreign key connectivity, and SCM\-based feature generation\. Schemas are sampled from random graph families such as Barabási–Albert, Watts–Strogatz, and reverse random trees; foreign keys are generated with hierarchical stochastic block models; and row features are produced by structural causal mechanisms conditioned on parent\-table information\. Unlike RDB\-PFN’s native generator, PluRel can also generate data under a fixed user\-specified schema, making it useful for schema\-guided pretraining\. However, PluRel generates databases rather than prediction tasks, so our pipeline adds binary task construction before DFS preprocessing\.
#### Relational benchmarks and alternative generators\.
RelBench\(Robinsonet al\.,[2024](https://arxiv.org/html/2607.29129#bib.bib3)\)provides standardized real\-world relational prediction tasks, while graph\-native RFMs such as griffin\(Wanget al\.,[2025](https://arxiv.org/html/2607.29129#bib.bib5)\)operate directly on heterogeneous relational graphs\. Other synthetic multi\-table generators include diffusion\-based methods such as ClavaDDPM\(Panget al\.,[2024](https://arxiv.org/html/2607.29129#bib.bib7)\)and RelDiff\(Hudoverniket al\.,[2025](https://arxiv.org/html/2607.29129#bib.bib9)\), and graph\-oriented synthetic pretraining approaches such as GraphPFN\(Eremeevet al\.,[2025](https://arxiv.org/html/2607.29129#bib.bib6)\)\. Our study is complementary: rather than proposing a new model architecture, we test whether an external synthetic RDB generator can be plugged into an existing RDB\-PFN\-style relational in\-context learning pipeline\.
## 3Method
### 3\.1PluRel\-to\-RDB\-PFN Pipeline
Our pipeline converts PluRel\-generated databases into RDB\-PFN\-compatible training data through five stages:
\(1\) Database generation\.We use PluRel’sSyntheticDatasetAPI under two modes\. In*schema\-guided*mode, we provide a fixed SQL schema derived from a real\-world enterprise ERP system \(RelBench’s rel\-salt dataset: 4 tables, 31 columns, 6 FK edges\), and PluRel generates synthetic row\-level data under this schema\. In*fully synthetic*mode, PluRel samples both schemas and data with configurable parameters\. We use three fully synthetic configurations:*Small1*\(2–4 tables, 1\-hop DFS\),*Small2*\(2 to 4 tables, 2\-hop DFS\), and*Large*\(5–8 tables, 1\-hop DFS\), with 5 to 15 columns, 50 to 200 entity rows, and 150 to 450 activity rows per table\. We encode all columns as INTEGER/FLOAT \(PluRel’s type constraint\), patch the SCM propagation to handle zero\-FK\-connection edge cases, and apply rank\-based normalization to restore realistic temporal distributions\.
\(2\) Binary task construction\.For each database, we select up to 6 candidate target columns, preferring columns that are naturally binary\. Otherwise, we binarize suitable categorical or numeric columns via median splits\. Each task defines a target table, target column, and entity identifier\.
\(3\) Relational export\.Each database–task pair is exported in the DBInfer format expected by RDB\-PFN’s preprocessing stack\.
\(4\) DFS linearization\.We apply the official RDB\-PFN DFS pipeline to produce fixed\-width tabular representations encoding multi\-hop relational features\.
\(5\) Training data assembly\.The DFS\-processed tasks are merged into HDF5 training files compatible with the RDB\-PFN training loop\.
### 3\.2Curriculum Strategies
We define four database pools, listed with their sizes:
- •Schema\-Guided \(SG\): 500 databases were generated under the fixed real\-world ERP schema\.
- •Small1: 3,000 fully synthetic databases \(2–4 tables, 1\-hop DFS\)\.
- •Small2: 1,000 fully synthetic databases \(2–4 tables, 2\-hop DFS\)\.
- •Large: 1,000 fully synthetic databases \(5–8 tables, 1\-hop DFS\)\.
The total corpus is∼5,500\{\\sim\}5\{,\}500databases with up to 6 tasks each, yielding∼33\{\\sim\}33K tasks\. For comparison, the original RDB\-PFN protocol uses∼1\.8\{\\sim\}1\.8M tasks \(55×55\\timeslarger\)\. Table[1](https://arxiv.org/html/2607.29129#S3.T1)summarizes this comparison\.
Table 1:Pretraining data comparison\. Our PluRel\-based pipeline uses∼55×\{\\sim\}55\\timesfewer tasks and no single\-table warm\-up compared to the original RDB\-PFN protocol\.We evaluate three multi\-stage curricula, training each stage sequentially:
Schema\-Guided First\(SGF\):SG→\\toSmall1→\\toSmall2→\\toLarge\. The model first learns from a fixed real\-world schema with PluRel\-generated content, and then encounters progressively more diverse synthetic schemas\.
Fully Synthetic\(FS\):Small1→\\toSmall2 \(→\\toLarge\)\. Both schemas and data are fully synthetic throughout\.
Schema\-Guided Last\(SGL\):Small1→\\toSmall2→\\toLarge→\\toSG\. The model trains on diverse synthetic data first, then adapts to the fixed real\-world schema\.
Additionally, we train the RDB\-PFN architecture independently on each data pool asstandalone baselines\(SG only, Small1 only, Small2 only, Large only\) to isolate the contribution of individual stages\.
## 4Experiments
### 4\.1Setup
#### Architecture and training\.
All models use the RDB\-PFN Transformer backbone \(6 layers, 128 dims, 4 heads, 2\.6M parameters\) with Schedule\-Free AdamW \(learning rate5×10−45\\times 10^\{\-4\}\), fixed context of 600 rows×\\times30 columns\. Each curriculum stage trains for 20K–50K steps\.
#### Evaluation\.
We evaluate 19 binary classification tasks from RelBench\(Robinsonet al\.,[2024](https://arxiv.org/html/2607.29129#bib.bib3)\)and DBInfer\(Wanget al\.,[2024](https://arxiv.org/html/2607.29129#bib.bib8)\), spanning e\-commerce \(rel\-amazon, rel\-avito, Amazon, RetailRocket\), social networks \(rel\-stack, StackExchange\), sports \(rel\-f1\), fashion \(rel\-hm\), clinical trials \(rel\-trial\), events \(rel\-event\), and advertising \(Diginetica, Outbrain, AVS\)\. All tasks use ROC\-AUC, evaluated at context sizes 64 and 1024 with 10 random seeds\.
### 4\.2Results
#### Main results\.
Table[2](https://arxiv.org/html/2607.29129#S4.T2)summarizes the average ROC\-AUC across all 19 tasks\. TheSchema\-Guided Firstcurriculum achieves the strongest results: 0\.6346 at 1024\-shot and 0\.6116 at 64\-shot\.Fully Syntheticis competitive at 64\-shot \(0\.6028\) but falls behind at 1024\-shot \(0\.6102\)\.Schema\-Guided Lastperforms substantially worse \(0\.5544/0\.5729\), suggesting that introducing a fixed real\-world schema*after*diverse synthetic training does not help and may overwrite previously learned patterns\.
Table 2:Average ROC\-AUC across 19 binary classification tasks\.Bold: best non\-reference result\.†Published RDB\-PFN results using∼55×\{\\sim\}55\\timesmore training data including 600K single\-table warm\-up tasks\.
#### Standalone pretraining is insufficient\.
No single data pool exceeds an average ROC\-AUC of 0\.58 \(Table[2](https://arxiv.org/html/2607.29129#S4.T2), bottom\)\. Small2 \(2\-hop DFS\) is the strongest standalone pool \(0\.5772 at 1024\-shot\), likely because 2\-hop features expose richer relational dependencies\. Large databases alone perform the worst \(0\.5258\), suggesting that complex schemas are too noisy without simpler relational stages as a foundation\.
#### Curriculum order matters substantially\.
Schema\-Guided FirstoutperformsFully Syntheticby 2\-3 points andSchema\-Guided Lastby 5\-6 points\. Starting from a fixed real\-world schema appears to provide a stable relational anchor—consistent table counts, stable FK patterns, and realistic column semantics—that enables the model to subsequently benefit from diverse synthetic schemas\. Introducing the real\-world schema*after*fully synthetic training \(Schema\-Guided Last\) yields no improvement over the synthetic\-only curriculum, suggesting that late\-stage schema adaptation is ineffective or causes catastrophic forgetting\.
#### Context\-size analysis\.
Our results strongly support the observation that context size changes the interpretation of performance\. At 64\-shot, the gap betweenSchema\-Guided Firstand the published RDB\-PFN is only−0\.0401\-0\.0401\(93\.8% recovery\)\. At 1024\-shot, the gap widens to−0\.0899\-0\.0899\(87\.6% recovery\)\. This suggests that PluRel\-based pretraining captures short\-context relational patterns effectively, while the original RDB\-PFN generator—with its bidirectional GNN content completion and55×55\\timeslarger corpus—provides stronger long\-context structural generalization\.
#### Per\-task analysis\.
Table[3](https://arxiv.org/html/2607.29129#S4.T3)shows per\-task results for the best curriculum \(Schema\-Guided First\) at 1024\-shot alongside published RDB\-PFN references\.
Our model achieves 0\.8535 on StackExchange/upvote \(exceeding RDB\-PFN’s 0\.8527\) and is competitive on RetailRocket/CVR \(0\.7420 vs\. 0\.7708\), rel\-stack/user\-badge \(0\.8005 vs\. 0\.8126\), and rel\-f1/driver\-top3 \(0\.7488 vs\. 0\.8115\)\. The largest gaps appear on tasks requiring fine\-grained relational reasoning: Amazon/churn \(−0\.25\-0\.25\), Diginetica/CTR \(−0\.18\-0\.18\), and rel\-event/user\-ignore \(−0\.16\-0\.16\)\.
Table 3:Per\-task ROC\-AUC at 1024\-shot context\. SGF =Schema\-Guided First\(this work\)\.†Published RDB\-PFN\. Tasks where SGF matches or exceeds RDB\-PFN are marked\.
## 5Discussion
#### Why does Schema\-Guided First work best?
We hypothesize that a fixed real\-world schema provides a structured relational inductive bias early in training: stable table counts, consistent FK patterns, and realistic column semantics\. This mirrors findings in curriculum learning\(Bengioet al\.,[2009](https://arxiv.org/html/2607.29129#bib.bib10)\), where starting with cleaner, more structured examples accelerates convergence and improves final performance\. The subsequent transition to diverse synthetic schemas then broadens the model’s generalization without destabilizing the relational reasoning acquired in the first stage\.
#### What does the data\-scale gap reveal?
The fact that∼33\{\\sim\}33K PluRel tasks recover 87\.6–93\.8% of the performance achieved by∼1\.8\{\\sim\}1\.8M RDB\-PFN tasks suggests that the schema flexibility of PluRel—specifically, the ability to inject a real\-world schema—partially compensates for the much smaller corpus\. However, the widening gap at longer contexts \(1024 vs\. 64 shots\) indicates that the original RDB\-PFN generator, with its learned GNN content completion and far larger training set, produces richer inter\-table statistical dependencies that become informative when many labeled examples are available in context\.
#### Limitations\.
Our comparison is not scale\-matched: the original RDB\-PFN uses∼55×\{\\sim\}55\\timesmore training data, including a single\-table warm\-up stage\. PluRel’s restriction to INTEGER/FLOAT types means categorical and text features are approximated, potentially reducing downstream task fidelity\. Our task construction is external and heuristic; improving task generation may yield further gains\. Finally, we evaluate only binary classification; extending to regression and multi\-class tasks is future work\.
#### Future directions\.
Scaling PluRel generation to match the original RDB\-PFN data budget would clarify whether the remaining gap is due to generator quality or data scale\. Combining PluRel’s schema flexibility with RDB\-PFN’s content generation \(e\.g\., using PluRel for schema/FK stages and a GNN for feature completion\) is a promising hybrid direction\. Extending schema\-guided generation to multiple real\-world schemas \(e\.g\., from other RelBench datasets\) could further improve curriculum diversity\.
## 6Conclusion
We have shown that PluRel, a general\-purpose synthetic relational database generator, can serve as an external data source for RDB\-PFN\-style relational in\-context learning\. Using only∼33\{\\sim\}33K relational tasks—55×55\\timesfewer than the original protocol—and no single\-table warm\-up, our best curriculum recovers 87\.6–93\.8% of the published RDB\-PFN performance across 19 real\-world tasks\. The central finding is that*curriculum ordering and schema realism matter*: beginning with a real\-world schema anchor and progressively introducing synthetic diversity substantially outperforms the reverse order and fully synthetic alternatives\. These results suggest that the data generation and model training components of relational foundation models can be productively decoupled, enabling schema\-controlled, privacy\-preserving synthetic pretraining for enterprise relational data\.
## References
- Y\. Bengio, J\. Louradour, R\. Collobert, and J\. Weston \(2009\)Curriculum learning\.InProceedings of the 26th annual international conference on machine learning,pp\. 41–48\.Cited by:[§5](https://arxiv.org/html/2607.29129#S5.SS0.SSS0.Px1.p1.1)\.
- D\. Eremeev, O\. Platonov, G\. Bazhenov, A\. Babenko, and L\. Prokhorenkova \(2025\)GraphPFN: a prior\-data fitted graph foundation model\.arXiv preprint arXiv:2509\.21489\.Cited by:[§2](https://arxiv.org/html/2607.29129#S2.SS0.SSS0.Px3.p1.1)\.
- N\. Hollmann, S\. Müller, K\. Eggensperger, and F\. Hutter \(2022\)Tabpfn: a transformer that solves small tabular classification problems in a second\.arXiv preprint arXiv:2207\.01848\.Cited by:[§2](https://arxiv.org/html/2607.29129#S2.SS0.SSS0.Px1.p1.1)\.
- V\. Hudovernik, M\. Xu, J\. Shi, L\. Šubelj, S\. Ermon, E\. Štrumbelj, and J\. Leskovec \(2025\)RelDiff: relational data generative modeling with graph\-based diffusion models\.arXiv preprint arXiv:2506\.00710\.Cited by:[§2](https://arxiv.org/html/2607.29129#S2.SS0.SSS0.Px3.p1.1)\.
- V\. Kothapalli, R\. Ranjan, V\. Hudovernik, V\. P\. Dwivedi, J\. Hoffart, C\. Guestrin, and J\. Leskovec \(2026\)PluRel: synthetic data unlocks scaling laws for relational foundation models\.arXiv preprint arXiv:2602\.04029\.Cited by:[§1](https://arxiv.org/html/2607.29129#S1.p2.1),[§2](https://arxiv.org/html/2607.29129#S2.SS0.SSS0.Px2.p1.1)\.
- W\. Pang, M\. Shafieinejad, L\. Liu, S\. Hazlewood, and X\. He \(2024\)Clavaddpm: multi\-relational data synthesis with cluster\-guided diffusion models\.Advances in Neural Information Processing Systems37,pp\. 83521–83547\.Cited by:[§2](https://arxiv.org/html/2607.29129#S2.SS0.SSS0.Px3.p1.1)\.
- J\. Robinson, R\. Ranjan, W\. Hu, K\. Huang, J\. Han, A\. Dobles, M\. Fey, J\. E\. Lenssen, Y\. Yuan, Z\. Zhang,et al\.\(2024\)Relbench: a benchmark for deep learning on relational databases\.Advances in Neural Information Processing Systems37,pp\. 21330–21341\.Cited by:[§2](https://arxiv.org/html/2607.29129#S2.SS0.SSS0.Px3.p1.1),[§4\.1](https://arxiv.org/html/2607.29129#S4.SS1.SSS0.Px2.p1.1)\.
- M\. Wang, Q\. Gan, D\. Wipf, Z\. Cai, N\. Li, J\. Tang, Y\. Zhang, Z\. Zhang, Z\. Mao, Y\. Song,et al\.\(2024\)4dbinfer: a 4d benchmarking toolbox for graph\-centric predictive modeling on relational dbs\.arXiv preprint arXiv:2404\.18209\.Cited by:[§4\.1](https://arxiv.org/html/2607.29129#S4.SS1.SSS0.Px2.p1.1)\.
- Y\. Wang, X\. Wang, Q\. Gan, M\. Wang, Q\. Yang, D\. Wipf, and M\. Zhang \(2025\)Griffin: towards a graph\-centric relational database foundation model\.arXiv preprint arXiv:2505\.05568\.Cited by:[§2](https://arxiv.org/html/2607.29129#S2.SS0.SSS0.Px3.p1.1)\.
- Y\. Wang, J\. You, C\. Shi, and M\. Zhang \(2026\)Relational in\-context learning via synthetic pre\-training with structural prior\.arXiv preprint arXiv:2603\.03805\.Cited by:[§1](https://arxiv.org/html/2607.29129#S1.p2.1),[§2](https://arxiv.org/html/2607.29129#S2.SS0.SSS0.Px1.p1.1)\.
## Appendix AGenerated Database Statistics
This appendix reports summary statistics for the PluRel\-generated relational databases used in our experiments\. The fully synthetic corpora are generated with both synthetic schemas and synthetic table contents\. The schema\-guided corpora use a fixed real\-world\-inspired schema, while all table contents are still generated by PluRel\. TheD\_Large1\_1000statistics appeared twice in the raw logs with identical values; we include them once\.
Table 4:Global statistics of the generated relational database corpora before task augmentation and DFSpreprocessing\. SG denotes the schema\-guided corpus; S1, S2, and L1 denote Small1, Small2, and Large1 fully synthetic corpora\.Table 5:Detailed distributional statistics of the generated corpora\. Values are reported as min–max; mean±\\pmstandard deviation\.The main long curricula use the first four corpora in[4](https://arxiv.org/html/2607.29129#A1.T4), totaling 5,467 generated relational databases with 5\.97M rows and 215K columns before task augmentation\. Including the schema\-guided pilot corpus, the full generated collection contains 5,477 databases with 6\.02M rows and 215K columns\.
## Appendix BExtended Results
This appendix provides extended ROC\-AUC results for standalone pretraining and the three curriculum families\. SG denotes schema\-guided PluReldata, where the schema is fixed to a real\-world\-inspired schema and table contents are generated by PluRel\. S1, S2, and L1 denote Small1, Small2, and Large1 fully synthetic PluRelcorpora\. When a run was repeated with a longer training schedule, we report the better average result and omit repeat identifiers for readability\.
### B\.1Aggregate Results
Table 6:Aggregate extended results across 19 real relational binary classification tasks\. The gap column reports the difference from the published RDB\-PFNreference at the same context size\. The SG\-only 32\-shot row has no corresponding RDB\-PFNreference and is included for completeness\.FamilyTraining stageContextStepsAvg\. ROC\-AUCGap to RDB\-PFNSchema\-guided onlySG32150,0000\.5431–Schema\-guided onlySG1024150,0000\.5571\-0\.1674StandaloneS16420,0000\.5146\-0\.1371StandaloneS1102420,0000\.5275\-0\.1970StandaloneS26420,0000\.5572\-0\.0945StandaloneS2102420,0000\.5772\-0\.1473StandaloneL16420,0000\.5112\-0\.1405StandaloneL1102420,0000\.5258\-0\.1987SG→\\rightarrowFully SyntheticSG→\\rightarrowS16450,0000\.6063\-0\.0454SG→\\rightarrowFully SyntheticSG→\\rightarrowS1102450,0000\.6138\-0\.1107SG→\\rightarrowFully SyntheticSG→\\rightarrowS1→\\rightarrowS264100,0000\.6071\-0\.0446SG→\\rightarrowFully SyntheticSG→\\rightarrowS1→\\rightarrowS21024100,0000\.6341\-0\.0904SG→\\rightarrowFully SyntheticSG→\\rightarrowS1→\\rightarrowS2→\\rightarrowL164100,0000\.6116\-0\.0401SG→\\rightarrowFully SyntheticSG→\\rightarrowS1→\\rightarrowS2→\\rightarrowL11024100,0000\.6346\-0\.0899Fully SyntheticS1→\\rightarrowS26450,0000\.6028\-0\.0489Fully SyntheticS1→\\rightarrowS2102450,0000\.6102\-0\.1143Fully SyntheticS1→\\rightarrowS2→\\rightarrowL164100,0000\.5701\-0\.0816Fully SyntheticS1→\\rightarrowS2→\\rightarrowL11024100,0000\.5438\-0\.1807Fully Synthetic→\\rightarrowSGS1→\\rightarrowS2→\\rightarrowL1→\\rightarrowSG64100,0000\.5544\-0\.0973Fully Synthetic→\\rightarrowSGS1→\\rightarrowS2→\\rightarrowL1→\\rightarrowSG1024100,0000\.5729\-0\.1516Published RDB\-PFNreferenceOriginal RDB\-PFNprotocol64–0\.6517–Published RDB\-PFNreferenceOriginal RDB\-PFNprotocol1024–0\.7245–
### B\.2Task Abbreviations
Table 7:Task abbreviations used in the extended task\-wise result tables\.
### B\.3Task\-Wise Results at 64\-Shot Context
Table 8:Extended 64\-shot task\-wise ROC\-AUC results\.
### B\.4Task\-Wise Results at 1024\-Shot Context
Table 9:Extended 1024\-shot task\-wise ROC\-AUC results\.
### B\.5Standalone Schema\-Guided Pilot at 32\-Shot
The schema\-guided standalone model was also evaluated at 32\-shot context\. Its average ROC\-AUC was 0\.5431\. We do not use this row in the main 64\-shot comparison because it has a different context size, but we retain it here for completeness\.
Table 10:Schema\-guided standalone 32\-shot ROC\-AUC results\.相似文章
课程设计至关重要:基于合成数据的高效数据关系型PFN预训练
本文研究了课程设计和合成数据多样性如何影响关系型先验数据拟合网络(PFN)的预训练,结果表明渐进式课程可以用远少于RDB-PFN的合成数据达到或接近其性能。
ProPRL:教育知识图谱中的属性感知前置关系学习
ProPRL提出了一种属性感知的前置关系学习框架,用于教育知识图谱,结合概念-资源超图和有向行为图,采用自适应成对条件融合与不可逆性约束,实现了最先进的性能。
通过预测性导航进行深度研究预训练
介绍了深度研究预训练(DRP),一种离线框架,从引文和超链接证据结构中生成搜索-打开-撰写轨迹。在1B token上预训练的Qwen3-14B模型在深度研究基准测试中优于匹配的无DRP基线,即使使用较少的监督微调数据也是如此。
当表格基础模型遇到策略性表格数据:一种先验对齐方法
本文研究了基于预训练先验数据拟合网络的表格基础模型是否能够泛化到个体在部署后修改特征的策略性表格数据。提出了策略性先验数据拟合网络(SPN),这是一个无需重新训练即可将PFN预测与操纵后分布对齐的推理时框架。
TabPFN-3:技术报告
TabPFN-3 是一个新的表格数据基础模型,在合成数据上预训练,可扩展到 100 万训练行,同时减少训练和推理时间,在表格预测、时间序列和关系数据上实现了最先进的性能。