Beyond Distribution Matching: Semantics-Consistent Tabular Diffusion with Weak Semantic Priors
Summary
SCTab-Diff is a semantics-consistent tabular diffusion framework that uses weak semantic priors to generate high-fidelity synthetic tabular data, improving distributional fidelity and semantic consistency over existing methods.
View Cached Full Text
Cached at: 09/16/26, 08:38 AM
# Beyond Distribution Matching: Semantics-Consistent Tabular Diffusion with Weak Semantic Priors
Source: [https://arxiv.org/html/2609.16069](https://arxiv.org/html/2609.16069)
Yili Wang††thanks:Equal contribution\.Affiliation:School of Artificial Intelligence, Jilin University, Changchun, ChinaEmail:[yichang@jlu\.edu\.cn](mailto:)Ruxue Shi11footnotemark:1Affiliation:School of Artificial Intelligence, Jilin University, Changchun, ChinaEmail:[xinwang@jlu\.edu\.cn](mailto:)Mengnan DuAffiliation:School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen, ChinaYi Chang††thanks:Corresponding authors\.Affiliation:School of Artificial Intelligence, Jilin University, Changchun, ChinaXin Wang22footnotemark:2Affiliation:School of Artificial Intelligence, Jilin University, Changchun, China
###### Abstract
Synthetic tabular data can match real data distributions while still violating the semantic constraints that govern valid tabular rows\. This reveals a key limitation of existing tabular generators: they mainly optimize distributional fidelity, but do not explicitly model weak semantic priors encoded in tabular schema and textual descriptions\. In this paper, we propose SCTab\-Diff, a semantics\-consistent tabular diffusion framework for high\-fidelity synthetic data generation under weakly specified semantic priors\. SCTab\-Diff first constructs two types of priors, namely intra\-column semantics and inter\-column symbolic rules, with LLM\-assisted extraction from metadata and validation on the real training split\. These priors are then used as generation conditions rather than post\-hoc filters\. Specifically, SCTab\-Diff maps heterogeneous column values, column identities, and semantic priors into a unified semantic space, and performs column\-wise forward corruption and prior\-conditioned reverse denoising to preserve both marginal distributions and rule\-consistent cross\-column dependencies\. Extensive experiments on six real\-world tabular benchmarks show that SCTab\-Diff consistently improves distributional fidelity, semantic consistency, and downstream task utility over representative VAE\-, GAN\-, LLM\-, and diffusion\-based baselines\. Additional analyses further demonstrate the robustness of SCTab\-Diff when semantic priors are partially unavailable\. Code is[https://anonymous\.4open\.science/status/SCTab\-Diff\-B6DF](https://anonymous.4open.science/status/SCTab-Diff-B6DF)\.
## 1Introduction
High\-fidelity tabular generation is often reduced to distribution matching[Liu and Liu \(2024\)](https://arxiv.org/html/2609.16069#bib.bib33);[Schreyer et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib34), yet for tabular data,*distributional realism alone is not sufficient*[Shi et al\. \(2025\)](https://arxiv.org/html/2609.16069#bib.bib18)\. As illustrated in Fig\.[1](https://arxiv.org/html/2609.16069#S1.F1)\(a\), a synthetic tuple may appear statistically plausible while still being semantically invalid, for example by assigning an implausible education level to a child or producing values that violate basic cross\-column dependency rules\. Such errors are especially problematic in tabular domains because synthetic data is often reused in downstream pipelines, including data augmentation[Zhang et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib12);[Kotelnikov et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib9), privacy\-preserving data sharing[Wang et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib36);[Torfi et al\. \(2022\)](https://arxiv.org/html/2609.16069#bib.bib35), and model training or evaluation[He et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib1);[Sattarov et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib2);[Zhang et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib26)\. Therefore, realistic tabular generation should satisfy a stronger objective: generated samples should be both*distributionally faithful*and*semantically valid*\.
This requirement is fundamentally tied to the structure of tabular data\. Unlike images or text, a table is composed of semantically typed columns rather than interchangeable dimensions[Seedat et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib4)\. Each column exhibits its own marginal behavior, while valid tuples must also respect complex dependencies across columns[Kim et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib3)\. Moreover, the semantic knowledge needed to characterize valid tables is often only*weakly specified*\. As shown in Fig\.[1](https://arxiv.org/html/2609.16069#S1.F1)\(b\), intra\-column semantics are usually implicit in column names, tabular schema, and textual descriptions, whereas inter\-column validity is governed bysymbolic rulesthat are rarely explicitly annotated in standard tabular benchmarks\. This makes semantically valid tabular generation a substantially harder problem than pure distribution matching\.This motivates a stronger formulation of tabular generation:
Realistic tabular generation requires not only distributional fidelity, but also semantic validity under weakly specified constraints\.
Figure 1:From Distributional Fidelity to Semantically Valid Tabular Generation\.Yet this stronger objective is exactly where existing tabular generators fall short\. From VAE[Xu et al\. \(2019\)](https://arxiv.org/html/2609.16069#bib.bib5);[Ma et al\. \(2020\)](https://arxiv.org/html/2609.16069#bib.bib21);[Liu et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib22)and GAN[Choi et al\. \(2017\)](https://arxiv.org/html/2609.16069#bib.bib23);[Lee et al\. \(2021\)](https://arxiv.org/html/2609.16069#bib.bib24);[Zhao et al\. \(2021\)](https://arxiv.org/html/2609.16069#bib.bib25)based methods to recent diffusion models[Dhariwal and Nichol \(2021\)](https://arxiv.org/html/2609.16069#bib.bib27);[Ho et al\. \(2020\)](https://arxiv.org/html/2609.16069#bib.bib28);[Song et al\. \(2020\)](https://arxiv.org/html/2609.16069#bib.bib10);[Austin et al\. \(2021\)](https://arxiv.org/html/2609.16069#bib.bib19), most existing approaches still follow a*distribution\-centric*view of tabular synthesis: each row is treated as a holistic vector, and generation is optimized toward reproducing overall statistics\. Such a design is convenient for distribution modeling, but it leaves the generation process largely blind to the semantic structure of tabular data\. In particular, existing diffusion formulations corrupt and recover tabular samples without explicitly preserving column identity or conditioning denoising on weak semantic priors\. As a result, semantic consistency is treated as an implicit byproduct of distribution learning rather than an explicit generation objective\. This limitation is not merely an evaluation issue, but reflects a mismatch between the structure of tabular data and the way it is generated: a tabular row is a set of typed semantic attributes, while most generators model it as an untyped numerical vector\.
To bridge this gap, this paper studies*semantically valid tabular generation under weakly specified constraints*\. Rather than treating semantic knowledge as external rules for filtering generated samples, we make weak semantic priors part of the diffusion mechanism itself\. Specifically, these priors serve as conditioning signals for reverse\-time score estimation, so that denoising is guided by both statistical recovery and semantic consistency\. As shown in Fig\.[1](https://arxiv.org/html/2609.16069#S1.F1)\(c\), we construct two types of semantic priors from weak semantic sources:*intra\-column semantics*, which encode attribute meaning and value plausibility, and*inter\-column symbolic rules*, which capture explicit dependency constraints across attributes\. Candidate symbolic constraints are obtained from tabular schema and textual descriptions with the help of LLM\-based semantic extraction111The LLM used for semantic extraction does not access raw tabular records\. This design reduces the risk of memorizing or leaking sensitive record\-level entries from the original table\., and are further validated and refined using observed data\. Based on this formulation, we proposeSemantics\-ConsistentTabularDiffusion \(SCTab\-Diff\), which couples column\-wise diffusion with prior\-conditioned score estimation in a unified semantic space\. Within this space, column identity specifies what a noisy latent variable represents, row context specifies whether it is compatible with other attributes, and weak semantic priors specify which recoveries are semantically admissible\. This design enables SCTab\-Diff to generate synthetic tables that are both distributionally faithful and semantically consistent\.
Our main contributions are summarized as follows:
- •We formulate tabular generation beyond distribution matching, requiring synthetic tables to satisfy bothdistributional fidelityandsemantic validityunder weakly specified constraints\.
- •We introduce a weak semantic prior construction strategy that derivesintra\-column semanticsfor attribute\-level plausibility andinter\-column symbolic rulesfor cross\-attribute dependency validity from tabular schema and textual descriptions\.
- •We proposeSCTab\-Diff, a semantics\-consistent diffusion framework that treats weak semantic priors as generation conditions and injects them into score\-based denoising to preserve column identity and enforce rule\-consistent dependencies\.
- •Extensive experiments demonstrate improvements in distributional fidelity, semantic consistency, and downstream utility, with additional robustness under incomplete semantic priors\.
## 2Preliminaries
### 2\.1Problem Formulation
LetD=\{X,F\}D=\\\{X,F\\\}denote a tabular dataset, whereX=\{x\(m\)\}m=1MX=\\\{x^\{\(m\)\}\\\}\_\{m=1\}^\{M\}is the set of table rows andF=\{fi\}i=1nF=\\\{f\_\{i\}\\\}\_\{i=1\}^\{n\}is the set of column names\. Each rowx∈Xx\\in Xis represented asx=\(x1,…,xn\)x=\(x\_\{1\},\\dots,x\_\{n\}\), where theii\-th attributexix\_\{i\}corresponds to columnfif\_\{i\}\. Among thenncolumns,NnN\_\{n\}are numerical andNcN\_\{c\}are categorical, withNn\+Nc=nN\_\{n\}\+N\_\{c\}=n\.
In addition toDD, this work considers weak semantic sources, such as tabular schema and accompanying textual documentation, from which semantic priors are constructed:
P=\{Pintra,Pinter\}\.P=\\\{P^\{\\mathrm\{intra\}\},P^\{\\mathrm\{inter\}\}\\\}\.Here,PintraP^\{\\mathrm\{intra\}\}denotes intra\-column semantics andPinterP^\{\\mathrm\{inter\}\}denotes inter\-column symbolic rules\. The goal is to learn a generatorgθ\(D,P\)g\_\{\\theta\}\(D,P\)that produces synthetic samplesx^∈D^\\hat\{x\}\\in\\hat\{D\}that are both distributionally faithful toDDand semantically valid underPP\.
### 2\.2Score\-Based Diffusion Preliminaries
Score\-based diffusion models perturb data with noise and learn a score function to reverse the corruption process[Song et al\. \(2020\)](https://arxiv.org/html/2609.16069#bib.bib10);[Song and Ermon \(2020\)](https://arxiv.org/html/2609.16069#bib.bib11)\. This work adopts the variance exploding \(VE\) formulation[Song et al\. \(2020\)](https://arxiv.org/html/2609.16069#bib.bib10), where the forward perturbation admits the closed form:
xt=x0\+σ\(t\)ϵ,ϵ∼𝒩\(0,I\)\.x\_\{t\}=x\_\{0\}\+\\sigma\(t\)\\epsilon,\\qquad\\epsilon\\sim\\mathcal\{N\}\(0,I\)\.\(1\)The corresponding reverse\-time denoising process is:
dxt=−2σ˙\(t\)σ\(t\)∇xtlogpt\(xt\)dt\+2σ˙\(t\)σ\(t\)dw¯t\.\\mathrm\{d\}x\_\{t\}=\-2\\,\\dot\{\\sigma\}\(t\)\\sigma\(t\)\\nabla\_\{x\_\{t\}\}\\log p\_\{t\}\(x\_\{t\}\)\\,\\mathrm\{d\}t\+\\sqrt\{2\\,\\dot\{\\sigma\}\(t\)\\sigma\(t\)\}\\,\\mathrm\{d\}\\bar\{w\}\_\{t\}\.\(2\)whereptp\_\{t\}denotes the perturbed data distribution at timett, andw¯t\\bar\{w\}\_\{t\}is a standard reverse\-time Wiener process\. In this work, the VE formulation serves as the diffusion backbone of SCTab\-Diff, upon which semantics\-consistent tabular denoising is built\.
## 3Proposed method: SCTab\-Diff
The central idea of SCTab\-Diff is to turn weakly specified semantic knowledge into explicit generation conditions for tabular diffusion\. Unlike conventional tabular generators that mainly recover the data distribution from noisy samples, SCTab\-Diff conditions the reverse denoising process on semantic priors that describe both attribute\-level plausibility and cross\-attribute dependency rules\. As illustrated in Fig\.[2](https://arxiv.org/html/2609.16069#S3.F2), we first formalize these weak semantic priors as generation conditions, then reformulate score\-based diffusion to incorporate them into reverse\-time denoising, and finally instantiate the formulation in a unified semantic space for end\-to\-end tabular synthesis\.

Figure 2:An overview of SCTab\-Diff\.### 3\.1Weak Semantic Priors as Generation Conditions
The reverse diffusion process in SCTab\-Diff is guided by weak semantic priorsPP, which serve as generation conditions beyond distributional recovery\. These priors encode two complementary aspects of semantic consistency: attribute\-level plausibility and tuple\-level dependency validity\. Formally, we decomposePPas:
P=\{Pintra,Pinter\},Pintra=\{piintra\}i=1n,Pinter=\{rk\}k=1K\.P=\\\{P^\{\\mathrm\{intra\}\},P^\{\\mathrm\{inter\}\}\\\},\\qquad P^\{\\mathrm\{intra\}\}=\\\{p\_\{i\}^\{\\mathrm\{intra\}\}\\\}\_\{i=1\}^\{n\},\\qquad P^\{\\mathrm\{inter\}\}=\\\{r\_\{k\}\\\}\_\{k=1\}^\{K\}\.\(3\)
Intra\-column semantics\.Eachpiintrap\_\{i\}^\{\\mathrm\{intra\}\}describes the semantic validity of an individual columnfif\_\{i\}\. It defines the plausible value space of this column, such as numerical ranges, categorical domains, or domain\-specific value constraints\. These priors operate at the attribute level and prevent the generator from producing values that may be numerically possible but semantically implausible\.
Inter\-column symbolic rules\.Eachrk∈Pinterr\_\{k\}\\in P^\{\\mathrm\{inter\}\}captures a symbolic dependency among multiple columns:
rk:ϕk\(xi1,…,xis\)=1,r\_\{k\}:\\quad\\phi\_\{k\}\(x\_\{i\_\{1\}\},\\dots,x\_\{i\_\{s\}\}\)=1,\(4\)whereϕk\(⋅\)\\phi\_\{k\}\(\\cdot\)is a Boolean constraint function over a subset of columns\. These priors operate at the tuple level and constrain whether different attributes can co\-occur consistently, such as whether an education level is compatible with age or whether income is compatible with working hours\. GivenPP, a synthetic rowx^\\hat\{x\}is semantically valid if it satisfies both attribute\-level and tuple\-level priors:
x^∈𝒱\(P\)⟺x^i⊧piintra,∀i,andϕk\(x^\)=1,∀rk∈Pinter,\\hat\{x\}\\in\\mathcal\{V\}\(P\)\\Longleftrightarrow\\hat\{x\}\_\{i\}\\models p\_\{i\}^\{\\mathrm\{intra\}\},\\ \\forall i,\\quad\\text\{and\}\\quad\\phi\_\{k\}\(\\hat\{x\}\)=1,\\ \\forall r\_\{k\}\\in P^\{\\mathrm\{inter\}\},\(5\)where𝒱\(P\)\\mathcal\{V\}\(P\)denotes the semantic validity set induced by the weak semantic priors\. In practice,PPis rarely provided as explicit annotations in public tabular benchmarks\. We construct candidate priors from tabular schema and textual descriptions with LLM\-based semantic extraction, and further validate and refine them using observed data\. The resultingPPis then used as the condition for semantics\-consistent diffusion\.
### 3\.2From Distribution\-Centric Diffusion to Semantics\-Consistent Generation
Given the weak semantic priorsPPdefined in Section[3\.1](https://arxiv.org/html/2609.16069#S3.SS1), we next reformulate score\-based diffusion from distribution\-centric recovery to semantics\-consistent generation\. Letz0,iz\_\{0,i\}denote the continuous representation of theii\-th column valuexix\_\{i\}\. In Section[3\.3](https://arxiv.org/html/2609.16069#S3.SS3),z0,iz\_\{0,i\}will be instantiated as the unified semantic representationh0,ih\_\{0,i\}\. We first apply column\-wise forward corruption:
zt,i=z0,i\+σρi\(t\)ϵ,ϵ∼𝒩\(0,I\),z\_\{t,i\}=z\_\{0,i\}\+\\sigma\_\{\\rho\_\{i\}\}\(t\)\\epsilon,\\qquad\\epsilon\\sim\\mathcal\{N\}\(0,I\),\(6\)whereσρi\(t\)\\sigma\_\{\\rho\_\{i\}\}\(t\)is a learnable noise schedule for columnfif\_\{i\}\. Compared with holistic row\-wise corruption, this formulation preserves column\-level modeling granularity and allows different columns to follow their own perturbation dynamics\.
A direct reverse process would estimate the marginal score∇zt,ilogpt\(zt,i\)\\nabla\_\{z\_\{t,i\}\}\\log p\_\{t\}\(z\_\{t,i\}\), which only encourages denoising toward statistically likely regions\. However, semantically valid tabular generation requires a stronger target: each column should be recovered under its column identity, the remaining attributes, and the weak semantic priors\. We replace the marginal score with a prior\-conditioned score:
∇zt,ilogpt\(zt,i∣P,fi,zt,−i\),\\nabla\_\{z\_\{t,i\}\}\\log p\_\{t\}\\bigl\(z\_\{t,i\}\\mid P,f\_\{i\},z\_\{t,\-i\}\\bigr\),\(7\)wherezt,−i=\{zt,j\}j≠iz\_\{t,\-i\}=\\\{z\_\{t,j\}\\\}\_\{j\\neq i\}denotes the noisy representations of other columns\. This changes the denoising target from recovering a distributionally plausible column value to recovering a column value that is also compatible with semantic priors and cross\-column context\.
Since weak semantic priors may be incomplete or partially unavailable, we randomly mask prior tokens during training:
M=𝟏\{U\>pu\},U∼Uniform\(0,1\)m,M=\\mathbf\{1\}\\\{U\>p\_\{u\}\\\},\\qquad U\\sim\\mathrm\{Uniform\}\(0,1\)^\{m\},\(8\)wheremmis the number of prior tokens andpup\_\{u\}controls the masking probability\. The reverse\-time process is then written as:
dzt,i=−2σ˙ρi\(t\)σρi\(t\)∇zt,ilogpt\(zt,i∣P∗M,fi,zt,−i\)dt\+2σ˙ρi\(t\)σρi\(t\)dωt\.\\begin\{split\}\\mathrm\{d\}z\_\{t,i\}=\{\}&\-2\\dot\{\\sigma\}\_\{\\rho\_\{i\}\}\(t\)\\sigma\_\{\\rho\_\{i\}\}\(t\)\\nabla\_\{z\_\{t,i\}\}\\log p\_\{t\}\\bigl\(z\_\{t,i\}\\mid P\\\!\\ast\\\!M,f\_\{i\},z\_\{t,\-i\}\\bigr\)\\mathrm\{d\}t\\\\ &\+\\sqrt\{2\\dot\{\\sigma\}\_\{\\rho\_\{i\}\}\(t\)\\sigma\_\{\\rho\_\{i\}\}\(t\)\}\\,\\mathrm\{d\}\\omega\_\{t\}\.\\end\{split\}\(9\)
This reformulation incorporates weak semantic priors into the prior\-conditioned reverse diffusion process, rather than using them as external post\-hoc filters\. As a result, the denoising process is guided by both statistical recovery and semantic consistency, enabling generation to preserve column\-wise distributions while enforcing rule\-consistent inter\-column dependencies\. Additional discussion on this prior\-conditioned denoising mechanism is provided in Appendix[B\.2](https://arxiv.org/html/2609.16069#A2.SS2)\.
### 3\.3Instantiating SCTab\-Diff
The reformulation in Section[3\.2](https://arxiv.org/html/2609.16069#S3.SS2)defines a prior\-conditioned diffusion process over continuous column representations, where denoising is guided by three types of conditions: the column identityfif\_\{i\}, the weak semantic priorsPP, and the remaining columnszt,−iz\_\{t,\-i\}\. This section describes how SCTab\-Diff instantiates these abstract conditions in a unified semantic latent space\. Specifically, the continuous representationz0,iz\_\{0,i\}is implemented as a semantic embeddingh0,ih\_\{0,i\}, the column identityfif\_\{i\}is represented by an embeddingeie\_\{i\}, and the semantic prior setPPis encoded as𝐏\\mathbf\{P\}\. The denoising networksθs\_\{\\theta\}then implements the prior\-conditioned score estimation in Eq\. \([7](https://arxiv.org/html/2609.16069#S3.E7)\)\.
Mapping tabular variables and priors into a unified semantic space\(USS\)\.Since tabular columns are heterogeneous in type and semantics, directly applying diffusion to raw values is not suitable, especially for categorical attributes\. Therefore, SCTab\-Diff first maps each column value and its column identity into a shared semantic space\. For theii\-th column, the initial latent representation is defined as:
h0,i=\{Average\(PLM\(\[fi,xi\]\)\),for categorical columns,Average\(PLM\(\[fi\]\)\)⋅xi,for numerical columns\.h\_\{0,i\}=\\begin\{cases\}\\mathrm\{Average\}\(\\mathrm\{PLM\}\(\[f\_\{i\},x\_\{i\}\]\)\),&\\text\{for categorical columns\},\\\\ \\mathrm\{Average\}\(\\mathrm\{PLM\}\(\[f\_\{i\}\]\)\)\\cdot x\_\{i\},&\\text\{for numerical columns\}\.\\end\{cases\}\(10\)This construction makesh0,ih\_\{0,i\}the concrete instantiation of the continuous variablez0,iz\_\{0,i\}in Section[3\.2](https://arxiv.org/html/2609.16069#S3.SS2)\. For categorical columns, the value is encoded together with its column name to preserve semantic meaning\. For numerical columns, the column\-name embedding is modulated by the numerical value, so that the representation remains value\-sensitive while retaining column semantics\.
The other two conditioning signals are instantiated similarly\. The column identityfif\_\{i\}is encoded as:
ei=Average\(PLM\(fi\)\),e\_\{i\}=\\mathrm\{Average\}\(\\mathrm\{PLM\}\(f\_\{i\}\)\),\(11\)and the weak semantic priorsPPdefined in Section[3\.1](https://arxiv.org/html/2609.16069#S3.SS1)are encoded as𝐏=PLM\(P\)\\mathbf\{P\}=\\mathrm\{PLM\}\(P\)\. Thus, column values, column identities, and weak semantic priors are all represented in the same latent space\. This shared space is what allowsPPto act as a generation condition rather than a detached external rule set\.
Implementing prior\-conditioned denoising\.Within this latent space, SCTab\-Diff applies the column\-wise forward process\(Cw\-FP\) to each semantic representation:
ht,i=h0,i\+σρi\(t\)ϵ,ϵ∼𝒩\(0,I\)\.h\_\{t,i\}=h\_\{0,i\}\+\\sigma\_\{\\rho\_\{i\}\}\(t\)\\epsilon,\\qquad\\epsilon\\sim\\mathcal\{N\}\(0,I\)\.\(12\)The main role of the denoising network is to approximate the prior\-conditioned score:
sθ\(ht,i,t,𝐏,ei,ht,−i\)≈−σρi\(t\)∇ht,ilogpt\(ht,i∣𝐏,ei,ht,−i\)\.s\_\{\\theta\}\(h\_\{t,i\},t,\\mathbf\{P\},e\_\{i\},h\_\{t,\-i\}\)\\approx\-\\sigma\_\{\\rho\_\{i\}\}\(t\)\\nabla\_\{h\_\{t,i\}\}\\log p\_\{t\}\(h\_\{t,i\}\\mid\\mathbf\{P\},e\_\{i\},h\_\{t,\-i\}\)\.\(13\)whereht,−i=\{ht,j\}j≠ih\_\{t,\-i\}=\\\{h\_\{t,j\}\\\}\_\{j\\neq i\}denotes the noisy representations of all columns except theii\-th column\. This equation shows how the abstract score in Section[3\.2](https://arxiv.org/html/2609.16069#S3.SS2)is implemented:eie\_\{i\}provides column identity,𝐏\\mathbf\{P\}provides semantic priors, andht,−ih\_\{t,\-i\}provides cross\-column context\.
To preserve column identity under corruption, the noisy representation is first annotated with its column identity:
h~t,i=\[ht,i∥ei\]\.\\tilde\{h\}\_\{t,i\}=\[h\_\{t,i\}\\\|e\_\{i\}\]\.\(14\)This step implements the conditioning onfif\_\{i\}\. It prevents the denoising network from treating different columns as interchangeable latent dimensions\.
Next, to make weak semantic priors actively guide denoising,𝐏\\mathbf\{P\}is used as semantic context through cross\-attention:
h¯t,i=h~t,i\+Softmax\(\(h~t,iWQ\)\(\(𝐏∗M\)WK\)⊤d\)\(𝐏∗M\)WV,\\bar\{h\}\_\{t,i\}=\\tilde\{h\}\_\{t,i\}\+\\mathrm\{Softmax\}\\\!\\left\(\\frac\{\(\\tilde\{h\}\_\{t,i\}W^\{Q\}\)\(\(\\mathbf\{P\}\\\!\\ast\\\!M\)W^\{K\}\)^\{\\top\}\}\{\\sqrt\{d\}\}\\right\)\(\\mathbf\{P\}\\\!\\ast\\\!M\)W^\{V\},\(15\)whereMMis the prior mask defined in Eq\. \([8](https://arxiv.org/html/2609.16069#S3.E8)\)\. This operation implements the conditioning onPP\. Instead of using semantic priors as post\-hoc filters, SCTab\-Diff lets each noisy column representation retrieve relevant prior information during reverse denoising\.
Finally, to implement the dependency on other columnsht,−ih\_\{t,\-i\}, the prior\-enhanced column representations are passed into a Transformer\-based dependency module:
h^t,1,…,h^t,n=DepCapture\(h¯t,1,…,h¯t,n\)\.\\hat\{h\}\_\{t,1\},\\dots,\\hat\{h\}\_\{t,n\}=\\mathrm\{DepCapture\}\(\\bar\{h\}\_\{t,1\},\\dots,\\bar\{h\}\_\{t,n\}\)\.\(16\)The resulting representationh^t,i\\hat\{h\}\_\{t,i\}integrates the three conditioning signals in Eq\. \([7](https://arxiv.org/html/2609.16069#S3.E7)\): column identity, weak semantic priors, and cross\-column context\. We then predict the injected noise byϵ^i=MLP\(h^t,i\)\\hat\{\\epsilon\}\_\{i\}=\\mathrm\{MLP\}\(\\hat\{h\}\_\{t,i\}\), and use it to parameterize the prior\-conditioned score:
sθ\(ht,i,t,𝐏,ei,ht,−i\)=−ϵ^iσρi\(t\)\.s\_\{\\theta\}\(h\_\{t,i\},t,\\mathbf\{P\},e\_\{i\},h\_\{t,\-i\}\)=\-\\frac\{\\hat\{\\epsilon\}\_\{i\}\}\{\\sigma\_\{\\rho\_\{i\}\}\(t\)\}\.\(17\)This score determines the reverse denoising direction\. Since it is conditioned on𝐏\\mathbf\{P\},eie\_\{i\}, andht,−ih\_\{t,\-i\}, each denoising step is guided not only by statistical recovery, but also by semantic priors and cross\-column context\. The denoising network is trained by minimizing the noise prediction error:
ℒdiff=𝔼t∼p\(t\)∑i=1n‖ϵ^i−ϵi‖22\.\\mathcal\{L\}\_\{\\mathrm\{diff\}\}=\\mathbb\{E\}\_\{t\\sim p\(t\)\}\\sum\_\{i=1\}^\{n\}\\left\\\|\\hat\{\\epsilon\}\_\{i\}\-\\epsilon\_\{i\}\\right\\\|\_\{2\}^\{2\}\.\(18\)
Reconstructing tabular rows\.After reverse denoising, SCTab\-Diff obtains the recovered latent representationh^0,i\\hat\{h\}\_\{0,i\}for each column\. The tabular decoder maps it back to the original data space:
x^i=\{Softmax\(h^0,iwicat\+bicat\),for categorical columns,h^0,iwinum\+binum,for numerical columns,\\hat\{x\}\_\{i\}=\\begin\{cases\}\\mathrm\{Softmax\}\(\\hat\{h\}\_\{0,i\}w\_\{i\}^\{\\mathrm\{cat\}\}\+b\_\{i\}^\{\\mathrm\{cat\}\}\),&\\text\{for categorical columns\},\\\\ \\hat\{h\}\_\{0,i\}w\_\{i\}^\{\\mathrm\{num\}\}\+b\_\{i\}^\{\\mathrm\{num\}\},&\\text\{for numerical columns\},\\end\{cases\}\(19\)wherewicat∈ℝd×Ciw\_\{i\}^\{cat\}\\in\\mathbb\{R\}^\{d\\text\{×\}C\_\{i\}\},bicat∈ℝ1×1b\_\{i\}^\{cat\}\\in\\mathbb\{R\}^\{1\\text\{×\}1\},winum∈ℝd×1w\_\{i\}^\{num\}\\in\\mathbb\{R\}^\{d\\text\{×\}1\},binum∈ℝ1×1b\_\{i\}^\{num\}\\in\\mathbb\{R\}^\{1\\text\{×\}1\}are decoder’s parameters for categorical and numerical columns\. The decoder is trained with a reconstruction objective:
ℒrec=ℓrecon\(x,x^\)=∑i∈𝒞CE\(xi,x^i\)\+∑i∈n‖xi−x^i‖22\.,\\mathcal\{L\}\_\{\\mathrm\{rec\}\}=\\ell\_\{\\mathrm\{recon\}\}\(x,\\hat\{x\}\)=\\sum\_\{i\\in\\mathcal\{C\}\}\\mathrm\{CE\}\(x\_\{i\},\\hat\{x\}\_\{i\}\)\+\\sum\_\{i\\in n\}\\\|x\_\{i\}\-\\hat\{x\}\_\{i\}\\\|\_\{2\}^\{2\}\.,\(20\)whereℓrecon\\ell\_\{\\mathrm\{recon\}\}measures the reconstruction error between the input and reconstructed data\. Through this instantiation, the three conditions introduced in the reformulated score function are explicitly realized:eie\_\{i\}preserves column identity,𝐏\\mathbf\{P\}injects weak semantic priors, andht,−ih\_\{t,\-i\}enables cross\-column dependency modeling\. For clarity, Algorithm[1](https://arxiv.org/html/2609.16069#alg1)presents the training procedure of SCTab\-Diff, while Algorithm[2](https://arxiv.org/html/2609.16069#alg2)describes synthetic tabular data generation\.
## 4Experiments
To comprehensively evaluate the performance of SCTab\-Diff we focus on the following key research questions:Q1:Can SCTab\-Diff preserve the distributional fidelity of real tabular data?Q2:Can SCTab\-Diff improve semantic validity by satisfying intra\-column semantics and inter\-column symbolic rules?Q3:Can synthetic data generated by SCTab\-Diff support downstream predictive tasks?Q4:How robust is SCTab\-Diff when weak semantic priors are incomplete or partially unavailable?
### 4\.1Experimental Setups
Datasets\.We evaluate SCTab\-Diff using six real\-world datasets from[Zhang et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib12), including four classification datasets \(i\.e\., Adult, Default, Shoppers, and Magic\) and two regression datasets \(i\.e\., Beijing and News\)\. Refer to Appendix[C\.1](https://arxiv.org/html/2609.16069#A3.SS1)for details of the dataset\. Baselines\.We compare SCTab\-Diff against seven baseline models that are categorized into three groups: 1\) Traditional methods: CTGAN[Xu et al\. \(2019\)](https://arxiv.org/html/2609.16069#bib.bib5), CTGAN\+[Zhao et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib6), and TVAE[Xu et al\. \(2019\)](https://arxiv.org/html/2609.16069#bib.bib5); 2\) LLM\-based methods: P\-TA[Yang et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib7); 3\) Diffusion\-based methods: TabDDPM[Kotelnikov et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib9), TABSYN[Zhang et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib12), and TABDIFF[Shi et al\. \(2025\)](https://arxiv.org/html/2609.16069#bib.bib18)\. Constrained variants based on post\-hoc filtering or rule\-based repair are discussed in Appendix[C\.3](https://arxiv.org/html/2609.16069#A3.SS3.SSS0.Px1), since they impose rules after generation and are not directly comparable to our prior\-conditioned denoising mechanism\. Implementation Details\.We compare SCTab\-Diff to all baseline methods using the same experimental setup\. All the methods are optimized with the Adam optimizer, and all the experiments are conducted on an Nvidia L40 GPU \(48GB\) with the same seed set\. Our method uses a pretrained BERT\-base\-uncased[Devlin et al\. \(2019\)](https://arxiv.org/html/2609.16069#bib.bib20)\(PLM\(⋅\\cdot\)\) to encode tabular data into a unified semantic spaceℝd\\mathbb\{R\}^\{d\}, whered=128d=128\. The batch size is set to 4096, and the learning rate is set to 1e\-3\. All reported results are averaged over 5 runs with different random seeds, and the subscripts denote standard deviations\. Evaluation Metrics\.We evaluate the quality of the generated data from three aspects:*distribution fidelity*,*structural and semantic fidelity*, and*task fidelity*\. Details of all metrics are provided in Appendix[C\.4](https://arxiv.org/html/2609.16069#A3.SS4)\.
### 4\.2Main Results
#### 4\.2\.1Distributional and Semantic Fidelity
To answer Q1 and Q2, we evaluate generated data using Shape, Trend, and SA in Table[1](https://arxiv.org/html/2609.16069#S4.T1)\. Shape measures marginal distribution fidelity at the column level\. Trend reflects cross\-column dependency preservation\. SA evaluates whether generated rows satisfy weak semantic priors, including intra\-column semantics and inter\-column symbolic rules\.
Table 1:Data fidelity evaluation results\. Shape\(%\)↑\\uparrowevaluates marginal distribution, while Trend\(%\)↑\\uparrowand SA\(%\)↑\\uparrowevaluate data fidelity\.↑\\uparrowindicates that higher values are better\. The best results are highlighted in bold, and suboptimal results are marked with an underline\.⊳\\rhdSCTab\-Diff achieves strong distributional fidelity\.As shown in Table[1](https://arxiv.org/html/2609.16069#S4.T1), SCTab\-Diff obtains the best Shape score on 5 out of 6 datasets, with an average Shape of 98\.29%, compared with 98\.03% for the strongest diffusion baseline TABDIFF\. The improvements are consistent in Beijing, News, Adult, Default, and Magic\. For example, SCTab\-Diff improves Shape from 98\.35% to 98\.56% on Beijing and from 98\.84% to 99\.06% on Adult\. These results indicate that column\-wise diffusion in the unified semantic space preserves marginal column distributions effectively\.
⊳\\rhdSCTab\-Diff improves semantic fidelity and dependency preservation\.For Trend, SCTab\-Diff achieves the best result on 5 out of 6 datasets, with an average score of 98\.05%, outperforming TABDIFF by 0\.73%percentage points on average\. The gain is especially clear on Default, where SCTab\-Diff improves Trend from 96\.46% to 97\.89%\. For SA, SCTab\-Diff also achieves the best result on 5 out of 6 datasets, improving the average score from 81\.38% for TABDIFF to 82\.23%\. Notably, SCTab\-Diff reaches 99\.98% on Shoppers, 93\.76% on Adult, 100\.00% on Default, and 99\.74% on Magic\. These results suggest that conditioning score estimation on𝐏\\mathbf\{P\},eie\_\{i\}, andht,−ih\_\{t,\-i\}helps generate rows that are not only distributionally plausible but also semantically consistent\.
#### 4\.2\.2Task Fidelity
To answer Q3, we evaluate downstream utility by training predictive models on synthetic data and testing them on real data\. Regression datasets are evaluated by RMSE, while classification datasets are evaluated by AUC, as reported in Table[2](https://arxiv.org/html/2609.16069#S4.T2)\.
Table 2:MLE scores to evaluate downstream task availability\. The best results are highlighted in bold, and suboptimal ones are marked with an underline\.⊳\\rhdSCTab\-Diff generates task\-useful synthetic data\.As shown in Table[2](https://arxiv.org/html/2609.16069#S4.T2), SCTab\-Diff achieves the best downstream performance on 5 out of 6 datasets and the second\-best result on Adult\. On the two regression datasets, SCTab\-Diff obtains the lowest RMSE, reducing the error from 0\.582 to 0\.498 on Beijing compared with the strongest baseline\. For classification tasks, SCTab\-Diff achieves the highest AUC on Shoppers, Default, and Magic, respectively\. These results indicate that SCTab\-Diff does not only improve distributional and semantic fidelity, but also preserves task\-relevant information for downstream learning\. In particular, the strong performance on both regression and classification datasets suggests that prior\-conditioned denoising helps maintain predictive column semantics and cross\-column dependency patterns, thereby providing more reliable synthetic supervision\.
### 4\.3Analysis of Weak Semantic Priors
Figure 3:Robustness to incomplete semantic priors on Beijing and Adult\.To answer Q4, we evaluate the robustness of SCTab\-Diff under incomplete semantic priors\. Since semantic priors are often weakly specified and may be only partially available, we randomly remove different proportions of priors and report Shape and Trend on Beijing and Adult in Fig\.[3](https://arxiv.org/html/2609.16069#S4.F3)\.
⊳\\rhdSCTab\-Diff remains stable under moderate prior missingness\.As shown in Fig\.[3](https://arxiv.org/html/2609.16069#S4.F3), Shape remains highly stable across different missing rates\. On Beijing, Shape stays around 98% even when the missing rate increases to 1\.0\. On Adult, Shape remains close to 99% under most missing ratios\. This indicates that marginal distribution modeling is mainly supported by column\-wise diffusion in the unified semantic space and is less sensitive to prior availability\.
⊳\\rhdSemantic priors mainly benefit dependency preservation\.Compared with Shape, Trend is more sensitive to missing priors\. On Beijing, Trend remains relatively stable under moderate missing rates but drops sharply when almost all priors are removed\. On Adult, Trend gradually decreases from around 98% to nearly 93% as the missing rate increases\. These results show that weak semantic priors mainly contribute to cross\-column dependency modeling, while SCTab\-Diff can still operate effectively when priors are only partially available\.
### 4\.4Ablation Study
To evaluate the contribution of each key design in SCTab\-Diff, we conduct ablation studies in Table[3](https://arxiv.org/html/2609.16069#S4.T3)\. USS denotes the unified semantic space that represents tabular values, column identities, and semantic priors in a shared latent space\. ICS denotes intra\-column semantics, which provide attribute\-level plausibility constraints\. ISR denotes inter\-column symbolic rules, which provide tuple\-level dependency constraints\. Cw\-FP denotes the column\-wise forward process, which performs column\-level corruption in the semantic latent space\.
Table 3:Ablation results of key designs in SCTab\-Diffon Default\.⊳\\rhdSemantic conditions improve both utility and fidelity\.Introducing USS improves AUC from 0\.741 to 0\.752, Shape from 96\.84% to 97\.18%, and Trend from 93\.98% to 95\.21%, showing that a unified semantic space provides a useful foundation for heterogeneous tabular generation\. Adding ICS further improves all metrics, indicating that intra\-column semantics help preserve attribute\-level plausibility\. Incorporating ISR further raises Trend from 95\.94% to 97\.95%, which confirms that inter\-column symbolic rules mainly benefit cross\-column dependency modeling\.
⊳\\rhdColumn\-wise forward process enhances marginal fidelity\.With Cw\-FP, SCTab\-Diff achieves the best AUC and Shape scores, 0\.771 and 98\.57%, respectively, while maintaining a strong Trend score of 97\.89%\. This suggests that column\-wise corruption improves marginal distribution preservation without undermining semantic dependency modeling\.
### 4\.5Visualization of Fine\-Grained Tabular Fidelity
Figure 4:Visualization of categorical column fidelity on News and Shoppers\.To further examine fine\-grained tabular fidelity, we visualize representative categorical columns in Fig\.[4](https://arxiv.org/html/2609.16069#S4.F4)\. Specifically, we compare the category\-wise sample counts of*Weekday*in News and*Region*in Shoppers across real data and synthetic data generated by different methods\. This visualization complements the Shape metric by showing whether each method preserves detailed category\-level patterns rather than only aggregate column\-wise fidelity\.
⊳\\rhdSCTab\-Diff better aligns category\-wise sample counts\.As shown in Fig\.[4](https://arxiv.org/html/2609.16069#S4.F4), TabDDPM exhibits clear deviations from the real data\. On the*Weekday*column in News, it substantially overestimates categories 2 and 3 while underestimating several other categories\. TABSYN and TABDIFF reduce some deviations, but still show mismatches in specific categories\. In contrast, SCTab\-Diff follows the real count pattern more closely across most categories, indicating that the unified semantic space and column\-wise denoising help preserve categorical column identity during generation\.
⊳\\rhdSCTab\-Diff preserves minority categorical patterns\.On the*Region*column in Shoppers, SCTab\-Diff better matches the real counts for minority categories such as 5, 8, and 9, while several baselines show larger deviations\. This suggests that SCTab\-Diff does not only recover dominant categories, but also preserves low\-frequency categorical patterns\. Such behavior is important for tabular generation because minority categories often carry useful downstream information\.
⊳\\rhdAdditional numerical and inter\-column visualizations\.Due to space limitations, additional visualizations are provided in Fig\.[7](https://arxiv.org/html/2609.16069#A5.F7)and Fig\.[8](https://arxiv.org/html/2609.16069#A5.F8)of Appendix[E\.1](https://arxiv.org/html/2609.16069#A5.SS1)and Appendix[E\.2](https://arxiv.org/html/2609.16069#A5.SS2)\. Fig\.[7](https://arxiv.org/html/2609.16069#A5.F7)shows that SCTab\-Diff better fits representative numerical columns such as*BounceRates*in Shoppers and*n\_tokens\_title*in News, while TabDDPM, TABSYN, and TABDIFF exhibit visible shifts or mismatches around high\-density regions\. Fig\.[8](https://arxiv.org/html/2609.16069#A5.F8)further shows that SCTab\-Diff preserves pair\-wise dependency patterns more faithfully than the baselines\.
## 5Conclusion
This paper introduces SCTab\-Diff, a semantics\-consistent diffusion framework for tabular data generation under weakly specified semantic priors\. The key idea is to move beyond pure distribution matching by treating intra\-column semantics and inter\-column symbolic rules as generation conditions during reverse denoising\. To this end, SCTab\-Diff aligns heterogeneous column values, column identities, and semantic priors in a unified semantic space, and performs prior\-conditioned denoising to preserve both column\-wise distributions and cross\-column semantic dependencies\. Experiments on six real\-world benchmark datasets demonstrate that SCTab\-Diff improves distributional fidelity, semantic consistency, and downstream task utility compared with representative tabular generation baselines\. Additional analyses under incomplete priors further show that the proposed framework can remain robust when semantic knowledge is only partially available\.
## References
- \[1\]C\. Liu and C\. Liu\(2024\)Entity\-based financial tabular data synthesis with diffusion models\.InProceedings of the 5th ACM International Conference on AI in Finance,pp\. 547–554\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p1.1)\.
- \[2\]M\. Schreyer, T\. Sattarov, A\. Sim, and K\. Wu\(2024\)Imb\-findiff: conditional diffusion models for class imbalance synthesis of financial tabular data\.InProceedings of the 5th ACM International Conference on AI in Finance,pp\. 617–625\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p1.1)\.
- \[3\]J\. Shi, M\. Xu, H\. Hua, H\. Zhang, S\. Ermon, and J\. Leskovec\(2025\)TabDiff: a mixed\-type diffusion model for tabular data generation\.InThe Thirteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=swvURjrt8z)Cited by:[§A\.2](https://arxiv.org/html/2609.16069#A1.SS2.p2.1),[3rd item](https://arxiv.org/html/2609.16069#A3.I3.i3.p1.1),[§D\.1](https://arxiv.org/html/2609.16069#A4.SS1.p2.1),[§1](https://arxiv.org/html/2609.16069#S1.p1.1),[§4\.1](https://arxiv.org/html/2609.16069#S4.SS1.p1.1)\.
- \[4\]H\. Zhang, J\. Zhang, Z\. Shen, B\. Srinivasan, X\. Qin, C\. Faloutsos, H\. Rangwala, and G\. Karypis\(2024\)Mixed\-type tabular data synthesis with score\-based diffusion in latent space\.InThe Twelfth International Conference on Learning Representations,Cited by:[§A\.2](https://arxiv.org/html/2609.16069#A1.SS2.p2.1),[§B\.1](https://arxiv.org/html/2609.16069#A2.SS1.p4.1),[2nd item](https://arxiv.org/html/2609.16069#A3.I3.i2.p1.1),[§C\.4\.2](https://arxiv.org/html/2609.16069#A3.SS4.SSS2.p1.1),[§1](https://arxiv.org/html/2609.16069#S1.p1.1),[§4\.1](https://arxiv.org/html/2609.16069#S4.SS1.p1.1)\.
- \[5\]A\. Kotelnikov, D\. Baranchuk, I\. Rubachev, and A\. Babenko\(2023\)Tabddpm: modelling tabular data with diffusion models\.InInternational Conference on Machine Learning,pp\. 17564–17579\.Cited by:[§A\.2](https://arxiv.org/html/2609.16069#A1.SS2.p1.1),[1st item](https://arxiv.org/html/2609.16069#A3.I3.i1.p1.1),[§1](https://arxiv.org/html/2609.16069#S1.p1.1),[§4\.1](https://arxiv.org/html/2609.16069#S4.SS1.p1.1)\.
- \[6\]Y\. Wang, D\. Feng, Y\. Dai, Z\. Chen, J\. Huang, S\. Ananiadou, Q\. Xie, and H\. Wang\(2024\)Harmonic: harnessing llms for tabular data synthesis and privacy protection\.Advances in Neural Information Processing Systems37,pp\. 100196–100212\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p1.1)\.
- \[7\]A\. Torfi, E\. A\. Fox, and C\. K\. Reddy\(2022\)Differentially private synthetic medical data generation using convolutional gans\.Information Sciences586,pp\. 485–500\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p1.1)\.
- \[8\]H\. He, W\. Hao, Y\. Xi, Y\. Chen, B\. Malin, and J\. Ho\(2024\)A flexible generative model for heterogeneous tabular\{\\\{ehr\}\\\}with missing modality\.InThe Twelfth International Conference on Learning Representations,Cited by:[§A\.2](https://arxiv.org/html/2609.16069#A1.SS2.p2.1),[§1](https://arxiv.org/html/2609.16069#S1.p1.1)\.
- \[9\]T\. Sattarov, M\. Schreyer, and D\. Borth\(2023\)Findiff: diffusion models for financial tabular data generation\.InProceedings of the Fourth ACM International Conference on AI in Finance,pp\. 64–72\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p1.1)\.
- \[10\]S\. Zhang, H\. Li, H\. Qu, and Y\. Wang\(2023\)Adavis: adaptive and explainable visualization recommendation for tabular data\.IEEE Transactions on Visualization and Computer Graphics30\(9\),pp\. 5923–5938\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p1.1)\.
- \[11\]N\. Seedat, N\. Huynh, B\. Van Breugel, and M\. Van Der Schaar\(2023\)Curated llm: synergy of llms and data curation for tabular augmentation in low\-data regimes\.arXiv preprint arXiv:2312\.12112\.Cited by:[§A\.1](https://arxiv.org/html/2609.16069#A1.SS1.p2.1),[§1](https://arxiv.org/html/2609.16069#S1.p2.1)\.
- \[12\]J\. Kim, T\. Kim, and J\. Choo\(2024\)Epic: effective prompting for imbalanced\-class data synthesis in tabular data classification via large language models\.Advances in Neural Information Processing Systems37,pp\. 31504–31542\.Cited by:[§A\.1](https://arxiv.org/html/2609.16069#A1.SS1.p2.1),[§1](https://arxiv.org/html/2609.16069#S1.p2.1)\.
- \[13\]L\. Xu, M\. Skoularidou, A\. Cuesta\-Infante, and K\. Veeramachaneni\(2019\)Modeling tabular data using conditional gan\.Advances in neural information processing systems32\.Cited by:[§A\.1](https://arxiv.org/html/2609.16069#A1.SS1.p1.1),[1st item](https://arxiv.org/html/2609.16069#A3.I1.i1.p1.1),[§1](https://arxiv.org/html/2609.16069#S1.p4.1),[§4\.1](https://arxiv.org/html/2609.16069#S4.SS1.p1.1)\.
- \[14\]C\. Ma, S\. Tschiatschek, R\. Turner, J\. M\. Hernández\-Lobato, and C\. Zhang\(2020\)Vaem: a deep generative model for heterogeneous mixed type data\.Advances in Neural Information Processing Systems33,pp\. 11237–11247\.Cited by:[§A\.1](https://arxiv.org/html/2609.16069#A1.SS1.p1.1),[§1](https://arxiv.org/html/2609.16069#S1.p4.1)\.
- \[15\]T\. Liu, Z\. Qian, J\. Berrevoets, and M\. van der Schaar\(2023\)Goggle: generative modelling for tabular data by learning relational structure\.InThe Eleventh International Conference on Learning Representations,Cited by:[§A\.1](https://arxiv.org/html/2609.16069#A1.SS1.p1.1),[§1](https://arxiv.org/html/2609.16069#S1.p4.1)\.
- \[16\]E\. Choi, S\. Biswal, B\. Malin, J\. Duke, W\. F\. Stewart, and J\. Sun\(2017\)Generating multi\-label discrete patient records using generative adversarial networks\.InMachine learning for healthcare conference,pp\. 286–305\.Cited by:[§A\.1](https://arxiv.org/html/2609.16069#A1.SS1.p1.1),[§1](https://arxiv.org/html/2609.16069#S1.p4.1)\.
- \[17\]J\. Lee, J\. Hyeong, J\. Jeon, N\. Park, and J\. Cho\(2021\)Invertible tabular gans: killing two birds with one stone for tabular data synthesis\.Advances in Neural Information Processing Systems34,pp\. 4263–4273\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p4.1)\.
- \[18\]Z\. Zhao, A\. Kunar, R\. Birke, and L\. Y\. Chen\(2021\)Ctab\-gan: effective table data synthesizing\.InAsian Conference on Machine Learning,pp\. 97–112\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p4.1)\.
- \[19\]P\. Dhariwal and A\. Nichol\(2021\)Diffusion models beat gans on image synthesis\.Advances in neural information processing systems34,pp\. 8780–8794\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p4.1)\.
- \[20\]J\. Ho, A\. Jain, and P\. Abbeel\(2020\)Denoising diffusion probabilistic models\.Advances in neural information processing systems33,pp\. 6840–6851\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p4.1)\.
- \[21\]Y\. Song, J\. Sohl\-Dickstein, D\. P\. Kingma, A\. Kumar, S\. Ermon, and B\. Poole\(2020\)Score\-based generative modeling through stochastic differential equations\.arXiv preprint arXiv:2011\.13456\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p4.1),[§2\.2](https://arxiv.org/html/2609.16069#S2.SS2.p1.1)\.
- \[22\]J\. Austin, D\. D\. Johnson, J\. Ho, D\. Tarlow, and R\. Van Den Berg\(2021\)Structured denoising diffusion models in discrete state\-spaces\.Advances in neural information processing systems34,pp\. 17981–17993\.Cited by:[§1](https://arxiv.org/html/2609.16069#S1.p4.1)\.
- \[23\]Y\. Song and S\. Ermon\(2020\)Improved techniques for training score\-based generative models\.Advances in neural information processing systems33,pp\. 12438–12448\.Cited by:[§2\.2](https://arxiv.org/html/2609.16069#S2.SS2.p1.1)\.
- \[24\]Z\. Zhao, A\. Kunar, R\. Birke, H\. Van der Scheer, and L\. Y\. Chen\(2024\)Ctab\-gan\+: enhancing tabular data synthesis\.Frontiers in big Data6,pp\. 1296508\.Cited by:[§A\.1](https://arxiv.org/html/2609.16069#A1.SS1.p1.1),[2nd item](https://arxiv.org/html/2609.16069#A3.I1.i2.p1.1),[§4\.1](https://arxiv.org/html/2609.16069#S4.SS1.p1.1)\.
- \[25\]S\. Yang, C\. Yuan, Y\. Rong, F\. Steinbauer, and G\. Kasneci\(2024\)P\-ta: using proximal policy optimization to enhance tabular data augmentation via large language models\.arXiv preprint arXiv:2406\.11391\.Cited by:[§A\.1](https://arxiv.org/html/2609.16069#A1.SS1.p2.1),[§A\.3](https://arxiv.org/html/2609.16069#A1.SS3.p1.1),[1st item](https://arxiv.org/html/2609.16069#A3.I2.i1.p1.1),[§4\.1](https://arxiv.org/html/2609.16069#S4.SS1.p1.1)\.
- \[26\]J\. Devlin, M\. Chang, K\. Lee, and K\. Toutanova\(2019\)Bert: pre\-training of deep bidirectional transformers for language understanding\.InProceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 \(long and short papers\),pp\. 4171–4186\.Cited by:[§4\.1](https://arxiv.org/html/2609.16069#S4.SS1.p1.1)\.
- \[27\]N\. Park, M\. Mohammadi, K\. Gorde, S\. Jajodia, H\. Park, and Y\. Kim\(2018\)Data synthesis based on generative adversarial networks\.arXiv preprint arXiv:1806\.03384\.Cited by:[§A\.1](https://arxiv.org/html/2609.16069#A1.SS1.p1.1)\.
- \[28\]C\. Lee, J\. Kim, and N\. Park\(2023\)Codi: co\-evolving contrastive diffusion models for mixed\-type tabular synthesis\.InInternational Conference on Machine Learning,pp\. 18940–18956\.Cited by:[§A\.2](https://arxiv.org/html/2609.16069#A1.SS2.p1.1)\.
- \[29\]T\. Ceritli, G\. O\. Ghosheh, V\. K\. Chauhan, T\. Zhu, A\. P\. Creagh, and D\. A\. Clifton\(2023\)Synthesizing mixed\-type electronic health records using diffusion models\.arXiv preprint arXiv:2302\.14679\.Cited by:[§A\.2](https://arxiv.org/html/2609.16069#A1.SS2.p1.1)\.
- \[30\]X\. Lin, C\. Xu, M\. Yang, and G\. Cheng\(2024\)CTSyn: a foundational model for cross tabular data generation\.arXiv preprint arXiv:2406\.04619\.Cited by:[§A\.2](https://arxiv.org/html/2609.16069#A1.SS2.p2.1)\.
- \[31\]K\. Yu, S\. Ishikura, Y\. Usukura, Y\. Shigoku, and T\. Hayashi\(2025\)SHAP distance: an explainability\-aware metric for evaluating the semantic fidelity of synthetic tabular data\.arXiv preprint arXiv:2511\.17590\.Cited by:[§A\.3](https://arxiv.org/html/2609.16069#A1.SS3.p1.1)\.
- \[32\]T\. S\. T\. Kwok, C\. Wang, and G\. Cheng\(2025\)GReaTER: generate realistic tabular data after data enhancement and reduction\.In41st IEEE International Conference on Data Engineering, ICDE 2025 \- Workshops, Hong Kong, May 19\-23, 2025,pp\. 218–229\.External Links:[Link](https://doi.org/10.1109/ICDEW67478.2025.00032),[Document](https://dx.doi.org/10.1109/ICDEW67478.2025.00032)Cited by:[§A\.3](https://arxiv.org/html/2609.16069#A1.SS3.p1.1)\.
- \[33\]M\. Spinaci, M\. Polewczyk, M\. Schambach, and S\. Thelin\(2026\)ConTextTab: a semantics\-aware tabular in\-context learner\.InThe Thirty\-ninth Annual Conference on Neural Information Processing Systems,External Links:[Link](https://openreview.net/forum?id=kGMRb4jbTP)Cited by:[§A\.3](https://arxiv.org/html/2609.16069#A1.SS3.p1.1)\.
- \[34\]S\. Jacob, B\. Prenkaj, W\. Shao, and G\. Kasneci\(2026\)TabSCM: a practical framework for generating realistic tabular data\.arXiv preprint arXiv:2604\.22337\.Cited by:[§A\.3](https://arxiv.org/html/2609.16069#A1.SS3.p1.1)\.
- \[35\]Y\. Long, L\. Xu, and A\. Brintrup\(2025\)LLM\-tablogic: preserving inter\-column logical relationships in synthetic tabular data via prompt\-guided latent diffusion\.arXiv preprint arXiv:2503\.02161\.Cited by:[§A\.3](https://arxiv.org/html/2609.16069#A1.SS3.p1.1)\.
- \[36\]M\. Zhang, Z\. Xiao, G\. Lu, S\. Wu, W\. Wang, X\. Fu, C\. Yi, and J\. Zhao\(2025\)AIGT: AI generative table based on prompt\.InProceedings of the 31st International Conference on Computational Linguistics,Abu Dhabi, UAE,pp\. 9926–9938\.External Links:[Link](https://aclanthology.org/2025.coling-main.664/)Cited by:[§A\.3](https://arxiv.org/html/2609.16069#A1.SS3.p1.1)\.
- \[37\]A\. Arazi, E\. Shapira, and R\. Reichart\(2026\)TabSTAR: a tabular foundation model for tabular data with text fields\.InThe Thirty\-ninth Annual Conference on Neural Information Processing Systems,External Links:[Link](https://openreview.net/forum?id=FrXHdcTEzE)Cited by:[§A\.3](https://arxiv.org/html/2609.16069#A1.SS3.p1.1)\.
- \[38\]S\. Yang, Z\. Zhang, B\. Prenkaj, and G\. Kasneci\(2026\)SAGE: sparse adaptive guidance for dependency\-aware tabular data generation\.arXiv preprint arXiv:2604\.24368\.Cited by:[§A\.3](https://arxiv.org/html/2609.16069#A1.SS3.p1.1)\.
- \[39\]J\. Huang, Q\. Huang, G\. Mou, and C\. Wu\(2022\)DPWGAN: high\-quality load profiles synthesis with differential privacy guarantees\.IEEE Transactions on Smart Grid14\(4\),pp\. 3283–3295\.Cited by:[2nd item](https://arxiv.org/html/2609.16069#A3.I1.i2.p1.1)\.
- \[40\]J\. Schulman, F\. Wolski, P\. Dhariwal, A\. Radford, and O\. Klimov\(2017\)Proximal policy optimization algorithms\.arXiv preprint arXiv:1707\.06347\.Cited by:[1st item](https://arxiv.org/html/2609.16069#A3.I2.i1.p1.1)\.
- \[41\]V\. W\. Berger and Y\. Zhou\(2014\)Kolmogorov–smirnov test: overview\.Wiley statsref: Statistics reference online\.Cited by:[§C\.4\.1](https://arxiv.org/html/2609.16069#A3.SS4.SSS1.p1.1)\.
- \[42\]L\. Tao, S\. Xu, C\. Wang, N\. Suh, and G\. Cheng\(2024\)Discriminative estimation of total variation distance: a fidelity auditor for generative data\.arXiv preprint arXiv:2405\.15337\.Cited by:[§C\.4\.1](https://arxiv.org/html/2609.16069#A3.SS4.SSS1.p1.1)\.
- \[43\]A\. Alaa, B\. Van Breugel, E\. S\. Saveliev, and M\. Van Der Schaar\(2022\)How faithful is your synthetic data? sample\-level metrics for evaluating and auditing generative models\.InInternational conference on machine learning,pp\. 290–306\.Cited by:[§C\.4\.2](https://arxiv.org/html/2609.16069#A3.SS4.SSS2.p1.1)\.
- \[44\]M\. N\. Fekri, A\. M\. Ghosh, and K\. Grolinger\(2019\)Generating energy data for machine learning with recurrent generative adversarial networks\.Energies13\(1\),pp\. 130\.Cited by:[§C\.4\.3](https://arxiv.org/html/2609.16069#A3.SS4.SSS3.p1.1)\.
## Appendix ARelated Work
### A\.1Distribution\-Centric Tabular Generation
Early studies on synthetic tabular data mainly follow a distribution\-centric paradigm, where the goal is to approximate the empirical distribution of real tables\. GAN\-based methods are widely used in this line\. CTGAN[Xu et al\. \(2019\)](https://arxiv.org/html/2609.16069#bib.bib5)introduces mode\-specific normalization to better handle non\-Gaussian continuous columns and conditional generation to address imbalanced categorical distributions\. CTAB\-GAN\+[Zhao et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib6)further improves the stability and utility of GAN\-based tabular synthesis\. Other representative methods include TableGAN[Park et al\. \(2018\)](https://arxiv.org/html/2609.16069#bib.bib29), which incorporates label information into the generation process, and MedGAN[Choi et al\. \(2017\)](https://arxiv.org/html/2609.16069#bib.bib23), which targets discrete medical records\. In parallel, VAE\-based models such as TVAE[Xu et al\. \(2019\)](https://arxiv.org/html/2609.16069#bib.bib5)and VAEM[Ma et al\. \(2020\)](https://arxiv.org/html/2609.16069#bib.bib21)have been developed to model heterogeneous tabular variables through latent representations\. GOGGLE[Liu et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib22)further introduces relational structure learning to capture dependencies among features\.
Recent work also explores the use of large language models for tabular data synthesis and augmentation\. For example, P\-TA[Yang et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib7)uses proximal policy optimization to guide LLM\-based tabular augmentation\. EPIC[Kim et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib3)studies effective prompting for imbalanced tabular classification\. Curated LLM[Seedat et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib4)further investigates the synergy between LLMs and data curation in low\-data regimes\. Although these methods improve tabular synthesis from different perspectives, they still mainly optimize distributional or task\-level fidelity\. They rarely model explicit semantic validity constraints that govern whether a generated row is logically plausible\.
### A\.2Diffusion Models for Mixed\-Type Tabular Data
Diffusion models have recently become a strong paradigm for tabular generation due to their stable training and strong distribution modeling ability\. Since tabular data contains both numerical and categorical columns, early diffusion\-based methods often design separate mechanisms for different data types\. TabDDPM[Kotelnikov et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib9)applies Gaussian diffusion to numerical features and multinomial diffusion to categorical features\. CoDi[Lee et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib30)further introduces co\-evolving diffusion processes for continuous and discrete variables\. TabDDPM\-HER[Ceritli et al\. \(2023\)](https://arxiv.org/html/2609.16069#bib.bib31)adapts diffusion\-based tabular generation to heterogeneous electronic health records\.
Another line of work performs diffusion in latent space\. TABSYN[Zhang et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib12)first maps mixed\-type tabular data into a continuous latent space and then applies score\-based diffusion for synthesis\. FLEXGEN\-EHR[He et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib1)incorporates optimal transport to align heterogeneous EHR features in latent space\. CTSyn[Lin et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib32)trains across multiple datasets and aims to build a foundation model for cross\-table generation\. More recently, TABDIFF[Shi et al\. \(2025\)](https://arxiv.org/html/2609.16069#bib.bib18)proposes a mixed\-type diffusion model with feature\-wise learnable diffusion processes, which improves the modeling of heterogeneous feature distributions\.
Despite these advances, existing tabular diffusion models are still largely distribution\-driven\. They mainly learn statistical regularities from observed samples and recover noisy tabular representations toward high\-density regions of the data distribution\. However, semantic validity in tabular data is often governed by column meanings and cross\-column symbolic rules\. Such constraints are difficult to recover from implicit correlations alone\. As a result, existing diffusion models may generate samples that are statistically plausible but semantically inconsistent\.
### A\.3Semantics\-Aware Tabular Generation
Realistic tabular generation requires more than matching marginal and joint distributions\. A valid tabular row should also satisfy attribute\-level semantic plausibility and tuple\-level dependency constraints[Yu et al\. \(2025\)](https://arxiv.org/html/2609.16069#bib.bib37)\. For example, a column may have a meaningful value range, an ordinal relation, or a domain\-specific interpretation\. Meanwhile, multiple columns may be linked by symbolic rules that define valid co\-occurrence patterns\. Some recent studies have started to use external knowledge or LLMs to improve tabular data generation and augmentation[Kwok et al\. \(2025\)](https://arxiv.org/html/2609.16069#bib.bib43);[Yang et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib7)\. However, these methods mainly use language models as data generators[Spinaci et al\. \(2026\)](https://arxiv.org/html/2609.16069#bib.bib39);[Jacob et al\. \(2026\)](https://arxiv.org/html/2609.16069#bib.bib42), prompt\-based augmenters[Long et al\. \(2025\)](https://arxiv.org/html/2609.16069#bib.bib38);[Zhang et al\. \(2025\)](https://arxiv.org/html/2609.16069#bib.bib44), or distribution refiners[Arazi et al\. \(2026\)](https://arxiv.org/html/2609.16069#bib.bib40);[Yang et al\. \(2026\)](https://arxiv.org/html/2609.16069#bib.bib41)\. They do not explicitly incorporate weak semantic priors into the generative dynamics of diffusion models\. Existing tabular diffusion methods also lack a mechanism to condition denoising on column identities, intra\-column semantics, and inter\-column symbolic rules at the same time\. In contrast, SCTab\-Diff studies semantics\-consistent tabular diffusion under weakly specified semantic priors\. Instead of treating semantic constraints as post\-hoc filters, SCTab\-Diff extracts intra\-column semantics and inter\-column symbolic rules from tabular schema and textual descriptions, then injects them into prior\-conditioned denoising\. This design enables the generator to preserve distributional fidelity while reducing rule\-violating and semantically implausible synthetic rows\.
## Appendix BAlgorithm and Theoretical Analysis
### B\.1Algorithms
Algorithm 1Training of SCTab\-Diff1:Tabular dataset
D=\{X,F\}D=\\\{X,F\\\}, weak semantic priors
PP, masking probability
pup\_\{u\}, noise schedules
\{σρi\(t\)\}i=1n\\\{\\sigma\_\{\\rho\_\{i\}\}\(t\)\\\}\_\{i=1\}^\{n\}
2:Trained denoising network
sθs\_\{\\theta\}and tabular decoder
3:Encode semantic priors into the unified semantic space:
𝐏=PLM\(P\)\\mathbf\{P\}=\\mathrm\{PLM\}\(P\)
4:repeat
5:Sample a mini\-batch
x∼Xx\\sim Xand timestep
t∼p\(t\)t\\sim p\(t\)
6:Sample prior mask
M=𝟏\{U\>pu\},U∼Uniform\(0,1\)mM=\\mathbf\{1\}\\\{U\>p\_\{u\}\\\},\\ U\\sim\\mathrm\{Uniform\}\(0,1\)^\{m\}
7:for
i=1,…,ni=1,\\dots,ndo
8:Construct column representation
h0,ih\_\{0,i\}and column identity embedding
eie\_\{i\}by Eq\. \([10](https://arxiv.org/html/2609.16069#S3.E10)\) and Eq\. \([11](https://arxiv.org/html/2609.16069#S3.E11)\)
9:Sample noise
ϵi∼𝒩\(0,I\)\\epsilon\_\{i\}\\sim\\mathcal\{N\}\(0,I\)
10:Apply column\-wise forward corruption:
ht,i=h0,i\+σρi\(t\)ϵih\_\{t,i\}=h\_\{0,i\}\+\\sigma\_\{\\rho\_\{i\}\}\(t\)\\epsilon\_\{i\}
11:Annotate noisy representation with column identity:
h~t,i=\[ht,i∥ei\]\\tilde\{h\}\_\{t,i\}=\[h\_\{t,i\}\\\|e\_\{i\}\]
12:Inject semantic priors through cross\-attention:
h¯t,i=PriorInjection\(h~t,i,𝐏∗M\)\\bar\{h\}\_\{t,i\}=\\mathrm\{PriorInjection\}\(\\tilde\{h\}\_\{t,i\},\\mathbf\{P\}\*M\)
13:endfor
14:Capture cross\-column dependencies:
h^t,1,…,h^t,n=DepCapture\(h¯t,1,…,h¯t,n\)\\hat\{h\}\_\{t,1\},\\dots,\\hat\{h\}\_\{t,n\}=\\mathrm\{DepCapture\}\(\\bar\{h\}\_\{t,1\},\\dots,\\bar\{h\}\_\{t,n\}\)
15:for
i=1,…,ni=1,\\dots,ndo
16:Predict noise:
ϵ^i=MLP\(h^t,i\)\\hat\{\\epsilon\}\_\{i\}=\\mathrm\{MLP\}\(\\hat\{h\}\_\{t,i\}\)
17:endfor
18:Compute diffusion loss Eq\. \([18](https://arxiv.org/html/2609.16069#S3.E18)\):
ℒdiff=∑i=1n‖ϵ^i−ϵi‖22\\mathcal\{L\}\_\{\\mathrm\{diff\}\}=\\sum\_\{i=1\}^\{n\}\\\|\\hat\{\\epsilon\}\_\{i\}\-\\epsilon\_\{i\}\\\|\_\{2\}^\{2\}
19:Decode clean latent representations
h0,1,…,h0,nh\_\{0,1\},\\dots,h\_\{0,n\}and compute reconstruction loss Eq\. \([20](https://arxiv.org/html/2609.16069#S3.E20)\):
ℒrec=ℓrecon\(x,x^\)\\mathcal\{L\}\_\{\\mathrm\{rec\}\}=\\ell\_\{\\mathrm\{recon\}\}\(x,\\hat\{x\}\)
20:Update parameters by minimizing
ℒ=ℒdiff\+λℒrec\\mathcal\{L\}=\\mathcal\{L\}\_\{\\mathrm\{diff\}\}\+\\lambda\\mathcal\{L\}\_\{\\mathrm\{rec\}\}
21:untilconvergence
Algorithm 2Synthetic Tabular Data Generation of SCTab\-Diff1:Trained SCTab\-Diff, column names
F=\{fi\}i=1nF=\\\{f\_\{i\}\\\}\_\{i=1\}^\{n\}, weak semantic priors
PP, number of synthetic samples
NsynN\_\{\\mathrm\{syn\}\}
2:Synthetic tabular dataset
D^\\hat\{D\}
3:Encode semantic priors:
𝐏=PLM\(P\)\\mathbf\{P\}=\\mathrm\{PLM\}\(P\)
4:Encode column identities:
ei=Average\(PLM\(fi\)\),i=1,…,ne\_\{i\}=\\mathrm\{Average\}\(\\mathrm\{PLM\}\(f\_\{i\}\)\),\\ i=1,\\dots,n
5:Set
M=𝟏M=\\mathbf\{1\}unless sampling under incomplete\-prior settings
6:for
m=1,…,Nsynm=1,\\dots,N\_\{\\mathrm\{syn\}\}do
7:for
i=1,…,ni=1,\\dots,ndo
8:Initialize latent variable Eq\. \([12](https://arxiv.org/html/2609.16069#S3.E12)\):
hT,i∼𝒩\(0,σρi2\(T\)I\)h\_\{T,i\}\\sim\\mathcal\{N\}\(0,\\sigma\_\{\\rho\_\{i\}\}^\{2\}\(T\)I\)
9:endfor
10:for
t=T,…,1t=T,\\dots,1do
11:for
i=1,…,ni=1,\\dots,ndo
12:Annotate noisy latent representation:
h~t,i=\[ht,i∥ei\]\\tilde\{h\}\_\{t,i\}=\[h\_\{t,i\}\\\|e\_\{i\}\]
13:Inject semantic priors Eq\. \([15](https://arxiv.org/html/2609.16069#S3.E15)\):
h¯t,i=PriorInjection\(h~t,i,𝐏∗M\)\\bar\{h\}\_\{t,i\}=\\mathrm\{PriorInjection\}\(\\tilde\{h\}\_\{t,i\},\\mathbf\{P\}\*M\)
14:endfor
15:Capture cross\-column dependencies:
h^t,1,…,h^t,n=DepCapture\(h¯t,1,…,h¯t,n\)\\hat\{h\}\_\{t,1\},\\dots,\\hat\{h\}\_\{t,n\}=\\mathrm\{DepCapture\}\(\\bar\{h\}\_\{t,1\},\\dots,\\bar\{h\}\_\{t,n\}\)
16:for
i=1,…,ni=1,\\dots,ndo
17:Predict noise:
ϵ^i=MLP\(h^t,i\)\\hat\{\\epsilon\}\_\{i\}=\\mathrm\{MLP\}\(\\hat\{h\}\_\{t,i\}\)
18:Approximate the prior\-conditioned score:
sθ\(ht,i,t,𝐏,ei,ht,−i\)=−ϵ^iσρi\(t\)s\_\{\\theta\}\(h\_\{t,i\},t,\\mathbf\{P\},e\_\{i\},h\_\{t,\-i\}\)=\-\\frac\{\\hat\{\\epsilon\}\_\{i\}\}\{\\sigma\_\{\\rho\_\{i\}\}\(t\)\}
19:Update
ht,ih\_\{t,i\}to
ht−1,ih\_\{t\-1,i\}using the reverse denoising step in Eq\. \([9](https://arxiv.org/html/2609.16069#S3.E9)\)
20:endfor
21:endfor
22:Obtain denoised latent representations
h^0,1,…,h^0,n\\hat\{h\}\_\{0,1\},\\dots,\\hat\{h\}\_\{0,n\}
23:for
i=1,…,ni=1,\\dots,ndo
24:Decode
h^0,i\\hat\{h\}\_\{0,i\}into
x^i\\hat\{x\}\_\{i\}using the tabular decoder in Eq\. \([19](https://arxiv.org/html/2609.16069#S3.E19)\)
25:endfor
26:Form one synthetic row
x^=\(x^1,…,x^n\)\\hat\{x\}=\(\\hat\{x\}\_\{1\},\\dots,\\hat\{x\}\_\{n\}\)and add it to
D^\\hat\{D\}
27:endfor
28:return
D^\\hat\{D\}
In this section, we summarize the training and synthetic data generation procedures of SCTab\-Diff\. Algorithm[1](https://arxiv.org/html/2609.16069#alg1)presents the training process, while Algorithm[2](https://arxiv.org/html/2609.16069#alg2)describes the reverse denoising and reconstruction process used for synthetic tabular data generation\.
During training, SCTab\-Diff first encodes the weak semantic priorsPPinto the unified semantic space as𝐏=PLM\(P\)\\mathbf\{P\}=\\mathrm\{PLM\}\(P\)\. For each mini\-batch, a timestepttand a prior maskMMare sampled\. Each column valuexix\_\{i\}is then mapped into its initial semantic representationh0,ih\_\{0,i\}, and the corresponding column identityfif\_\{i\}is encoded aseie\_\{i\}\. Gaussian noise is injected into each column representation through the column\-wise forward process, yieldinght,i=h0,i\+σρi\(t\)ϵih\_\{t,i\}=h\_\{0,i\}\+\\sigma\_\{\\rho\_\{i\}\}\(t\)\\epsilon\_\{i\}\. To implement prior\-conditioned denoising, the noisy representation is first annotated with its column identity, and the masked semantic prior representation𝐏∗M\\mathbf\{P\}\*Mis then injected through cross\-attention\. The resulting prior\-enhanced column representations are passed into the dependency capture module to model cross\-column context\. Finally, the denoising network predicts the injected noiseϵ^i\\hat\{\\epsilon\}\_\{i\}, and the diffusion loss is computed by matchingϵ^i\\hat\{\\epsilon\}\_\{i\}with the true noiseϵi\\epsilon\_\{i\}\. The decoder is trained with the reconstruction objective, and all trainable parameters are optimized by minimizing the combined training loss\.
During generation, SCTab\-Diff starts from Gaussian latent variableshT,ih\_\{T,i\}sampled independently for each column\. At each reverse denoising step, the model uses the column identity embeddingeie\_\{i\}, the semantic prior embedding𝐏\\mathbf\{P\}, and the current cross\-column contextht,−ih\_\{t,\-i\}to approximate the prior\-conditioned score\. The reverse process iteratively updatesht,ih\_\{t,i\}toht−1,ih\_\{t\-1,i\}until denoised latent representationsh^0,1,…,h^0,n\\hat\{h\}\_\{0,1\},\\dots,\\hat\{h\}\_\{0,n\}are obtained\. These representations are then decoded column by column through the tabular decoder to form a synthetic rowx^\\hat\{x\}\. Repeating this process yields the synthetic tabular datasetD^\\hat\{D\}\.
It is worth noting that the PLM encoder and the tabular reconstruction module follow the pretraining strategy of[Zhang et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib12)\. Their parameters are kept frozen when training the denoising network of SCTab\-Diff\.
### B\.2Analysis of Prior\-Conditioned Denoising
This section provides an interpretation of why prior\-conditioned denoising can improve semantic consistency\. The analysis does not introduce an additional training objective\. Instead, it explains how weak semantic priors change the reverse denoising direction\.
##### Bayesian view of semantic conditioning\.
Recall that𝒱\(P\)\\mathcal\{V\}\(P\)denotes the semantic validity set induced by weak semantic priorsPP\. We define the semantic validity event as
ℰP=\{x0∈𝒱\(P\)\},\\mathcal\{E\}\_\{P\}=\\\{x\_\{0\}\\in\\mathcal\{V\}\(P\)\\\},\(21\)which means that the clean tabular row satisfies the weak semantic priors\. In conventional diffusion, the reverse process follows the distributional score∇htlogpt\(ht\)\\nabla\_\{h\_\{t\}\}\\log p\_\{t\}\(h\_\{t\}\), which guides noisy samples toward high\-density regions of the perturbed data distribution\. In contrast, semantics\-consistent generation should follow the score of the perturbed distribution conditioned on the validity event:
∇htlogpt\(ht∣ℰP\)\.\\nabla\_\{h\_\{t\}\}\\log p\_\{t\}\(h\_\{t\}\\mid\\mathcal\{E\}\_\{P\}\)\.\(22\)By Bayes’ rule, we have
pt\(ht∣ℰP\)=pt\(ht\)Pr\(ℰP∣ht\)Pr\(ℰP\)\.p\_\{t\}\(h\_\{t\}\\mid\\mathcal\{E\}\_\{P\}\)=\\frac\{p\_\{t\}\(h\_\{t\}\)\\Pr\(\\mathcal\{E\}\_\{P\}\\mid h\_\{t\}\)\}\{\\Pr\(\\mathcal\{E\}\_\{P\}\)\}\.\(23\)Taking the gradient with respect tohth\_\{t\}gives
∇htlogpt\(ht∣ℰP\)=∇htlogpt\(ht\)\+∇htlogPr\(ℰP∣ht\)\.\\nabla\_\{h\_\{t\}\}\\log p\_\{t\}\(h\_\{t\}\\mid\\mathcal\{E\}\_\{P\}\)=\\nabla\_\{h\_\{t\}\}\\log p\_\{t\}\(h\_\{t\}\)\+\\nabla\_\{h\_\{t\}\}\\log\\Pr\(\\mathcal\{E\}\_\{P\}\\mid h\_\{t\}\)\.\(24\)Eq\. \([24](https://arxiv.org/html/2609.16069#A2.E24)\) shows that the semantics\-aware score can be decomposed into two terms\. The first term is the standard distributional score, which encourages statistical realism\. The second term increases the probability that the noisy representation will be denoised into a semantically valid row\. Therefore, semantic priors affect the denoising direction before a complete sample is generated, rather than being applied as post\-hoc filters\.
##### Connection to prior\-conditioned score estimation\.
In SCTab\-Diff, we do not explicitly estimatePr\(ℰP∣ht\)\\Pr\(\\mathcal\{E\}\_\{P\}\\mid h\_\{t\}\)\. Instead, the denoising network amortizes this effect by conditioning score estimation on weak semantic priors, column identity, and cross\-column context:
sθ\(ht,i,t,𝐏,ei,ht,−i\)≈−σρi\(t\)∇ht,ilogpt\(ht,i∣𝐏,ei,ht,−i\)\.s\_\{\\theta\}\(h\_\{t,i\},t,\\mathbf\{P\},e\_\{i\},h\_\{t,\-i\}\)\\approx\-\\sigma\_\{\\rho\_\{i\}\}\(t\)\\nabla\_\{h\_\{t,i\}\}\\log p\_\{t\}\(h\_\{t,i\}\\mid\\mathbf\{P\},e\_\{i\},h\_\{t,\-i\}\)\.\(25\)Here,𝐏\\mathbf\{P\}provides semantic prior information,eie\_\{i\}specifies the column identity, andht,−ih\_\{t,\-i\}provides row\-level context\. This conditional score can be viewed as an amortized approximation to the semantics\-aware score in Eq\. \([24](https://arxiv.org/html/2609.16069#A2.E24)\)\. In this sense, the model learns to move noisy column representations toward regions that are not only likely under the data distribution, but also compatible with weak semantic priors\.
##### Effect on invalid regions\.
The decomposition above also explains why prior\-conditioned denoising can reduce invalid samples\. For any noisy latent representationhth\_\{t\}, Bayes’ rule gives
pt\(ht∣ℰP\)pt\(ht\)=Pr\(ℰP∣ht\)Pr\(ℰP\)\.\\frac\{p\_\{t\}\(h\_\{t\}\\mid\\mathcal\{E\}\_\{P\}\)\}\{p\_\{t\}\(h\_\{t\}\)\}=\\frac\{\\Pr\(\\mathcal\{E\}\_\{P\}\\mid h\_\{t\}\)\}\{\\Pr\(\\mathcal\{E\}\_\{P\}\)\}\.\(26\)Thus, noisy states that are more likely to denoise into semantically valid rows receive larger relative density under the semantics\-conditioned distribution\. For two noisy stateshtah\_\{t\}^\{a\}andhtbh\_\{t\}^\{b\}, if
Pr\(ℰP∣hta\)\>Pr\(ℰP∣htb\),\\Pr\(\\mathcal\{E\}\_\{P\}\\mid h\_\{t\}^\{a\}\)\>\\Pr\(\\mathcal\{E\}\_\{P\}\\mid h\_\{t\}^\{b\}\),\(27\)then
pt\(hta∣ℰP\)/pt\(htb∣ℰP\)pt\(hta\)/pt\(htb\)=Pr\(ℰP∣hta\)Pr\(ℰP∣htb\)\>1\.\\frac\{p\_\{t\}\(h\_\{t\}^\{a\}\\mid\\mathcal\{E\}\_\{P\}\)/p\_\{t\}\(h\_\{t\}^\{b\}\\mid\\mathcal\{E\}\_\{P\}\)\}\{p\_\{t\}\(h\_\{t\}^\{a\}\)/p\_\{t\}\(h\_\{t\}^\{b\}\)\}=\\frac\{\\Pr\(\\mathcal\{E\}\_\{P\}\\mid h\_\{t\}^\{a\}\)\}\{\\Pr\(\\mathcal\{E\}\_\{P\}\\mid h\_\{t\}^\{b\}\)\}\>1\.\(28\)This means that semantic conditioning increases the relative likelihood of trajectories that can lead to valid rows\. In contrast, trajectories that are likely to end in𝒱c\(P\)\\mathcal\{V\}^\{c\}\(P\), the complement of the validity set, are relatively down\-weighted\. This provides an intuitive explanation for why SCTab\-Diff can reduce tuple\-level semantic violations while maintaining distributional fidelity\.
##### Robustness induced by prior masking\.
Weak semantic priors may be incomplete in real applications\. To improve robustness, SCTab\-Diff randomly masks prior tokens during training\. LetM∈\{0,1\}mM\\in\\\{0,1\\\}^\{m\}denote the prior mask, where each prior token is retained with probability1−pu1\-p\_\{u\}\. The training objective can be viewed as minimizing the expected denoising loss over different available prior subsets:
ℒdiff=𝔼t,ϵ,M∑i=1n‖ϵi−ϵθ\(ht,i,t,𝐏∗M,ei,ht,−i\)‖22\.\\mathcal\{L\}\_\{\\mathrm\{diff\}\}=\\mathbb\{E\}\_\{t,\\epsilon,M\}\\sum\_\{i=1\}^\{n\}\\left\\\|\\epsilon\_\{i\}\-\\epsilon\_\{\\theta\}\(h\_\{t,i\},t,\\mathbf\{P\}\\ast M,e\_\{i\},h\_\{t,\-i\}\)\\right\\\|\_\{2\}^\{2\}\.\(29\)The expected number of active prior tokens is:
𝔼\[‖M‖0\]=\(1−pu\)m\.\\mathbb\{E\}\\left\[\\\|M\\\|\_\{0\}\\right\]=\(1\-p\_\{u\}\)m\.\(30\)Therefore, prior masking trains the model under multiple partial\-prior conditions rather than assuming complete prior availability\. This acts as a regularizer and prevents the denoising network from over\-relying on a fixed, complete prior set\. A largerpup\_\{u\}weakens semantic guidance, while a moderatepup\_\{u\}improves robustness to incomplete priors\.
## Appendix CDetailed Experiment Setups
### C\.1Datasets
Table 4:Statistics of datasets\. \# Num/Cat stands for the number of numerical columns and the number of categorical columns, respectively\. \# Weak Semantic Priors for the number of Inter\-Column Symbolic Rules and Intra\-Column Semantics, respectively\.We use six tabular datasets from the UCI machine learning library222[https://archive\.ics\.uci\.edu/datasets](https://archive.ics.uci.edu/datasets), including Adult, Default, Shoppers, and Magic datasets for classification tasks, as well as Beijing and News datasets for regression tasks\. The statistical information of the dataset is shown in Table[4](https://arxiv.org/html/2609.16069#A3.T4)\. Weak Semantic Priors for each dataset are shown in Tables \[[10](https://arxiv.org/html/2609.16069#A6.T10)\-[15](https://arxiv.org/html/2609.16069#A6.T15)\]\.
### C\.2LLM\-based Prior Construction and Validation
To construct weak semantic priors used by SCTab\-Diff, we adopt a metadata\-driven LLM\-assisted protocol based onGPT\-4o mini\. The LLM is provided only with dataset metadata, tabular schema, and textual descriptions, and does not access raw tabular records during candidate constraint generation\. The goal is not to use the LLM as an unconstrained rule generator, but to extract candidate constraints from weak semantic sources and validate them with observed training data before they are used as semantic conditions\.
##### Candidate constraint generation\.
For each dataset, we provide the LLM with the tabular schema and textual descriptions from the dataset metadata\. The LLM does not access raw table records during this stage\. It is instructed to generate two types of candidate priors: intra\-column semantics and inter\-column symbolic rules\. Intra\-column semantics describe the valid value space or semantic type of an individual column, such as numerical ranges, categorical domains, non\-negativity, or ordinal meanings\. Inter\-column symbolic rules describe dependency constraints across multiple columns, such as compatibility relations, temporal consistency, or order constraints\. To make the generated priors verifiable, the LLM is asked to express candidate constraints as Python\-style checking code\.
##### Validation with observed data\.
Since LLM\-generated constraints may be incomplete or noisy, we validate each candidate constraint on the real training split\. For each rulerkr\_\{k\}, we compute its violation rate as:
v\(rk\)=1\|𝒟train\|∑x∈𝒟train𝕀\[ϕk\(x\)=0\],v\(r\_\{k\}\)=\\frac\{1\}\{\|\\mathcal\{D\}\_\{\\mathrm\{train\}\}\|\}\\sum\_\{x\\in\\mathcal\{D\}\_\{\\mathrm\{train\}\}\}\\mathbb\{I\}\\left\[\\phi\_\{k\}\(x\)=0\\right\],whereϕk\(x\)\\phi\_\{k\}\(x\)is the Boolean checking function of rulerkr\_\{k\}\. Candidate constraints with low violation rates and clear metadata support are retained as weak semantic priors\. Constraints with high violation rates are discarded if they are not supported by the metadata, or revised when the violation pattern indicates that the original rule is overly strict\. This validation step is performed only on the training split and does not use the test split or generated samples\. The real training data is never exposed to the LLM during candidate constraint generation; it only serves as a post\-generation validation source for filtering or revising unreliable constraints\.
##### Natural\-language verbalization\.
After validation, the retained constraints are converted into natural\-language descriptions for reporting\. The LLM is only allowed to verbalize the validated constraints and is not allowed to introduce new rules\. The final descriptions are organized into Dataset Constraints, Intra\-Column Semantics, and Inter\-Column Symbolic Rules, as shown in Tables[10](https://arxiv.org/html/2609.16069#A6.T10)–[15](https://arxiv.org/html/2609.16069#A6.T15)\. These validated priors are then encoded and used as semantic conditions in the prior\-conditioned denoising process of SCTab\-Diff\.
Table 5:Prompt templates used for LLM\-based weak semantic prior construction\.
### C\.3Baselines
In this section, we introduce the baseline methods used in this paper in three groups:
1\) Traditional methods include GAN\-based methods \(e\.g\., CTGAN and CTGAN\+\) and VAE\-based methods \(e\.g\., TVAE\):
- •CTGAN and TVAE are two methods for synthetic tabular data generation proposed by[Xu et al\. \(2019\)](https://arxiv.org/html/2609.16069#bib.bib5)\. While both methods share the same underlying framework, they are built on different generative models: CTGAN is based on GANs, whereas TVAE relies on VAEs\. Both approaches incorporate two key components: \(1\) mode\-specific normalization, designed to handle numerical columns with complex distributions; and \(2\) conditional generation of numerical columns based on categorical columns, aimed at addressing imbalance issues\.
- •CTAB\-GAN\+\([Zhao et al\., 2024](https://arxiv.org/html/2609.16069#bib.bib6)\)builds upon existing methods CTGAN by incorporating RDP\-based privacy accounting, similar to DP\-WGAN\([Huang et al\., 2022](https://arxiv.org/html/2609.16069#bib.bib13)\)\. Furthermore, by leveraging the Was\+GP loss, CTAB\-GAN\+ effectively constrains the gradient norm, eliminating the need for weight clipping and resulting in more stable training for differentially private GANs\.
2\) LLM\-based methods:
- •P\-TA\([Yang et al\., 2024](https://arxiv.org/html/2609.16069#bib.bib7)\)proposes the use of Proximal Policy Optimization \(PPO\([Schulman et al\., 2017](https://arxiv.org/html/2609.16069#bib.bib8)\)\) to apply GANs to guide LLMs to refine the probability distribution of tabular features and thereby generate more realistic data\.
3\) Diffusion model methods:
- •TabDDPM\([Kotelnikov et al\., 2023](https://arxiv.org/html/2609.16069#bib.bib9)\)addresses the difficulty of handling categorical features in diffusion models by introducing additional categorical diffusion models specifically for categorical features\. Despite its simplicity, our experiments have shown that TabDDPM achieves excellent performance\.
- •TABSYN\([Zhang et al\., 2024](https://arxiv.org/html/2609.16069#bib.bib12)\)synthesizes tabular data by leveraging a diffusion model within a VAE\-crafted latent space\. Meanwhile, it adopts a simplified forward diffusion process, which adds Gaussian noises of linear standard deviation with respect to time, thus improving sampling speed\.
- •TABDIFF\([Shi et al\., 2025](https://arxiv.org/html/2609.16069#bib.bib18)\)introduces a joint continuous\-time diffusion process for both numerical and categorical data, enabling the modeling of multimodal distributions of tabular data within a single unified framework\. To address the large differences in the distributions of individual features, TABDIFF employs a feature\-based learnable diffusion process, which improves the model’s ability to accurately capture the overall data distribution\.
##### Discussion on constrained baseline variants\.
Post\-hoc constrained variants, such as rejection sampling or rule\-based repair, are not included as primary baselines because they evaluate a different mechanism from SCTab\-Diff\. SCTab\-Diff does not apply weak semantic priors after generation\. Instead, it encodes them as semantic embeddings and injects them into the reverse denoising process as generation conditions\. In contrast, post\-hoc filtering may improve rule satisfaction by discarding invalid samples, but can also change the generated distribution and reduce diversity\. Rule\-based repair may enforce local validity, but can move samples away from the learned data manifold\. Moreover, most existing tabular diffusion models do not provide a direct interface for incorporating textual or symbolic priors into denoising without architectural changes\. Therefore, we focus on comparing SCTab\-Diff with representative tabular generators under the same evaluation protocol, and use ablation studies to isolate the effects of intra\-column semantics, inter\-column symbolic rules, the unified semantic space, and the column\-wise forward process\.
### C\.4Metrics
In this section, we provide a detailed introduction to all the evaluation metrics used in this paper\.
Evaluation Metrics\.We evaluate the quality of the generated data from three aspects:*distribution fidelity*,*structural and semantic fidelity*, and*task fidelity*\. Specifically,*Distribution fidelity*measures the alignment between synthetic and real data distributions\. We focus on per\-column marginal distributions using Shape\. Additionally, we reportα\\alpha\-Precision,β\\beta\-Recall, and C2ST to evaluate the overall distribution in Appendix[D\.1](https://arxiv.org/html/2609.16069#A4.SS1)and[D\.2](https://arxiv.org/html/2609.16069#A4.SS2)\. These metrics quantify precision, diversity/coverage, and overall distinguishability between real and synthetic samples, respectively\.*Structural and semantic fidelity*evaluates whether inter\-column dependencies and domain\-specific constraints are preserved\. We use Trend to measure the preservation of relational dependencies, and SA is used to evaluate the extent to which the synthetic dataset satisfies the constraints of the real tabular data\.*Task fidelity*assesses the usability of the generated data in downstream tasks\. We evaluate this using Machine Learning Efficiency \(MLE\), including RMSE and AUC as performance metrics\.
#### C\.4\.1Shape and Trend
Shape\.This metric measures the column\-wise density estimation performance, which includes the Kolmogorov\-Smirnov Test \(KST\)\([Berger and Zhou, 2014](https://arxiv.org/html/2609.16069#bib.bib14)\)for numerical features and the Total Variation Distance \(TVD\)\([Tao et al\., 2024](https://arxiv.org/html/2609.16069#bib.bib15)\)for categorical data\. Given two numerical distributions,pr\(x\)p\_\{r\}\(x\)\(representing real data\) andps\(x\)p\_\{s\}\(x\)\(representing synthetic data\), KST quantifies the distance between these distributions by calculating the maximum discrepancy between their corresponding Cumulative Distribution Functions \(CDFs\):
KST=supx\|Fr\(x\)−Fs\(x\)\|,\\text\{KST\}=\\sup\_\{x\}\\left\|F\_\{r\}\(x\)\-F\_\{s\}\(x\)\\right\|,\(31\)
whereFr\(x\)F\_\{r\}\(x\)andFs\(x\)F\_\{s\}\(x\)are the CDFs ofpr\(x\)p\_\{r\}\(x\)andps\(x\)p\_\{s\}\(x\), respectively:
F\(x\)=∫−∞xp\(x\)𝑑x\.F\(x\)=\\int\_\{\-\\infty\}^\{x\}p\(x\)\\,dx\.\(32\)
For categorical data, the TVD is commonly used\. TVD computes the frequency of each category and expresses it as a probability\. The TVD score represents the average difference between the probabilities of each category:
TVD=12∑ω∈Ω\|R\(ω\)−S\(ω\)\|,\\text\{TVD\}=\\frac\{1\}\{2\}\\sum\_\{\\omega\\in\\Omega\}\\left\|R\(\\omega\)\-S\(\\omega\)\\right\|,\(33\)
whereω\\omegarepresents all possible categories in a given columnΩ\\Omega, andR\(⋅\)R\(\\cdot\)andS\(⋅\)S\(\\cdot\)denote the real and synthetic frequencies for these categories, respectively\.
Trend\.This metric measures the pair\-wise column correlation estimation performance, which includes the Pearson Score for a pair of numerical columns and the Contingency Score for a pair of categorical columns:
Pearson Score=12𝔼x,y\|ρR\(x,y\)−ρS\(x,y\)\|,\\displaystyle\\text\{Pearson Score\}=\\frac\{1\}\{2\}\\mathbb\{E\}\_\{x,y\}\\left\|\\rho^\{R\}\(x,y\)\-\\rho^\{S\}\(x,y\)\\right\|,\(34\)Contingency Score=12∑α∈A∑β∈B\|Rα,β−Sα,β\|,\\displaystyle\\text\{Contingency Score\}=\\frac\{1\}\{2\}\\sum\_\{\\alpha\\in A\}\\sum\_\{\\beta\\in B\}\\left\|R\_\{\\alpha,\\beta\}\-S\_\{\\alpha,\\beta\}\\right\|,whereρR\(x,y\)\\rho^\{R\}\(x,y\)andρS\(x,y\)\\rho^\{S\}\(x,y\)denotes the Pearson correlation coefficient between columnxxand columnyyof the real data and synthetic data, respectively\.α\\alphaandβ\\betadescribe all the possible categories in column A and column B, respectively\.Rα,βR\_\{\\alpha,\\beta\}andSα,βS\_\{\\alpha,\\beta\}are the joint frequency ofα\\alphaandβ\\betain the real data and synthetic data, respectively\.
#### C\.4\.2α\\alpha\-Precision andβ\\beta\-Recall
Following[Zhang et al\. \(2024\)](https://arxiv.org/html/2609.16069#bib.bib12), we adopt theα\\alpha\-Precision andβ\\beta\-Recall metrics introduced in[Alaa et al\. \(2022\)](https://arxiv.org/html/2609.16069#bib.bib16)to evaluate the quality of synthetic tabular data\. These two metrics are designed to provide sample\-level assessments of how well the synthetic data approximates the real data distribution, focusing on two critical aspects: fidelity and coverage\.
α\\alpha\-Precision quantifies the fidelity of the synthetic data\. Specifically, it measures the proportion of synthetic samples that lie within the support of the real data distribution\. In essence, it evaluates whether the synthetic data points are realistic and indistinguishable from genuine data samples\. A highα\\alpha\-Precision score indicates that the synthetic generator avoids producing out\-of\-distribution samples\. On the other hand,β\\beta\-Recall measures the coverage of the real data by the synthetic data\. It reflects how well the synthetic samples represent the entire variability of the real data\. In practice,β\\beta\-Recall evaluates whether every real data point is “close enough” to at least one synthetic sample, thereby assessing how comprehensively the synthetic distribution captures the diversity present in the original dataset\.
Together,α\\alpha\-Precision andβ\\beta\-Recall provide a balanced view of synthetic data quality: the former ensures fidelity, while the latter ensures completeness\. These metrics are particularly important for applications such as data augmentation, privacy\-preserving data sharing, and model training, where both overfitting to narrow patterns and missing important data characteristics can significantly harm downstream performance\.
#### C\.4\.3Machine Learning Efficiency \(MLE\)
To measure the ability of synthetic tabular data to support downstream task learning, we evaluate their performance using Machine Learning Efficiency \(MLE\)\. Specifically, we adopt the Training on Synthetic and Testing on Real \(TSTR\)\([Fekri et al\., 2019](https://arxiv.org/html/2609.16069#bib.bib17)\)scheme\. In this approach, the real dataset is first split into a training set and a testing set\. Next, a generation model is used to synthesize synthetic data that matches the size of the training set\. This synthetic data is then used to train an XGBoost classifier or XGBoost regressor\. Finally, we evaluate these machine learning models based on the real test set, calculating the AUC scores for classification tasks and the RMSE for regression tasks, respectively\.
#### C\.4\.4Ability to Accurately Generate Sample
Sample Accuracy \(SA\) evaluates the ability of a generative model to correctly generate samples, that is, whether the generated samples can accurately follow Weak Semantic Priors and domain knowledge, as shown in Tables \[[10](https://arxiv.org/html/2609.16069#A6.T10)\-[15](https://arxiv.org/html/2609.16069#A6.T15)\]\. Enhancing the model’s ability to generate accurate and representative samples can significantly reduce the likelihood of producing biased or even toxic outputs\. This improvement is particularly important for downstream tasks, where the quality and reliability of the synthetic data directly impact model performance, fairness, and safety\.
#### C\.4\.5Detection
Detection evaluates how difficult it is to distinguish synthetic data from real data when the two are mixed\. Specifically, we adopt the Classifier Two\-Sample Test \(C2ST\) as implemented in the SDMetrics library333[https://docs\.sdv\.dev/sdmetrics](https://docs.sdv.dev/sdmetrics), where a logistic regression model serves as the discriminator\.
## Appendix DAddition Experimental Results
### D\.1Joint Distribution
Table 6:Comparison ofα\\alpha\-Precision scores\. Bold Face represents the best score on each dataset and marks the suboptimal ones with an underline\.Table 7:Comparison ofβ\\beta\-Recall scores\. Bold Face represents the best score on each dataset and marks the suboptimal ones with an underline\.We use column\-related distribution, including the column\-wise density estimation and pairwise column correlation estimation, to evaluate the fidelity of synthetic data generated from different models\. However, these results are insufficient to evaluate the synthetic data’s overall density estimation performance\. Therefore, in this section, we adoptα\\alpha\-Precision andβ\\beta\-Recall to evaluate the joint distribution of the synthetic data\.
As shown in Tables[6](https://arxiv.org/html/2609.16069#A4.T6)and[7](https://arxiv.org/html/2609.16069#A4.T7), we compared theα\\alpha\-Precision andβ\\beta\-Recall scores of the SCTab\-Diff and baseline, respectively\. SCTab\-Diff achieved improvements of 0\.60% and 2\.72% in these two metrics compared to the suboptimal method TABDIFF\([Shi et al\., 2025](https://arxiv.org/html/2609.16069#bib.bib18)\), indicating that SCTab\-Diff maintains a balance between extensive data coverage and preserving fine\-grained details, thus faithfully capturing the breadth and depth of the true data distribution\.
### D\.2Detection Score \(C2ST\)
Table 8:Detection score \(C2ST\) using logistic regression classifier\. Bold Face represents the best score on each dataset and marks the suboptimal ones with an underline\.SCTab\-Diff achieves either the best or second\-best performance in terms of the Detection Score measured by the C2ST\. This metric reflects how distinguishable the synthetic data is from the real data\. The strong performance of SCTab\-Diff under this metric suggests that the synthetic samples generated are highly realistic and closely align with the underlying real data distribution\. Compared to baseline models, SCTab\-Diff produces synthetic data that is more difficult for a classifier \(logistic regression\) to distinguish from real data, demonstrating its effectiveness in preserving key statistical properties while minimizing artifacts that often arise in generative processes\. This property is particularly important for downstream applications where distributional consistency between synthetic and real data is crucial\.
### D\.3Analysis of Condition Guidance Level Parameters
Figure 5:The impact of Condition Guidance Level Parameterspup\_\{u\}on MLE, SA, Shape, and Trend across the Adult, Magic, Beijing, and News datasets\.To verify the impact of different Condition Guidance Levelspup\_\{u\}on the synthesized data \(i\.e\., what extent condition information should be considered during the sampling process\), we evaluate the variation trends of MLE, SA, Shape, and Trend with respect to thepup\_\{u\}on four datasets: Adult, Magic, Beijing, and News\. Adult and Magic are classification datasets, while Beijing and News are regression datasets\.
As shown in Fig\.[5](https://arxiv.org/html/2609.16069#A4.F5), we observe that the MLE, SA, Shape, and Trend metrics exhibit similar trends in response to changes in the Condition Guidance Level Parameterpup\_\{u\}\. The almost consistent pattern of changes in these metrics suggests that there may be a correlation between them, and that adjustingpup\_\{u\}influences multiple aspects of the synthesized data in a related manner\.
### D\.4Analysis of Prior Masking Probability
We further analyze the effect of the prior masking probabilitypup\_\{u\}\. In the main experiments, we setpu=0\.2p\_\{u\}=0\.2for all datasets\. This setting reflects a practical scenario where tabular schema and textual descriptions may be partially incomplete, while most semantic information remains available\. In real\-world tabular datasets, semantic priors are unlikely to be almost entirely missing\. Therefore, extremely large masking probabilities may correspond to overly pessimistic settings\.
The parameterpup\_\{u\}controls the probability of masking prior tokens during training\. A largerpup\_\{u\}weakens the semantic guidance received by the denoising network and may reduce semantic consistency\. However, the effect is not necessarily strictly monotonic, since moderate masking can also regularize the model and prevent over\-reliance on complete priors\. Table[9](https://arxiv.org/html/2609.16069#A4.T9)reports the results under different values ofpup\_\{u\}\. Overall, increasingpup\_\{u\}tends to reduce Shape, Trend, and SA, which is consistent with the intuition that masking more prior tokens weakens semantic guidance during denoising\. Nevertheless, the degradation is generally moderate whenpu≤0\.2p\_\{u\}\\leq 0\.2, supporting the choice ofpu=0\.2p\_\{u\}=0\.2as a practical default setting\.
Table 9:Effect of prior masking probabilitypup\_\{u\}on data fidelity and semantic consistency\. The main experiments usepu=0\.2p\_\{u\}=0\.2\.Beijing
News
Shoppers
Adult
Default
Magic
### D\.5Visualization of Authenticity Comparison between Synthetic Data and Real Data
Figure 6:Visualization of real and synthetic samples on the Adult dataset\.Fig\.[6](https://arxiv.org/html/2609.16069#A4.F6)provides a sample\-level authenticity comparison between real Adult samples and synthetic samples generated by TABDIFF and SCTab\-Diff\. Unlike distribution\-level metrics, this visualization directly examines whether individual generated rows satisfy weak semantic priors\. In the figure, highlighted cells within the same row indicate detected violations of intra\-column semantics or inter\-column symbolic rules\. These violations correspond to unrealistic local patterns that may not be fully reflected by aggregate distributional fidelity metrics\.
As shown in Fig\.[6](https://arxiv.org/html/2609.16069#A4.F6), real samples are generally consistent with the predefined weak semantic priors\. For example, categorical attributes take valid values, numerical attributes remain within plausible ranges, and related columns such as*education*and*education\_num*follow their expected correspondence\. In contrast, TABDIFF can generate rows that appear plausible at the distribution level but contain tuple\-level semantic inconsistencies\. Typical examples include mismatches between*education*and*education\_num*, as well as incompatible combinations among*marital\.status*,*relationship*, and other demographic attributes\. These errors indicate that relying only on implicit correlations learned from data may be insufficient for enforcing semantic validity at the row level\.
Compared with TABDIFF, SCTab\-Diff produces fewer highlighted violations and better preserves the logical consistency among related columns\. This improvement comes from the prior\-conditioned denoising process, where weak semantic priors are encoded in the unified semantic space and injected into generation as semantic conditions\. As a result, SCTab\-Diff is better able to reduce unrealistic combinations while still maintaining distributional plausibility\. This sample\-level visualization further supports the quantitative SA results and shows that SCTab\-Diff improves not only statistical realism, but also semantic consistency of generated tabular rows\.
## Appendix EDetailed Visualization Experiment
This section supplements Section[4\.5](https://arxiv.org/html/2609.16069#S4.SS5)by providing a more detailed description of the distribution visualization experiment, as outlined below:
### E\.1Detailed Description of Numerical Column Distribution Visualization
Figure 7:Visualization of intra\-column distribution fidelity on Shoppers and News\.Fig\.[7](https://arxiv.org/html/2609.16069#A5.F7)provides a fine\-grained visualization of numerical column distribution fidelity\. Specifically, we plot the one\-dimensional kernel density estimation \(KDE\) curves for the numerical column*BounceRates*in Shoppers and the numerical column*n\_tokens\_title*in News\. The black curve denotes the real data distribution, while the blue curve denotes the synthetic data distribution generated by each method\. This visualization complements the Shape metric by showing whether each model can preserve detailed numerical density patterns beyond aggregate column\-wise scores\.
As shown in Fig\.[7](https://arxiv.org/html/2609.16069#A5.F7), different methods exhibit clear differences in numerical distribution preservation\. For the*BounceRates*column in Shoppers, the real distribution is highly concentrated near zero with a small peak around larger values\. TabDDPM, TABSYN, and TABDIFF fail to accurately capture these density peaks, which indicates that they either over\-smooth the numerical distribution or shift probability mass away from high\-density regions\. In contrast, SCTab\-Diff more closely follows the real KDE curve and better preserves both the dominant near\-zero region and the secondary high\-value region\.
For the*n\_tokens\_title*column in News, the distribution is more challenging because News contains a relatively large number of features\. TabDDPM exhibits a severe degeneration on this column, where the generated values are highly concentrated, and most synthetic samples collapse into a narrow range\. As a result, its KDE curve becomes extremely sharp, making the real distribution visually compressed under the same density scale\. This suggests that TabDDPM struggles to generate high\-dimensional tabular data with many correlated features, possibly because it does not explicitly model feature identity and cross\-feature dependency during denoising\. In contrast, TABSYN and TABDIFF produce more reasonable distributions, while SCTab\-Diff further aligns better with the real density shape\. This indicates that the unified semantic space and prior\-conditioned denoising help SCTab\-Diff preserve numerical column distributions even when the table contains many features\.
For the*n\_tokens\_title*column in News, the distribution is more complex and has a clear central density region\. TabDDPM exhibits a visible distributional shift and fails to match the real density shape\. TABSYN and TABDIFF improve the fit, but still show mismatches around the main peak\. SCTab\-Diff produces a synthetic distribution that is more aligned with the real curve\. The unified semantic space and column\-wise diffusion process help preserve value\-sensitive numerical semantics\.
### E\.2Detailed Description of Inter\-Column Dependency Visualization
Figure 8:Visualization of inter\-column dependency preservation on Shoppers and News\.Fig\.[8](https://arxiv.org/html/2609.16069#A5.F8)visualizes the ability of different methods to preserve inter\-column dependency patterns on Shoppers and News\. We use heatmaps to compare pair\-wise dependency preservation between real and synthetic data\. Lighter colors indicate stronger preservation of real dependency patterns, while darker regions indicate larger deviations\. This visualization complements the Trend metric by showing whether a model can maintain global cross\-column structures rather than only individual column distributions\.
As shown in Fig\.[8](https://arxiv.org/html/2609.16069#A5.F8), TabDDPM and TABSYN show more dark blocks on both datasets\. This suggests that their generated data contains larger discrepancies in pair\-wise column relationships\. These deviations are especially visible on News, where the number of columns is larger and the dependency structure is more complex\. Although TABDIFF preserves part of the dependency structure, it still shows visible mismatches in several off\-diagonal regions\.
In contrast, SCTab\-Diff produces heatmaps that are more consistent with the real dependency patterns\. On Shoppers, SCTab\-Diff better preserves the block\-wise dependency structure among behavioral features\. On News, SCTab\-Diff maintains more coherent pair\-wise relationships across article\-level features\. This improvement can be attributed to prior\-conditioned denoising, where weak semantic priors and cross\-column context are jointly used during the reverse process\. These results indicate that SCTab\-Diff not only preserves marginal column distributions, but also better captures inter\-column dependencies\. This further supports the Trend improvements reported in Table[1](https://arxiv.org/html/2609.16069#S4.T1)\.
## Appendix FLimitations
SCTab\-Diff has several limitations\. First, the quality of weak semantic priors depends on the availability and informativeness of tabular schema and textual descriptions\. Although candidate priors are validated on the real training split, noisy or incomplete metadata may still lead to imperfect semantic guidance\. Second, the current framework mainly considers intra\-column semantics and inter\-column symbolic rules\. More complex forms of domain knowledge, such as causal relations or procedural constraints, are not explicitly modeled\. Third, our experiments are conducted on six real\-world tabular benchmarks, which may not fully cover highly specialized domains with stricter semantic requirements\. Finally, while the LLM used for prior extraction does not access raw tabular records, the generative model is still trained on real data\. Future work will explore stronger privacy auditing, privacy\-preserving training, and richer semantic prior representations\.
Table 10:Weak Semantic Priors of Adult\.Dataset Constraints
Predict whether the annual income of an individual exceeds $50K/yr based on census data\. Also known as the “Census Income” dataset\.Intra\-Column Semantics 1\.Age is between 17 and 90 \(inclusive of 17, exclusive of 91\)\. 2\.Workclass must be one of a specific list \(e\.g\., “Private”, “Federal\-gov”, etc\.\)\. 3\.Fnlwgt \(final weight\) must be a non\-negative number\. 4\.Education must be from a predefined list \(e\.g\., “HS\-grad”, “Masters”, etc\.\)\. 5\.Education number \(numeric representation\) must be between 1 and 16\. 6\.Marital status must match one of the listed valid options\. 7\.Occupation must match a set list of roles\. 8\.Relationship must be a valid type \(e\.g\., “Husband”, “Own\-child”\)\. 9\.Race, Sex, and Income must be one of the specified categories\. 10\.Capital gain must be between 0 and 99,999\. 11\.Capital loss must be non\-negative\. 12\.Hours worked per week must be between 1 and 99\. 13\.Native country must be one of the recognized entries\.
Inter\-Column Symbolic Rules 1\.If the relationship is “Husband” or “Wife”, then marital status must imply the person is or was married\. If someone is “Never\-married”, they shouldn’t be listed as “Husband” or “Wife”\. 2\.if someone has a higher education degree \(Masters, Doctorate, Prof\-school\), they must be at least 22 years old\. 3\.Ensures that if the workclass indicates self\-employment, the relationship should not be “Own\-child”\.
Table 11:Weak Semantic Priors of Shoppers\.Dataset Constraints
Of the 12,330 sessions in the dataset, 84\.5% \(10,422\) were negative class samples that did not end with shopping, and the rest \(1908\) were positive class samples ending with shopping\.Intra\-Column Semantics 1\.Administrative, Informational, ProductRelated: must be non\-negative integers within known upper limits \(e\.g\.,Administrative≤\\leq27, Informational≤\\leq24, ProductRelated≤\\leq705\)\. 2\.Durations: \(e\.g\., Administrative\_Duration\) must be non\-negative\. 3\.BounceRates and ExitRates: must be between 0 and 0\.2\. 4\.PageValues and SpecialDay: must be≥\\geq0, with SpecialDay≤\\leq1\. 5\.Month: must be a valid month string \(e\.g\., “May”, “Nov”\)\.
Inter\-Column Symbolic Rules 1\.If a visit count \(e\.g\., Administrative\) is zero, the corresponding duration must also be zero\. 2\.If duration is greater than 0, then the corresponding visit count must be\>\>0\. 3\.If BounceRates\>\>0\.2, then ProductRelated should be≤\\leq10\. 4\.If a user viewed fewer than one product\-related page, then PageValues must be 0\. 5\.If PageValues\>\>0, then ProductRelated\_Duration\>\>0 must be true\.
Table 12:Weak Semantic Priors of Default\.Dataset Constraints
The dataset consists of feature vectors belonging to 12,330 sessions\. The dataset was formed so that each session would belong to a different user in a 1\-year period to avoid any tendency to a specific campaign, special day, user profile, or period\.Intra\-Column Semantics 1\.LIMIT\_BAL: Credit limit is between 10,000 and 1,000,000\. 2\.SEX: Coded as 1 \(male\) or 2 \(female\)\. 3\.EDUCATION: Must be one of 0–6 \(0 = unknown, 1 = graduate school, etc\.\)\. 4\.MARRIAGE: Must be one of 0–3 \(0 = unknown, 1 = married, etc\.\)\. 5\.AGE: Between 18 and 100 years\. 6\.PAY\_0 to PAY\_6: Monthly payment statuses must be in the range \[\-2, 8\]\. These indicate repayment behavior \(e\.g\., \-1 = paid in full, 1 = one month delay, etc\.\)\. 7\.BILL\_AMT1 to BILL\_AMT6: Monthly bill amounts fall within observed realistic ranges \(can be negative, possibly indicating credit\)\. 8\.PAY\_AMT1 to PAY\_AMT6: Payments are between 0 and an upper bound \(no negative payments\)\. 9\.default\_payment\_next\_month: Must be 0 or 1 \(0 = no default, 1 = default\)\.
Inter\-Column Symbolic Rules 1\.For any month where the payment status \(PAY\_\*\) indicates a delay greater than 1 month, the corresponding bill amount \(BILL\_AMT\*\) must be non\-negative \(i\.e\., the person owed money\) 2\.If there is any positive payment in a month, the total of all bill amounts should be greater than or equal to the total payments\. 3\.If a person is 20 years or younger, their credit limit \(LIMIT\_BAL\) must be zero or less \(suggesting they should not have a credit limit\)\.
Table 13:Weak Semantic Priors of Magic\.Dataset Constraints
Data are MC generated to simulate registration of high\-energy gamma particles in an atmospheric Cherenkov telescope\.Intra\-Column Semantics 1\.All physical quantities \(like Length, Width, Size, Dist\) must be non\-negative\. 2\.Concentration ratios \(Conc, Conc1\) must be between 0 and 1\. 3\.Asymmetry and moment features must fall within realistic range limits \(e\.g\., \-500 to 580\)\. 4\.Alpha \(angle in degrees\) must be between 0 and 90\. 5\.class must be either ’g’ \(gamma\-ray signal\) or ’h’ \(hadron background\)\.
Inter\-Column Symbolic Rules 1\.The major axis \(Length\) must be≥\\geqminor axis \(Width\), as expected for an ellipse\. 2\.The intensity from the highest pixel \(Conc1\) must be≤\\leqthe sum of the top 2 pixels \(Conc\), and both must be≤\\leq1\. 3\.If the image is highly concentrated \(Conc\>\>0\.5\), the total intensity \(Size\) should be sufficiently large \(\>\>1\.5\)\. This helps avoid extreme concentration in very faint showers, which is likely noise\. 4\.If the ellipse is centered \(Dist<<50\) and symmetric \(Asym≈\\approx0\), then the orientation angle \(Alpha\) should be small \(<<30°\)\. This reflects physically aligned gamma\-ray events\. 5\.If the asymmetry is large \(absolute value\>\>100 mm\), then the third moment along the major axis \(M3Long\) should also be large \(\>\>\|8\|\|8\|mm\), reflecting skewed energy distributions in real air showers\.
Table 14:Weak Semantic Priors of Beijing\.Dataset Constraints
This data set contains the PM2\.5 data of the US Embassy in Beijing\. Meanwhile, meteorological data from Beijing Capital International Airport are also included\.Intra\-Column Semantics 1\.Year should be between 2010 and 2014\. 2\.Month: between 1 and 12, Day: between 1 and 31, Hour: between 0 and 23\. 3\.PM2\.5 concentration \(pm2\_5\) must be non\-negative\. 4\.Dew point \(DEWP\) must be≥\\geq\-100\. 5\.Temperature must be between \-50 and 60 °C\. 6\.Pressure \(PRES\) must be between 800 and 1100 hPa\. 7\.Wind direction \(cbwd\) must be one of \(’SE’, ’NW’, ’cv’, ’NE’\)\. 8\.Wind speed \(Iws\) and other count columns \(Is, Ir\) must be non\-negative\.
Inter\-Column Symbolic Rules 1\.Ensures that a month like 2 4 6 9 11 doesn’t have 31 days\. 2\.For February, it checks if the year is a leap year, and sets the maximum allowed day to 29 \(leap\) or 28 \(non\-leap\)\. 3\.The dew point \(DEWP\) should never exceed the actual temperature \(TEMP\)\. 4\.If wind speed \(Iws\) is high \(\>\>10\), the PM2\.5 \(pm2\_5\) level is expected to be below 800 \(because wind typically disperses pollutants\)\. 5\.If there is no wind \(wind speed \(Iws\) = 0\), then the wind direction \(cbwd\) should be ’cv’ \(likely short for “calm/variable”\)\.
Table 15:Weak Semantic Priors of News\.Dataset Constraints
This dataset summarizes a heterogeneous set of features about articles published by Mashable in a period of two years\. The goal is to predict the number of shares in social networks \(popularity\)\.Intra\-Column Semantics 1\.Numeric Features \(e\.g\., n\_tokens\_title, average\_token\_length\) must be non\-negative\. 2\.num\_keywords: must be between 1 and 10\. 3\.LDA\_00 to LDA\_04: must be between 0 and 1\. 4\.title\_sentiment\_polarity, avg\_negative\_polarity, etc\., must lie in valid sentiment ranges \(e\.g\., \[\-1, 1\]\)\. 5\.Sharerelated features \(e\.g\., shares, self\_reference\_min\_shares\): must lie between 0 and 843300 \(the observed max\)\.
Inter\-Column Symbolic Rules 1\.Ensures that the sum of positive and negative word rates is approximately 1 \(±0\.01 tolerance\)\. 2\.when there is at least one keyword, the three keyword minimum/average features are each≥\\geq\-1\. 3\.Enforces that the average of keyword metrics follows a logical order: kw\_min\_avg≤\\leqkw\_avg\_avg≤\\leqkw\_max\_avg\. 4\.Self\-reference shares follow: min≤\\leqavg≤\\leqmax\. 5\.Verifies that the sum of all LDA topic probabilities is approximately 1\. 6\.Ensures: min\_positive≤\\leqavg\_positive≤\\leqmax\_positive 7\.Ensures: min\_negative≤\\leqavg\_negative≤\\leqmax\_negative 8\.Ensures: abs\_title\_sentiment\_polarity == abs\(title\_sentiment\_polarity\) 9\.If global\_rate\_positive\_words\>\>0, then avg\_positive\_polarity must be\>\>0\. 10\.If global\_rate\_negative\_words\>\>0, then avg\_negative\_polarity must be<<0\.Similar Articles
SeT-Diff: Towards Semantic Foundation Models for HPC Telemetry and Time-Series
SeT-Diff proposes the first foundation model for HPC telemetry, using diffusion conditioned on semantic sensor descriptions to enable zero-shot generalization across tasks like imputation, forecasting, and virtual sensing, achieving an MAE of 0.0470 on reconstruction.
Geometry-Aware Tabular Diffusion
Introduces Geometry-Aware Tabular Diffusion (GATD), which augments tabular diffusion denoisers with explicit pairwise geometric features. Achieves state-of-the-art performance on ten benchmarks while using significantly fewer parameters.
Constrained Tabular Diffusion for Finance
Introduces Constrained Tabular Diffusion for Finance (CTDF), a method that integrates feasibility operations into diffusion sampling to enforce hard constraints for financial synthetic data generation.
Semantic DLM+: Improving Diffusion Language Models through Bias-variance Trade-off in Transition Kernel Design
This paper theoretically analyzes diffusion language models through a bias-variance lens, identifying trade-offs between masking and uniform diffusion kernels. It proposes SemDLM+, which adds a global transition and semantic-frequency penalty to overcome the semantic basin problem, achieving competitive generation quality on LM1B and OpenWebText benchmarks.
MobiDiff: Semantic-Aware Multi-Channel Discrete Diffusion for Human Mobility Data Generation
Introduces MobiDiff, an end-to-end discrete diffusion framework for generating human mobility data by denoising multi-channel semantic skeletons, achieving faster inference and competitive fidelity on real-world datasets.