FM-fMRI: Event Conditioned Flow Matching for Rest-to-Task fMRI Time-Series Synthesis
Summary
Proposes FM-fMRI, an event-conditioned flow matching model that synthesizes task fMRI time series from resting-state fMRI, achieving superior spectral and connectivity agreement over baselines on the Human Connectome Project and an internal autism cohort, and improving downstream autism classification.
View Cached Full Text
Cached at: 05/27/26, 09:10 AM
# FM-fMRI: Event Conditioned Flow Matching for Rest-to-Task fMRI Time-Series Synthesis
Source: [https://arxiv.org/html/2605.26423](https://arxiv.org/html/2605.26423)
11institutetext:Department of Biomedical Engineering,22institutetext:Department of Radiology & Biomedical Imaging,33institutetext:Department of Electrical Engineering
Yale University, New Haven, CT, USA
33email:camille\.duan@yale\.eduJiyao WangNicha C\. Dvornek Junlin YangZiqi GaoLawrence H\. StaibJames S\. Duncan
###### Abstract
Task\-based fMRI provides a direct readout of task\-evoked neural dynamics, but it is expensive and difficult to acquire at scale, motivating rest\-to\-task synthesis from widely available resting\-state fMRI \(rsfMRI\)\. We proposeFM\-fMRI, anevent\-conditioned flow\-matchingmodel that learns a continuous\-time conditional vector field to generate task ROI time series from a subject’s rsfMRI and the task event information\. The formulation enables fast ODE\-based sampling and flexible conditioning over heterogeneous event schedules\. Rather than optimizing for pointwise reconstruction, we evaluated generated signals using complementary criteria that probe temporal and spectral structure, subject and group\-level connectome consistency, and distributional alignment\. On the public Human Connectome Project and internal Biopoint autism cohort, FM\-fMRI achieves the strongest spectral and connectivity agreement and improved distribution\-level matching over conditional diffusion, generative adversarial networks \(GANs\), and variational autoencoders \(VAEs\) baselines\. Furthermore, we augment the BioPoint cohort by synthesizing task\-fMRI ROI time series with our method, improving downstream autism classification and demonstrating practical utility in data\-limited clinical settings\. The code will be available on GitHub\.
## 1Introduction
Task\-based functional Magnetic Resonance Imaging \(tfMRI\) is a primary tool for quantifying how the brain reconfigures under controlled cognitive and affective demands, which can expose disorder\-related alterations and compensatory dynamics, supporting more sensitive disease identification than resting state fMRI \(rsfMRI\)\[[29](https://arxiv.org/html/2605.26423#bib.bib44)\]\[[27](https://arxiv.org/html/2605.26423#bib.bib24)\]\. However, it is expensive and operationally fragile due to its strict experimental control, longer scan sessions, and sustained subject engagement\. These constraints make tfMRI difficult to collect at scale and particularly challenging in pediatric, aging, and clinical cohorts\. rsfMRI is comparatively easy to acquire and widely available, motivating rest\-to\-task generation that synthesizes task\-evoked signals from rsfMRI to broaden access to task\-like measurements and enable data augmentation when tfMRI is scarce\.
Existing rest\-to\-task approaches often map resting connectivity to task activation or contrast maps, with recent graph neural networks, convolutional architectures, and transformers improving predictive performance\[[22](https://arxiv.org/html/2605.26423#bib.bib2),[18](https://arxiv.org/html/2605.26423#bib.bib3),[16](https://arxiv.org/html/2605.26423#bib.bib5),[17](https://arxiv.org/html/2605.26423#bib.bib4),[10](https://arxiv.org/html/2605.26423#bib.bib18)\]\. However, these formulations target static summaries rather than ROI\-resolved task time series, and their deterministic objectives tend to regress toward conditional means, under\-representing distributional variability and task\-evoked dynamics\. Generic multivariate time\-series generators based on GANs, VAEs, and diffusion models can produce stochastic samples\[[30](https://arxiv.org/html/2605.26423#bib.bib6),[31](https://arxiv.org/html/2605.26423#bib.bib7),[19](https://arxiv.org/html/2605.26423#bib.bib8),[14](https://arxiv.org/html/2605.26423#bib.bib9)\], and neuroimaging\-specific variants have begun to add task\-alignment objectives for clinical prediction\[[11](https://arxiv.org/html/2605.26423#bib.bib29)\]; yet they remain challenging to control with experimental schedules and are seldom constrained to preserve fMRI structure such as low\-frequency spectra and functional connectivity\. What is needed is a generative framework that natively supports structured conditioning, efficient sampling, and differentiable constraint enforcement\. Flow matching and rectified flow address this by learning continuous\-time vector fields for conditional generation, enabling stable training and ODE\-based sampling with a direct handle for incorporating structured, differentiable constraints\[[12](https://arxiv.org/html/2605.26423#bib.bib10),[15](https://arxiv.org/html/2605.26423#bib.bib11),[13](https://arxiv.org/html/2605.26423#bib.bib12)\]\. Despite these advantages, flow\-based formulations have rarely been explored for rest\-conditioned, timing\-controlled tfMRI time\-series synthesis with explicit spectral and connectomic constraints\.
We proposeFM\-fMRI, anevent\-conditioned flow\-matchingframework that synthesizes task\-evoked ROI time series from a subject’s rsfMRI and experimental schedule timing via a learned continuous\-time conditional vector field\. Our main contributions are threefold: \(1\) an event\-conditioned flow\-matching formulation for rest\-to\-task fMRI generation; \(2\) evaluation prioritizing neurobiological realism, such as spectral, connectomic, and distribution\-level validity, including recovery of group\-level connectivity structure, over pointwise reconstruction; \(3\) strong synthesis performance across multiple tfMRI tasks with synthesized task signals improving downstream learning in data\-limited clinical settings\.
## 2Method
We model rest\-to\-task synthesis as the conditional generation of task\-evoked ROI time series given resting\-state dynamics and experimental timing \(Fig\.[1](https://arxiv.org/html/2605.26423#S2.F1)\),xtask∼pθ\(xtask∣xrest,e\)x\_\{\\text\{task\}\}\\sim p\_\{\\theta\}\(x\_\{\\text\{task\}\}\\mid x\_\{\\text\{rest\}\},e\)wherextask∈ℝT×Vx\_\{\\text\{task\}\}\\in\\mathbb\{R\}^\{T\\times V\}denotes ROI time series withVVregions andTTtime points,xrestx\_\{\\text\{rest\}\}is resting\-state input, andeeencodes task event information\.
Figure 1:FM\-fMRI overview\.\(A\) Inputs and encoders: resting\-state ROI time series are encoded to parameterize a structured prior, while event information is encoded into event tokens; \(B\) Training: we learn an event\-conditioned velocity field via cross\-attention, optimized with flow\-matching, connectivity and spectrum\-aware objectives\. \(C\) Inference: task time series trajectories are synthesized by integrating the learned ODE\.Resting\-state encoderGiven resting\-state inputxrest∈ℝTrest×Vx\_\{\\text\{rest\}\}\\in\\mathbb\{R\}^\{T\_\{\\text\{rest\}\}\\times V\}, we extract a subject\-specific context embeddingc=fenc\(xrest\)c=f\_\{\\text\{enc\}\}\(x\_\{\\text\{rest\}\}\)using a patch\-based Transformer encoder\. A prepended\[CLS\]token aggregates sequence information, and its final representation is used as the resting context\.
Structured priorRather than using a typical flow\-matching setup initialized from isotropic Gaussian noise, we learn a subject context\-dependent structured prior specific to the fMRI signal:
x0=μ\(c\)\+σ\(c\)ϵcolored\+U\(c\)zz∼𝒩\(0,IK\),x\_\{0\}=\\mu\(c\)\+\\sigma\(c\)\\,\\epsilon\_\{\\text\{colored\}\}\+U\(c\)z\\quad z\\sim\\mathcal\{N\}\(0,I\_\{K\}\),\(1\)whereμ\(c\)\\mu\(c\)andσ\(c\)\\sigma\(c\)are rest\-conditioned per\-ROI means and scale heads, andU\(c\)∈ℝV×KU\(c\)\\in\\mathbb\{R\}^\{V\\times K\}is a rest\-conditioned low\-rank spatial factor with rankK=8K=8that captures structured cross\-ROI covariance\. The termϵcolored\\epsilon\_\{\\text\{colored\}\}is a temporal template with the power spectral density proportional to1/f1/f, to better capture the elevated low\-frequency power of fMRI signals\[[1](https://arxiv.org/html/2605.26423#bib.bib34)\], and stabilize training\.
Task fMRI Event tokenTask event information is derived from FSL\-style event timing files\[[5](https://arxiv.org/html/2605.26423#bib.bib38)\], which contain information regarding the types of tasks performedss, the time durationdd, stimulus amplitudeaa, and task onsetoo\. For thekk\-th event, we parse the information into tuples\(ok,dk,ak,sk\)\(o\_\{k\},d\_\{k\},a\_\{k\},s\_\{k\}\)\. We convertok,dko\_\{k\},d\_\{k\}to TR units \(divided by TR\) andzz\-scoreaka\_\{k\}\. The task event token \(e\) in Fig\.[1](https://arxiv.org/html/2605.26423#S2.F1)is embedded as
ek=ϕMLP\(\[ok,dk,ak\]\)\+Econd\(sk\),e\_\{k\}=\\phi\_\{\\text\{MLP\}\}\(\[o\_\{k\},d\_\{k\},a\_\{k\}\]\)\+E\_\{\\text\{cond\}\}\(s\_\{k\}\),\(2\)whereϕMLP\\phi\_\{\\text\{MLP\}\}projects continuous timing features andEcondE\_\{\\text\{cond\}\}is a learned embedding for the task event type\.
Event\-conditioned cross\-attentionTo allow time\-specific modulation by experimental structure, event tokens are incorporated through cross\-attention within the velocity network\[[25](https://arxiv.org/html/2605.26423#bib.bib30)\]\. Queries are computed from the linear projection of the current state,Q=WqxtQ=W\_\{q\}x\_\{t\}, while keys and values are derived from event tokensK=WkeK=W\_\{k\}e,V=WveV=W\_\{v\}e\. Attention weights areA=softmax\(QK⊤dev\+M\)A=\\mathrm\{softmax\}\\\!\\left\(\\frac\{QK^\{\\top\}\}\{\\sqrt\{d\_\{\\text\{ev\}\}\}\}\+M\\right\), whereMMmasks padded events\. The resulting event contextectx=AV\\mathrm\{e\}\_\{\\text\{ctx\}\}=AVis concatenated withxtx\_\{t\}, the resting contextcc, and the time embedding before predicting the velocity\. This enables each time point to attend selectively to relevant task events\.
Conditional flow matchingWe train a conditional velocity fieldvθ\(t,xt,c,e\)v\_\{\\theta\}\(t,x\_\{t\},c,e\)using flow matching\. Given prior samplesx0x\_\{0\}and real task signalsx1x\_\{1\}, we construct linear interpolantsxt=\(1−t\)x0\+tx1,t∼𝒰\(0,1\)x\_\{t\}=\(1\-t\)x\_\{0\}\+tx\_\{1\},\\quad t\\sim\\mathcal\{U\}\(0,1\)with target velocityv∗\(xt,t\)=x1−x0v^\{\*\}\(x\_\{t\},t\)=x\_\{1\}\-x\_\{0\}\. The flow\-matching objective is
ℒFM=𝔼t,x0\[‖vθ\(t,xt,c,e\)−\(x1−x0\)‖22\]\.\\mathcal\{L\}\_\{\\text\{FM\}\}=\\mathbb\{E\}\_\{t,x\_\{0\}\}\\left\[\\left\\\|v\_\{\\theta\}\(t,x\_\{t\},c,e\)\-\(x\_\{1\}\-x\_\{0\}\)\\right\\\|\_\{2\}^\{2\}\\right\]\.\(3\)In practice,vθv\_\{\\theta\}is parameterized by a lightweight MLP applied pointwise over time: we concatenatextx\_\{t\}, the resting contextcc, a learned time embeddingψ\(t\)\\psi\(t\), and an event\-derived context vector\.
Connectivity and spectrum\-aware objectivesWe add auxiliary losses to preserve neurophysiological structure beyond pointwise fidelity\. For functional connectivity \(FC\), letRij\(x\)R\_\{ij\}\(x\)denote the Pearson correlation between ROIiiandjj; we define a weighted FC loss which emphasizes preservation of strong task\-relevant connections\.
ℒFC=∑i<jwij\(Rij\(x^1\)−Rij\(x1\)\)2,wij=\|Rij\(x1\)\|2,\\mathcal\{L\}\_\{\\text\{FC\}\}=\\sum\_\{i<j\}w\_\{ij\}\\big\(R\_\{ij\}\(\\hat\{x\}\_\{1\}\)\-R\_\{ij\}\(x\_\{1\}\)\\big\)^\{2\},\\quad w\_\{ij\}=\|R\_\{ij\}\(x\_\{1\}\)\|^\{2\},\(4\)For spectral fidelity, letPi\(f\)=\|ℱ\(xi\)\(f\)\|2P\_\{i\}\(f\)=\|\\mathcal\{F\}\(x\_\{i\}\)\(f\)\|^\{2\}denote the power spectrum of ROIii; over a physiologically relevant bandℬ\\mathcal\{B\}\(0\.01–0\.05 Hz\)\[[33](https://arxiv.org/html/2605.26423#bib.bib36)\], we use
ℒPSD=∑i∑f∈ℬ\(logPix^1\(f\)−logPix1\(f\)\)2\.\\mathcal\{L\}\_\{\\text\{PSD\}\}=\\sum\_\{i\}\\sum\_\{f\\in\\mathcal\{B\}\}\\left\(\\log P\_\{i\}^\{\\hat\{x\}\_\{1\}\}\(f\)\-\\log P\_\{i\}^\{x\_\{1\}\}\(f\)\\right\)^\{2\}\.\(5\)The overall training objective isℒ=ℒFM\+λFCℒFC\+λPSDℒPSD\.\\mathcal\{L\}=\\mathcal\{L\}\_\{\\text\{FM\}\}\+\\lambda\_\{\\text\{FC\}\}\\mathcal\{L\}\_\{\\text\{FC\}\}\+\\lambda\_\{\\text\{PSD\}\}\\mathcal\{L\}\_\{\\text\{PSD\}\}\.
We optimize all models with Adam \(learning rate1×10−31\\times 10^\{\-3\}; weight decay1×10−51\\times 10^\{\-5\}\) for 50 epochs and a batch size of 16\. At test time, task trajectories are generated by integrating the learned ODE
d𝐱dt=v𝜽\(t,x,c,e\)\\frac\{d\\mathbf\{x\}\}\{dt\}=v\_\{\\boldsymbol\{\\theta\}\}\(t,x,c,e\)\(6\)fromt=0t=0to 1 using an explicit Euler fixed\-step solver starting from the learned structured priorx0x\_\{0\}, yieldingx\(1\)x\(1\)as the synthesized task fMRI signal\[[2](https://arxiv.org/html/2605.26423#bib.bib31)\]\.
## 3Experiments and Results
Datasets and Data PreprocessingWe evaluate rest\-to\-task synthesis with two cohorts that span large\-scale normative fMRI and a clinical task\-fMRI setting\. For the Human Connectome Project \(HCP\)\[[24](https://arxiv.org/html/2605.26423#bib.bib22)\], we use 1,025 subjects with paired rsfMRI and tfMRI across seven paradigms\. For each run, we extract regional mean BOLD time series using the AAL atlas\[[23](https://arxiv.org/html/2605.26423#bib.bib26)\], yielding paired resting inputs and task targets\. For FM\-fMRI, we additionally leverage the task timing files, which contain stimulus onsets, duration, and conditioning information\. To assess generalization beyond HCP, we also evaluate on the Biopoint cohort\[[6](https://arxiv.org/html/2605.26423#bib.bib20)\]\(118 participants; 75 with autism and 43 controls\), extracting ROI time series with the Shen268 atlas\[[20](https://arxiv.org/html/2605.26423#bib.bib25)\]\. For both datasets, we use subject\-disjoint splits of 70% for training, 15% for validation, 15% for test to prevent data leakage\.
Table 1:Subject\-level generation performance grouped by metric\. Best values are bolded\.MetricModelEmotionGamblingLanguageMotorRelationalSocialWMPSD↓\\downarrowTimeGAN\[[30](https://arxiv.org/html/2605.26423#bib.bib6)\]2\.05461\.99231\.91091\.93901\.93051\.91791\.9371TimeVAE\[[21](https://arxiv.org/html/2605.26423#bib.bib17)\]2\.05171\.97211\.87911\.88291\.88051\.85601\.9093Diffusion\-TS\[[31](https://arxiv.org/html/2605.26423#bib.bib7)\]4\.00474\.09423\.98484\.06203\.99834\.10183\.9994DDPM\[[4](https://arxiv.org/html/2605.26423#bib.bib15)\]1\.77931\.69211\.59441\.63501\.67191\.78941\.4799LSTM\-GAN\[[32](https://arxiv.org/html/2605.26423#bib.bib27)\]2\.10062\.09591\.99161\.97272\.06872\.12361\.8706FM\-fMRI1\.60011\.53991\.42221\.36341\.43051\.56011\.3189FC sim\.↑\\uparrowTimeGAN\[[30](https://arxiv.org/html/2605.26423#bib.bib6)\]0\.25460\.22290\.23070\.17230\.24730\.26300\.2296TimeVAE\[[21](https://arxiv.org/html/2605.26423#bib.bib17)\]0\.27950\.26530\.26400\.24330\.29420\.30780\.2580Diffusion\-TS\[[31](https://arxiv.org/html/2605.26423#bib.bib7)\]0\.04420\.01680\.01090\.00260\.01230\.00780\.0073DDPM\[[4](https://arxiv.org/html/2605.26423#bib.bib15)\]0\.26770\.26180\.24540\.24290\.20560\.20870\.2274LSTM\-GAN\[[32](https://arxiv.org/html/2605.26423#bib.bib27)\]0\.29350\.14320\.23050\.24390\.25930\.33990\.1968FM\-fMRI0\.56840\.54550\.52720\.53020\.56060\.60460\.5366cFID↓\\downarrowTimeGAN\[[30](https://arxiv.org/html/2605.26423#bib.bib6)\]98\.06114\.91127\.31151\.15121\.47120\.66116\.97TimeVAE\[[21](https://arxiv.org/html/2605.26423#bib.bib17)\]105\.62116\.22129\.48154\.58127\.17123\.59118\.43Diffusion\-TS\[[31](https://arxiv.org/html/2605.26423#bib.bib7)\]177\.12188\.78194\.03220\.74194\.29202\.80189\.29DDPM\[[4](https://arxiv.org/html/2605.26423#bib.bib15)\]35\.6941\.1639\.5944\.6640\.4346\.8048\.78LSTM\-GAN\[[32](https://arxiv.org/html/2605.26423#bib.bib27)\]113\.76257\.37128\.54142\.30159\.14102\.28184\.56FM\-fMRI24\.131130\.671237\.506735\.571729\.825030\.768839\.9683MAE↓\\downarrowTimeGAN\[[30](https://arxiv.org/html/2605.26423#bib.bib6)\]0\.76760\.76580\.76620\.77020\.75510\.75270\.7670TimeVAE\[[21](https://arxiv.org/html/2605.26423#bib.bib17)\]0\.76610\.76200\.75620\.75320\.74710\.74310\.7529Diffusion\-TS\[[31](https://arxiv.org/html/2605.26423#bib.bib7)\]0\.93930\.93820\.93150\.94450\.93510\.93920\.9174DDPM\[[4](https://arxiv.org/html/2605.26423#bib.bib15)\]0\.80160\.80050\.80400\.80190\.80020\.80290\.8025LSTM\-GAN\[[32](https://arxiv.org/html/2605.26423#bib.bib27)\]0\.77970\.79040\.78770\.77850\.78880\.77850\.7913FM\-fMRI0\.93420\.94130\.95080\.95990\.95880\.95690\.9437P@5%↑\\uparrowTimeGAN\[[30](https://arxiv.org/html/2605.26423#bib.bib6)\]0\.21730\.21860\.22890\.17750\.29860\.17310\.1809TimeVAE\[[21](https://arxiv.org/html/2605.26423#bib.bib17)\]0\.22150\.21300\.23290\.21570\.30100\.20460\.1904Diffusion\-TS\[[31](https://arxiv.org/html/2605.26423#bib.bib7)\]0\.15990\.24260\.23180\.23610\.21750\.17480\.3084DDPM\[[4](https://arxiv.org/html/2605.26423#bib.bib15)\]0\.26410\.25060\.21370\.22100\.21810\.22080\.2635LSTM\-GAN\[[32](https://arxiv.org/html/2605.26423#bib.bib27)\]0\.23940\.12310\.12400\.18360\.14850\.23420\.1082FM\-fMRI0\.46170\.43290\.43520\.44040\.50000\.48250\.4535### 3\.1Baseline and Metrics
We benchmark FM\-fMRI against conditional DDPM\[[4](https://arxiv.org/html/2605.26423#bib.bib15)\], Diffusion\-TS\[[31](https://arxiv.org/html/2605.26423#bib.bib7)\], TimeVAE\[[8](https://arxiv.org/html/2605.26423#bib.bib16),[21](https://arxiv.org/html/2605.26423#bib.bib17)\], TimeGAN\[[30](https://arxiv.org/html/2605.26423#bib.bib6)\], and LSTM\-GAN\[[32](https://arxiv.org/html/2605.26423#bib.bib27)\], all conditioned on a resting\-state context embedding\. We use tfMRI\-aligned metrics:PSD\[[28](https://arxiv.org/html/2605.26423#bib.bib33)\]discrepancy to assess preservation of the spectrum, FC similarity calculated by the Pearson correlation of the FC map, top\-5% edge recovery \(P@5%\) to evaluate connectome structure, and cFID\[[3](https://arxiv.org/html/2605.26423#bib.bib32)\]to quantify conditional distributional alignment in FC space\. Since rest\-to\-task synthesis is many\-to\-many, we prioritize second\-order structure and report MAE only as an amplitude sanity check\.
Task fMRI Synthesis on HCP and BiopointHCP results in Table[1](https://arxiv.org/html/2605.26423#S3.T1)highlight the distinction between pointwise reconstruction fidelity and neurophysiological realism in rest\-to\-task synthesis\. Methods such as TimeVAE achieve the lowest MAE, consistent with variance\-shrinking conditional\-mean predictions that match average trajectories yet over\-smooth task\-evoked variability and distort spectral or connectomic structure shown in Fig\.[2](https://arxiv.org/html/2605.26423#S3.F2)\. FM\-fMRI exhibits higher MAE than reconstruction\-focused baselines, which is expected given that it is not optimized for strict pointwise waveform matching\. Instead, FM\-fMRI preserves realistic low\-frequency power and cross\-ROI covariance geometry, leading to improved PSD and FC realism and stronger conditional population alignment, which better reflects downstream connectivity and group\-level analyses\.
On Biopoint \(Table[2](https://arxiv.org/html/2605.26423#S3.T2)\), despite cohort and atlas differences, the same pattern holds: baseline rankings vary across MAE and PSD, whereas FM\-fMRI consistently yields the strongest connectivity realism and distributional matching, supporting robustness under dataset and atlas shifts\.
Figure 2:Group\-level FC comparison on all HCP tasks\.Table 2:Biopoint subject\-level generation performance\. Best values are bolded\.ModelMAE↓\\downarrowPSD↓\\downarrowFC sim\.↑\\uparrowFC P@5%↑\\uparrowcFID↓\\downarrowTimeGAN\[[30](https://arxiv.org/html/2605.26423#bib.bib6)\]0\.76672\.58190\.16720\.0977168\.76TimeVAE\[[21](https://arxiv.org/html/2605.26423#bib.bib17)\]0\.76592\.57910\.26790\.1688118\.60Diffusion\-TS\[[31](https://arxiv.org/html/2605.26423#bib.bib7)\]1\.06502\.63240\.09400\.0855116\.99DDPM\[[4](https://arxiv.org/html/2605.26423#bib.bib15)\]0\.82182\.36430\.14020\.1344104\.53LSTM\-GAN\[[32](https://arxiv.org/html/2605.26423#bib.bib27)\]0\.76722\.58520\.00120\.0532455\.66FM\-fMRI0\.79232\.34450\.35080\.243643\.32
### 3\.2Ablation: Event Conditioning and Auxiliary Objectives
Table[3](https://arxiv.org/html/2605.26423#S3.T3)ablates event token and auxiliary connectivity \(Aux\) losses on HCP\. The full model with event information input and connectivity objective is the most reliable configuration, achieving the best or near\-best performance across tasks on structure\-aware metrics, indicating that task\-timing cues and explicit neurophysiological regularization are jointly necessary for realistic synthesis\. The ablation also highlights complementary effects: Aux alone drives substantial gains in spectral and connectivity fidelity relative to the baseline, whereas event information alone often improves pointwise alignment but does not consistently enhance FC\-space distributional matching\. Together, these results reinforce that MAE is insufficient to characterize rest\-to\-task realism and that combining event token conditioning with spectrum/FC\-aware objectives yields the most consistent improvements on metrics aligned with downstream neuroimaging analyses\.
Table 3:Ablation results on Event information and Aux losses\. Best values are bolded\.TaskEventAuxMAE↓\\downarrowPSD↓\\downarrowFC Sim↑\\uparrowP@5↑\\uparrowcFID↓\\downarrowWM––0\.86252\.02860\.26650\.252844\.1144–✓0\.94251\.36880\.50250\.411141\.8149✓–0\.85492\.01580\.31830\.268264\.9692✓✓0\.94371\.31890\.53660\.453539\.9683Emotion––0\.81842\.02380\.33910\.287933\.0135–✓0\.94361\.64750\.50950\.407744\.4805✓–0\.84481\.95400\.42190\.297765\.4704✓✓0\.93421\.60010\.56840\.461724\.1311Gambling––0\.82971\.95460\.24720\.239147\.6530–✓0\.93821\.60740\.50390\.394946\.1616✓–0\.82621\.94160\.47200\.361337\.1983✓✓0\.94131\.53990\.54550\.432930\.6712Language––0\.85351\.97300\.28750\.266938\.2063–✓0\.96021\.47490\.50070\.394460\.30✓–0\.85051\.96690\.35430\.286759\.6663✓✓0\.95081\.42220\.52720\.435237\.5067Motor––0\.88052\.16430\.23800\.240850\.4327–✓0\.96041\.71530\.48860\.412439\.5460✓–0\.87482\.12860\.29660\.257667\.4445✓✓0\.95991\.36340\.53020\.440435\.5717Relational––0\.85441\.97000\.29860\.273340\.0110–✓0\.95391\.49970\.50640\.455945\.1027✓–0\.85161\.96150\.36140\.289461\.1435✓✓0\.95881\.43050\.56060\.500029\.8250Social––0\.85882\.02070\.32650\.271864\.3218–✓0\.97631\.60570\.55680\.431347\.2015✓–0\.86392\.01990\.26850\.253943\.3593✓✓0\.95691\.56010\.60460\.482530\.7688
### 3\.3Downstream Classification Augmentation on Biopoint
We assess downstream utility on Biopoint autism classification with three graph\-based models under three training regimes: rsfMRI\-only, tfMRI\-only without augmentation, and tfMRI augmented with our proposed model\. Synthetic tfMRI is generated for all biopoint cohort in the training split using its rsfMRI without access to validation/test subjects\. The final performance is reported on a held\-out test set \(Table[4](https://arxiv.org/html/2605.26423#S3.T4)\)\. tfMRI\-only generally surpasses rsfMRI\-only performance, implying added discriminative information in task\-evoked signals, except for the lowest\-capacity classifier\. Across all classifiers and metrics, augmentation with our synthesized signals yields consistent performance gains, with the largest improvements for the most state\-of\-the\-art model \(STAGIN\)\[[7](https://arxiv.org/html/2605.26423#bib.bib28)\]\. These results demonstrate that generative rest\-to\-task modeling provides a practical and reliable augmentation strategy for data\-scarce clinical cohorts\.
Table 4:Biopoint ASD classification performance under three settings: rest\-only, task\-based with and w/o augmentation\. Best performance is bolded\.ModelRest\-onlyTask w/o AugmentationTask with AugmentationAcc\.↑\\uparrowF1↑\\uparrowAUC↑\\uparrowSens\.↑\\uparrowAcc\.↑\\uparrowF1↑\\uparrowAUC↑\\uparrowSens\.↑\\uparrowAcc\.↑\\uparrowF1↑\\uparrowAUC↑\\uparrowSens\.↑\\uparrowGCN\[[9](https://arxiv.org/html/2605.26423#bib.bib42)\]0\.45830\.51850\.53330\.46670\.45830\.55170\.49630\.53330\.62500\.68970\.67410\.6667GAT\[[26](https://arxiv.org/html/2605.26423#bib.bib43)\]0\.54170\.59260\.60740\.53330\.58330\.61540\.60740\.53330\.62500\.64000\.72590\.5333STAGIN\[[7](https://arxiv.org/html/2605.26423#bib.bib28)\]0\.58330\.68750\.50370\.73330\.66670\.73330\.67410\.73330\.75000\.76090\.74810\.8667
## 4Conclusion and Discussion
We presentedFM\-fMRI, an event\-conditioned flow\-matching model for rest\-to\-task fMRI time\-series synthesis\. Across seven HCP tasks, FM\-fMRI delivers the best spectral fidelity, functional\-connectivity recovery, and FC\-based distributional alignment, underscoring the importance of structure\-aware evaluation beyond pointwise reconstruction\. Ablations confirm that event conditioning and connectivity regularization are both necessary for distribution\-level performance\. On the data\-limited Biopoint autism cohort, synthesized task\-like signals consistently improve downstream autism classification, with the largest gains for STAGIN\. FM\-fMRI remains effective across cohorts and atlas choices\. Future work will extend conditioning and test cross\-site robustness and calibration\.
## References
- \[1\]B\. Biswal, F\. Z\. Yetkin, V\. M\. Haughton, and J\. S\. Hyde\(1995\)Functional connectivity in the motor cortex of resting human brain using echo\-planar MRI\.Magnetic Resonance in Medicine34\(4\),pp\. 537–541\.External Links:[Document](https://dx.doi.org/10.1002/mrm.1910340409)Cited by:[§2](https://arxiv.org/html/2605.26423#S2.p3.6)\.
- \[2\]R\. T\. Q\. Chen, Y\. Rubanova, J\. Bettencourt, and D\. K\. Duvenaud\(2018\)Neural ordinary differential equations\.InAdvances in Neural Information Processing Systems,Vol\.31\.Cited by:[§2](https://arxiv.org/html/2605.26423#S2.p8.5)\.
- \[3\]M\. Heusel, H\. Ramsauer, T\. Unterthiner, B\. Nessler, and S\. Hochreiter\(2017\)GANs trained by a two time\-scale update rule converge to a local nash equilibrium\.InAdvances in Neural Information Processing Systems,Vol\.30\.Cited by:[§3\.1](https://arxiv.org/html/2605.26423#S3.SS1.p1.1)\.
- \[4\]J\. Ho, A\. Jain, and P\. Abbeel\(2020\)Denoising diffusion probabilistic models\.InAdvances in Neural Information Processing Systems,Cited by:[§3\.1](https://arxiv.org/html/2605.26423#S3.SS1.p1.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.14.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.19.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.24.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.29.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.9.1),[Table 2](https://arxiv.org/html/2605.26423#S3.T2.5.9.1)\.
- \[5\]M\. Jenkinson, C\. F\. Beckmann, T\. E\. J\. Behrens, M\. W\. Woolrich, and S\. M\. Smith\(2012\)FSL\.NeuroImage62\(2\),pp\. 782–790\.External Links:[Document](https://dx.doi.org/10.1016/j.neuroimage.2011.09.015)Cited by:[§2](https://arxiv.org/html/2605.26423#S2.p4.9)\.
- \[6\]M\. D\. Kaiser, C\. M\. Hudac, S\. Shultz, S\. M\. Lee, C\. Cheung, A\. M\. Berken, B\. Deen, N\. B\. Pitskel, D\. R\. Sugrue, A\. C\. Voos, C\. A\. Saulnier, P\. Ventola, J\. M\. Wolf, A\. Klin, B\. C\. Vander Wyk, and K\. A\. Pelphrey\(2010\)Neural signatures of autism\.Proceedings of the National Academy of Sciences107\(49\),pp\. 21223–21228\.External Links:[Document](https://dx.doi.org/10.1073/pnas.1010412107)Cited by:[§3](https://arxiv.org/html/2605.26423#S3.p1.1)\.
- \[7\]B\. Kim, J\. C\. Ye, and J\. Kim\(2021\)Learning dynamic graph representation of brain connectome with spatio\-temporal attention\.InAdvances in Neural Information Processing Systems,Vol\.34,pp\. 4314–4327\.Cited by:[§3\.3](https://arxiv.org/html/2605.26423#S3.SS3.p1.1),[Table 4](https://arxiv.org/html/2605.26423#S3.T4.12.12.16.1)\.
- \[8\]D\. P\. Kingma and M\. Welling\(2014\)Auto\-encoding variational bayes\.InInternational Conference on Learning Representations,Cited by:[§3\.1](https://arxiv.org/html/2605.26423#S3.SS1.p1.1)\.
- \[9\]T\. N\. Kipf and M\. Welling\(2017\)Semi\-supervised classification with graph convolutional networks\.In5th International Conference on Learning Representations \(ICLR\) 2017, Conference Track Proceedings,Cited by:[Table 4](https://arxiv.org/html/2605.26423#S3.T4.12.12.14.1)\.
- \[10\]J\. Kwon, J\. Seo, H\. Wang, T\. Moon, S\. Yoo, and J\. Cha\(2025\)Predicting task\-related brain activity from resting\-state brain dynamics with fMRI transformer\.Imaging Neuroscience\.External Links:[Document](https://dx.doi.org/10.1162/imag%5Fa%5F00440)Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[11\]Y\. Li, X\. Wu, X\. Zhang, H\. Jiang, W\. Wu, D\. Shen, and J\. Zhang\(2025\)Task\-aligned fMRI generation model for brain disorder diagnosis\.InMedical Image Computing and Computer Assisted Intervention – MICCAI 2025,Lecture Notes in Computer Science, Vol\.15971,pp\. 638–648\.External Links:[Document](https://dx.doi.org/10.1007/978-3-032-05162-2%5F61)Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[12\]Y\. Lipman, R\. T\. Q\. Chen, H\. Ben\-Hamu, M\. Nickel, and M\. Le\(2022\)Flow matching for generative modeling\.arXiv\.Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[13\]Y\. Lipmanet al\.\(2024\)A guide to flow matching and its extensions\.arXiv\.Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[14\]X\. Liuet al\.\(2024\)Retrieval\-augmented diffusion models for time series generation\.InAdvances in Neural Information Processing Systems,Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[15\]X\. Liu, C\. Gong, and Q\. Liu\(2022\)Rectified flow: a marginal preserving approach to optimal transport\.arXiv\.Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[16\]G\. Ngo, Y\. Huang, Y\. Zhang, and A\. Raj\(2020\)Connectomic deep learning for predicting functional activation from resting\-state fMRI\.arXiv\.Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[17\]G\. Ngo, W\. W\. Seeley, and A\. Raj\(2022\)Predicting task activation from resting\-state functional connectivity using deep learning\.NeuroImage246,pp\. 118703\.Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[18\]O\. Parker Jones, N\. L\. Voets, J\. E\. Adcock, R\. Stacey, and S\. Jbabdi\(2017\)Resting connectivity predicts task activation in pre\-surgical populations\.NeuroImage: Clinical13,pp\. 378–385\.External Links:[Document](https://dx.doi.org/10.1016/j.nicl.2016.12.028)Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[19\]L\. Shen, W\. Chen, and J\. T\. Kwok\(2024\)Multi\-resolution diffusion models for time series forecasting\.InInternational Conference on Learning Representations,Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[20\]X\. Shen, F\. Tokoglu, X\. Papademetris, and R\. T\. Constable\(2013\)Groupwise whole\-brain parcellation from resting\-state fMRI data for network node identification\.NeuroImage82,pp\. 403–415\.External Links:ISSN 1053\-8119Cited by:[§3](https://arxiv.org/html/2605.26423#S3.p1.1)\.
- \[21\]K\. Sohn, H\. Lee, and X\. Yan\(2015\)Learning structured output representation using deep conditional generative models\.InAdvances in Neural Information Processing Systems,Cited by:[§3\.1](https://arxiv.org/html/2605.26423#S3.SS1.p1.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.12.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.17.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.22.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.27.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.7.1),[Table 2](https://arxiv.org/html/2605.26423#S3.T2.5.7.1)\.
- \[22\]I\. Tavor, O\. P\. Jones, R\. B\. Mars, S\. M\. Smith, T\. E\. Behrens, and S\. Jbabdi\(2016\)Task\-free MRI predicts individual differences in brain activity during task performance\.Science352\(6282\),pp\. 216–220\.Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1)\.
- \[23\]N\. Tzourio\-Mazoyer, B\. Landeau, D\. Papathanassiou, F\. Crivello, O\. Etard, N\. Delcroix, B\. Mazoyer, and M\. Joliot\(2002\)Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single\-subject brain\.NeuroImage15\(1\),pp\. 273–289\.Cited by:[§3](https://arxiv.org/html/2605.26423#S3.p1.1)\.
- \[24\]D\. C\. Van Essen, K\. Ugurbil, E\. Auerbach, D\. Barch, T\. E\. J\. Behrens, R\. Bucholz, A\. Chang, L\. Chen, M\. Corbetta, S\. W\. Curtiss, S\. Della Penna, D\. Feinberg, M\. F\. Glasser, N\. Harel, A\. C\. Heath, L\. Larson\-Prior, D\. Marcus, G\. Michalareas, S\. Moeller, R\. Oostenveld, S\. E\. Petersen, F\. Prior, B\. L\. Schlaggar, S\. M\. Smith, A\. Z\. Snyder, J\. Xu, and E\. Yacoub\(2012\)The human connectome project: a data acquisition perspectiveThe human connectome project: a data acquisition perspective\.NeuroImage62\(4\),pp\. 2222–2231\.External Links:[Document](https://dx.doi.org/10.1016/j.neuroimage.2012.02.018),ISSN 1053\-8119Cited by:[§3](https://arxiv.org/html/2605.26423#S3.p1.1)\.
- \[25\]A\. Vaswani, N\. Shazeer, N\. Parmar, J\. Uszkoreit, L\. Jones, A\. N\. Gomez, L\. Kaiser, and I\. Polosukhin\(2017\)Attention is all you need\.InAdvances in Neural Information Processing Systems,Vol\.30\.Cited by:[§2](https://arxiv.org/html/2605.26423#S2.p5.8)\.
- \[26\]P\. Velickovic, G\. Cucurull, A\. Casanova, A\. Romero, P\. Liò, and Y\. Bengio\(2018\)Graph attention networks\.In6th International Conference on Learning Representations \(ICLR\) 2018, Conference Track Proceedings,Cited by:[Table 4](https://arxiv.org/html/2605.26423#S3.T4.12.12.15.1)\.
- \[27\]J\. Wang, N\. C\. Dvornek, P\. Duan, L\. H\. Staib, P\. Ventola, and J\. S\. Duncan\(2024\)STNAGNN: spatiotemporal node attention graph neural network for task\-based fMRI analysis\.arXiv\.Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p1.1)\.
- \[28\]P\. D\. Welch\(1967\)The use of fast fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms\.IEEE Transactions on Audio and Electroacoustics15\(2\),pp\. 70–73\.Cited by:[§3\.1](https://arxiv.org/html/2605.26423#S3.SS1.p1.1)\.
- \[29\]C\. Woo, L\. J\. Chang, M\. A\. Lindquist, and T\. D\. Wager\(2017\-03\)Building better biomarkers: brain models in translational neuroimaging\.Nature Neuroscience20\(3\),pp\. 365–377\.Note:Epub 2017\-02\-23External Links:[Document](https://dx.doi.org/10.1038/nn.4478)Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p1.1)\.
- \[30\]J\. Yoon, D\. Jarrett, and M\. van der Schaar\(2019\)Time\-series generative adversarial networks\.InAdvances in Neural Information Processing Systems,Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1),[§3\.1](https://arxiv.org/html/2605.26423#S3.SS1.p1.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.1.1.2),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.2.2.2),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.3.3.2),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.4.4.2),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.5.2),[Table 2](https://arxiv.org/html/2605.26423#S3.T2.5.6.1)\.
- \[31\]Y\. Yuanet al\.\(2024\)Diffusion models for time series generation\.InInternational Conference on Learning Representations,Cited by:[§1](https://arxiv.org/html/2605.26423#S1.p2.1),[§3\.1](https://arxiv.org/html/2605.26423#S3.SS1.p1.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.13.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.18.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.23.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.28.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.8.1),[Table 2](https://arxiv.org/html/2605.26423#S3.T2.5.8.1)\.
- \[32\]G\. Zhu, H\. Zhao, H\. Liu, and H\. Sun\(2019\)A novel LSTM\-GAN algorithm for time series anomaly detection\.In2019 Prognostics and System Health Management Conference,pp\. 1–6\.Cited by:[§3\.1](https://arxiv.org/html/2605.26423#S3.SS1.p1.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.10.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.15.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.20.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.25.1),[Table 1](https://arxiv.org/html/2605.26423#S3.T1.5.30.1),[Table 2](https://arxiv.org/html/2605.26423#S3.T2.5.10.1)\.
- \[33\]X\. Zuoet al\.\(2010\)The oscillating brain: complex and reliable\.NeuroImage49\(2\),pp\. 1432–1445\.External Links:[Document](https://dx.doi.org/10.1016/j.neuroimage.2009.09.037)Cited by:[§2](https://arxiv.org/html/2605.26423#S2.p7.6)\.Similar Articles
Functional MRI Time Series Generation via Wavelet-Based Image Transform and Spectral Flow Matching for Brain Disorder Identification
This paper proposes DSFM, a novel generative framework that uses wavelet decomposition and spectral flow matching to synthesize realistic fMRI time series for brain disorder identification, addressing data scarcity and non-stationarity challenges.
FlowLet: Conditional 3D Brain MRI Synthesis using Wavelet Flow Matching
FlowLet is a conditional generative framework that synthesizes age-conditioned 3D brain MRIs using flow matching in an invertible wavelet domain, improving brain age prediction accuracy for underrepresented age groups with high efficiency.
NeuroSonic: Conditional Flow Matching for EEG-to-Speech Reconstruction
NeuroSonic introduces a conditional flow-matching framework for reconstructing continuous speech from EEG signals, addressing the structural mismatch between neural and acoustic data by learning a deterministic probability-flow velocity field. It achieves up to 26.3% improvement in perceptual quality over existing GAN, diffusion, and mean-flow baselines on cross-subject benchmarks.
Recursive Flow Matching
Introduces Recursive Flow Matching (RecFM), a generative framework for forecasting complex spatiotemporal dynamics that achieves high fidelity with fewer steps and improved accuracy and speed, including up to 20x speedup over diffusion-based emulators.
WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis
WaveDiT is a conditional flow matching framework for full-resolution 3D brain MRI synthesis that operates in wavelet coefficient space, enabling efficient generation on standard GPUs without lossy latent compression. It achieves improved alignment with real MRI distributions and downstream tasks.