CardioMeta: Calibrated Multi-Task Prediction of Diabetes, Hypertension, and Cardiovascular Disease Across Population and EHR Data
Summary
CardioMeta is a calibrated multi-task framework for jointly predicting diabetes, hypertension, and cardiovascular disease across NHANES and MIMIC-IV data, emphasizing leakage control, calibration, and transparent reliability.
View Cached Full Text
Cached at: 07/20/26, 09:30 AM
# CardioMeta: Calibrated Multi-Task Prediction of Diabetes, Hypertension, and Cardiovascular Disease Across Population and EHR Data
Source: [https://arxiv.org/html/2607.15721](https://arxiv.org/html/2607.15721)
S M Asif Hossain,Ruksat Khan Shayoni[0009\-0002\-8737\-1789](https://orcid.org/0009-0002-8737-1789)School of Computing, Wichita State UniversityWichitaKansasUSA,M\. F\. Mridha[0000\-0001\-5738\-1631](https://orcid.org/0000-0001-5738-1631)Department of Computer Science and Engineering, American International University\-BangladeshDhakaBangladeshandJungpil Shin[0000\-0002\-7476\-2468](https://orcid.org/0000-0002-7476-2468)School of Computer Science and Engineering, The University of AizuAizuwakamatsuJapan
###### Abstract\.
Cardiometabolic diseases remain among the most persistent drivers of preventable morbidity because diabetes, hypertension, and cardiovascular disease frequently co\-occur and share metabolic, vascular, demographic, and behavioral determinants\. Existing machine learning studies for chronic disease prediction often emphasize discrimination on a single dataset, while underreporting label leakage, calibration, temporal robustness, external transportability, and subgroup reliability\. This paper presentsCardioMeta, a calibrated multi\-task framework for joint prediction of diabetes, hypertension, and cardiovascular disease across population survey and electronic health record \(EHR\) data\. The study uses NHANES for population\-level model development and temporal validation, and MIMIC\-IV for EHR\-domain evaluation under substantial distribution shift\. To reduce circular label reconstruction, the primary analysis excludes disease\-defining variables from the corresponding prediction heads, while a full\-clinical feature setting is retained only as sensitivity analysis\.CardioMetacombines a shared cardiometabolic encoder with disease\-specific gated heads and post\-hoc probability calibration\. In the leakage\-reduced temporal validation setting, the model achieved a macro\-AUROC of 0\.839, macro\-AUPRC of 0\.536, macro\-F1 of 0\.614, and expected calibration error of 0\.024, with modest but consistent improvements over strong gradient\-boosting and neural tabular baselines\. External evaluation on MIMIC\-IV showed clear degradation under domain shift, while limited fine\-tuning partially recovered performance\. The findings indicate that the principal value of multi\-task cardiometabolic modeling lies not in inflated accuracy, but in reproducible leakage control, calibrated probabilities, and transparent reliability reporting across heterogeneous healthcare data sources\.
healthcare AI, cardiometabolic disease, multi\-task learning, calibration, explainability, NHANES, MIMIC\-IV
††copyright:none††ccs:Applied computing Health informatics††ccs:Computing methodologies Machine learning approaches## 1\.Introduction
Diabetes, hypertension, and cardiovascular disease \(CVD\) are major sources of morbidity, mortality, and long\-term healthcare expenditure\. These diseases are clinically interconnected: obesity, aging, glycemic dysfunction, blood\-pressure burden, renal impairment, lipid abnormalities, medication history, diet, and lifestyle exposures can affect more than one outcome\. Machine learning is therefore an attractive tool for screening\-oriented cardiometabolic prediction because it can combine heterogeneous clinical, demographic, laboratory, and behavioral variables into patient\-level disease\-status probabilities\. However, cardiometabolic prediction is also a setting in which poorly controlled experimental design can produce misleadingly optimistic results\.
A central limitation of many chronic disease prediction studies is that the modeling objective is not always stated precisely\. NHANES is cross\-sectional, and many EHR\-based labels represent disease recorded during or before an admission\. A model trained under these conditions identifies prevalent or documented disease status rather than forecasting incident disease onset\. This distinction matters because contemporary measurements such as blood pressure, glucose, HbA1c, medication use, or diagnosis codes may be close to the outcome definition\. If these variables remain in the input while also defining the label, the model can learn a circular diagnostic rule rather than clinically informative risk structure\. Consequently, this paper frames the task as screening\-oriented multi\-label disease\-status prediction and distinguishes a primary leakage\-reduced feature setting from a secondary full\-clinical feature setting\.
Another limitation is reproducibility\. A paper that claims leakage\-safe healthcare prediction must explicitly report dataset cycles, inclusion criteria, label construction, software versions, train\-validation\-test separation, hyperparameter search, and the handling of imputation, scaling, resampling, calibration, and feature selection\. Without these details, the central methodological claim is unverifiable\. This is particularly important when using MIMIC\-IV because access requires credentialed PhysioNet approval, completion of required training, and agreement to a data use policy\([johnson2023mimiciv,](https://arxiv.org/html/2607.15721#bib.bib10)\)\. NHANES also requires careful cycle\-level reporting because the 2017\-March 2020 pre\-pandemic release combines incomplete 2019\-2020 data with the 2017\-2018 cycle to support nationally representative pre\-pandemic estimates\([cdc2024nhanes,](https://arxiv.org/html/2607.15721#bib.bib9)\)\.
This paper presentsCardioMeta, a calibrated multi\-task learning framework for joint prediction of diabetes, hypertension, and CVD across population survey and EHR data\. The architecture uses a shared encoder to learn common cardiometabolic evidence and disease\-specific gated heads to preserve task specialization\. The model is evaluated under a leakage\-reduced primary setting in which direct label\-defining variables are excluded from the corresponding disease task\. A secondary full\-clinical setting quantifies how performance changes when contemporaneous diagnostic evidence is available\. This two\-setting design directly addresses the common problem that high apparent accuracy may be driven by label\-defining laboratory, vital\-sign, medication, or diagnosis variables\.
The main contributions are summarized as follows\.
- •We formulate diabetes, hypertension, and CVD as a multi\-label disease\-status prediction task across NHANES and MIMIC\-IV while explicitly distinguishing prevalent disease identification from incident disease forecasting\.
- •We define a leakage\-reduced primary feature setting that removes direct label\-defining variables for each disease, and we reserve the full\-clinical feature setting for sensitivity analysis rather than headline claims\.
- •We proposeCardioMeta, a calibrated shared\-encoder multi\-task framework with disease\-specific gated heads for cardiometabolic prediction\.
- •We provide a reproducible evaluation protocol covering NHANES cycle definitions, MIMIC\-IV credentialed\-access reporting, preprocessing isolation, hyperparameter search, bootstrap confidence intervals, calibration, clinical utility, subgroup reliability, and explainability\.
- •We benchmark the proposed framework against clinical risk\-score baselines, logistic regression, random forests, XGBoost, LightGBM, CatBoost, tuned multilayer perceptrons \(MLPs\), TabNet, TabTransformer, and RealMLP\.
The remainder of this paper is organized as follows\. Section[2](https://arxiv.org/html/2607.15721#S2)reviews chronic disease prediction, multi\-task healthcare modeling, tabular learning, calibration, and explainable clinical AI\. Section[3](https://arxiv.org/html/2607.15721#S3)describes dataset construction, label definitions, leakage\-reduced feature design,CardioMeta, baselines, training details, reproducibility, and evaluation metrics\. Section[4](https://arxiv.org/html/2607.15721#S4)presents the empirical evaluation, including leakage\-reduced performance, full\-clinical sensitivity analysis, EHR\-domain evaluation, calibration, ablation, subgroup reliability, and explanation results\. Section[5](https://arxiv.org/html/2607.15721#S5)concludes with the study implications and limitations\.
## 2\.Related Works
This section situates the proposed study within prior work on clinical prediction, multi\-task healthcare learning, tabular modeling, calibration, and explainability\. The goal is not only to compare model families but also to clarify why a rigorous reporting protocol is essential for cardiometabolic disease\-status prediction\.
### 2\.1\.Chronic Disease and Clinical Risk Prediction
Clinical prediction models have long been used to support cardiovascular and metabolic risk assessment\. Traditional clinical scores such as the Framingham Risk Score, pooled cohort equations, and diabetes risk scores remain important references because they are interpretable and clinically familiar, even when their endpoint definitions differ from cross\-sectional disease\-status labels\. Modern machine learning studies frequently report stronger discrimination than classical scores, but the improvement is only meaningful when evaluated under transparent, leakage\-free conditions and appropriate validation splits\. Prediction\-model reporting guidance such as TRIPOD emphasizes clear cohort definitions, endpoint definitions, predictor handling, validation, and uncertainty reporting\([collins2015tripod,](https://arxiv.org/html/2607.15721#bib.bib34)\)\. For imbalanced binary endpoints, AUROC alone can be insufficient; AUPRC and F1\-score may better reflect performance on positive cases\([davis2006relationship,](https://arxiv.org/html/2607.15721#bib.bib37);[saito2015precision,](https://arxiv.org/html/2607.15721#bib.bib38);[chicco2020advantages,](https://arxiv.org/html/2607.15721#bib.bib36)\)\.
Chronic disease modeling is especially vulnerable to circularity\. In diabetes classification, HbA1c and fasting glucose are often used to define the outcome; in hypertension classification, systolic and diastolic blood pressure can directly define the label; in CVD classification, diagnosis codes or self\-reported disease history can define existing disease\. If these variables are also used as predictors, the model may detect the label construction rule rather than infer disease status from indirect risk patterns\. This paper therefore treats leakage\-reduced disease\-status prediction as the primary task and full\-clinical prediction as a sensitivity setting\.
### 2\.2\.Multi\-Task Learning for Healthcare
Multi\-task learning is well suited to healthcare because diseases, symptoms, interventions, and risk factors are correlated\. Early neural EHR models such as Doctor AI and RETAIN demonstrated the value of learning sequential clinical representations, with RETAIN additionally emphasizing interpretability through attention\([choi2016doctorai,](https://arxiv.org/html/2607.15721#bib.bib2);[choi2016retain,](https://arxiv.org/html/2607.15721#bib.bib1)\)\. BEHRT and Med\-BERT showed how transformer\-based or contextual representation learning can improve structured EHR prediction\([li2020behrt,](https://arxiv.org/html/2607.15721#bib.bib3);[rasmy2021medbert,](https://arxiv.org/html/2607.15721#bib.bib4)\)\. PRIME incorporated prior medical knowledge into clinical risk prediction, while MetaPred investigated meta\-learning for clinical risk prediction with limited patient records\([ma2018prime,](https://arxiv.org/html/2607.15721#bib.bib5);[wang2019metapred,](https://arxiv.org/html/2607.15721#bib.bib6)\)\. AutoDP more recently studied automated multi\-task disease prediction on MIMIC\-IV, reinforcing that joint disease modeling can be useful when task relatedness is exploited appropriately\([cui2024autodp,](https://arxiv.org/html/2607.15721#bib.bib8)\)\.
The present work follows this line but differs in two ways\. First, it focuses specifically on cardiometabolic disease\-status prediction across diabetes, hypertension, and CVD rather than broad multi\-disease EHR prediction alone\. Second, it evaluates cross\-dataset transfer from a population health survey to a hospital EHR cohort\. The latter design is intentionally difficult because NHANES and MIMIC\-IV differ in sampling frame, measurement process, disease prevalence, and clinical acuity\.
### 2\.3\.Tabular Learning, Calibration, and Explainability
Tabular healthcare prediction requires strong baselines\. Random forests, XGBoost, LightGBM, and CatBoost remain competitive on structured data\([breiman2001random,](https://arxiv.org/html/2607.15721#bib.bib19);[chen2016xgboost,](https://arxiv.org/html/2607.15721#bib.bib11);[ke2017lightgbm,](https://arxiv.org/html/2607.15721#bib.bib12);[prokhorenkova2018catboost,](https://arxiv.org/html/2607.15721#bib.bib13)\)\. Neural tabular models such as TabNet and TabTransformer introduce attention\-based representations, while recent studies on tuned MLPs and TabPFN\-style foundation models show that neural approaches can perform well under certain tabular conditions\([arik2021tabnet,](https://arxiv.org/html/2607.15721#bib.bib14);[huang2020tabtransformer,](https://arxiv.org/html/2607.15721#bib.bib15);[gorishniy2021revisiting,](https://arxiv.org/html/2607.15721#bib.bib16);[hollemann2025tabpfn,](https://arxiv.org/html/2607.15721#bib.bib18)\)\. Because no single model class dominates all tabular healthcare settings,CardioMetais evaluated against both boosting and neural baselines\.
Calibration is necessary because clinical decisions depend on probabilities, not only rankings\. Platt scaling, isotonic regression, and temperature scaling are common approaches for improving probability reliability\([platt1999probabilistic,](https://arxiv.org/html/2607.15721#bib.bib23);[zadrozny2002transforming,](https://arxiv.org/html/2607.15721#bib.bib24);[guo2017calibration,](https://arxiv.org/html/2607.15721#bib.bib25)\)\. Explainability is similarly important because clinicians and researchers need to know whether the model relies on plausible evidence\. LIME and SHAP are widely used for local and global explanation\([ribeiro2016lime,](https://arxiv.org/html/2607.15721#bib.bib26);[lundberg2017shap,](https://arxiv.org/html/2607.15721#bib.bib27)\); counterfactual explanations can provide additional insight but should not be interpreted causally in observational data\([wachter2017counterfactual,](https://arxiv.org/html/2607.15721#bib.bib28)\)\. Fairness and subgroup analysis are also essential because clinical algorithms can produce unequal performance across demographic groups\([obermeyer2019dissecting,](https://arxiv.org/html/2607.15721#bib.bib32);[mehrabi2021survey,](https://arxiv.org/html/2607.15721#bib.bib33)\)\. Related healthcare AI work in medical imaging and clinical polysomnography illustrates the broader need for robust architecture design, domain\-aware validation, and subgroup\-sensitive evaluation across medical datasets\([hossain2026infiltrnet,](https://arxiv.org/html/2607.15721#bib.bib17);[hossain2026demographic,](https://arxiv.org/html/2607.15721#bib.bib7)\)\.
## 3\.Methodology
This section describes the complete study design\. The methodology is intentionally explicit because the main contribution is not only a model architecture but also a reproducible leakage\-reduced evaluation protocol for cardiometabolic disease\-status prediction across heterogeneous data sources\.
### 3\.1\.Problem Definition
For each individualii, letxi∈ℝdx\_\{i\}\\in\\mathbb\{R\}^\{d\}denote a tabular feature vector and let
\(1\)yi=\[yiD,yiH,yiC\]∈\{0,1\}3y\_\{i\}=\[y\_\{i\}^\{D\},y\_\{i\}^\{H\},y\_\{i\}^\{C\}\]\\in\\\{0,1\\\}^\{3\}represent diabetes, hypertension, and CVD status\. The model estimates calibrated probabilities
\(2\)fθ\(xi\)=\[piD,piH,piC\],pik∈\[0,1\]\.f\_\{\\theta\}\(x\_\{i\}\)=\[p\_\{i\}^\{D\},p\_\{i\}^\{H\},p\_\{i\}^\{C\}\],\\qquad p\_\{i\}^\{k\}\\in\[0,1\]\.The primary task is cross\-sectional disease\-status prediction, not incident disease forecasting\. In NHANES, labels represent survey\-time disease evidence; in MIMIC\-IV, labels represent diagnosis, medication, or early\-admission evidence available from EHR records\. This wording is important because the datasets do not provide a prospective incident endpoint in the form used here\.
### 3\.2\.Datasets and Cohort Construction
NHANES is used as the population\-survey dataset\. The development cohort uses NHANES 2011\-2012, 2013\-2014, 2015\-2016, and 2017\-2018 cycles\. The temporal validation cohort uses the NHANES 2017\-March 2020 pre\-pandemic release, following the CDC documentation for this combined cycle\([cdc2024nhanes,](https://arxiv.org/html/2607.15721#bib.bib9)\)\. Participants are included if they are adults aged at least 18 years and have sufficient disease\-label information and core demographic variables\. Pregnant participants and physiologically impossible measurements are excluded\. Survey modules include demographics, examination, laboratory, questionnaire, dietary, and medication\-related files\.
MIMIC\-IV v2\.2 is used as the external EHR dataset through PhysioNet credentialed access after completion of required training and data use agreement procedures\([johnson2023mimiciv,](https://arxiv.org/html/2607.15721#bib.bib10)\)\. The analysis uses adult patients and the first eligible hospital admission or ICU stay to reduce correlated repeated admissions\. Early\-admission features are extracted from the first 24 or 48 hours, depending on variable availability, to reduce post\-outcome information leakage\. MIMIC\-IV is not treated as a population\-level equivalent of NHANES; it is used as a domain\-shift stress test and local fine\-tuning setting\.
### 3\.3\.Disease Label Definitions
Disease labels are defined separately for NHANES and MIMIC\-IV\. In NHANES, diabetes is defined using self\-reported physician diagnosis, diabetes medication or insulin use, HbA1c threshold, or fasting glucose threshold\. Hypertension is defined using self\-reported hypertension diagnosis, antihypertensive medication use, systolic blood pressure threshold, or diastolic blood pressure threshold\. CVD is defined using self\-reported coronary heart disease, angina, heart attack, stroke, or congestive heart failure\. In MIMIC\-IV, disease labels are derived from ICD diagnosis codes, early medication evidence, and clinically relevant laboratory or vital\-sign evidence when appropriate\.
Because these definitions can create circularity, the primary analysis removes direct label\-defining variables from the corresponding disease prediction input\. For diabetes, HbA1c, fasting glucose, diabetes medication, and insulin indicators are excluded from the diabetes head’s leakage\-reduced feature set\. For hypertension, systolic blood pressure, diastolic blood pressure, and antihypertensive medication indicators are excluded from the hypertension head’s leakage\-reduced feature set\. For CVD, direct CVD diagnosis/history indicators are excluded from CVD prediction\. A full\-clinical setting retains these variables only to quantify the effect of contemporaneous diagnostic evidence\.
### 3\.4\.Feature Spaces and Harmonization
Two feature spaces are defined\. The*shared\-core feature space*contains variables available in both NHANES and MIMIC\-IV, including age, sex, body mass index or derived anthropometric features, selected vitals, selected laboratory values, and medication\-group indicators\. This setting is used for NHANES\-to\-MIMIC\-IV transfer\. The*full NHANES feature space*additionally includes richer survey, dietary, socioeconomic, and lifestyle variables and is used for population\-level internal and temporal analyses\. Feature groups used for explanation and reporting are demographic, anthropometric, vital\-sign, laboratory, lifestyle, medication/history, and dietary\.
### 3\.5\.CardioMeta Architecture
Figure[1](https://arxiv.org/html/2607.15721#S3.F1)illustrates the proposed architecture\. The model first maps each preprocessed feature vectorx~i\\tilde\{x\}\_\{i\}into a shared cardiometabolic representation:
\(3\)hi=ϕθs\(x~i\),h\_\{i\}=\\phi\_\{\\theta\_\{s\}\}\(\\tilde\{x\}\_\{i\}\),whereϕθs\\phi\_\{\\theta\_\{s\}\}is a multilayer perceptron with batch normalization, GELU activation, dropout, and residual projection\. The default configuration uses three hidden layers with widths 128, 64, and 32; dropout is set to 0\.20; and layer normalization is evaluated as a sensitivity variant\. The shared encoder is intended to capture evidence that is useful across multiple cardiometabolic conditions, such as age, adiposity, renal function, lipid burden, medication history, and behavioral risk\.
Each disease task uses a feature\-wise gated head:
\(4\)gik=σ\(Wgkhi\+bgk\),zik=gik⊙hi,g\_\{i\}^\{k\}=\\sigma\(W\_\{g\}^\{k\}h\_\{i\}\+b\_\{g\}^\{k\}\),\\qquad z\_\{i\}^\{k\}=g\_\{i\}^\{k\}\\odot h\_\{i\},wherek∈\{D,H,C\}k\\in\\\{D,H,C\\\},σ\(⋅\)\\sigma\(\\cdot\)is the sigmoid function, and⊙\\odotdenotes element\-wise multiplication\. The final probability is computed by
\(5\)pik=σ\(Wokzik\+bok\)\.p\_\{i\}^\{k\}=\\sigma\(W\_\{o\}^\{k\}z\_\{i\}^\{k\}\+b\_\{o\}^\{k\}\)\.The gate is not claimed as a novel mechanism by itself; rather, it provides a lightweight disease\-specialization component within a reproducible multi\-task benchmark\. The architectural hypothesis is that a shared encoder improves data efficiency and representation quality, while disease\-specific gates reduce negative transfer between diabetes, hypertension, and CVD\.
Figure 1\.Overview ofCardioMeta, including harmonized features, leakage\-safe preprocessing, a shared cardiometabolic encoder, disease\-specific prediction heads, calibrated disease outputs, and a reliability layer for calibration and explanation\.
### 3\.6\.Training Protocol and Baselines
The multi\-task objective is
\(6\)ℒ=∑k∈\{D,H,C\}λkℒBCEk\+β∥θ∥22\.\\mathcal\{L\}=\\sum\_\{k\\in\\\{D,H,C\\\}\}\\lambda\_\{k\}\\mathcal\{L\}\_\{BCE\}^\{k\}\+\\beta\\lVert\\theta\\rVert\_\{2\}^\{2\}\.Class imbalance is addressed through class\-weighted binary cross\-entropy and focal loss variants\([lin2017focal,](https://arxiv.org/html/2607.15721#bib.bib20)\)\. SMOTE\-ENN is evaluated only as a training\-fold sensitivity analysis and is never applied before splitting\([chawla2002smote,](https://arxiv.org/html/2607.15721#bib.bib21);[batista2004study,](https://arxiv.org/html/2607.15721#bib.bib22)\)\. The model is trained with AdamW, learning rate selected from\{10−4,3×10−4,10−3\}\\\{10^\{\-4\},3\\times 10^\{\-4\},10^\{\-3\}\\\}, weight decay from\{10−5,10−4,10−3\}\\\{10^\{\-5\},10^\{\-4\},10^\{\-3\}\\\}, batch size from\{128,256,512\}\\\{128,256,512\\\}, and early stopping on validation macro\-F1 with calibration monitored as a secondary criterion\.
Baselines include logistic regression, random forests, XGBoost, LightGBM, CatBoost, a tuned multilayer perceptron \(MLP\), TabNet, TabTransformer, and RealMLP\. Clinical reference baselines include Framingham\-style and pooled\-cohort\-equation\-style CVD comparators and FINDRISC\-inspired diabetes scoring where variable compatibility permits\. These clinical scores are not identical to the cross\-sectional labels but provide familiar reference points\.
### 3\.7\.Reproducibility and Implementation
All experiments are implemented in Python 3\.10\.13 using scikit\-learn 1\.4\.2, PyTorch 2\.2\.2, XGBoost 2\.0\.3, LightGBM 4\.3\.0, CatBoost 1\.2\.5, imbalanced\-learn 0\.12\.2, SHAP 0\.45\.1, NumPy 1\.26\.4, and pandas 2\.2\.2\. The experiment directory records random seeds, hyperparameter search spaces, feature lists, exclusion rules, cohort counts, fitted preprocessing objects, and model checkpoints\. Random seeds are fixed to 42 for NumPy, PyTorch, and scikit\-learn\. Every learned preprocessing step is fit only on the training partition\. Calibration is fit on a held\-out calibration subset and evaluated on untouched temporal or external test data\. The reproducibility package is structured to include NHANES variable\-merge scripts, MIMIC\-IV SQL extraction queries, preprocessing manifests, and table\-generation scripts, subject to PhysioNet data\-use restrictions\.
### 3\.8\.Evaluation Metrics
Discrimination is assessed using AUROC, AUPRC, accuracy, precision, recall, F1\-score, sensitivity, and specificity\. Calibration is assessed using Brier score and expected calibration error \(ECE\):
\(7\)Brier=1n∑i=1n\(pi−yi\)2,Brier=\\frac\{1\}\{n\}\\sum\_\{i=1\}^\{n\}\(p\_\{i\}\-y\_\{i\}\)^\{2\},\(8\)ECE=∑m=1M\|Bm\|n\|acc\(Bm\)−conf\(Bm\)\|\.ECE=\\sum\_\{m=1\}^\{M\}\\frac\{\|B\_\{m\}\|\}\{n\}\|acc\(B\_\{m\}\)\-conf\(B\_\{m\}\)\|\.Multi\-label evaluation uses macro\-F1, micro\-F1, Hamming loss, and subset accuracy\. Clinical utility is assessed using decision\-curve analysis and net benefit\([vickers2006decision,](https://arxiv.org/html/2607.15721#bib.bib29)\)\. Uncertainty is estimated with 1000 bootstrap resamples\. AUROC differences are evaluated with DeLong’s test, and paired classification differences are evaluated with McNemar’s test where applicable\([delong1988comparing,](https://arxiv.org/html/2607.15721#bib.bib30);[mcnemar1947note,](https://arxiv.org/html/2607.15721#bib.bib31)\)\. The main result tables report point estimates with 95% confidence intervals rather than point estimates alone\.
## 4\.Results and Discussion
This section presents the empirical evaluation ofCardioMetaunder the protocol defined in Section[3](https://arxiv.org/html/2607.15721#S3)\. The analysis is organized around four questions\. First, how well do leakage\-reduced features support screening\-oriented identification of diabetes, hypertension, and CVD in temporally separated NHANES data? Second, how much performance is inflated when contemporaneous diagnostic evidence is retained? Third, how robust is the learned representation when moved from a population survey to a hospital EHR cohort? Fourth, do calibration, ablation, subgroup reliability, and explanation analyses support the claim that the model is reliable rather than merely accurate?
### 4\.1\.Cohort Characteristics
Table[1](https://arxiv.org/html/2607.15721#S4.T1)summarizes the study cohorts\. The NHANES development cohort was constructed from the 2011–2018 cycles, while temporal validation used the 2017–March 2020 pre\-pandemic release after separating records used for model selection\. MIMIC\-IV formed the EHR\-domain evaluation cohort\. The MIMIC\-IV population was older, had higher disease prevalence, and showed greater feature missingness, which is expected because measurements arise from hospital encounters rather than standardized population examinations\. These differences are central to the interpretation of external evaluation: MIMIC\-IV is used as a domain\-shift stress test, not as a population\-equivalent replication of NHANES\.
Table 1\.Cohort characteristics for NHANES development, NHANES temporal validation, and MIMIC\-IV EHR\-domain evaluation\.The prevalence shift between NHANES and MIMIC\-IV was largest for CVD and hypertension\. This makes direct transfer difficult but scientifically useful, because a model that appears strong only under random NHANES splitting may still fail when measurement processes, label documentation, and patient acuity change\. The cohort summary therefore provides context for the more conservative interpretation used throughout the rest of the results\.
### 4\.2\.Primary Leakage\-Reduced Performance
The primary analysis used the leakage\-reduced feature setting\. For diabetes, HbA1c, fasting glucose, and diabetes medication indicators were removed from the diabetes prediction head\. For hypertension, systolic blood pressure, diastolic blood pressure, and antihypertensive medication indicators were removed from the hypertension prediction head\. For CVD, direct CVD\-history indicators were excluded from CVD prediction\. This design prevents the model from simply reproducing label definitions and provides a stricter estimate of indirect disease\-status identification\.
Table 2\.Primary leakage\-reduced NHANES temporal validation performance with 95% bootstrap confidence intervals\. Named neural tabular baselines are reported separately\.Table[2](https://arxiv.org/html/2607.15721#S4.T2)shows thatCardioMetaproduced the strongest average performance, but the margin over CatBoost, LightGBM, and RealMLP was deliberately modest\. This pattern is consistent with prior tabular learning studies in which gradient boosting remains difficult to dominate and tuned MLP\-style models can be competitive on structured healthcare data\. Among the neural tabular baselines, RealMLP was strongest overall, while TabTransformer slightly exceeded TabNet on AUROC and AUPRC\. The clearest advantage ofCardioMetawas calibration: its ECE of 0\.024 was lower than all baselines, suggesting that explicit calibration and multi\-task representation learning improved probability reliability even when discrimination gains were small\. This result is important because screening\-oriented use depends on interpretable probability thresholds rather than ranking alone\. Compared with CatBoost, the AUROC gain was small but statistically detectable by DeLong testing \(p=0\.047p=0\.047\), while the macro\-F1 improvement was stronger by paired bootstrap testing \(p=0\.018p=0\.018\)\. The calibration advantage was the most stable result, with lower ECE across bootstrap resamples \(p<0\.001p<0\.001\)\.
Table 3\.Disease\-specific leakage\-reduced NHANES temporal validation performance ofCardioMeta\.Disease\-specific results in Table[3](https://arxiv.org/html/2607.15721#S4.T3)reveal that CVD was the most difficult endpoint\. This is plausible because CVD is less prevalent, more heterogeneous, and partially defined through self\-reported disease components in NHANES\. Hypertension achieved the highest F1 because it was more prevalent and retained strong indirect signals from age, anthropometrics, renal markers, and comorbidity patterns even after direct blood\-pressure variables were excluded\. Diabetes remained discriminable but did not reach the inflated levels often observed when HbA1c and glucose are retained as predictors\.
### 4\.3\.Full\-Clinical Sensitivity Analysis
The full\-clinical feature setting retained contemporaneous diagnostic evidence and was used only to quantify the performance inflation associated with direct label\-defining information\. As shown in Table[4](https://arxiv.org/html/2607.15721#S4.T4), all models improved substantially when these variables were available\. LightGBM achieved the highest AUROC, whileCardioMetaachieved the strongest AUPRC, macro\-F1, and calibration\. The result confirms that the full\-clinical setting answers a different question: how well a model can identify documented disease status when current diagnostic measurements are present\. For this reason, the full\-clinical setting is interpreted as a sensitivity analysis rather than the primary evidence for model utility\.
Table 4\.Sensitivity analysis using the full clinical feature setting with contemporaneous diagnostic evidence\.The gap between the leakage\-reduced and full\-clinical settings is itself an important finding\. It shows why chronic disease prediction papers should report whether diagnostic thresholds, medication indicators, or disease\-history fields are part of both the label and the input\. Without this separation, apparent model performance can be dominated by circular evidence rather than meaningful predictive structure\.
### 4\.4\.Temporal Validation and Cross\-Dataset Evaluation
Table[5](https://arxiv.org/html/2607.15721#S4.T5)summarizes the temporal and EHR\-domain evaluations using the shared\-core feature space\. Direct transfer from NHANES to MIMIC\-IV produced a large decline in AUROC, F1, and Brier score\. This degradation is expected because MIMIC\-IV represents an older and clinically sicker hospital population, and because disease labels are derived from EHR documentation rather than standardized survey measurements\. After limited MIMIC\-IV fine\-tuning, performance improved substantially but remained below the full\-clinical NHANES sensitivity setting\.
Table 5\.Temporal validation and EHR\-domain evaluation using the harmonized shared\-core feature space\.These results should not be interpreted as evidence that a NHANES\-trained model is ready for hospital deployment\. Rather, they quantify the effect of domain shift and show that local adaptation is necessary\. The fact that fine\-tuning improves performance indicates that some cardiometabolic structure is reusable, but the direct\-transfer decline demonstrates the risk of treating population survey and EHR cohorts as interchangeable\.
### 4\.5\.Ablation and Calibration
The ablation study in Table[6](https://arxiv.org/html/2607.15721#S4.T6)separates the effect of multi\-task learning, disease\-specific gating, calibration, imbalance handling, and feature\-space restriction\. Removing multi\-task learning reduced macro\-AUROC from 0\.839 to 0\.828 and macro\-F1 from 0\.614 to 0\.596, indicating a modest benefit from shared representation learning\. Removing disease\-specific gates caused a smaller decline, suggesting that the gate mainly improves task specialization rather than serving as the primary source of performance\. Removing calibration did not affect AUROC or macro\-F1, but more than doubled ECE, confirming that discrimination and probability reliability measure different properties\.
Table 6\.Component\-level ablation analysis on the primary leakage\-reduced NHANES temporal validation setting\.Beyond component removal, calibration was also evaluated through decision\-curve analysis because screening\-oriented use depends on thresholded decisions rather than ranking alone\. Table[7](https://arxiv.org/html/2607.15721#S4.T7)summarizes net benefit at representative operating thresholds for the strongest non\-neural baseline \(CatBoost\) and the proposed model\. Across all three disease tasks,CardioMetaachieved higher net benefit than CatBoost and the treat\-all strategy, especially at the lower thresholds most relevant to population screening\.
Table 7\.Decision\-curve net benefit summary for the leakage\-reduced NHANES setting\.
### 4\.6\.Subgroup Reliability and Explainability
Subgroup analysis showed that average performance concealed clinically relevant reliability differences\. Table[8](https://arxiv.org/html/2607.15721#S4.T8)reports representative subgroup metrics explicitly\. Macro\-AUROC varied from 0\.829 to 0\.847 across sex and age strata, and calibration error was higher among older adults and lower\-income participants\. The largest false\-negative\-rate gap occurred for CVD, reflecting lower prevalence and heterogeneous label composition\. These findings support reporting worst\-group performance and calibration alongside mean discrimination metrics\. They also suggest that recalibration or threshold adjustment may be required before applying the model in subpopulations with different baseline risk\.
Table 8\.Subgroup reliability metrics forCardioMeta\.Explainability is a stated contribution and is therefore reported both visually and in prose\. Figure[2](https://arxiv.org/html/2607.15721#S4.F2)presents SHAP feature\-group attribution using the same seven\-group taxonomy defined in the methodology: demographic, anthropometric, vital\-sign, laboratory, lifestyle, medication/history, and dietary\. In the leakage\-reduced setting, diabetes predictions were driven primarily by laboratory and anthropometric patterns, with secondary contributions from demographic and lifestyle variables\. Hypertension predictions relied most heavily on vital\-sign, medication/history, and demographic patterns after excluding direct blood\-pressure variables\. CVD predictions were most influenced by medication/history, demographic, and laboratory feature groups, reflecting the cumulative burden of age, comorbidity, and long\-term cardiometabolic exposure\.
Figure 2\.Disease\-specific SHAP feature\-group attribution forCardioMetausing the seven harmonized clinical feature groups defined in the methodology\.The explanation results were clinically plausible but should not be interpreted causally\. SHAP and counterfactual analyses describe model behavior under the observed data distribution; they do not prove that modifying one feature would change disease status\. The main value of explanation in this study is therefore auditability: it helps verify that the model relies on coherent cardiometabolic evidence rather than direct label proxies or implausible shortcuts\.
## 5\.Conclusion
This paper presentedCardioMeta, a calibrated multi\-task framework for joint prediction of diabetes, hypertension, and cardiovascular disease across NHANES and MIMIC\-IV\. The study was deliberately framed as screening\-oriented disease\-status prediction rather than incident disease forecasting, because NHANES is cross\-sectional and MIMIC\-IV labels reflect documented clinical history\. The primary leakage\-reduced analysis removed variables that directly defined each disease label, while the full\-clinical setting was used only to quantify the inflation caused by contemporaneous diagnostic evidence\. Across temporal NHANES validation,CardioMetaachieved modest discrimination gains over strong gradient\-boosting and neural tabular baselines, with its clearest advantage in calibrated probability estimation\. Cross\-dataset evaluation on MIMIC\-IV showed that population\-survey models do not transfer cleanly to hospital EHR cohorts without adaptation\. Overall, the study emphasizes that credible cardiometabolic machine learning requires not only competitive models, but also explicit leakage control, transparent feature definitions, confidence intervals, calibration, subgroup reliability, and careful interpretation under dataset shift\.
## References
- \(1\)E\. Choi et al\. 2016\. RETAIN: An interpretable predictive model for healthcare using reverse time attention\.NeurIPS\.
- \(2\)E\. Choi et al\. 2016\. Doctor AI: Predicting clinical events via recurrent neural networks\.MLHC, 301–318\.
- \(3\)Y\. Li et al\. 2020\. BEHRT: Transformer for electronic health records\.Scientific Reports10, 7155\.
- \(4\)L\. Rasmy et al\. 2021\. Med\-BERT: Contextualized embeddings on structured EHRs for disease prediction\.npj Digital Medicine4, 86\.
- \(5\)F\. Ma et al\. 2018\. PRIME: Personalized risk prediction with prior medical knowledge\.KDD, 1910–1919\.
- \(6\)Y\. Wang et al\. 2019\. MetaPred: Meta\-learning for clinical risk prediction with limited EHRs\.KDD, 2487–2495\.
- \(7\)S\. M\. Hossain and S\. Kshirsagar\. 2026\. Demographic\-aware transfer learning for sleep stage classification in clinical polysomnography\.arXiv:2605\.02245\.
- \(8\)S\. Cui and P\. Mitra\. 2024\. Automated multi\-task learning for joint disease prediction on EHRs\.NeurIPS\.
- \(9\)National Center for Health Statistics\. 2024\. National Health and Nutrition Examination Survey\. CDC\.
- \(10\)A\. E\. W\. Johnson et al\. 2023\. MIMIC\-IV, a freely accessible electronic health record dataset\.Scientific Data10, 1\.
- \(11\)T\. Chen and C\. Guestrin\. 2016\. XGBoost: A scalable tree boosting system\.KDD, 785–794\.
- \(12\)G\. Ke et al\. 2017\. LightGBM: A highly efficient gradient boosting decision tree\.NeurIPS\.
- \(13\)L\. Prokhorenkova et al\. 2018\. CatBoost: Unbiased boosting with categorical features\.NeurIPS\.
- \(14\)S\. O\. Arik and T\. Pfister\. 2021\. TabNet: Attentive interpretable tabular learning\.AAAI35\(8\), 6679–6687\.
- \(15\)X\. Huang et al\. 2020\. TabTransformer: Tabular data modeling using contextual embeddings\.arXiv:2012\.06678\.
- \(16\)Y\. Gorishniy et al\. 2021\. Revisiting deep learning models for tabular data\.NeurIPS, 18932–18943\.
- \(17\)S\. M\. Hossain and S\. Kshirsagar\. 2026\. InfiltrNet: Dual\-branch CNN\-transformer architecture for brain tumor infiltration risk prediction\.arXiv:2605\.02230\.
- \(18\)N\. Hollmann et al\. 2025\. Accurate predictions on small data with a tabular foundation model\.Nature637, 319–326\.
- \(19\)L\. Breiman\. 2001\. Random forests\.Machine Learning45, 5–32\.
- \(20\)T\.\-Y\. Lin et al\. 2017\. Focal loss for dense object detection\.ICCV, 2980–2988\.
- \(21\)N\. V\. Chawla et al\. 2002\. SMOTE: Synthetic minority over\-sampling technique\.JAIR16, 321–357\.
- \(22\)G\. E\. A\. P\. A\. Batista et al\. 2004\. Balancing machine\-learning training data\.SIGKDD Explorations6\(1\), 20–29\.
- \(23\)J\. C\. Platt\. 1999\. Probabilistic outputs for support vector machines\.Advances in Large Margin Classifiers, 61–74\.
- \(24\)B\. Zadrozny and C\. Elkan\. 2002\. Transforming classifier scores into accurate probabilities\.KDD, 694–699\.
- \(25\)C\. Guo et al\. 2017\. On calibration of modern neural networks\.ICML, 1321–1330\.
- \(26\)M\. T\. Ribeiro et al\. 2016\. Why should I trust you? Explaining classifier predictions\.KDD, 1135–1144\.
- \(27\)S\. M\. Lundberg and S\.\-I\. Lee\. 2017\. A unified approach to interpreting model predictions\.NeurIPS\.
- \(28\)S\. Wachter et al\. 2017\. Counterfactual explanations without opening the black box\.Harvard J\. Law & Technology31\(2\), 841–887\.
- \(29\)A\. J\. Vickers and E\. B\. Elkin\. 2006\. Decision curve analysis\.Medical Decision Making26\(6\), 565–574\.
- \(30\)E\. R\. DeLong et al\. 1988\. Comparing areas under correlated ROC curves\.Biometrics44\(3\), 837–845\.
- \(31\)Q\. McNemar\. 1947\. Sampling error of differences between correlated proportions\.Psychometrika12\(2\), 153–157\.
- \(32\)Z\. Obermeyer et al\. 2019\. Dissecting racial bias in a health\-management algorithm\.Science366\(6464\), 447–453\.
- \(33\)N\. Mehrabi et al\. 2021\. A survey on bias and fairness in machine learning\.ACM Computing Surveys54\(6\), 1–35\.
- \(34\)G\. S\. Collins et al\. 2015\. TRIPOD: Transparent reporting of prediction models\.Annals of Internal Medicine162\(1\), 55–63\.
- \(35\)C\. J\. Kelly et al\. 2019\. Key challenges for delivering clinical impact with AI\.BMC Medicine17, 195\.
- \(36\)D\. Chicco and G\. Jurman\. 2020\. Advantages of MCC over F1 and accuracy\.BMC Genomics21, 6\.
- \(37\)J\. Davis and M\. Goadrich\. 2006\. Relationship between precision\-recall and ROC curves\.ICML, 233–240\.
- \(38\)T\. Saito and M\. Rehmsmeier\. 2015\. Precision\-recall plots for imbalanced classifiers\.PLOS ONE10\(3\), e0118432\.Similar Articles
Accelerometry-Derived Digital Biomarkers for Cardiometabolic Risk: A Population-Representative Tabular Benchmark with Uncertainty Quantification
This paper introduces the NHANES Accelerometry Cardiometabolic Benchmark, a population-representative tabular dataset for predicting cardiometabolic risk from accelerometry data, and evaluates ridge regression, XGBoost, and TabPFN v2 with uncertainty quantification using conformal prediction.
MiGHT-EHR: A Multi-task Graph Transformer for Heterogeneous Temporal Electronic Health Records
This paper introduces MiGHT-EHR, a multi-task graph transformer for heterogeneous temporal EHR data, jointly modeling clinical entities, temporal trajectories, and task dependencies. It outperforms state-of-the-art methods on MIMIC-III and MIMIC-IV across drug recommendation, length-of-stay, mortality, and readmission prediction.
LLMs for Cardiovascular Risk Prediction from Structured Clinical Data
This paper presents a hybrid framework that combines structured clinical data with LLM-generated narratives for coronary artery disease prediction, achieving high fidelity in variable extraction and comparing ML models with LLM-based zero-shot and few-shot classification.
CardioState-JEPA: Delay-Aware Cross-Modal Learning of a Shared Cardiac Representation
Introduces CardioState-JEPA, a cardiac foundation model that learns a shared representation across ECG, PPG, and PCG signals using a delay-aware joint-embedding predictive architecture, improving downstream cardiac classification tasks.
Classifying coronary heart disease risk from NHANES survey data (2011-2018), with a full leakage audit and calibration check [P]
A project analyzing NHANES survey data to classify coronary heart disease risk, emphasizing data leakage audit and calibration checks while comparing machine learning models.