PatTree: a novel approach for automated creation of multimodal, graph-based patient representations for medical classification tasks
Summary
This paper introduces PatTree, a graph-based multimodal patient representation that automatically structures heterogeneous clinical data for medical classification tasks. It achieves state-of-the-art performance on the ADNI-1 cohort with 98.5% balanced accuracy for Alzheimer's disease classification.
View Cached Full Text
Cached at: 08/05/26, 07:41 AM
# PatTree: a novel approach for automated creation of multimodal, graph-based patient representations for medical classification tasks Source: [https://arxiv.org/abs/2608.02692](https://arxiv.org/abs/2608.02692) [View PDF](https://arxiv.org/pdf/2608.02692) > Abstract:Access to holistic, multimodal data improves the performance of Artificial Intelligence \(AI\) in medical classification tasks compared to utilizing single modalities or data sources\. However, the inherent heterogeneity and complexity of clinical real\-world data pose significant challenges to structured data analysis and AI application\. This heterogeneity includes missing values, multiple time points, diverse modalities, and inconsistent formats and semantics\. Data harmonization prior to data integration tackles this challenge but remains resource\-intensive and error\-prone, limiting the scalability and reproducibility of holistic, AI\-driven decision support on clinical real\-world data\. We therefore propose PatTree, a graph\-based, holistic representation of patients that can be derived from real\-world clinical data through the automated structuring of multimodal clinical data\. PatTree enables early\-stage data integration without relying on pre\-standardized inputs\. While representing heterogeneous clinical data within a unified knowledge graph, PatTree preserves the semantic relationships between data elements across modalities and data sources, facilitating interoperability and machine\-interpretable data access\. Using a subset of the ADNI\-1 cohort \(n = 763\), we demonstrate that classification of patients is directly feasible on PatTree reaching state\-of\-the\-art classification performance\. In the three\-class classification task distinguishing Alzheimer's disease, mild cognitive impairment, and cognitively normal individuals, we achieve a balanced accuracy of 98\.5% and an F$\_1$ score of 0\.987 on the held\-out test set\. Our results show that assumption\-free, automated structuring of multimodal medical data can serve as a scalable foundation for clinical AI pipelines bypassing tedious data preparation and standardization\. ## Submission history From: Julia Gehrmann \[[view email](https://arxiv.org/show-email/2962cede/2608.02692)\] **\[v1\]**Mon, 3 Aug 2026 09:44:35 UTC \(1,347 KB\)
Similar Articles
Pretrained Medical Representations for the Practical Screening of Drug Repositioning Candidates
This paper proposes a new unified pre-training framework for medical code sequences that captures hierarchical structures and complex interactions, demonstrating superior performance in clinical event prediction and drug repositioning case studies for Alzheimer's disease.
CaresAI at SMM4H-HeaRD 2026: Predicting TNM Staging
This paper presents CaresAI's approach to the SMM4H-HeaRD 2026 shared task on predicting TNM staging from pathology reports using various embeddings and classifiers, achieving strong results but noting generalization issues.
Evidence-Based Intelligent Diagnostic and Therapeutic Visualization System with Large Language Models: Multi-Turn Interaction and Multimodal Treatment Plan Generation
This paper proposes a knowledge-enhanced visual diagnostic system for traditional Chinese medicine that uses a Neo4j knowledge graph, a four-stage symptom matching pipeline, and an information gain-driven proactive questioning strategy to improve transparency and interpretability. Results demonstrate significant improvements in diagnostic trust and reduced cognitive load.
TreeText-CTS: Compact, Source-Traceable Tree-Path Evidence for Irregular Clinical Time-Series Prediction
Introduces TreeText-CTS, a method that converts irregular EHR trajectories into compact, source-traceable tree-path evidence units without patient-level summarization. Achieves state-of-the-art AUROC and AUPRC among text-based EHR time-series interfaces on three clinical benchmarks.
PATHFinder Agent for Tailored Prenatal Care
This paper presents PATHFinder Agent, an end-to-end conversational AI system that generates personalized prenatal care plans following ACOG's PATH guidelines, integrating patient intake, dynamic dialogue, plan synthesis, and clinician oversight. Evaluation of frontier LLMs, including GPT-5.2, shows promising but incomplete performance, highlighting gaps in antenatal testing recommendations.