xMICD: Explainable Representation of Multiple ICD Codes
Summary
This paper introduces xMICD, a method that combines ICD code groupings with pre-trained embedding similarities to create low-dimensional, clinically interpretable patient representations, achieving predictive performance comparable to embedding-based approaches.
View Cached Full Text
Cached at: 08/04/26, 07:44 AM
# Explainable Representation of Multiple ICD Codes Source: [https://arxiv.org/html/2608.00935](https://arxiv.org/html/2608.00935) Kumkup KeeratisiwakulAlbert Phuoc Kien Van TruongNutcha YodrabumWasin PansiritanachotMarvin N\. WrightThanapon Noraset[thanapon\.nor@mahidol\.ac\.th](https://arxiv.org/html/2608.00935v1/mailto:[email protected]) ###### Abstract Background:Electronic Health Records \(EHRs\) are widely used for clinical risk prediction using machine learning\. International Classification of Diseases \(ICD\) codes provide structured information about patient diagnoses, but representing them effectively remains challenging\. Existing approaches often face a trade\-off between predictive performance and interpretability: grouping\-based representations are interpretable but may lose information, while embedding\-based representations achieve strong predictive performance but are difficult to interpret\. Methods:We propose Explainable Representation of Multiple ICD Codes \(xMICD\), a method for constructing low\-dimensional patient representations from sets of ICD codes\. xMICD combines clinically meaningful diagnostic groupings with similarity in a pre\-trained ICD embedding space\. Instead of using binary group membership, the method assigns codes to groups via similarity\-based relative assignments, yielding features that reflect how closely a patient’s diagnoses align with each clinical group\. Results:Experiments on large\-scale EHR datasets demonstrate that xMICD achieves predictive performance comparable to embedding\-based representations such as ICD2Vec across multiple clinical prediction tasks\. At the same time, the resulting features remain clinically interpretable because each dimension corresponds to a recognizable diagnostic group\. xMICD therefore provides a practical way to integrate embedding\-based semantic relationships into interpretable clinical feature spaces for machine learning models\. ###### keywords: International Classification of Diseases codes, Electronic Health Records, Medical code embeddings, Interpretable features, Explainable AI ††journal:Journal of Computers in Biology and Medicine\\affiliation \[label1\]organization=Faculty of Information and Communication Technology,addressline=Mahidol University, city=Nakhon Pathom, country=Thailand \\affiliation \[label2\]organization=Faculty of Mathematics and Computer Science,addressline=University of Bremen, city=Bremen, country=Germany \\affiliation \[label4\]organization=Leibniz Institute for Prevention Research and Epidemiology \- BIPS,city=Bremen, country=Germany \\affiliation \[label3\]organization=Department of Transdisciplinary Science and Engineering, School of Environment and Society,addressline=Institute of Science Tokyo, city=Tokyo, country=Japan \\affiliation \[label5\]organization=Department of Emergency Medicine, Faculty of Medicine Siriraj Hospital, Mahidol University,city=Bangkok, country=Thailand \\affiliation \[label6\]organization=Department of Surgery, Faculty of Medicine Siriraj Hospital, Mahidol University,city=Bangkok, country=Thailand ## 1Introduction Electronic Health Records \(EHRs\) are widely used to develop machine learning \(ML\) models for clinical risk prediction and decision support\. Among the many elements recorded in EHRs, International Classification of Diseases \(ICD\) codes play a key role, as they summarize patients’ diagnoses in a standardized format\[[25](https://arxiv.org/html/2608.00935#bib.bib36),[38](https://arxiv.org/html/2608.00935#bib.bib1),[30](https://arxiv.org/html/2608.00935#bib.bib15)\]\. However, using ICD codes directly in ML models is not straightforward\. The large number of distinct codes results in high\-dimensional and sparse feature spaces when one\-hot encoded, which can increase model complexity and reduce generalization performance\. Existing methods for representing ICD codes generally follow two directions\. The first uses clinically defined groupings, such as comorbidity indices or ICD chapters and blocks\. These representations are compact and easy to understand, but they often lose detailed information and may not achieve strong predictive performance\[[4](https://arxiv.org/html/2608.00935#bib.bib16),[42](https://arxiv.org/html/2608.00935#bib.bib17)\]\. The second direction relies on deep learning–based embeddings, which learn dense vector representations that capture relationships between codes\. These approaches often perform well in prediction tasks, but the learned dimensions are abstract and difficult to interpret in clinical terms\[[11](https://arxiv.org/html/2608.00935#bib.bib32),[44](https://arxiv.org/html/2608.00935#bib.bib35)\]\. This creates a trade\-off between interpretability and predictive accuracy\. Interpretability is especially important in healthcare, where ML models may influence high\-stakes decisions\. It is not enough for a model to be interpretable at the algorithm level; the input features should also be understandable to clinicians and other stakeholders\[[45](https://arxiv.org/html/2608.00935#bib.bib14),[34](https://arxiv.org/html/2608.00935#bib.bib38)\]\. Even simple models can be difficult to explain if their input features lack clear clinical meaning\. Therefore, designing ICD representations that are both informative and interpretable is an important step toward trustworthy clinical ML systems\. In this work, we propose xMICD \(Explainable Representation of Multiple ICD Codes\), a method that aims to balance predictive performance and interpretability\. xMICD represents a patient’s set of ICD codes as a single, low\-dimensional vector\. Each dimension corresponds to a clinically meaningful group of codes \(e\.g\., ICD\-10\-CM blocks\)\. Instead of using only binary indicators for group membership, xMICD employs a relative assignment mechanism based on similarity in a pre\-trained ICD embedding space\. Specifically, the value of each dimension reflects the similarity between a patient’s diagnoses and a predefined clinical reference group, allowing each dimension to capture graded relatedness rather than simple presence or absence\. Conceptually, this representation is inspired by anchor\-based interpretable embeddings, where each dimension reflects similarity to predefined reference anchors in the representation space\[[27](https://arxiv.org/html/2608.00935#bib.bib57),[37](https://arxiv.org/html/2608.00935#bib.bib56)\]\. By anchoring each dimension to clinically defined diagnostic groups, xMICD produces a compact and interpretable relative representation of ICD codes\. Our contributions are as follows: - 1\.We introduce xMICD, a method that converts multiple ICD codes into a low\-dimensional, clinically structured feature vector for standard ML models\. - 2\.We integrate pre\-trained ICD embeddings with clinically defined groupings to retain semantic relationships while preserving feature\-level interpretability\. - 3\.We evaluate xMICD on a large\-scale EHR dataset against common ICD representations across predictive performance in several downstream tasks, similarity preservation, and interpretability\. xMICD achieves performance comparable to embedding\-based methods while retaining clinically grounded structure absent in dense black\-box embeddings\. ## 2Background ### 2\.1Challenges of Using ICD Codes With Machine Learning The International Classification of Diseases \(ICD\) was first introduced in 1900 as a system for recording causes of death\. Since then, the World Health Organization \(WHO\) has revised it multiple times, leading to ICD\-9 and ICD\-10, which are still widely used today\[[38](https://arxiv.org/html/2608.00935#bib.bib1),[30](https://arxiv.org/html/2608.00935#bib.bib15)\]\. ICD\-10 contains more than 12,000 codes, and extended versions such as ICD\-10\-CM include around 70,000 codes\[[39](https://arxiv.org/html/2608.00935#bib.bib4),[26](https://arxiv.org/html/2608.00935#bib.bib20)\]\. ICD\-10\-CM codes follow a structured format\. The first three characters represent a broad disease category\. Codes are grouped into chapters based on the first letter, and further divided into blocks within each chapter\. Additional characters provide more detailed information, such as anatomical site, severity, or type of encounter\. For example, in the code S52\.001A, “S” indicates injury\-related conditions, “52” refers to a fracture of the forearm, and the remaining characters specify further details, including side and encounter type\. ICD\-10 codes have a similar structure but are generally less detailed than ICD\-10\-CM\[[39](https://arxiv.org/html/2608.00935#bib.bib4),[26](https://arxiv.org/html/2608.00935#bib.bib20)\]\. While ICD codes are clinically meaningful, they create practical challenges for machine learning\. When represented as one\-hot vectors, the large number of distinct codes leads to very high\-dimensional and sparse feature spaces\. This can increase computational cost and make it harder for models to generalize well\[[6](https://arxiv.org/html/2608.00935#bib.bib5),[42](https://arxiv.org/html/2608.00935#bib.bib17)\]\. For this reason, many studies have proposed transforming ICD codes into lower\-dimensional representations\. These approaches are reviewed in Section[3](https://arxiv.org/html/2608.00935#S3)\. ### 2\.2Interpretable Features In machine learning, interpretability generally refers to how easily humans can understand how a model works, while explainability focuses on how well the reasons behind a model’s predictions can be communicated\[[32](https://arxiv.org/html/2608.00935#bib.bib10),[21](https://arxiv.org/html/2608.00935#bib.bib28),[14](https://arxiv.org/html/2608.00935#bib.bib29)\]\. In healthcare, limited interpretability may reduce trust, slow adoption, and raise ethical or legal concerns\[[36](https://arxiv.org/html/2608.00935#bib.bib30),[43](https://arxiv.org/html/2608.00935#bib.bib31)\]\. Clinicians who cannot clearly understand how a model reaches its conclusions may hesitate to rely on it in practice\. Importantly, interpretability is not only about the model itself but also about the features it uses\. Even simple models, such as linear regression, can be difficult to interpret if their input features lack clear meaning\[[21](https://arxiv.org/html/2608.00935#bib.bib28)\]\. Therefore, in clinical ML applications, features should be understandable and clinically relevant to domain experts\[[45](https://arxiv.org/html/2608.00935#bib.bib14)\]\. According toZyteket al\.\[[45](https://arxiv.org/html/2608.00935#bib.bib14)\], feature properties can be grouped into three categories\. The first includes properties needed for effective modeling, such as predictive strength and compatibility with the chosen algorithm\. The second includes properties related to interpretability, such as readability, clear descriptions, and alignment with real\-world clinical concepts\. The third includes general properties relevant to all stakeholders, such as meaningfulness, traceability back to the original data, and the ability to reason about how changes in inputs affect outputs\[[29](https://arxiv.org/html/2608.00935#bib.bib60)\]\. These considerations show that choosing an appropriate feature representation is as important as selecting the learning algorithm itself\. This motivates our development of xMICD, which aims to produce features that are both model\-ready and clinically interpretable\. ## 3Related Work Existing approaches for representing ICD codes in machine learning fall into two main categories: grouping\-based binary representations and embedding\-based representations\. ### 3\.1Grouping\-Based Binary Representations Grouping\-based representations reduce the dimensionality of ICD codes by mapping them into clinically defined categories and representing each category using binary indicators\. The ICD coding system itself defines a hierarchical structure consisting of chapters and blocks, which group related diagnoses within the taxonomy\. These hierarchical levels can be encoded as binary features indicating whether a visit contains at least one diagnosis code within each group\[[7](https://arxiv.org/html/2608.00935#bib.bib22),[12](https://arxiv.org/html/2608.00935#bib.bib8)\]\. Beyond the native ICD hierarchy, several derived grouping systems have been developed\. The Clinical Classifications Software \(CCS\) aggregates ICD\-9\-CM codes into mutually exclusive clinical categories\[[1](https://arxiv.org/html/2608.00935#bib.bib51)\]\. For ICD\-10\-CM, the related Clinical Classifications Software Refined \(CCSR\) provides a similar mapping that organizes diagnosis codes into clinically meaningful groups\[[2](https://arxiv.org/html/2608.00935#bib.bib58)\]\. Another widely used approach focuses specifically on comorbidity measurement\. The Charlson Comorbidity Index \(CCI\) summarizes diagnoses into 17 predefined comorbidity groups\[[8](https://arxiv.org/html/2608.00935#bib.bib13)\]\. The Elixhauser Comorbidity Index \(ECI\) later expanded this framework to 31 comorbidity categories derived from ICD\-9\-CM codes, where each category is typically encoded as a binary indicator\[[13](https://arxiv.org/html/2608.00935#bib.bib18)\]\. These indices were originally designed for severity adjustment and outcome comparison in clinical and epidemiological studies\[[22](https://arxiv.org/html/2608.00935#bib.bib6),[5](https://arxiv.org/html/2608.00935#bib.bib7),[35](https://arxiv.org/html/2608.00935#bib.bib12)\]\. These representations are easy to interpret and align with clinical reasoning\. However, by reducing each group to a binary indicator, they treat heterogeneous diseases within the same category as equivalent\. This simplification may obscure differences in severity or subtype and can limit predictive performance in some tasks\[[17](https://arxiv.org/html/2608.00935#bib.bib25),[3](https://arxiv.org/html/2608.00935#bib.bib9),[9](https://arxiv.org/html/2608.00935#bib.bib11)\]\. ### 3\.2Deep Learning\-Based Embedding Methods Embedding\-based methods aim to learn dense vector representations for ICD codes that capture semantic relationships beyond manual groupings\. Med2Vec is one of the early approaches, learning code embeddings from patient visit data\[[10](https://arxiv.org/html/2608.00935#bib.bib26)\]\. ICD2Vec further leverages textual descriptions of ICD codes to generate embeddings, and patient\-level representations are typically formed by averaging code vectors within a visit\[[19](https://arxiv.org/html/2608.00935#bib.bib27)\]\. More recent work incorporates temporal context\. Models such as BEHRT and Med\-BERT adapt Transformer architectures to represent sequences of visits, capturing disease progression and longitudinal dependencies\[[20](https://arxiv.org/html/2608.00935#bib.bib48),[31](https://arxiv.org/html/2608.00935#bib.bib49)\]\. In these approaches, embeddings become context\-dependent rather than static\. Graph\-based methods provide another direction\. For example, GraphSAGE\-MC models ICD codes as nodes in a graph defined by hierarchical relationships and introduces multi\-code nodes to represent combinations of diagnoses\[[23](https://arxiv.org/html/2608.00935#bib.bib41)\]\. This design allows the model to represent unseen code combinations without retraining\. Embedding\-based methods generally achieve strong predictive performance because they capture complex relationships between codes\. However, their learned dimensions are abstract and do not correspond directly to clinically meaningful categories\. This limits their transparency at the feature level, especially in high\-stakes clinical settings\. ## 4xMICD: The Proposed Method A common way to represent multiple ICD codes is to rely on clinical groupings\. Let a visit be associated with ICD codes\{C1,C2,…,Cn\}\\\{C\_\{1\},C\_\{2\},\\ldots,C\_\{n\}\\\}\. Assume thatmmclinically meaningful groups \(for example ICD Blocks or comorbidity categories\) are available\. A standard grouping\-based representation defines, for each groupjj, Gj=\{1if anyCibelongs to groupj,0otherwise\.G\_\{j\}=\\begin\{cases\}1&\\text\{if any \}C\_\{i\}\\text\{ belongs to group \}j,\\\\ 0&\\text\{otherwise\.\}\\end\{cases\}This representation is straightforward to interpret, as each dimension corresponds to a known clinical concept\. However, it treats all codes within a group as equivalent and does not differentiate between, for example, mild and severe manifestations or between codes that are similar but assigned to different groups\. The xMICD framework relaxes this hard membership assumption\. Instead of using binary group membership, it relies on similarity between ICD codes and a set of representative “anchors”\. The resulting representation can still be read at the level of clinical groups, but each dimension reflects how strongly the codes in a visit relate to the corresponding anchor\. ### 4\.1xMICD Formulation Let\{A1,…,Am\}\\\{A\_\{1\},\\ldots,A\_\{m\}\\\}be a set of anchors\. Anchors may correspond to individual ICD codes or to vectors in an ICD embedding space, as discussed further\. We first compute a raw similarity between each codeCiC\_\{i\}and each anchorAjA\_\{j\}, sij=Sim\(Ci,Aj\),i=1,…,n,j=1,…,m,s\_\{ij\}=\\mathrm\{Sim\}\(C\_\{i\},A\_\{j\}\),\\quad i=1,\\ldots,n,\\;j=1,\\ldots,m,whereSim\(⋅,⋅\)\\mathrm\{Sim\}\(\\cdot,\\cdot\)is a chosen code–anchor similarity measure\. This yields ann×mn\\times msimilarity matrix\. To remove scale differences between codes and to focus on the relative importance of anchors for each code, we normalize similarities within each row\. For a fixed codeCiC\_\{i\}, we apply min–max scaling across all anchors, sij′=sij−minjsijmaxjsij−minjsij\.s^\{\\prime\}\_\{ij\}=\\frac\{s\_\{ij\}\-\\min\_\{j\}s\_\{ij\}\}\{\\max\_\{j\}s\_\{ij\}\-\\min\_\{j\}s\_\{ij\}\}\.Under this transformation, the anchor with the highest similarity toCiC\_\{i\}is mapped to 1, the anchor with the lowest similarity is mapped to 0, and other anchors take values between 0 and 1 according to their relative distances\. The normalized valuessij′s^\{\\prime\}\_\{ij\}describe, for each code, the relative strength of each anchor compared to the others, rather than absolute similarity in the embedding space\. This emphasizes contextual dominance within each code\. We then aggregate across codes at the anchor level\. For each anchorAjA\_\{j\}, we define Sj=maxi=1,…,nsij′\.S\_\{j\}=\\max\_\{i=1,\\ldots,n\}s^\{\\prime\}\_\{ij\}\.The vectorS=\(S1,…,Sm\)S=\(S\_\{1\},\\ldots,S\_\{m\}\)is the xMICD representation of the set of ICD codes\. The quantitySjS\_\{j\}does not measure absolute geometric proximity between codes and anchorAjA\_\{j\}\. Instead, it captures whetherAjA\_\{j\}is relatively dominant for at least one of the codes in the visit\. IfSj=1S\_\{j\}=1, thenAjA\_\{j\}is the top\-ranked anchor for at least one code\. IfSj<1S\_\{j\}<1,AjA\_\{j\}never attains the highest normalized similarity, and low values indicate that it is consistently outperformed by other anchors within all codes in the visit\. In this way, xMICD encodes contextual dominance of anchors across the codes rather than global similarity\. Figure[1](https://arxiv.org/html/2608.00935#S4.F1)illustrates the overall computation process of xMICD, from a set of ICD codes to the final anchor\-based representation\. Figure 1:Overview of the xMICD computation process\. A set of ICD codes is mapped into an embedding space, similarities to anchor groups are computed, normalized within each code, and aggregated across codes to produce the final anchor\-based representation\.So far, two components remain to be specified: the similarity functionSim\\mathrm\{Sim\}and the construction of the anchor set\. We describe these choices next\. ### 4\.2Similarity Measures The similarity functionSim\(⋅,⋅\)\\mathrm\{Sim\}\(\\cdot,\\cdot\)can be defined at the code level or in an embedding space\. We distinguish between these two perspectives\. ##### Code similarity The first approach defines similarity directly between ICD codes\. Such measures typically exploit structural or semantic information inherent in the ICD hierarchy\. For example, ontology\-based semantic similarity measures such as Wu–Palmer\[[40](https://arxiv.org/html/2608.00935#bib.bib52)\]and Leacock–Chodorow\[[18](https://arxiv.org/html/2608.00935#bib.bib53)\]compute similarity based on the relative positions of concepts in the taxonomy\. These measures operate directly on the coding system and preserve relationships encoded in the ontology rather than relying on data\-driven co\-occurrence patterns\. They have been used in prior work to compute semantic similarity between ICD codes when comparing patient diagnosis sets\[[33](https://arxiv.org/html/2608.00935#bib.bib55)\]\. ##### Embedding\-based similarity The second approach defines similarity in a learned embedding space\. Each ICD code is represented as a dense vector learned from clinical data, and similarity is computed using a standard vector similarity measure such as cosine similarity\. Pre\-trained models such as Med2Vec or ICD2Vec provide such embeddings \(see Section[3\.2](https://arxiv.org/html/2608.00935#S3.SS2)\)\. Unlike code\-level measures, embedding\-based similarity captures statistical relationships derived from data and may reflect co\-occurrence or contextual patterns that are not explicit in the ICD hierarchy\. In this work, we primarily focus on embedding\-based similarity, specifically ICD2Vec\. This choice is motivated by the ability of embedding methods to capture richer relationships between diseases that may not be explicitly represented in the ICD hierarchy\[[24](https://arxiv.org/html/2608.00935#bib.bib2),[16](https://arxiv.org/html/2608.00935#bib.bib3)\]\. In addition, using ICD2Vec as the similarity backbone allows us to directly compare the representations produced by xMICD with its underlying embedding space, providing a natural baseline for evaluating how the proposed method transforms and aggregates the original ICD2Vec representations\. ### 4\.3Anchor Selection Anchors act as reference points in the code space\. We consider both clinically defined and data\-driven constructions\. ##### Clinically defined anchors Anchors may be derived from established clinical groupings such as CCI, ECI, or ICD Blocks\. When a group contains multiple codes, a single representative can be selected as the most central element in the embedding space\. For a groupkk, we define its anchor as Ak=argmaxA∈groupk∑V∈groupkSim\(A,V\),A\_\{k\}=\\operatorname\*\{argmax\}\_\{A\\in\\text\{group \}k\}\\sum\_\{V\\in\\text\{group \}k\}\\mathrm\{Sim\}\(A,V\),that is, the code whose embedding has the highest average similarity to other codes in the same group\. ##### Data\-driven anchors Anchors can also be defined directly from the embedding space without relying on predefined groupings\. One option is farthest point sampling, which iteratively selects anchors that are maximally distant from those already chosen, thereby covering the space with diverse representatives\. Another option is clustering, where a clustering algorithm is applied to the embeddings and cluster medoids are used as anchors\. Such anchor selection strategies have been used in interpretable text embedding models such as LDIR\[[37](https://arxiv.org/html/2608.00935#bib.bib56)\]\. The overall construction process combines a chosen similarity measure with either clinically defined or data\-driven anchors\. Through this design, xMICD provides a flexible framework for constructing clinically structured representations from ICD codes\. ### 4\.4Positioning of xMICD xMICD occupies an intermediate position between grouping\-based binary representations and embedding\-based dense representations\. Compared to binary grouping methods, xMICD preserves graded semantic relationships through similarity\-based relative assignment\. Compared to dense embedding methods, xMICD constrains each dimension to correspond to a clinically interpretable anchor, improving feature\-level transparency\. This positioning allows xMICD to balance semantic expressiveness and interpretability within a clinically structured representation space\. Figure[2](https://arxiv.org/html/2608.00935#S4.F2)compares xMICD with grouping\-based and embedding\-based representations\. Note that xMICD values should be interpreted with care\. Each dimension reflects the relative prominence of the corresponding anchor under the chosen similarity function, not a probability of belonging to that group and not a measure of disease severity\. Because similarities are normalized across anchors for each ICD code and then aggregated across codes, a high xMICD value indicates that the anchor is relatively prominent for at least one diagnosis code in the visit\. Figure 2:Positioning of xMICD between grouping\-based and embedding\-based representations for multi\-ICD feature construction\. ## 5Experimental Setup ### 5\.1Setting ##### Dataset and Preprocessing Experiments are conducted using two publicly available clinical datasets: MIMIC\-IV\-ED\[[15](https://arxiv.org/html/2608.00935#bib.bib24)\]and the eICU Collaborative Research Database \(eICU\-CRD\)\[[28](https://arxiv.org/html/2608.00935#bib.bib54)\]\. The MIMIC\-IV\-ED dataset contains 448,972 emergency department visits from 215,736 patients at Beth Israel Deaconess Medical Center between 2011 and 2019\. Patients under 18 years of age or with missing triage acuity information were excluded, and outlier vital signs were removed\. After preprocessing, 418,490 ED visits remained\. The eICU\-CRD is a multi\-center intensive care dataset collected from hospitals across the United States\. Records without ICD diagnosis codes or without discharge information were removed to ensure that both diagnostic features and outcome labels were available\. All ICD\-9\-CM codes were mapped to ICD\-10\-CM using the General Equivalence Mapping \(GEM\) to ensure consistency within a single coding system\. ##### Baseline We compare several configurations of xMICD against established baselines, including raw ICD features, grouping\-based binary representations, and embedding\-based representations\. The raw ICD representation is constructed by one\-hot encoding diagnosis codes appearing in the dataset\. Although the ICD\-10\-CM system contains 24,354 diagnosis codes in total, only a subset appears in each dataset\. In MIMIC\-IV\-ED, 10509 distinct codes occur in diagnoses recorded during the current ED visit and 14874 additional codes occur in inpatient admissions within the preceding five years, resulting in 25383 dimensions when combined\. In contrast, the eICU\-CRD dataset contains only 811 unique diagnosis codes\. Grouping\-based baselines map ICD codes into predefined clinical groups and encode them as binary indicators, resulting in 31 dimensions for Elixhauser, 209 for ICD\-10\-CM Blocks, and 553 for CCSR\. For embedding\-based baselines, we use ICD2Vec embeddings with 1024 dimensions, where visit\-level representations are obtained by averaging code embeddings\. For MIMIC\-IV\-ED, diagnoses from the current visit and the preceding five years are encoded separately and concatenated, doubling the dimensionality \(62, 418, 1106, and 2048 respectively\)\. In eICU, only diagnoses from the current ICU stay are used, so the dimensionality remains 31, 209, 553, and 1024\. ##### xMICD configurations We construct xMICD under cosine similarity computed from ICD2Vec embeddings\. For anchors, we evaluate four strategies: medoids of ECI groups \(31 anchors\), medoids of ICD\-10\-CM Blocks \(209 anchors\), medoids of CCSR \(553 anchors\), and anchors selected using farthest point sampling \(209 and 553 anchors\)\. ### 5\.2Evaluation We evaluate xMICD against other representations in terms of predictive performance on downstream tasks and similarity preservation\. ##### Downstream tasks Representations of ICD codes are used as features for predictive tasks on both datasets\. For MIMIC\-IV\-ED, we follow the benchmark tasks introduced in\[[41](https://arxiv.org/html/2608.00935#bib.bib40)\]: critical outcome prediction, hospitalization requirement, and revisit in 72h\. ICD features are constructed using diagnoses from the current ED visit together with diagnoses recorded during inpatient admissions in the preceding five years to capture comorbidities\. The dataset is randomly split into 80% training and 20% testing\. For eICU\-CRD, we consider two commonly studied ICU outcomes: in\-ICU mortality and prolonged ICU stay \(defined as a length of stay greater than 3 days\)\. ICD features are derived only from diagnoses recorded during the corresponding ICU stay\. The split is performed at the hospital level, assigning hospitals exclusively to either the training or test set, thereby providing external validation across institutions\. The experimental pipeline, predictive models, and evaluation procedures are kept consistent across both datasets\. We evaluate two models, XGBoost and a multilayer perceptron \(MLP\) trained with Adam\. Performance is measured using AUROC, and uncertainty is estimated via bootstrap resampling of the test set \(200 replicates\), following\[[41](https://arxiv.org/html/2608.00935#bib.bib40)\]\. ##### Similarity preservation In natural language processing, representation quality is often evaluated by comparing representation\-induced similarity with a human\-annotated ground\-truth similarity\. However, in the clinical domain, no such gold\-standard similarity exists at the patient level\. We therefore evaluate similarity preservation by assessing the consistency of patient\-level similarity structures across representations\. For each representation, patient\-level similarity was computed using cosine similarity between visit\-level feature vectors\. We then computed Spearman’s rank correlation between the resulting similarity matrices across representations\. This evaluates the consistency of patient similarity structures across different representations\. ### 5\.3Interpretability Assessment Unlike predictive performance and similarity, feature\-level interpretability does not have a widely accepted quantitative metric\. Instead, prior work has proposed qualitative criteria that characterize whether features are actionable and clinically meaningful\. We therefore adopt the framework introduced in Section[2\.2](https://arxiv.org/html/2608.00935#S2.SS2)to evaluate interpretability using a set of qualitative properties\. Each property is assessed using three ordinal levels, indicating whether it is present, partially present, or absent for a given representation\. This allows us to systematically compare baseline representations and xMICD in terms of their interpretability characteristics\. The evaluated properties are:Readable:Features are expressed in recognizable, domain\-appropriate vocabulary rather than opaque or coded representations\.Understandable:Features refer to real\-world quantities that users can reason about in context\.Meaningful:Features align with clinically plausible or domain\-relevant concepts\.Trackable:Features have clear data lineage and can be traced back to the original input data\.Simulatable:The feature computation process can be reconstructed or reasoned about from available information\. A detailed discussion of these criteria is provided in\[[45](https://arxiv.org/html/2608.00935#bib.bib14)\]\. ## 6Results ### 6\.1Predictive performance on downstream tasks We evaluate xMICD constructed using cosine similarity computed from ICD2Vec embeddings with different types of anchors\. We compare these variants with Raw ICD features, ICD2Vec embeddings, and several binary grouping features\. Figures[3](https://arxiv.org/html/2608.00935#S6.F3)and[4](https://arxiv.org/html/2608.00935#S6.F4)present the results on the MIMIC\-IV\-ED dataset for the tasks of Critical Outcome, Hospitalization, and Revisit in 72h using XGBoost and MLP models, respectively\. Figures[5](https://arxiv.org/html/2608.00935#S6.F5)and[6](https://arxiv.org/html/2608.00935#S6.F6)show the results on the eICU\-CRD dataset for the tasks of Mortality and Prolonged Stay using the same two models\. Error bars represent the 95% confidence intervals\. The complete set of results is reported in Table[2](https://arxiv.org/html/2608.00935#Sx2.T2)and Table[3](https://arxiv.org/html/2608.00935#Sx2.T3)in the Appendix\. Figure 3:Predictive performance of different ICD representations on the MIMIC\-IV\-ED dataset using XGBoost\.Figure 4:Predictive performance of different ICD representations on the MIMIC\-IV\-ED dataset using MLP\.Figure 5:Predictive performance of different ICD representations on the eICU\-CRD dataset using XGBoost\.Figure 6:Predictive performance of different ICD representations on the eICU\-CRD dataset using MLP\.Overall, we observe that binary grouping representations, which reduce dimensionality by assigning codes to discrete clinical groups, generally lead to lower predictive performance compared to using Raw ICD features\. In contrast, embedding\-based representations such as ICD2Vec consistently improve predictive performance across most tasks and models, suggesting that continuous representations capture richer relationships between diagnoses than binary indicators\. Among the different xMICD variants constructed using different anchor sets, most configurations yield very similar predictive performance\. In particular, the difference between clinically defined anchors \(such as ICD blocks or CCSR categories\) and data\-driven anchor \(FPS\) appears to be relatively small when the dimensionality is comparable\. The main exception is xMICD based on ECI anchors\. Because ECI contains only 31 groups, the resulting representation has a much lower dimensionality and therefore captures less diagnostic information, leading to substantially lower predictive performance than other xMICD variants\. Finally, we find that xMICD representations built on ICD2Vec embeddings, except for the ECI\-based variant, achieve predictive performance comparable to ICD2Vec itself\. For XGBoost models, xMICD occasionally slightly exceeds ICD2Vec, whereas for MLP models ICD2Vec typically remains marginally better\. However, the differences between the two representations are generally small, indicating that xMICD preserves most of the predictive power of ICD2Vec while providing a more structured and interpretable representation\. These patterns hold consistently across nearly all tasks and models considered in our experiments\. For the eICU\-CRD dataset, it can be observed that Raw ICD codes perform comparably to both ICD2Vec and xMICD\. This is largely due to the fact that the dataset contains only 811 unique codes, which is even fewer than the dimensionality of the ICD2Vec embeddings\. As a result, dimensionality reduction provides limited benefit in this setting\. In contrast, in the MIMIC\-IV\-ED dataset the number of distinct codes reaches the order of tens of thousands, making dimensionality reduction substantially more important\. This contrast suggests that xMICD is particularly useful in settings with a large number of unique ICD codes, such as MIMIC\-IV\-ED, where dimensionality reduction becomes important for improving model performance\. At the same time, the results show that xMICD can preserve predictive performance at a level close to ICD2Vec while providing a more structured and interpretable representation\. ### 6\.2Similarity preservation To understand why xMICD based on ICD2Vec retains strong predictive performance, we analyze how well different representations preserve the similarity structure between patients\. Figure[7](https://arxiv.org/html/2608.00935#S6.F7)shows the pairwise Spearman correlation between patient–patient similarity matrices derived from each representation\. The results indicate that xMICD variants remain substantially closer to ICD2Vec than binary grouping\-based representations\. In particular, xMICD\-FPS shows the highest agreement with ICD2Vec \(0\.7961\), followed by xMICD\-CCSR \(0\.7446\), xMICD\-Block \(0\.6546\), and xMICD\-ECI \(0\.6464\)\. By contrast, the correlations between ICD2Vec and the binary grouping features are considerably lower: 0\.2123 for ECI, 0\.3300 for Block, and 0\.2656 for CCSR\. These findings suggest that xMICD preserves much of the relational structure captured by ICD2Vec\. Although xMICD replaces the dense latent dimensions of ICD2Vec with clinically interpretable anchor\-based features, the resulting patient similarity relationships remain strongly aligned with those induced by ICD2Vec\. This helps explain why xMICD can maintain predictive performance close to ICD2Vec while providing a more structured and interpretable representation\. Figure 7:Pairwise Spearman correlation between patient–patient similarity matrices induced by different ICD representations\. Higher values indicate that two representations preserve more similar patient similarity structures\. ### 6\.3Interpretability We evaluate the interpretability of different ICD code representations according to the criteria introduced in Section[5\.3](https://arxiv.org/html/2608.00935#S5.SS3): readability, understandability, meaningfulness, trackability, and simulatability\. #### 6\.3\.1Readability, Understandability, and Meaningfulness Binary grouping representations are generally readable because their features correspond to clinically familiar concepts such as diagnoses, comorbidities, or disease categories\. In contrast, embedding\-based representations such as ICD2Vec are not directly readable because their dimensions correspond to latent numerical components without interpretable labels\. The xMICD representation largely preserves readability because each dimension is anchored to a clinically meaningful diagnostic group\. As a result, clinicians can associate each feature with recognizable disease categories even though the values themselves are derived from similarity calculations\. A similar contrast appears in terms of understandability\. Binary grouping representations are directly understandable because their features correspond to concepts clinicians routinely use in reasoning\. ICD2Vec lacks this property since its latent dimensions capture statistical relationships rather than explicit medical concepts\. In xMICD, each feature represents the similarity between a patient’s diagnoses and a clinically defined group\. Although these values do not correspond to a direct clinical quantity, they can be interpreted as indicators of diagnostic relatedness, allowing clinicians to reason about the representation in practice\. Meaningfulness is more nuanced\. Binary grouping representations are meaningful because each feature corresponds to a specific clinical entity\. ICD2Vec lacks this property since embedding dimensions do not have inherent clinical interpretation\. In xMICD, the dimensions correspond to recognizable disease groups, but feature values reflect ‘diagnostic proximity’ or ‘phenotypic similarity’ rather than explicit membership\. Unlike traditional binary encoding, xMICD captures the clinical neighborhood of a patient\. Consequently, a patient may obtain a non\-zero value for a group even if no diagnosis belongs to that group directly\. This allows clinicians to identify patients who are leaning toward specific critical states\. While this requires careful interpretation, the representation still preserves clinically meaningful reference concepts and provides more interpretable signals than pure embeddings\. The choice of anchors also affects interpretability\. When anchors correspond to clinically defined groupings such as ICD blocks or curated disease categories, each dimension maps to a recognizable clinical concept\. In contrast, anchors selected using data\-driven procedures such as farthest point sampling may correspond to individual ICD codes that are less clinically intuitive\. In this case the features remain interpretable as similarity to reference diagnoses, but their clinical meaning may be less immediately apparent\. #### 6\.3\.2Trackability and Simulatability Regarding trackability, binary grouping representations can be traced directly to the original ICD codes through explicit mappings\. ICD2Vec and xMICD are only partially trackable because they depend on embeddings derived from the code corpus\. In terms of simulatability, binary grouping representations are fully simulatable because they follow deterministic rules\. ICD2Vec is not simulatable without training an embedding model, whereas xMICD lies between these extremes: it depends on embeddings but uses explicitly defined similarity and aggregation rules\. Overall, the comparison reveals a clear trade\-off\. Binary grouping representations offer strong readability and traceability but may lose information\. ICD2Vec captures rich semantic relationships but provides little interpretability\. xMICD occupies an intermediate position, preserving much of the predictive signal of embedding\-based representations while mapping explanations back to clinically meaningful diagnostic groups\. #### 6\.3\.3Example of Model Explanations To examine interpretability empirically, we analyze global SHAP \(Shapley Additive exPlanations\) values aggregated across the dataset\. Figure[8](https://arxiv.org/html/2608.00935#S6.F8)shows SHAP summary plots for predicting in\-ICU mortality on the eICU\-CRD dataset using an XGBoost model\. Each plot displays the most influential features across the dataset, where the horizontal axis represents the SHAP value and color indicates the feature value\. Using the Raw ICD representation, the model highlights individual diagnosis codes as the most influential predictors\. Severe conditions such as respiratory failure \(J96\.00\), cardiac arrest \(I46\.9\), and acute kidney failure \(N17\.9\) show strong positive contributions, reflecting clinically intuitive drivers of mortality risk in the ICU\. However, explanations based on raw codes are highly fragmented because each diagnosis appears as an independent sparse feature\. When ICD codes are aggregated into clinically defined groups, as in the CCSR representation, explanations become more structured\. Influential predictors correspond to broader disease categories such as respiratory disorders, infections, and circulatory conditions, providing a clearer clinical overview\. By contrast, ICD2Vec produces explanations based on embedding dimensions rather than medical concepts\. Although these dimensions capture meaningful statistical relationships, they lack direct clinical interpretation\. The xMICD representations provide an intermediate form of explanation by combining embedding\-based similarity with clinically meaningful anchors\. In the xMICD\-CCSR representation, each feature corresponds to the similarity between a patient’s diagnoses and a specific disease group, allowing explanations to remain clinically interpretable while still reflecting relationships learned in the embedding space\. Two observations further illustrate this behavior\. First, the ranking of important disease groups remains broadly consistent between CCSR and xMICD\-CCSR\. Groups such as respiratory failure \(RSP012\), infections and sepsis \(INF002\), and renal failure \(GEN002\) appear among the most influential predictors in both representations, indicating that xMICD preserves the core clinical signals present in the data\. At the same time, some groups change their relative importance because xMICD distributes similarity across related disease groups rather than using binary membership\. This suggests that xMICD captures broader physiological states rather than relying solely on discrete diagnosis labels\. Second, the comparison between Raw ICD and xMICD\-FPS reveals how embedding\-based similarity can expose latent clinical relationships\. In the Raw ICD representation, the code Z66 \(Do Not Resuscitate\) does not appear among the most influential predictors, likely because it is rare or inconsistently recorded\. Instead, the model relies on diagnoses such as cardiac arrest, respiratory failure, or severe infection to infer critical patient status\. In contrast, the ability of xMICD to link Z66 with critical anchors demonstrates its capacity for phenotype discovery\. In clinical practice, a Do Not Resuscitate order is rarely an isolated event but rather a proxy for multi\-organ failure or terminal illness\. xMICD’s interpretability allows the model to surface these latent clinical contexts which are often lost in traditional sparse representations\. This does not imply that the patient explicitly has a Z66 diagnosis, but rather that the patient’s diagnoses occupy a similar region of the embedding space associated with terminal or critical conditions\. \(a\)Raw ICD \(b\)CCSR \(c\)ICD2Vec \(d\)xMICD\-CCSR \(e\)xMICD\-FPS Figure 8:Global SHAP summary plots showing the most influential features for predicting in\-ICU mortality using different ICD representations\. Each point represents a patient observation\. The horizontal axis shows the SHAP value indicating the impact of a feature on the prediction, while color represents the feature value\. ## 7Discussion The results from experiments on predictive performance and interpretability analyses of different ICD code representations are summarized in Table[1](https://arxiv.org/html/2608.00935#S7.T1)\. In addition to predictive performance, the table compares dimensionality and several interpretability\-related criteria\. Raw ICD codes and grouping\-based vectorization methods exhibit high interpretability but relatively limited predictive power\. In contrast, deep learning–based embedding methods such as ICD2Vec achieve strong predictive performance but are difficult to interpret, suggesting that high interpretability often comes at the cost of predictive performance\. This observation aligns closely with findings reported in prior literature discussed in Section[3](https://arxiv.org/html/2608.00935#S3)\. Table 1:Comparison of ICD code representations in terms of dimensionality, predictive power, and five interpretability\-related properties: readability, understandability, meaningfulness, trackability, and simulatability\. Symbols indicate the extent to which each property is present: ⚫ means present, ◗ means partially present, and – means absent or not present\. Symbols provide a qualitative high\-level summary based on the findings of this study\.RawECIBlock/CCSRICD2VecxMICDLow\-Dimension–⚫⚫◗⚫Predictive◗–◗⚫⚫Readable⚫⚫⚫–⚫Understandable⚫⚫⚫–⚫Meaningful⚫⚫⚫–◗Trackable⚫⚫⚫◗◗Simulatable⚫⚫⚫–◗However, we demonstrate that xMICD, except for the ECI\-based variant, achieves predictive performance comparable to ICD2Vec across most prediction tasks\. This relatively small performance gap supports the central hypothesis of this work: high interpretability does not necessarily require sacrificing predictive power\. One reason for this comparable performance lies in semantic information preservation\. xMICD is built upon the semantic structure captured by ICD2Vec embeddings\. By using these embeddings to compute similarity between ICD codes and clinically meaningful anchors, xMICD incorporates latent relationships learned by the embedding model while organizing them into an interpretable feature space\. In this sense, xMICD can be viewed as a structured projection of ICD2Vec representations onto clinically interpretable disease groups\. Furthermore, the strong performance of xMICD when used with XGBoost highlights a practical advantage\. Tree\-based models are well suited to capturing nonlinear interactions and handling sparse or heterogeneous clinical features\. The xMICD representation provides structured similarity signals across disease groups, allowing these models to leverage both clinical grouping information and embedding\-based relationships\. As observed in several prediction tasks, including Hospitalization and Revisit within 72 hours, XGBoost models using xMICD features often achieve the best or near\-best predictive performance\. xMICD also has limitations that should be acknowledged\. Because the representation depends on pre\-trained embeddings such as ICD2Vec, it cannot be fully simulatable from the raw ICD codes alone\. This reflects a trade\-off between interpretability and representational richness\. In addition, although xMICD anchors its features to clinically meaningful constructs such as ICD blocks or CCSR groups, the similarity\-based representation may introduce ambiguity in terms of meaningfulness\. A high value in a particular dimension does not necessarily indicate the direct presence of diseases within that group, but rather reflects semantic similarity between the patient’s ICD codes and the anchor diseases\. Without careful interpretation, this may lead to overly literal or incorrect clinical conclusions\. Therefore, when applying xMICD in practice, the resulting features and explanations should be interpreted with caution and with awareness of the underlying similarity mechanism\. This is crucial for building trust in AI\-assisted systems, as it allows practitioners to verify the model’s reasoning against their own clinical intuition\. Nevertheless, because the anchors correspond to medically meaningful disease groupings, the resulting representation remains substantially more interpretable than purely embedding\-based approaches\. ## 8Conclusion In this work, we proposed xMICD, an explainable representation of multiple ICD codes designed to balance predictive performance with clinical interpretability\. xMICD is a flexible framework built upon two core components: a pre\-trained ICD embedding model \(e\.g\., ICD2Vec\) and a set of clinically defined groupings \(e\.g\., Blocks, CCSR\)\. By combining these elements through a relative assignment mechanism, xMICD represents a patient’s diagnoses as a low\-dimensional vector that captures semantic relationships among co\-occurring ICD codes while remaining interpretable to clinicians\. Experiments on large\-scale EHR datasets demonstrate that xMICD achieves predictive performance comparable to embedding\-based representations and other state\-of\-the\-art approaches\. At the same time, the representation maintains a clear connection to clinically meaningful diagnostic groups, enabling more interpretable explanations than purely embedding\-based features\. Overall, xMICD provides a practical way to integrate the semantic power of ICD embeddings into clinically interpretable feature spaces\. This approach contributes toward the development of more transparent and trustworthy machine learning models for AI\-assisted clinical decision support\. ## Acknowledgment This research project has been supported by Mahidol University \(Fundamental Fund: fiscal year 2026 by National Science Research and Innovation Fund \(NSRF\), grant number FF\-027/2569\)\. ## References - \[1\]Agency for Healthcare Research and Quality\(2017\)Clinical classifications software \(ccs\) for icd\-9\-cm\.Healthcare Cost and Utilization Project \(HCUP\)\.Note:Available at: https://www\.hcup\-us\.ahrq\.gov/toolssoftware/ccs/ccs\.jspCited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p3.1)\. - \[2\]Agency for Healthcare Research and Quality\(2020\)Clinical classifications software refined \(ccsr\) for icd\-10\-cm diagnoses\.Healthcare Cost and Utilization Project \(HCUP\)\.Note:Available at: https://www\.hcup\-us\.ahrq\.gov/toolssoftware/ccsr/ccs\_refined\.jspCited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p3.1)\. - \[3\]M\. Askar, L\. Småbrekke, E\. Holsbø, L\. A\. Bongo, and K\. Svendsen\(2024\)Using network analysis modularity to group health code systems and decrease dimensionality in machine learning models\.Exploratory Research in Clinical and Social Pharmacy14,pp\. 100463\.Cited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p5.1)\. - \[4\]A\. Atutxa, A\. Pérez, and A\. Casillas\(2017\)Machine learning approaches on diagnostic term encoding with the ICD for clinical documentation\.IEEE Journal of Biomedical and Health Informatics22\(4\),pp\. 1323–1329\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p2.1)\. - \[5\]A\. Bannay, C\. Chaignot, P\.\-O\. Blotière, M\. Basson, A\. Weill, P\. Ricordeau, and F\. Alla\(2016\)The best use of the charlson comorbidity index with electronic health care database to predict mortality\.Medical Care54\(2\),pp\. 188–194\.Cited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p4.1)\. - \[6\]C\. M\. Bishop\(2006\)Pattern recognition and machine learning\.Springer,New York\.Cited by:[§2\.1](https://arxiv.org/html/2608.00935#S2.SS1.p3.1)\. - \[7\]D\. J\. Cartwright\(2013\)ICD\-9\-CM to ICD\-10\-CM codes: what? why? how?\.Cited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p2.1)\. - \[8\]M\. E\. Charlson, P\. Pompei, K\. L\. Ales, and C\. R\. MacKenzie\(1987\)A new method of classifying prognostic comorbidity in longitudinal studies: development and validation\.Journal of Chronic Diseases40\(5\),pp\. 373–383\.Cited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p4.1)\. - \[9\]N\. L\. Chervu, J\. Balian, A\. Verma, S\. Sakowitz, N\. Y\. Cho, S\. Mallick, T\. A\. Russell, and P\. Benharash\(2024\)Development of a surgery\-specific comorbidity score for use in administrative data\.Annals of Surgery,pp\. 10–1097\.Cited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p5.1)\. - \[10\]E\. Choi, M\. T\. Bahadori, E\. Searles, C\. Coffey, M\. Thompson, J\. Bost, J\. Tejedor\-Sojo, and J\. Sun\(2016\)Multi\-layer representation learning for medical concepts\.InProceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining,pp\. 1495–1504\.Cited by:[§3\.2](https://arxiv.org/html/2608.00935#S3.SS2.p1.1)\. - \[11\]G\. Deimazar and A\. Sheikhtaheri\(2023\)Machine learning models to detect and predict patient safety events using electronic health records: a systematic review\.International Journal of Medical Informatics,pp\. 105246\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p2.1)\. - \[12\]J\. Dugan and J\. Shubrook\(2017\)International classification of diseases, 10th revision, coding for diabetes\.Clinical Diabetes35\(4\),pp\. 232–238\.Cited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p2.1)\. - \[13\]A\. Elixhauser, C\. Steiner, D\. R\. Harris, and R\. M\. Coffey\(1998\)Comorbidity measures for use with administrative data\.Medical Care36\(1\),pp\. 8–27\.Cited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p4.1)\. - \[14\]H\. Hakkoum, I\. Abnane, and A\. Idri\(2022\)Interpretability in the medical field: a systematic mapping and review study\.Applied Soft Computing117,pp\. 108391\.Cited by:[§2\.2](https://arxiv.org/html/2608.00935#S2.SS2.p1.1)\. - \[15\]A\. Johnson, L\. Bulgarelli, T\. Pollard, S\. Horng, L\. A\. Celi, and R\. Mark\(2023\)MIMIC\-IV\-ED \(version 2\.2\)\.Cited by:[§5\.1](https://arxiv.org/html/2608.00935#S5.SS1.SSS0.Px1.p1.1)\. - \[16\]R\. Johnson, U\. Gottlieb, G\. Shaham, L\. Eisen, J\. Waxman, S\. Devons\-Sberro, C\. R\. Ginder, P\. Hong, R\. Sayeed, X\. Su,et al\.\(2025\)ClinVec: unified embeddings of clinical codes enable knowledge\-grounded ai in medicine\.medRxiv,pp\. 2024–12\.Cited by:[§4\.2](https://arxiv.org/html/2608.00935#S4.SS2.SSS0.Px2.p3.1)\. - \[17\]A\. Kansal, M\. Gao, S\. Balu, M\. Nichols, K\. Corey, S\. Kashyap, and M\. Sendak\(2021\)Impact of diagnosis code grouping method on clinical prediction model performance: a multi\-site retrospective observational study\.International Journal of Medical Informatics151,pp\. 104466\.Cited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p5.1)\. - \[18\]C\. Leacock and M\. Chodorow\(1998\)Combining local context and WordNet similarity for word sense identification\.WordNet: An Electronic Lexical Database,pp\. 265\.Cited by:[§4\.2](https://arxiv.org/html/2608.00935#S4.SS2.SSS0.Px1.p1.1)\. - \[19\]Y\. C\. Lee, S\. H\. Jung, A\. Kumar, I\. Shim, M\. Song, M\.\-S\. Kim, K\. Kim, W\. Myung, W\.\-Y\. Park, and H\.\-H\. Won\(2023\)ICD2Vec: mathematical representation of diseases\.Journal of Biomedical Informatics140,pp\. 104361\.Cited by:[§3\.2](https://arxiv.org/html/2608.00935#S3.SS2.p1.1)\. - \[20\]Y\. Li, S\. Rao, J\. R\. A\. Solares, A\. Hassaine, R\. Ramakrishnan, D\. Canoy, Y\. Zhu, K\. Rahimi, and G\. Salimi\-Khorshidi\(2020\)BEHRT: transformer for electronic health records\.Scientific Reports\.Cited by:[§3\.2](https://arxiv.org/html/2608.00935#S3.SS2.p2.1)\. - \[21\]L\. Longo, M\. Brcic, F\. Cabitza, J\. Choi, R\. Confalonieri, J\. D\. Ser, R\. Guidotti, Y\. Hayashi, F\. Herrera, A\. Holzinger, R\. Jiang, H\. Khosravi, F\. Lecue, G\. Malgieri, A\. Páez, W\. Samek, J\. Schneider, T\. Speith, and S\. Stumpf\(2024\)Explainable artificial intelligence \(XAI\) 2\.0: a manifesto of open challenges and interdisciplinary research directions\.Information Fusion106,pp\. 102301\.Cited by:[§2\.2](https://arxiv.org/html/2608.00935#S2.SS2.p1.1),[§2\.2](https://arxiv.org/html/2608.00935#S2.SS2.p2.1)\. - \[22\]J\. F\. Ludvigsson, P\. Appelros, J\. Askling, L\. Byberg, J\.\-J\. Carrero, A\. M\. Ekström, M\. Ekström, K\. Smedby, H\. Hagström, S\. James,et al\.\(2021\)Adaptation of the charlson comorbidity index for register\-based research in sweden\.Clinical Epidemiology,pp\. 21–41\.Cited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p4.1)\. - \[23\]S\. J\. Lui, X\. Cheng, and S\. Krishnaswamy\(2022\)Inductive representation learning of multiple ICD codes for healthcare\.In2022 IEEE 17th International Conference on Control & Automation \(ICCA\),pp\. 498–503\.Cited by:[§3\.2](https://arxiv.org/html/2608.00935#S3.SS2.p3.1)\. - \[24\]J\. Luo, X\. Wang, J\. Wang, A\. Chang, Y\. Wang, and F\. Ma\(2024\)CoRelation: boosting automatic icd coding through contextualized code relation learning\.InProceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation \(LREC\-COLING 2024\),pp\. 3997–4007\.Cited by:[§4\.2](https://arxiv.org/html/2608.00935#S4.SS2.SSS0.Px2.p3.1)\. - \[25\]N\. Menachemi and T\. H\. Collum\(2011\)Benefits and drawbacks of electronic health record systems\.Risk Management and Healthcare Policy4,pp\. 47–55\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p1.1)\. - \[26\]National Center for Health Statistics \(U\.S\.\)\(2022\)ICD\-10\-CM tabular list of diseases and injuries\.Centers for Disease Control and Prevention\.Cited by:[§2\.1](https://arxiv.org/html/2608.00935#S2.SS1.p1.1),[§2\.1](https://arxiv.org/html/2608.00935#S2.SS1.p2.1)\. - \[27\]J\. Opitz, L\. Moeller, A\. Michail, S\. Padó, and S\. Clematide\(2025\)Interpretable text embeddings and text similarity explanation: a survey\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing,pp\. 22314–22330\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p6.1)\. - \[28\]T\. J\. Pollard, A\. E\. W\. Johnson, J\. D\. Raffa, L\. A\. Celi, R\. G\. Mark, and O\. Badawi\(2018\)The eicu collaborative research database, a freely available multi\-center database for critical care research\.Scientific Data5\(1\),pp\. 180178\.Cited by:[§5\.1](https://arxiv.org/html/2608.00935#S5.SS1.SSS0.Px1.p1.1)\. - \[29\]A\. Preece, D\. Harborne, D\. Braines, R\. Tomsett, and S\. Chakraborty\(2018\)Stakeholders in explainable AI\.CoRRabs/1810\.00184\.Cited by:[§2\.2](https://arxiv.org/html/2608.00935#S2.SS2.p3.1)\. - \[30\]H\. Quan, B\. Li, L\. D\. Saunders, G\. A\. Parsons, C\. I\. Nilsson, A\. Alibhai, and IMECCHI investigators\(2008\)Assessing validity of ICD\-9\-CM and ICD\-10 administrative data in recording clinical conditions in a unique dually coded database\.Health Services Research43\(4\),pp\. 1424–1441\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p1.1),[§2\.1](https://arxiv.org/html/2608.00935#S2.SS1.p1.1)\. - \[31\]L\. Rasmy, Y\. Wu, N\. Wang, X\. Geng, H\. Xu, and D\. Zhi\(2021\)Med\-bert: pretrained contextualized embeddings on large\-scale structured electronic health records for disease prediction\.NPJ Digital Medicine\.Cited by:[§3\.2](https://arxiv.org/html/2608.00935#S3.SS2.p2.1)\. - \[32\]C\. Rudin\(2019\)Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead\.Nature Machine Intelligence1\(5\),pp\. 206–215\.Cited by:[§2\.2](https://arxiv.org/html/2608.00935#S2.SS2.p1.1)\. - \[33\]J\. J\. Schneider, M\. Adler, C\. Ammer\-Herrmenau, A\. O\. König, U\. Sax, and J\. Hügel\(2023\)Improving icd\-based semantic similarity by accounting for varying degrees of comorbidity\.arXiv preprint arXiv:2308\.07359\.Cited by:[§4\.2](https://arxiv.org/html/2608.00935#S4.SS2.SSS0.Px1.p2.1)\. - \[34\]L\. K\. Şenel, İ\. Utlu, F\. Şahinuç, H\. M\. Ozaktas, and A\. Koç\(2020\)Imparting interpretability to word embeddings while preserving semantic structure\.Natural Language Engineering27\(6\),pp\. 721–746\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p3.1)\. - \[35\]N\. Sharma, R\. Schwendimann, O\. Endrich, D\. Ausserhofer, and M\. Simon\(2021\)Comparing Charlson and Elixhauser comorbidity indices with different weightings to predict in\-hospital mortality: an analysis of national inpatient data\.BMC Health Services Research21\(1\),pp\. 13\.Cited by:[§3\.1](https://arxiv.org/html/2608.00935#S3.SS1.p4.1)\. - \[36\]A\. Vellido\(2019\)The importance of interpretability and visualization in machine learning for applications in medicine and health care\.Neural Computing and Applications32\(24\),pp\. 18069–18083\.Cited by:[§2\.2](https://arxiv.org/html/2608.00935#S2.SS2.p1.1)\. - \[37\]Y\. Wang, Z\. Shen, and H\. Huang\(2025\)LDIR: low\-dimensional dense and interpretable text embeddings with relative representations\.InFindings of the Association for Computational Linguistics: ACL 2025,pp\. 14397–14409\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p6.1),[§4\.3](https://arxiv.org/html/2608.00935#S4.SS3.SSS0.Px2.p1.1)\. - \[38\]World Health Organization\(1978\)International classification of diseases: ninth revision, basic tabulation list with alphabetic index\.World Health Organization\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p1.1),[§2\.1](https://arxiv.org/html/2608.00935#S2.SS1.p1.1)\. - \[39\]World Health Organization\(2016\)International statistical classification of diseases and related health problems, 10th revision, fifth edition\.World Health Organization\.Cited by:[§2\.1](https://arxiv.org/html/2608.00935#S2.SS1.p1.1),[§2\.1](https://arxiv.org/html/2608.00935#S2.SS1.p2.1)\. - \[40\]Z\. Wu and M\. Palmer\(1994\)Verb semantics and lexical selection\.In32nd Annual Meeting of the Association for Computational Linguistics,pp\. 133–138\.Cited by:[§4\.2](https://arxiv.org/html/2608.00935#S4.SS2.SSS0.Px1.p1.1)\. - \[41\]F\. Xie, J\. Zhou, J\. W\. Lee, M\. Tan, S\. Li, L\. S\. O\. Rajnthern, M\. L\. Chee, B\. Chakraborty, A\.\-K\. I\. Wong, A\. Dagan, M\. E\. H\. Ong, F\. Gao, and N\. Liu\(2022\)Benchmarking emergency department prediction models with machine learning and public electronic health records\.Scientific Data9\(1\),pp\. 658\.Cited by:[§5\.2](https://arxiv.org/html/2608.00935#S5.SS2.SSS0.Px1.p2.1),[§5\.2](https://arxiv.org/html/2608.00935#S5.SS2.SSS0.Px1.p4.1)\. - \[42\]K\. Xu, M\. Lam, J\. Pang, X\. Gao, C\. Band, P\. Mathur, F\. Papay, A\. K\. Khanna, J\. B\. Cywinski, K\. Maheshwari, P\. Xie, and E\. P\. Xing\(2019\)Multimodal machine learning for automated ICD coding\.InProceedings of the 4th Machine Learning for Healthcare Conference,Proceedings of Machine Learning Research, Vol\.106,pp\. 197–215\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p2.1),[§2\.1](https://arxiv.org/html/2608.00935#S2.SS1.p3.1)\. - \[43\]I\. Z\. Zárdai\(2023\)Why autonomous agents should not be built for war\.Journal of Philosophy of Life13\(1\),pp\. 64–96\.Cited by:[§2\.2](https://arxiv.org/html/2608.00935#S2.SS2.p1.1)\. - \[44\]D\. Zikos, A\. Shrestha, and L\. Fegaras\(2021\)A cross\-sectional study to predict mortality for Medicare patients based on the combined use of HCUP tools\.Journal of Healthcare Informatics Research5\(3\),pp\. 300–318\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p2.1)\. - \[45\]A\. Zytek, I\. Arnaldo, D\. Liu, L\. Berti\-Équille, and K\. Veeramachaneni\(2022\)The need for interpretable features: motivation and taxonomy\.SIGKDD Explorations24\(1\),pp\. 1–12\.Cited by:[§1](https://arxiv.org/html/2608.00935#S1.p3.1),[§2\.2](https://arxiv.org/html/2608.00935#S2.SS2.p2.1),[§2\.2](https://arxiv.org/html/2608.00935#S2.SS2.p3.1),[§5\.3](https://arxiv.org/html/2608.00935#S5.SS3.p3.1)\. ## Appendix Tables[2](https://arxiv.org/html/2608.00935#Sx2.T2)and[3](https://arxiv.org/html/2608.00935#Sx2.T3)summarize the predictive performance of different ICD representations\. Table[2](https://arxiv.org/html/2608.00935#Sx2.T2)reports the main results on the MIMIC\-IV\-ED dataset, including Raw ICD, binary grouping features, ICD2Vec, and xMICD variants\. Table[3](https://arxiv.org/html/2608.00935#Sx2.T3)presents the corresponding evaluation on the eICU\-CRD dataset\. All results are reported as mean AUC with the half\-width of the 95% bootstrap confidence interval based on 200 resamples of the test set\. Table 2:Predictive performance \(AUC\) of different ICD representations on the MIMIC\-IV\-ED dataset using XGBoost and multilayer perceptron \(MLP\) models\. Features are constructed from diagnoses in the current emergency department visit and inpatient diagnoses from the preceding five years\.Critical OutcomeHospitalizationRevisit in 72hDim\.XGBoostMLPXGBoostMLPXGBoostMLPRaw ICD253830\.861±0\.0050\.774±0\.0060\.806±0\.0040\.784±0\.0030\.692±0\.0090\.568±0\.013ECI620\.595±0\.0060\.598±0\.0070\.599±0\.0030\.597±0\.0030\.554±0\.0100\.552±0\.010Block4180\.839±0\.0050\.812±0\.0060\.804±0\.0030\.823±0\.0030\.687±0\.0100\.620±0\.015CCSR11060\.855±0\.0040\.857±0\.0050\.809±0\.0020\.836±0\.0020\.639±0\.0110\.602±0\.011ICD2Vec Avg\.20480\.893±0\.0050\.901±0\.0040\.864±0\.0030\.883±0\.0030\.697±0\.0100\.685±0\.011xMICD\-ECI620\.868±0\.0060\.818±0\.0050\.838±0\.0030\.806±0\.0030\.690±0\.0080\.664±0\.011xMICD\-Block4180\.893±0\.0030\.864±0\.0050\.861±0\.0030\.848±0\.0030\.702±0\.0100\.684±0\.009xMICD\-CCSR11060\.893±0\.0040\.871±0\.0040\.860±0\.0030\.843±0\.0030\.701±0\.0090\.681±0\.009xMICD\-FPS4180\.891±0\.0040\.868±0\.0050\.860±0\.0030\.844±0\.0030\.706±0\.0080\.686±0\.009xMICD\-FPS11060\.892±0\.0040\.872±0\.0050\.861±0\.0030\.848±0\.0030\.699±0\.0090\.680±0\.010Table 3:Predictive performance \(AUC\) of different ICD representations on the eICU\-CRD dataset using XGBoost and multilayer perceptron \(MLP\) models\.MortalityProlonged StayDim\.XGBoostMLPXGBoostMLPRaw ICD8110\.841±0\.0100\.793±0\.0120\.742±0\.0070\.719±0\.007ECI310\.653±0\.0140\.647±0\.0120\.643±0\.0080\.640±0\.007Block2090\.801±0\.0100\.780±0\.0110\.727±0\.0070\.722±0\.006CCSR5530\.830±0\.0110\.799±0\.0110\.732±0\.0070\.717±0\.006ICD2Vec Avg\.10240\.833±0\.0100\.835±0\.0100\.735±0\.0070\.733±0\.007xMICD\-ECI310\.829±0\.0100\.798±0\.0100\.735±0\.0070\.725±0\.007xMICD\-Block2090\.841±0\.0100\.824±0\.0100\.742±0\.0070\.733±0\.007xMICD\-CCSR5530\.840±0\.0100\.824±0\.0090\.738±0\.0060\.726±0\.007xMICD\-FPS2090\.837±0\.0100\.807±0\.0110\.739±0\.0070\.728±0\.007xMICD\-FPS5530\.840±0\.0100\.828±0\.0100\.743±0\.0070\.732±0\.007
Similar Articles
Hierarchical Modeling of ICD Codes in EHR Foundation Models
This paper investigates explicit encoding of ICD-10-CM hierarchy in EHR foundation models, using hierarchical token augmentation and graph-based code representations. Experiments on MIMIC-IV and eICU show improvements over flat code representations for in-domain and cross-dataset prediction tasks.
Primary ICD Category Prediction using LLM-based Probing
This paper presents a method that uses frozen medical large language model (LLM) representations as a shared embedding space to predict primary ICD diagnosis categories from both structured and unstructured electronic health record data, achieving improved accuracy over baseline methods on MIMIC-IV and showing transferability to MIMIC-III.
A Machine-Learned Comorbidity Index
This paper proposes a Machine-Learned Comorbidity Index (MLCI) that uses diagnosis codes and nonlinear learning to improve risk adjustment across multiple clinical outcomes, outperforming traditional mortality-centric indices.
Multimodal Routing for Interpretable, Robust, and Auditable Clinical Prediction
This paper proposes an explicit multimodal routing framework for clinical prediction using EHR data, enabling interpretable, robust, and auditable reasoning across structured variables, clinical notes, and chest X-rays via discrete unimodal, bimodal, and trimodal routes with inference-time route masking for missing modality simulation.
Graph-Constrained Policy Learning for Extreme Clinical Code Prediction
Proposes a graph-constrained traversal policy that reformulates ICD-10-CM code prediction as a finite-horizon decision process over a pruned code hierarchy, outperforming flat baselines on MIMIC-IV discharge summaries.