LusoClin:用于欧洲葡萄牙语医学信息检索的合成临床笔记数据集

arXiv cs.AI 论文

摘要

LusoClin 是一个公开发布的欧洲葡萄牙语合成临床记录数据集,用于保护隐私的医疗信息检索研究。该数据集通过使用 QLoRA 微调 Llama 3.2(3B)生成,并使用基于 BERT 的临床实体模型进行标注。评估表明,该数据集可支持下游信息检索任务,但标注人员通常能够区分合成记录与真实记录。

arXiv:2611.23454v1 Announce Type: new Abstract: Access to large-scale clinical text collections is crucial for advancing medical information retrieval research, including clinical note search, patient cohort identification, and domain-adapted retrieval models. However, real clinical notes are rarely available due to privacy regulations, which particularly limits progress for low-resource languages such as European Portuguese. We present LusoClin, a publicly released dataset of synthetic clinical notes in European Portuguese, created to support privacy-preserving research on clinical text retrieval. LusoClin was generated by pre-processing real clinical data, fine-tuning the open-source Llama 3.2 (3B) instruction-tuned model using Quantized Low-Rank Adaptation, and applying prompt-based clinical note generation. To facilitate semantic indexing and clinical search, the notes are automatically annotated with clinical entities using a BERT-based model. We evaluate LusoClin in terms of utility, fidelity, diversity, and privacy using automatic metrics and human evaluation. Results indicate that the dataset captures clinically relevant language patterns and can support downstream IR applications such as clinical document retrieval and domain-specific model adaptation, although annotators can often distinguish synthetic from real notes and some medical inconsistencies persist.
查看原文
查看缓存全文

缓存时间: 2026/11/20 09:03

# LusoClin: A Synthetic Clinical Note Dataset for Medical Information Retrieval in European Portuguese
Source: [https://arxiv.org/html/2611.23454](https://arxiv.org/html/2611.23454)
Carla Teixeira Lopes[https://orcid.org/0000-0002-4202-791X](https://orcid.org/0000-0002-4202-791X)Affiliation:Faculty of Engineering of the University of Porto, Porto, PortugalAffiliation:INESC TEC, Porto, PortugalE\-mail[ctl@fe\.up\.pt,up201905189@up\.pt](mailto:[email protected],[email protected])Daniel Félix[https://orcid.org/0009-0007-1835-2513](https://orcid.org/0009-0007-1835-2513)Affiliation:Faculty of Engineering of the University of Porto, Porto, PortugalAffiliation:INESC TEC, Porto, PortugalE\-mail[ctl@fe\.up\.pt,up201905189@up\.pt](mailto:[email protected],[email protected])

###### Abstract

Access to large\-scale clinical text collections is crucial for advancing medical information retrieval research, including clinical note search, patient cohort identification, and domain\-adapted retrieval models\. However, real clinical notes are rarely available due to privacy regulations, which particularly limits progress for low\-resource languages such as European Portuguese\. We present LusoClin, a publicly released dataset of synthetic clinical notes in European Portuguese, created to support privacy\-preserving research on clinical text retrieval\. LusoClin was generated by pre\-processing real clinical data, fine\-tuning the open\-source Llama 3\.2 \(3B\) instruction\-tuned model using Quantized Low\-Rank Adaptation, and applying prompt\-based clinical note generation\. To facilitate semantic indexing and clinical search, the notes are automatically annotated with clinical entities using a BERT\-based model\. We evaluate LusoClin in terms of utility, fidelity, diversity, and privacy using automatic metrics and human evaluation\. Results indicate that the dataset captures clinically relevant language patterns and can support downstream IR applications such as clinical document retrieval and domain\-specific model adaptation, although annotators can often distinguish synthetic from real notes and some medical inconsistencies persist\.

###### Keywords:

Clinical Notes Synthetic Data Generation Large Language Model

## 1Introduction

Electronic health records \(EHRs\) contain longitudinal patient information collected during healthcare delivery\[[5](https://arxiv.org/html/2611.23454#bib.bib29),[14](https://arxiv.org/html/2611.23454#bib.bib30)\]\. Much of this information is stored in clinical notes, unstructured records describing clinical encounters\[[32](https://arxiv.org/html/2611.23454#bib.bib7)\]\. These notes capture contextual information often absent from structured EHR fields\.

Clinical information retrieval plays a central role in enabling access to this unstructured information, useful for decision\-making and clinical research\[[41](https://arxiv.org/html/2611.23454#bib.bib1)\]\. Retrieval techniques, including recent dense retrieval methods, have also been applied to patient cohort identification by querying electronic health records to identify patient groups with shared criteria\[[17](https://arxiv.org/html/2611.23454#bib.bib3),[23](https://arxiv.org/html/2611.23454#bib.bib4),[3](https://arxiv.org/html/2611.23454#bib.bib2)\]\. Because clinical information is often recorded as unstructured text\[[22](https://arxiv.org/html/2611.23454#bib.bib42)\], retrieval systems rely on robust text representations, often supported by information extraction and natural language processing techniques\[[39](https://arxiv.org/html/2611.23454#bib.bib5)\]\. In this context, the development and evaluation of clinical IR systems increasingly depend on large\-scale, high\-quality textual collections, which are difficult to obtain due to privacy regulations\[[24](https://arxiv.org/html/2611.23454#bib.bib14)\]\.

This challenge is especially pronounced for languages other than English\. While English medical corpora are increasingly available\[[39](https://arxiv.org/html/2611.23454#bib.bib5)\], many languages remain severely under\-resourced\[[38](https://arxiv.org/html/2611.23454#bib.bib6)\]\. Portuguese is a representative example: although some clinical text resources exist for Brazilian Portuguese\[[21](https://arxiv.org/html/2611.23454#bib.bib35),[34](https://arxiv.org/html/2611.23454#bib.bib34),[37](https://arxiv.org/html/2611.23454#bib.bib41)\], European Portuguese remains largely unsupported\[[26](https://arxiv.org/html/2611.23454#bib.bib36)\], primarily due to a lack of publicly available clinical text\[[25](https://arxiv.org/html/2611.23454#bib.bib8)\]\. This scarcity limits the development, adaptation, and evaluation of clinical retrieval models for European Portuguese\.

Synthetic data is computer\-generated data used to augment or replace real data\[[16](https://arxiv.org/html/2611.23454#bib.bib10)\]\. Recent progress in large language models \(LLMs\) has renewed interest in synthetic data generation showing that LLMs can generate high\-quality synthetic clinical text at scale, reducing both cost and privacy concerns\[[24](https://arxiv.org/html/2611.23454#bib.bib14),[20](https://arxiv.org/html/2611.23454#bib.bib12),[48](https://arxiv.org/html/2611.23454#bib.bib51),[50](https://arxiv.org/html/2611.23454#bib.bib16),[51](https://arxiv.org/html/2611.23454#bib.bib19)\]\. In this work, we introduce LusoClin, a large\-scale, publicly available dataset of synthetic clinical notes in European Portuguese generated using the open\-source Llama 3\.2 \(3B\) instruction\-tuned model\. Although the dataset presents limitations typical of synthetic clinical text, LusoClin provides a resource for developing and evaluating clinical IR models in European Portuguese, addressing a critical gap in available retrieval resources\. The dataset, along with generation prompts, annotations, and human evaluation results, is publicly released in a dedicated repository\[[10](https://arxiv.org/html/2611.23454#bib.bib45)\]\.

## 2Related Work

Synthetic data has been increasingly explored as a way to address the difficulty of obtaining large\-scale real\-world data, particularly in sensitive domains such as healthcare\. In addition to alleviating data scarcity, synthetic data generation has been shown to offer benefits such as reducing bias\[[20](https://arxiv.org/html/2611.23454#bib.bib12),[45](https://arxiv.org/html/2611.23454#bib.bib11)\], improving performance, scalability, and stronger privacy guarantees\[[18](https://arxiv.org/html/2611.23454#bib.bib13)\]\. These properties make synthetic data particularly attractive\.

Recent advances in LLMs have further accelerated interest in synthetic clinical text generation\. Due to extensive pre\-training, LLMs exhibit strong language understanding capabilities\[[7](https://arxiv.org/html/2611.23454#bib.bib15),[48](https://arxiv.org/html/2611.23454#bib.bib51)\]and can generate fluent unstructured text\[[48](https://arxiv.org/html/2611.23454#bib.bib51),[49](https://arxiv.org/html/2611.23454#bib.bib25)\]\. As a result, several studies have leveraged LLMs to generate synthetic unstructured clinical datas\. While methodologies vary, most approaches share elements related to data preparation, prompt design, and evaluation\.

Some studies rely primarily on pre\-trained LLMs\[[9](https://arxiv.org/html/2611.23454#bib.bib23),[43](https://arxiv.org/html/2611.23454#bib.bib20)\], occasionally augmented with few\-shot examples\[[12](https://arxiv.org/html/2611.23454#bib.bib26),[27](https://arxiv.org/html/2611.23454#bib.bib28),[49](https://arxiv.org/html/2611.23454#bib.bib25)\], while others further adapt models through fine\-tuning on clinical or task\-specific corpora\[[33](https://arxiv.org/html/2611.23454#bib.bib22),[1](https://arxiv.org/html/2611.23454#bib.bib27),[19](https://arxiv.org/html/2611.23454#bib.bib44)\]\.

Prompt engineering plays a central role in guiding LLMs to produce clinically meaningful outputs\. Prior work has explored diverse prompting strategies, ranging from highly structured prompts specifying content and format constraints\[[9](https://arxiv.org/html/2611.23454#bib.bib23)\]to iterative prompt refinement\[[43](https://arxiv.org/html/2611.23454#bib.bib20)\], few\-shot prompting with annotated examples\[[12](https://arxiv.org/html/2611.23454#bib.bib26),[27](https://arxiv.org/html/2611.23454#bib.bib28)\], and frameworks that inject external medical knowledge\[[49](https://arxiv.org/html/2611.23454#bib.bib25)\]\. These studies highlight the importance of balancing guidance and variability to achieve realistic and diverse synthetic clinical text\.

Evaluation of synthetic clinical datasets is independent of the generation approach and remains a critical challenge\. In the clinical domain, evaluation typically focuses on four key dimensions: utility, fidelity, diversity, and privacy\[[46](https://arxiv.org/html/2611.23454#bib.bib43)\]\. Utility assesses whether synthetic data can effectively support downstream modelling and retrieval tasks\[[2](https://arxiv.org/html/2611.23454#bib.bib33)\], while fidelity measures the degree to which synthetic samples resemble real clinical text in terms of correctness and coherence\[[2](https://arxiv.org/html/2611.23454#bib.bib33),[11](https://arxiv.org/html/2611.23454#bib.bib17),[24](https://arxiv.org/html/2611.23454#bib.bib14)\]\. Diversity reflects the ability to capture clinically meaningful variation\[[8](https://arxiv.org/html/2611.23454#bib.bib21),[24](https://arxiv.org/html/2611.23454#bib.bib14)\], and privacy ensures that synthetic data cannot be linked back to real individuals\[[8](https://arxiv.org/html/2611.23454#bib.bib21)\]\. These dimensions are often in tension, requiring careful trade\-offs during dataset construction and evaluation\[[13](https://arxiv.org/html/2611.23454#bib.bib18)\]\.

## 3Dataset Construction

We generated LusoClin using Meta’s Llama 3\.2\[[44](https://arxiv.org/html/2611.23454#bib.bib31)\], specifically the 3\-billion\-parameter instruction\-tuned variant \(“Llama\-3\.2\-3B\-Instruct”\)\. This model was selected to support local execution and fine\-tuning using publicly available weights, avoiding the need to share sensitive data with third\-party services and enabling greater control over the generation\. Additional selection criteria included a context window large enough to accommodate the longest clinical documents and example prompts \(with 2,048 tokens used as a safe threshold\), compatibility with available GPU and storage resources, and support for Portuguese—particularly European Portuguese—within an instruction\-based prompt–response framework\.

To ground the generation process in realistic clinical language and structure, we leveraged existing publicly available clinical datasets\. Specifically, we used SemClinBr\[[32](https://arxiv.org/html/2611.23454#bib.bib7)\]and CLINpt\[[25](https://arxiv.org/html/2611.23454#bib.bib8)\]as source data\. SemClinBr consists of 1,000 Brazilian Portuguese clinical notes spanning four types—admission notes, ambulatory notes, discharge summaries, and nursing notes—and includes annotations for 87 semantic entity types, along with abbreviation and negation labels and two relation types\. CLINpt comprises 281 European Portuguese neurology clinical cases with manually annotated named entities, providing complementary coverage of European Portuguese clinical language\. Both datasets are anonymized\. An overview of the generation process is shown in Figure[1](https://arxiv.org/html/2611.23454#S3.F1)\.

![Refer to caption](https://arxiv.org/html/2611.23454v1/figures/Pipeline.png)Figure 1:Generation pipeline\.### 3\.1Fine\-tuning

Following prior work\[[1](https://arxiv.org/html/2611.23454#bib.bib27),[33](https://arxiv.org/html/2611.23454#bib.bib22)\], we pre\-processed both datasets by extracting document text, converting characters to lowercase, normalizing diacritics, and removing punctuation\. Fine\-tuning was performed using QLoRA\[[6](https://arxiv.org/html/2611.23454#bib.bib37)\]with the AdamW optimizer\[[28](https://arxiv.org/html/2611.23454#bib.bib38)\], a learning rate of 3e−3e^\{\-3\}, weight decay of 0\.01, four epochs, and a batch size of four\. Training used a virtual machine with 100 GB RAM, 100 GB storage, and one NVIDIA RTX 3090 GPU\.

### 3\.2Prompt definition

We iteratively refined the generation prompt through empirical experimentation until the model’s outputs consistently resembled realistic clinical notes\. Drawing on prior work, we progressively enriched an initial prompt that instructed the model to act as a Portuguese clinician by adding more detailed task descriptions, explicit constraints to mitigate common generation errors, and few\-shot examples sampled from SemClinBr\. Prompt refinement was accompanied by tuning the model’s temperature\.

Prompt constraints controlled aspects such as text length, structure, and style, including avoiding section headers, signatures, lists, repetitive phrasing, and excessive use of generic terms \(e\.g\., repeated mentions of “patient”\)\. These constraints were combined to correct recurring issues while avoiding excessive prompt complexity\. We did not explicitly describe the characteristics of each clinical note type, allowing the model to infer them from examples\. To encourage lexical and semantic diversity, each prompt instance included an example containing a randomly selected Disease or Syndrome entity from SemClinBr\. Attempts to use English\-language prompts were unsuccessful\.

All prompt templates, associated temperatures, and generated responses from this phase are publicly available in the accompanying repository\[[10](https://arxiv.org/html/2611.23454#bib.bib45)\]\. For clarity, we present an English translation of the final prompt template below; the original Portuguese version was used for generation and is included in the repository\.

Write, in European Portuguese, \[Clinical Note Type\] with 10 sentences, 130 words, and only 1 paragraph\.Clinical Note Type\] must be in running text, without any subdivision\. Do not include any ‘Age: 52’\-style sections\. Don’t repeat the word ‘patient’ several times\. Don’t repeat sentences\. Your answer must include only \[Clinical Note Type\]\.Some examples are: \[Examples with one randomly chosen ‘Disease or Syndrome’ entity\]\. Don’t give any more examples\. Don’t elaborate on any of these examples\.

For each generation prompt, we specified a clinical note type corresponding to those defined in SemClinBr, translated to European Portuguese with the assistance of medical students\. Prompts included up to four few\-shot examples selected from SemClinBr notes of the requested type that contained a randomly chosen Disease or Syndrome entity; when fewer matching notes were available, all were used\. This strategy was adopted to encourage semantic diversity while maintaining note\-type consistency\.

To mitigate common generation errors, we introduced explicit constraints on length and structure, setting limits of 130 words and 10 sentences based on the average size of SemClinBr notes, and empirically selected a temperature of 0\.6\. In addition, simple rule\-based post\-processing was applied to generated outputs to remove instruction\-related artifacts, repeated or incomplete sentences, and isolated numbered points\.

To assess whether further prompt refinement was necessary before large\-scale generation, we conducted a small\-scale preliminary evaluation with two final\-year medical students\. Sixteen synthetic notes \(four per note type\) and eight real notes from SemClinBr \(two per note type\) were randomly selected and evenly split between the evaluators\. The evaluators were blinded to both the origin and type of each note and completed a Turing\-style assessment and qualitative classifications\. Although limited in scale, this evaluation was sufficient to determine that no further prompt modifications were required, and the original prompt was retained\.

### 3\.3Dataset generation and post\-processing

After completing prompt engineering, we generated the full LusoClin dataset comprising 100,000 synthetic clinical notes, with 25,000 notes per clinical note type\. Generation was performed on the same virtual machine used for fine\-tuning and required a total of 17 days, 20 hours, 50 minutes, and 44 seconds\.

Following generation, we applied additional rule\-based post\-processing to remove noisy outputs\. Some generated notes contained instruction\-like text, such as requests to generate notes or meta\-level guidance, while others resembled transcripts of physician–patient interactions rather than clinical documentation\. To filter such cases, we automatically removed notes containing a predefined set of keywords indicative of these errors, including the portuguese translations of ’to write’, ’to rewrite’, ’write’, ’rewrite’,’to register’, ’you are’, formal version of ’you’, informal version of ’you’\.

### 3\.4Human evaluation

Human evaluation was conducted due to its importance in assessing the realism \(fidelity dimension\) and utility of synthetic clinical data\. After post\-processing, LusoClin comprised 98,571 synthetic clinical notes: 24,759 admission notes, 24,411 ambulatory notes, 24,639 discharge summaries, and 24,762 nursing notes\.

The evaluation involved medical professionals and medical students enrolled in the third to sixth years of a six\-year medical degree at the University of Porto\. Recruitment was conducted via institutional email lists and faculty outreach, and evaluations took place between May 15 and June 2, 2025\. Participants completed the evaluation through a dedicated web application111[https://notasclinicas\.inesctec\.pt](https://notasclinicas.inesctec.pt/), where they were shown a clinical note selected with a 90% probability from LusoClin and a 10% probability from the real SemClinBr dataset, without being informed of its origin\.

For each note, evaluators indicated whether they believed it to be real or synthetic and optionally provided justifications and excerpt\-level comments\. To increase reliability while preserving coverage, we collected up to two independent evaluations per note using a controlled random assignment strategy that avoided repeated evaluations by the same user\. The results of this evaluation are included in Section[4\.1](https://arxiv.org/html/2611.23454#S4.SS1)\.

### 3\.5Dataset improvements

Following the initial evaluation, we applied a series of refinements to improve LusoClin, focusing on reducing Brazilian Portuguese \(PT\-BR\) influence, correcting syntactic issues, and removing irrelevant content\. To identify PT\-BR usage, we employed PtVId\[[42](https://arxiv.org/html/2611.23454#bib.bib50)\], a BERT\-based classifier that distinguishes between European Portuguese \(PT\-PT\) and PT\-BR and provides a confidence score\. In an initial pass, only 31,525 of the 98,564 notes \(approximately 32%\) were classified as PT\-PT\. To mitigate this, we manually analyzed the 1,000 most salient terms \(by TF–IDF\) in notes classified as PT\-BR and replaced PT\-BR expressions with their PT\-PT equivalents\. This process resulted in modifications to 71,381 notes and increased the number of notes classified as PT\-PT to 56,079 \(approximately 57%\)\.

We then addressed recurrent syntactic issues, primarily the absence of diacritics, which led to corrections in 60,590 clinical notes\. These corrections improved linguistic quality without altering clinical content\. Finally, we removed notes deemed irrelevant\. This included six notes containing no Portuguese content and 2,362 notes containing terms indicative of prompt echoing or generic descriptions rather than clinical documentation\. After these filtering steps, LusoClin comprised 96,202 clinical notes, of which 54,518 \(approximately 57%\) were classified as PT\-PT\.

Given our objective of producing a strictly European Portuguese clinical dataset, we retained only notes classified as PT\-PT\. The final version of LusoClin contains 54,518 synthetic clinical notes: 14,253 admission notes, 13,561 ambulatory notes, 9,032 discharge summaries, and 17,672 nursing notes\.

### 3\.6Automatic Evaluation

To complement human evaluation, we conducted an automatic assessment targeting utility, fidelity, diversity, and privacy\. Evaluation included perplexity, textual and entity\-level statistics, t\-SNE visualizations, Central Moment Discrepancy \(CMD\), cosine similarity, and Hausdorff distance to compare synthetic and real clinical text representations\.

### 3\.7Dataset Annotation

To enable entity\-level evaluation, we automatically annotated LusoClin with named entities using MediAlbertina PT\-PT\[[31](https://arxiv.org/html/2611.23454#bib.bib32)\], a 1\.5B BERT\-based model fine\-tuned for NER\. The model was pre\-trained on European Portuguese text\[[36](https://arxiv.org/html/2611.23454#bib.bib9)\]and further adapted using medical documents from Portugal’s largest public hospital\[[31](https://arxiv.org/html/2611.23454#bib.bib32)\]\. We applied the publicly available NER version to all clinical notes using the entity categories Diagnosis, Symptom, Medication/Drug, Dosage, Medical Procedure, Vital Sign, Result, and Progress\.

## 4Evaluation Results

This section reports the results of our two\-stage evaluation\.

### 4\.1Human evaluation results

We collected 149 evaluations of 78 clinical notes\. Among these, 71 notes \(57 LusoClin and 14 SemClinBr\) received two evaluations, summarized in Table[1](https://arxiv.org/html/2611.23454#S4.T1)\.

Table 1:Distribution of votes for clinical notes with two independent evaluations \(R = Real, S = Synthetic\)\.We computed Cohen’s Kappa\[[4](https://arxiv.org/html/2611.23454#bib.bib46)\], obtaining a value of \-0\.04, indicating no meaningful inter\-annotator agreement\[[29](https://arxiv.org/html/2611.23454#bib.bib47),[40](https://arxiv.org/html/2611.23454#bib.bib48),[47](https://arxiv.org/html/2611.23454#bib.bib49)\]\. This may reflect the difficulty of distinguishing synthetic from real clinical notes or differences in evaluator criteria\[[40](https://arxiv.org/html/2611.23454#bib.bib48)\]\. We therefore restrict the remaining analysis to the 41 notes with concordant evaluations\.

Table[2](https://arxiv.org/html/2611.23454#S4.T2)shows the human classifications\. Only 9% of LusoClin notes were classified as real, while 67% of SemClinBr notes were judged synthetic\. This suggests evaluators adopted strict realism criteria, potentially interpreting characteristics of genuine clinical notes as indicators of synthetic origin\. Five LusoClin notes received concordant justifications, attributed to medical errors, meta\-data artifacts, missing key information, or an overall synthetic appearance\. Discordant justifications are summarized in Table[3](https://arxiv.org/html/2611.23454#S4.T3)\. Although most justifications were provided by only one evaluator, they remain useful for identifying potential weaknesses and informing dataset improvements\.

Table 2:Human classification of clinical notes\.Table 3:Number and proportion of justifications for classifying notes as synthetic, excluding empty justifications\.
### 4\.2Automatic evaluation results

As described in Section[3\.6](https://arxiv.org/html/2611.23454#S3.SS6), we combined several automatic evaluation methods targeting utility, fidelity, diversity, and privacy\. Table[4](https://arxiv.org/html/2611.23454#S4.T4)summarizes the methods and baselines used\.

Table 4:Evaluation methods, assessed dimensions, and comparison baselines\.- \*Computed on a subset of LusoClin matched to the size of SemClinBr\.

Perplexity and textual statistics were computed on the full dataset, while t\-SNE, CMD, cosine similarity, and Hausdorff distance used a subset of 1,000 LusoClin notes matched to SemClinBr\. These methods relied on multilingual SentenceBERT embeddings\[[35](https://arxiv.org/html/2611.23454#bib.bib39)\]\. SemClinBr served as baseline for perplexity, statistics, and cosine similarity, while\[[49](https://arxiv.org/html/2611.23454#bib.bib25)\]provided the English\-language baseline for t\-SNE and CMD\.

#### Perplexity

We computed the average perplexity of GlórIA\[[26](https://arxiv.org/html/2611.23454#bib.bib36)\]and Cabrita\[[21](https://arxiv.org/html/2611.23454#bib.bib35)\]on LusoClin and SemClinBr\. LusoClin achieved lower perplexity on both models \(68\.32 vs\. 82\.57 for GlórIA; 29\.44 vs\. 37\.31 for Cabrita\), indicating that the synthetic notes were easier to predict\. Since lower perplexity has been associated with medically coherent clinical content\[[1](https://arxiv.org/html/2611.23454#bib.bib27),[20](https://arxiv.org/html/2611.23454#bib.bib12),[30](https://arxiv.org/html/2611.23454#bib.bib24)\], these results support the utility and fidelity of LusoClin\.

#### Textual and entity statistics

We compared textual and entity\-level statistics between datasets, including document length, sentence count, and entity distributions\. Figure[2](https://arxiv.org/html/2611.23454#S4.F2)shows that synthetic notes are slightly longer than real notes, while Figure[3](https://arxiv.org/html/2611.23454#S4.F3)indicates similar sentence structures, although SemClinBr displays greater variability\. Table[5](https://arxiv.org/html/2611.23454#S4.T5)reports entity type frequencies\. The average absolute difference between datasets was 3\.71%, indicating close alignment in medical entity distributions and supporting the realism of LusoClin\. Figure[4](https://arxiv.org/html/2611.23454#S4.F4)further shows that synthetic notes contain more entities on average, suggesting denser medical terminology\.

![Refer to caption](https://arxiv.org/html/2611.23454v1/figures/word_count_comparison.png)Figure 2:Word count distributions for each note type\.![Refer to caption](https://arxiv.org/html/2611.23454v1/figures/sentence_count_comparison.png)Figure 3:Sentence count distributions for each note type\.![Refer to caption](https://arxiv.org/html/2611.23454v1/figures/entity_count_comparison.png)Figure 4:Entity count distributions for each note type\.Table 5:Entity type frequencies\.
#### t\-SNE plots

We examined t\-SNE visualizations of the LusoClin subset and SemClinBr, shown in Figure[5](https://arxiv.org/html/2611.23454#S4.F5)\. The plots reveal only partial overlap between the two datasets, suggesting that the distribution of LusoClin could more closely align with that of SemClinBr to achieve comparable levels of utility and fidelity\. This observation is consistent with findings reported by Xu et al\.\[[49](https://arxiv.org/html/2611.23454#bib.bib25)\], whose English\-language baseline exhibits a greater overlap between synthetic and real data distributions\. At the same time, the overall spacing and dispersion of LusoClin data points appear similar to those of SemClinBr, mirroring the behavior observed in the English baseline\[[49](https://arxiv.org/html/2611.23454#bib.bib25)\]\. This indicates that LusoClin captures a comparable level of diversity, which is a positive outcome given that SemClinBr is a multi\-specialty clinical dataset\.

![Refer to caption](https://arxiv.org/html/2611.23454v1/figures/t_sne_plot.png)Figure 5:t\-SNE plots of LusoClin and SemClinBr\.
#### Central Moment Discrepancy

We additionally computed the average CMD between the LusoClin subset and SemClinBr, obtaining a value of 0\.395\. Compared with the English\-language baseline reported by Xu et al\.\[[49](https://arxiv.org/html/2611.23454#bib.bib25)\], LusoClin achieves a lower CMD on this metric\. This result indicates limited shift between the synthetic and real clinical notes, providing further evidence that LusoClin preserves key characteristics of the clinical domain and exhibits satisfactory fidelity\.

#### Cosine similarity

We computed cosine similarity using sentence\-level embeddings to assess both diversity and privacy\. First, we calculated the average cosine similarity over all pairwise combinations of sentences within the LusoClin subset\. LusoClin exhibits a lower average pairwise cosine similarity \(0\.091\) than SemClinBr \(0\.137\), indicating higher internal diversity among synthetic notes\. This is a positive outcome, as it suggests that LusoClin is not overly repetitive\. One possible concern is that increased diversity could reflect a shift away from the clinical domain toward more general language; however, this interpretation is not supported by the human evaluation and CMD results, which indicate preservation of clinical characteristics\.

For privacy, we then computed the average cosine similarity between cross\-dataset pairs consisting of one LusoClin sample and one SemClinBr sample, considering \(1\) all note types jointly and \(2\) pairs matched by note type\. As shown in Table[6](https://arxiv.org/html/2611.23454#S4.T6), cross\-dataset similarities are consistently low\. Following the privacy preservation criterion proposed by Henrnadez et al\.\[[15](https://arxiv.org/html/2611.23454#bib.bib40)\], which sets a cosine similarity threshold of 0\.5, both the type\-agnostic and type\-matched results fall well below this threshold\. This provides strong evidence that LusoClin does not exhibit excessive similarity to real clinical notes and therefore supports its privacy\-preserving nature\.

Table 6:Average cosine similarity \(CosineS\) and Hausdorff distance \(HausD\) between pairs consisting of one LusoClin note and one SemClinBr note\.
#### Hausdorff distance

We computed the average Hausdorff distance between cross\-dataset pairs consisting of one LusoClin note and one SemClinBr note, considering both all note types jointly and pairs matched by note type\. These results were compared against the privacy preservation baseline proposed by Hernadez et al\.\[[15](https://arxiv.org/html/2611.23454#bib.bib40)\], which sets a threshold value of 1\. As shown in Table[6](https://arxiv.org/html/2611.23454#S4.T6), all computed Hausdorff distances exceed this threshold, both in the type\-agnostic and type\-matched settings\. This provides additional evidence that synthetic notes are sufficiently separated from real notes, supporting the privacy\-preserving properties of LusoClin\.

## 5Conclusions

Based on the applied evaluation methods, we draw several conclusions regarding the quality of LusoClin\. Utility and fidelity were the most critical dimensions and were primarily assessed through human evaluation\. While evaluators identified issues such as nonsensical content and medical errors in a subset of notes, many synthetic notes were medically coherent and informative\. Although most LusoClin notes did not pass as real, this outcome must be interpreted in light of the fact that two\-thirds of the SemClinBr notes were also judged synthetic\. This highlights the inherent difficulty and subjectivity of human evaluation in synthetic data settings, where evaluators tend to apply stricter realism criteria\.

Automatic evaluations of utility and fidelity yielded encouraging results, with LusoClin matching baselines on t\-SNE plot and textual and entity statistics and outperforming them on perplexity and CMD\. Overall, these findings indicate that LusoClin provides a reasonable level of utility and fidelity, though quality issues remain in a subset of notes\.

Evaluation of diversity showed that LusoClin is at least as diverse as SemClinBr, suggesting that it meets diversity requirements for downstream use\. Privacy assessment results were also positive\. The combination of our evaluation results and the use of professionally de\-identified source data strongly suggests that LusoClin does not pose privacy risks\.

Overall, the results indicate that LusoClin cannot fully replace real clinical data but can serve as a valuable complementary resource for research, particularly in low\-resource settings\.

#### Acknowledgements

This work was co\-financed by Component 5 \- Capitalization and Business Innovation, integrated in the Resilience Dimension of the Recovery and Resilience Plan within the scope of the Recovery and Resilience Mechanism \(MRR\) of the European Union \(EU\), framed in the Next Generation EU, for the period 2021 \- 2026, within project HfPT, with reference 41\.

## References

- \[1\]\(2020\)Exploring transformer text generation for medical dataset augmentation\.InProceedings of the Twelfth Language Resources and Evaluation Conference,N\. Calzolari, F\. Béchet, P\. Blache, K\. Choukri, C\. Cieri, T\. Declerck, S\. Goggi, H\. Isahara, B\. Maegaard, J\. Mariani, H\. Mazo, A\. Moreno, J\. Odijk, and S\. Piperidis \(Eds\.\),Marseille, France,pp\. 4699–4708\(English\)\.External Links:[Link](https://aclanthology.org/2020.lrec-1.578),ISBN 979\-10\-95546\-34\-4Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p3.1),[§3\.1](https://arxiv.org/html/2611.23454#S3.SS1.p1.1),[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.SSSx1.p1.1)\.
- \[2\]E\. Budu, K\. Etminani, A\. Soliman, and T\. Rögnvaldsson\(2024\)Evaluation of synthetic electronic health records: a systematic review and experimental assessment\.Neurocomputing603,pp\. 128253\.Note:doi: 10\.1016/j\.neucom\.2024\.128253External Links:ISSN 0925\-2312,[Link](https://www.sciencedirect.com/science/article/pii/S0925231224010245)Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p5.1)\.
- \[3\]S\. R\. Chamberlin, S\. D\. Bedrick, A\. M\. Cohen, Y\. Wang, A\. Wen, S\. Liu, H\. Liu, and W\. R\. Hersh\(2020\)Evaluation of patient\-level retrieval from electronic health record data for a cohort discovery task\.JAMIA Open3,pp\. 395–404\.External Links:[Document](https://dx.doi.org/10.1093/JAMIAOPEN/OOAA026),ISSN 25742531,[Link](https://dx.doi.org/10.1093/jamiaopen/ooaa026)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p2.1)\.
- \[4\]J\. Cohen\(1960\)A coefficient of agreement for nominal scales\.\.Educational and Psychological Measurement20,pp\. 37–46\.Note:doi: 10\.1177/001316446002000104External Links:[Link](https://doi.org/10.1177/001316446002000104)Cited by:[§4\.1](https://arxiv.org/html/2611.23454#S4.SS1.p2.1)\.
- \[5\]M\. R\. Cowie, J\. I\. Blomster, L\. H\. Curtis, S\. Duclaux, I\. Ford, F\. Fritz, S\. Goldman, S\. Janmohamed, J\. Kreuzer, M\. Leenay, A\. Michel, S\. Ong, J\. P\. Pell, M\. R\. Southworth, W\. G\. Stough, M\. Thoenes, F\. Zannad, and A\. Zalewski\(2017\)Electronic health records to facilitate clinical research\.Clinical Research in Cardiology106\(1\),pp\. 1–9\.Note:doi: 10\.1007/s00392\-016\-1025\-6External Links:ISSN 1861\-0692,[Link](https://doi.org/10.1007/s00392-016-1025-6)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p1.1)\.
- \[6\]T\. Dettmers, A\. Pagnoni, A\. Holtzman, and L\. Zettlemoyer\(2023\)QLORA: efficient finetuning of quantized llms\.InProceedings of the 37th International Conference on Neural Information Processing Systems,NIPS ’23,Red Hook, NY, USA\.Cited by:[§3\.1](https://arxiv.org/html/2611.23454#S3.SS1.p1.1)\.
- \[7\]B\. Ding, C\. Qin, L\. Liu, Y\. K\. Chia, S\. Joty, B\. Li, and L\. Bing\(2023\)Is gpt\-3 a good data annotator?\.Note:doi: 10\.48550/arXiv\.2212\.10450External Links:2212\.10450,[Link](https://arxiv.org/abs/2212.10450)Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p2.1)\.
- \[8\]P\. Eigenschink, T\. Reutterer, S\. Vamosi, R\. Vamosi, C\. Sun, and K\. Kalcher\(2023\)Deep generative models for synthetic data: a survey\.IEEE Access11\(\),pp\. 47304–47320\.Note:doi: 10\.1109/ACCESS\.2023\.3275134Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p5.1)\.
- \[9\]M\. Falis, A\. P\. Gema, H\. Dong, L\. Daines, S\. Basetti, M\. Holder, R\. S\. Penfold, A\. Birch, and B\. Alex\(2024\)Can GPT\-3\.5 generate and code discharge summaries?\.Journal of the American Medical Informatics Association31\(10\),pp\. 2284–2293\.Note:doi: 10\.1093/jamia/ocae132External Links:ISSN 1527\-974X,[Link](https://doi.org/10.1093/jamia/ocae132),https://academic\.oup\.com/jamia/article\-pdf/31/10/2284/59206416/ocae132\.pdfCited by:[§2](https://arxiv.org/html/2611.23454#S2.p3.1),[§2](https://arxiv.org/html/2611.23454#S2.p4.1)\.
- \[10\]D\. Félix and C\. Teixeira Lopes\(2025\)Dataset of synthetic clinical notes in european portuguese generated using an open\-source large language model, along with prompting and evaluation data\.Note:INESC TECExternal Links:[Link](https://doi.org/10.25747/4GC6-DK48)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p4.1),[§3\.2](https://arxiv.org/html/2611.23454#S3.SS2.p3.1)\.
- \[11\]A\. Figueira and B\. Vaz\(2022\)Survey on synthetic data generation, evaluation methods and gans\.Mathematics10\(15\)\.Note:doi: 10\.3390/math10152733External Links:[Link](https://www.mdpi.com/2227-7390/10/15/2733),ISSN 2227\-7390Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p5.1)\.
- \[12\]J\. Frei and F\. Kramer\(2023\)Annotated dataset creation through large language models for non\-english medical nlp\.Journal of Biomedical Informatics145,pp\. 104478\.Note:doi: 10\.1016/j\.jbi\.2023\.104478External Links:ISSN 1532\-0464,[Link](https://www.sciencedirect.com/science/article/pii/S1532046423001995)Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p3.1),[§2](https://arxiv.org/html/2611.23454#S2.p4.1)\.
- \[13\]A\. Goncalves, P\. Ray, B\. Soper, J\. Stevens, L\. Coyle, and A\. P\. Sales\(2020\)Generation and evaluation of synthetic patient data\.BMC Medical Research Methodology20\(1\),pp\. 108\.Note:doi: 10\.1186/s12874\-020\-00977\-1External Links:ISSN 1471\-2288,[Link](https://doi.org/10.1186/s12874-020-00977-1)Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p5.1)\.
- \[14\]T\. D\. Gunter and N\. P\. Terry\(2005\)The emergence of national electronic health record architectures in the united states and australia: models, costs, and questions\.J\. Med\. Internet Res\.7\(1\),pp\. e3\(en\)\.Note:[https://pmc\.ncbi\.nlm\.nih\.gov/articles/PMC1550638/](https://pmc.ncbi.nlm.nih.gov/articles/PMC1550638/)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p1.1)\.
- \[15\]M\. Hernadez, G\. Epelde, A\. Alberdi, R\. Cilla, and D\. Rankin\(2023\)Synthetic tabular data evaluation in the health domain covering resemblance, utility, and privacy dimensions\.Methods Inf Med62\(S 01\),pp\. e19–e38\(EN\)\.Note:doi: 10\.1055/s\-0042\-1760247External Links:ISSN 0026\-1270,[Link](http://www.thieme-connect.com/products/ejournals/abstract/10.1055/s-0042-1760247)Cited by:[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.SSSx5.p2.1),[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.SSSx6.p1.1),[Table 4](https://arxiv.org/html/2611.23454#S4.T4.4.6.3),[Table 4](https://arxiv.org/html/2611.23454#S4.T4.4.7.3)\.
- \[16\]IBMWhat is synthetic data?\.Note:[https://research\.ibm\.com/blog/what\-is\-synthetic\-data](https://research.ibm.com/blog/what-is-synthetic-data)Accessed: 2024\-08\-27Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p4.1)\.
- \[17\]P\. Jadhav\(2025\)Cohort retrieval using dense passage retrieval\.External Links:2507\.01049,[Link](https://arxiv.org/abs/2507.01049)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p2.1)\.
- \[18\]I\. Joshi, M\. Grimmer, C\. Rathgeb, C\. Busch, F\. Bremond, and A\. Dantcheva\(2024\)Synthetic data in human analysis: a survey\.IEEE Transactions on Pattern Analysis and Machine Intelligence46\(7\),pp\. 4957–4976\.Note:doi: 10\.1109/TPAMI\.2024\.3362821Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p1.1)\.
- \[19\]G\. Kumichev, P\. Blinov, Y\. Kuzkina, V\. Goncharov, G\. Zubkova, N\. Zenovkin, A\. Goncharov, and A\. Savchenko\(2024\)MedSyn: llm\-based synthetic medical text generation framework\.InMachine Learning and Knowledge Discovery in Databases\. Applied Data Science Track,A\. Bifet, T\. Krilavičius, I\. Miliou, and S\. Nowaczyk \(Eds\.\),Cham,pp\. 215–230\.Note:doi: 10\.1007/978\-3\-031\-70381\-2\_14External Links:ISBN 978\-3\-031\-70381\-2Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p3.1)\.
- \[20\]S\. Kweon, J\. Kim, J\. Kim, S\. Im, E\. Cho, S\. Bae, J\. Oh, G\. Lee, J\. H\. Moon, S\. C\. You, S\. Baek, C\. H\. Han, Y\. B\. Jung, Y\. Jo, and E\. Choi\(2024\)Publicly shareable clinical large language model built on synthetic clinical notes\.Note:doi: 10\.48550/arXiv\.2309\.00237External Links:2309\.00237Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p4.1),[§2](https://arxiv.org/html/2611.23454#S2.p1.1),[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.SSSx1.p1.1)\.
- \[21\]C\. Larcher, M\. Piau, P\. Finardi, P\. Gengo, P\. Esposito, and V\. Caridá\(2023\)Cabrita: closing the gap for foreign languages\.External Links:2308\.11878Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p3.1),[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.SSSx1.p1.1)\.
- \[22\]I\. Li, J\. Pan, J\. Goldwasser, N\. Verma, W\. P\. Wong, M\. Y\. Nuzumlalı, B\. Rosand, Y\. Li, M\. Zhang, D\. Chang, R\. A\. Taylor, H\. M\. Krumholz, and D\. Radev\(2022\)Neural natural language processing for unstructured data in electronic health records: a review\.Computer Science Review46,pp\. 100511\.Note:doi: 10\.1016/j\.cosrev\.2022\.100511External Links:ISSN 1574\-0137,[Document](https://dx.doi.org/https%3A//doi.org/10.1016/j.cosrev.2022.100511),[Link](https://www.sciencedirect.com/science/article/pii/S1574013722000454)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p2.1)\.
- \[23\]S\. Liu, Y\. Wang, A\. Wen, L\. Wang, N\. Hong, F\. Shen, S\. Bedrick, W\. Hersh, and H\. Liu\(2020\)Implementation of a cohort retrieval system for clinical data repositories using the observational medical outcomes partnership common data model: proof\-of\-concept system validation\.JMIR Medical Informatics8\.External Links:[Document](https://dx.doi.org/10.2196/17376),ISSN 2291\-9694Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p2.1)\.
- \[24\]L\. Long, R\. Wang, R\. Xiao, J\. Zhao, X\. Ding, G\. Chen, and H\. Wang\(2024\)On llms\-driven synthetic data generation, curation, and evaluation: a survey\.Note:doi: 10\.48550/arXiv\.2406\.15126External Links:2406\.15126,[Link](https://arxiv.org/abs/2406.15126)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p2.1),[§1](https://arxiv.org/html/2611.23454#S1.p4.1),[§2](https://arxiv.org/html/2611.23454#S2.p5.1)\.
- \[25\]F\. Lopes, C\. Teixeira, and H\. Gonçalo Oliveira\(2019\)Contributions to clinical named entity recognition in Portuguese\.InProceedings of the 18th BioNLP Workshop and Shared Task,D\. Demner\-Fushman, K\. B\. Cohen, S\. Ananiadou, and J\. Tsujii \(Eds\.\),Florence, Italy,pp\. 223–233\.Note:doi: 10\.18653/v1/W19\-5024External Links:[Link](https://aclanthology.org/W19-5024)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p3.1),[§3](https://arxiv.org/html/2611.23454#S3.p2.1)\.
- \[26\]R\. Lopes, J\. Magalhaes, and D\. Semedo\(2024\)GlórIA: a generative and open large language model for Portuguese\.InProceedings of the 16th International Conference on Computational Processing of Portuguese,P\. Gamallo, D\. Claro, A\. Teixeira, L\. Real, M\. Garcia, H\. G\. Oliveira, and R\. Amaro \(Eds\.\),Santiago de Compostela, Galicia/Spain,pp\. 441–453\.External Links:[Link](https://aclanthology.org/2024.propor-1.45)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p3.1),[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.SSSx1.p1.1)\.
- \[27\]I\. Lorge, D\. W\. Joyce, N\. Taylor, A\. Nevado\-Holgado, A\. Cipriani, and A\. Kormilitzin\(2024\)Detecting the clinical features of difficult\-to\-treat depression using synthetic data from large language models\.Note:doi: 10\.48550/arXiv\.2402\.07645External Links:2402\.07645,[Link](https://arxiv.org/abs/2402.07645)Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p3.1),[§2](https://arxiv.org/html/2611.23454#S2.p4.1)\.
- \[28\]I\. Loshchilov and F\. Hutter\(2019\)Decoupled weight decay regularization\.Note:doi: 10\.48550/arXiv\.1711\.05101External Links:1711\.05101,[Link](https://arxiv.org/abs/1711.05101)Cited by:[§3\.1](https://arxiv.org/html/2611.23454#S3.SS1.p1.1)\.
- \[29\]M\. L\. McHugh\(2012\)Interrater reliability: the kappa statistic\.Biochem Med \(Zagreb\)22\(3\),pp\. 276–282\(en\)\.Note:doi: 10\.1177/001316446002000104Cited by:[§4\.1](https://arxiv.org/html/2611.23454#S4.SS1.p2.1)\.
- \[30\]O\. Melamud and C\. Shivade\(2019\)Towards automatic generation of shareable synthetic clinical notes using neural language models\.Note:doi: 10\.48550/arXiv\.1905\.07002External Links:1905\.07002,[Link](https://arxiv.org/abs/1905.07002)Cited by:[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.SSSx1.p1.1)\.
- \[31\]M\. Nunes, J\. Boné, J\. C\. Ferreira, P\. Chaves, and L\. B\. Elvas\(2024\)MediAlbertina: an european portuguese medical language model\.Computers in Biology and Medicine182,pp\. 109233\.Note:doi: 10\.1016/j\.compbiomed\.2024\.109233External Links:ISSN 0010\-4825,[Link](https://www.sciencedirect.com/science/article/pii/S0010482524013180)Cited by:[§3\.7](https://arxiv.org/html/2611.23454#S3.SS7.p1.1)\.
- \[32\]L\. E\. S\. e\. Oliveira, A\. C\. Peters, A\. M\. P\. da Silva, C\. P\. Gebeluca, Y\. B\. Gumiel, L\. M\. M\. Cintho, D\. R\. Carvalho, S\. Al Hasan, and C\. M\. C\. Moro\(2022\)SemClinBr \- a multi\-institutional and multi\-specialty semantically annotated corpus for portuguese clinical nlp tasks\.Journal of Biomedical Semantics13\(1\),pp\. 13\.Note:doi: 10\.1186/s13326\-022\-00269\-1External Links:ISSN 2041\-1480,[Link](https://doi.org/10.1186/s13326-022-00269-1)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p1.1),[§3](https://arxiv.org/html/2611.23454#S3.p2.1)\.
- \[33\]C\. Peng, X\. Yang, A\. Chen, K\. E\. Smith, N\. PourNejatian, A\. B\. Costa, C\. Martin, M\. G\. Flores, Y\. Zhang, T\. Magoc, G\. Lipori, D\. A\. Mitchell, N\. S\. Ospina, M\. M\. Ahmed, W\. R\. Hogan, E\. A\. Shenkman, Y\. Guo, J\. Bian, and Y\. Wu\(2023\)A study of generative large language model for medical research and healthcare\.npj Digital Medicine6\(1\),pp\. 210\.Note:doi: 10\.1038/s41746\-023\-00958\-wExternal Links:ISSN 2398\-6352,[Link](https://doi.org/10.1038/s41746-023-00958-w)Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p3.1),[§3\.1](https://arxiv.org/html/2611.23454#S3.SS1.p1.1)\.
- \[34\]R\. Pires, H\. Abonizio, T\. S\. Almeida, and R\. Nogueira\(2023\)Sabiá: portuguese large language models\.InIntelligent Systems,Cham,pp\. 226–240\.External Links:ISBN 978\-3\-031\-45392\-2Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p3.1)\.
- \[35\]N\. Reimers and I\. Gurevych\(2019\)Sentence\-bert: sentence embeddings using siamese bert\-networks\.Note:[https://fq\.pkwyx\.com/default/https/aclanthology\.org/D19\-1410\.pdf](https://fq.pkwyx.com/default/https/aclanthology.org/D19-1410.pdf)Cited by:[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.p2.1)\.
- \[36\]J\. Rodrigues, L\. Gomes, J\. Silva, A\. Branco, R\. Santos, H\. L\. Cardoso, and T\. Osório\(2023\)Advancing neural encoding of portuguese with transformer albertina pt\-\*\.InProgress in Artificial Intelligence,N\. Moniz, Z\. Vale, J\. Cascalho, C\. Silva, and R\. Sebastião \(Eds\.\),Cham,pp\. 441–453\.Note:doi: 10\.1007/978\-3\-031\-49008\-8\_35External Links:ISBN 978\-3\-031\-49008\-8Cited by:[§3\.7](https://arxiv.org/html/2611.23454#S3.SS7.p1.1)\.
- \[37\]E\. T\. R\. Schneider, J\. V\. A\. de Souza, Y\. B\. Gumiel, C\. Moro, and E\. C\. Paraiso\(2021\)A gpt\-2 language model for biomedical texts in portuguese\.In2021 IEEE 34th International Symposium on Computer\-Based Medical Systems \(CBMS\),Vol\.,pp\. 474–479\.Note:doi: 10\.1109/CBMS52027\.2021\.00056Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p3.1)\.
- \[38\]E\. T\. R\. Schneider, J\. V\. A\. de Souza, J\. Knafou, L\. E\. S\. e Oliveira, J\. Copara, Y\. B\. Gumiel, L\. F\. A\. de Oliveira, E\. C\. Paraiso, D\. Teodoro, and C\. M\. C\. Moro\(2020\)BioBERTpt \- a portuguese neural language model for clinical named entity recognition\.Association for Computational Linguistics\.External Links:[Document](https://dx.doi.org/10.18653/v1/2020.clinicalnlp-1.7),[Link](https://aclanthology.org/2020.clinicalnlp-1.7/)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p3.1)\.
- \[39\]J\. Shi, Z\. Yuan, W\. Guo, C\. Ma, J\. Chen, and M\. Zhang\(2023\)Knowledge\-graph\-enabled biomedical entity linking: a survey\.World Wide Web26\(5\),pp\. 2593–2622\.Note:doi: 10\.1007/s11280\-023\-01144\-4External Links:ISSN 1573\-1413,[Link](https://doi.org/10.1007/s11280-023-01144-4)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p2.1),[§1](https://arxiv.org/html/2611.23454#S1.p3.1)\.
- \[40\]J\. Sim and C\. C\. Wright\(2005\)The kappa statistic in reliability studies: use, interpretation, and sample size requirements\.Physical Therapy85\(3\),pp\. 257–268\.Note:doi: 10\.1093/ptj/85\.3\.257External Links:ISSN 1538\-6724,[Link](https://doi.org/10.1093/ptj/85.3.257),https://academic\.oup\.com/ptj/article\-pdf/85/3/257/31670498/ptj0257\.pdfCited by:[§4\.1](https://arxiv.org/html/2611.23454#S4.SS1.p2.1)\.
- \[41\]S\. Sivarajkumar, H\. A\. Mohammad, D\. Oniani, K\. Roberts, W\. Hersh, H\. Liu, D\. He, S\. Visweswaran, and Y\. Wang\(2024\)Clinical information retrieval: a literature review\.Journal of Healthcare Informatics Research8,pp\. 313–352\.External Links:[Document](https://dx.doi.org/10.1007/S41666-024-00159-4),ISSN 2509498X,[Link](https://link.springer.com/article/10.1007/s41666-024-00159-4)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p2.1)\.
- \[42\]H\. Sousa, R\. Almeida, P\. Silvano, I\. Cantante, R\. Campos, and A\. Jorge\(2025\)Enhancing portuguese variety identification with cross\-domain approaches\.Proceedings of the AAAI Conference on Artificial Intelligence39,pp\. 25192–25200\.Note:doi: 10\.1609/aaai\.v39i24\.34705External Links:ISSN 2374\-3468Cited by:[§3\.5](https://arxiv.org/html/2611.23454#S3.SS5.p1.1)\.
- \[43\]R\. Tang, X\. Han, X\. Jiang, and X\. Hu\(2023\)Does synthetic data generation of llms help clinical text mining?\.Note:doi: 10\.48550/arXiv\.2303\.04360External Links:2303\.04360,[Link](https://arxiv.org/abs/2303.04360)Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p3.1),[§2](https://arxiv.org/html/2611.23454#S2.p4.1)\.
- \[44\]L\. Team\(2024\)The llama 3 herd of models\.Note:doi: 10\.48550/arXiv\.2407\.21783External Links:2407\.21783,[Link](https://arxiv.org/abs/2407.21783)Cited by:[§3](https://arxiv.org/html/2611.23454#S3.p1.1)\.
- \[45\]F\. Umer and N\. Adnan\(2024\)Generative artificial intelligence: synthetic datasets in dentistry\.BDJ Open10\(1\),pp\. 13\.Note:doi: 10\.1038/s41405\-024\-00198\-4External Links:ISSN 2056\-807X,[Link](https://doi.org/10.1038/s41405-024-00198-4)Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p1.1)\.
- \[46\]B\. van Breugel, T\. Liu, D\. Oglic, and M\. van der Schaar\(2024\)Synthetic data in biomedicine via generative artificial intelligence\.Nature Reviews Bioengineering2\(12\),pp\. 991–1004\.Note:doi:10\.1038/s44222\-024\-00245\-7External Links:ISSN 2731\-6092,[Link](https://doi.org/10.1038/s44222-024-00245-7)Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p5.1)\.
- \[47\]A\. J\. Viera J\. M\. Garrettet al\.\(2005\)Understanding interobserver agreement: the kappa statistic\.Fam med37\(5\),pp\. 360–363\.Note:[http://www1\.cs\.columbia\.edu/~julia/courses/CS6998/Interrater\_agreement\.Kappa\_statistic\.pdf](http://www1.cs.columbia.edu/~julia/courses/CS6998/Interrater_agreement.Kappa_statistic.pdf)Cited by:[§4\.1](https://arxiv.org/html/2611.23454#S4.SS1.p2.1)\.
- \[48\]H\. M\. Waseem, S\. U\. Islam, N\. Matragkas, G\. Epiphaniou, T\. N\. Arvanitis, and C\. Maple\(2025\)Review of generative ai for synthetic data generation: a healthcare perspective\.Artificial Intelligence Review59\(2\),pp\. 55\.Note:doi: 10\.1007/s10462\-025\-11440\-2External Links:ISSN 1573\-7462,[Link](https://doi.org/10.1007/s10462-025-11440-2)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p4.1),[§2](https://arxiv.org/html/2611.23454#S2.p2.1)\.
- \[49\]R\. Xu, H\. Cui, Y\. Yu, X\. Kan, W\. Shi, Y\. Zhuang, M\. D\. Wang, W\. Jin, J\. Ho, and C\. Yang\(2024\)Knowledge\-infused prompting: assessing and advancing clinical text data generation with large language models\.InFindings of the Association for Computational Linguistics ACL 2024,L\. Ku, A\. Martins, and V\. Srikumar \(Eds\.\),Bangkok, Thailand and virtual meeting,pp\. 15496–15523\.Note:doi: 10\.18653/v1/2024\.findings\-acl\.916External Links:[Link](https://aclanthology.org/2024.findings-acl.916)Cited by:[§2](https://arxiv.org/html/2611.23454#S2.p2.1),[§2](https://arxiv.org/html/2611.23454#S2.p3.1),[§2](https://arxiv.org/html/2611.23454#S2.p4.1),[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.SSSx3.p1.1),[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.SSSx4.p1.1),[§4\.2](https://arxiv.org/html/2611.23454#S4.SS2.p2.1),[Table 4](https://arxiv.org/html/2611.23454#S4.T4.4.4.3),[Table 4](https://arxiv.org/html/2611.23454#S4.T4.4.5.3)\.
- \[50\]Y\. Yu, Y\. Zhuang, J\. Zhang, Y\. Meng, A\. Ratner, R\. Krishna, J\. Shen, and C\. Zhang\(2023\)Large language model as attributed training data generator: a tale of diversity and bias\.InProceedings of the 37th International Conference on Neural Information Processing Systems,NIPS ’23,Red Hook, NY, USA\.Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p4.1)\.
- \[51\]G\. Zhang, Q\. Jin, Y\. Zhou, S\. Wang, B\. Idnay, Y\. Luo, E\. Park, J\. G\. Nestor, M\. E\. Spotnitz, A\. Soroush, T\. R\. Campion, Z\. Lu, C\. Weng, and Y\. Peng\(2024\)Closing the gap between open source and commercial large language models for medical evidence summarization\.npj Digital Medicine7\(1\),pp\. 239\.Note:doi: 10\.1038/s41746\-024\-01239\-wExternal Links:ISSN 2398\-6352,[Link](https://doi.org/10.1038/s41746-024-01239-w)Cited by:[§1](https://arxiv.org/html/2611.23454#S1.p4.1)\.

相似文章

用于模式约束临床信息抽取的检索增强型大语言模型

arXiv cs.CL

本文提出了一种模块化的检索增强生成(RAG)流水线,用于从护理人员与患者的对话转录中提取结构化临床观察结果,采用模式约束提示和第二遍审核,基于Llama和GPT骨干模型,取得了80.36%的F1分数。