Development and Preliminary Evaluation of a Domain-Specific Large Language Model for Tuberculosis Care in South Africa
Summary
Researchers fine-tuned BioMistral-7B with QLoRA and GraphRAG to create a TB-care LLM for South Africa, showing improved contextual alignment over the base model.
View Cached Full Text
Cached at: 04/23/26, 10:02 AM
# Development and Preliminary Evaluation of a Domain-Specific Large Language Model for Tuberculosis Care in South Africa Source: [https://arxiv.org/abs/2604.19776](https://arxiv.org/abs/2604.19776) [View PDF](https://arxiv.org/pdf/2604.19776) > Abstract:Tuberculosis \(TB\) is one of the world's deadliest infectious diseases, and in South Africa, it contributes a significant burden to the country's health care system\. This paper presents an experimental study on the development of a domain\-specific Large Language Model \(DS\-LLM\) for TB care that can help to alleviate the burden on patients and healthcare providers\. To achieve this, a literature review was conducted to understand current LLM development strategies, specifically in the medical domain\. Thereafter, data were collected from South African TB guidelines, selected TB literature, and existing benchmark medical datasets\. We performed LLM fine\-tuning by using the Quantised Low\-Rank Adaptation \(QLoRA\) algorithm on a medical LLM \(BioMistral\-7B\), and also implemented Retrieval\-Augmented Generation using GraphRAG\. The developed DS\-LLM was evaluated against the base BioMistral\-7B model and a general\-purpose LLM using a mix of automated metrics and quantitative ratings\. The results show that the DS\-LLM had better performance compared to the base model in terms of its contextual alignment \(lexical, semantic, and knowledge\) for TB care in South Africa\. ## Submission history From: Olawande Daramola Prof\. \[[view email](https://arxiv.org/show-email/a3ae5965/2604.19776)\] **\[v1\]**Sat, 28 Mar 2026 11:22:05 UTC \(651 KB\)
Similar Articles
Locally Deployable Small Language Models for Emergency Department Decision Support: A Systematic Benchmark of Fine-Tuning Strategies
This arXiv paper benchmarks eight open-source small language models under different fine-tuning strategies for emergency department decision support, finding that LoRA-tuned SLMs can outperform commercial baselines on triage and referral tasks while remaining locally deployable.
A Multi-Domain Red Teaming Framework for Safety, Robustness, and Fairness Evaluation of Medical Large Language Models
This paper presents a multi-domain red teaming framework for evaluating safety, robustness, and fairness of medical LLMs across 690 clinically grounded scenarios. Results show that high aggregate accuracy can mask critical failures, and hybrid evaluation with clinician oversight is necessary for credible safety assessment.
Small LLMs for Biomedical Claim Verification: Cost-Effective Fine-Tuning, Structural Dataset Shortcuts, and Cross-Domain Generalization
Fine-tuning small LLMs (3B-7B) with QLoRA on biomedical claim verification achieves higher F1 than GPT-4o and GPT-5 at 44.5x lower cost, and reveals a structural artifact in SciFact. The study demonstrates robust cross-domain transfer when training on structurally sound data.
Bridging the English-Arabic Medical Knowledge Gap: Targeted Low-Rank Adaptation via Causal Layer Selection
This paper investigates why LLMs underperform in Arabic medical tasks, showing via mechanistic analysis that knowledge exists internally but fails to surface, then proposes TLoRA, a targeted low-rank adaptation method that outperforms full-network LoRA on medical QA and introduces a new Arabic clinical dialogue benchmark.
Reinforcement Learning for Evidence-Seeking Diagnostic Reasoning with Large Language Models
This paper proposes a reinforcement learning framework for evidence-seeking diagnostic reasoning using LLMs. The RL-trained 7B model outperforms larger models in multilingual clinical consultation tasks, showing that specialized RL can distill high-level clinical reasoning.