Tag
This paper introduces Feature Sufficiency Analysis (FSA), a framework to determine whether a subset of clinical features is sufficient for AI model predictions, with case studies in postoperative ventilation and mortality prediction.
LongMedBench is a new benchmark for evaluating LLM-based medical agents on long-horizon clinical decision-making using real EHR data from MIMIC-IV. It includes 335 patients with multiple visits and proposes evaluation suites for fact-based QA, temporal reasoning, and long-horizon decision-making.
This paper introduces xAARA, an uncertainty-aware multi-expert fusion engine that augments clinical assessment of stroke rehabilitation by providing calibrated uncertainty and interpretable explanations, achieving high accuracy and reducing predictive uncertainty in movement quality evaluation.
ClinicalMC is a benchmark designed to evaluate large language models in multi-course clinical decision-making, featuring datasets in Chinese and English and a multi-agent evaluation framework.
This study examines how AI raters (LLMs) score clinical AI outputs under different protocols in complex type 2 diabetes pharmacotherapy, finding that rubric-anchored scoring provides greater discriminative power than rubric-free scoring.
Researchers introduce MedSP1000, a 1,638-case interactive benchmark derived from standardized patient scenarios to evaluate LLMs as dynamic clinical agents across multi-turn encounters. Results show even the best model (GPT-5.5) completes only 60.4% of expert rubric items, suggesting current LLMs are not yet reliable enough for clinical practice.
EHRBench is an automated and reliable benchmark for evaluating LLMs on clinical decision-making tasks using real-world electronic health records, covering nearly 1M QA items across diagnosis, treatment, and prognosis tasks.