ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoning

Hugging Face Daily Papers Papers

Summary

ClinSeekAgent is an automated agentic framework that enables large language models to actively acquire and synthesize multimodal clinical evidence from raw data sources, improving decision-making accuracy in both text-only and multimodal tasks. It introduces the ClinSeek-Bench benchmark and a distilled model ClinSeek-35B-A3B that achieves strong performance on agentic clinical reasoning.

Large language models (LLMs) and agentic systems have shown promise for clinical decision support, but existing works largely assume that evidence has already been curated and handed to the model. Real-world clinical workflows instead require agents to actively seek, iteratively plan, and synthesize multimodal evidence from heterogeneous sources. In this paper, we introduce ClinSeekAgent, an automated agentic framework for dynamic multimodal evidence seeking that shifts the paradigm from passive evidence consumption to active evidence acquisition. Given only a clinical query and access to raw data sources, ClinSeekAgent gathers evidence by querying medical knowledge bases, navigating raw EHRs, and invoking medical imaging tools; refines its hypotheses as new information emerges; and integrates the collected evidence into grounded clinical decisions. ClinSeekAgent serves both as an inference-time agent for frontier LLMs and as a training-time pipeline for distilling high-quality agent trajectories into compact open-source models. To validate its inference-time effectiveness, we construct ClinSeek-Bench, which pairs Curated Input reasoning from fixed pre-selected evidence with Automated Evidence-Seeking over raw clinical data. On text-only EHR tasks, ClinSeekAgent improves Claude Opus 4.6 from 60.0 to 63.2 overall F1 and MiniMax M2.5 from 43.1 to 47.3, with positive risk-prediction gains in 7 out of 9 evaluated host models. On multimodal tasks, ClinSeekAgent improves Claude Opus 4.6 from 47.5 to 62.6 (+15.1); all evaluated models improve across the three CXR-related task groups. We further validate ClinSeekAgent as a training pipeline by distilling agentic evidence-seeking trajectories into ClinSeek-35B-A3B, which achieves 34.0 average F1 on existing AgentEHR-Bench, improving over its Qwen3.5-35B-A3B baseline by +11.9 points and approaching Claude Opus 4.6.
Original Article
View Cached Full Text

Cached at: 05/22/26, 06:23 AM

Paper page - ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoning

Source: https://huggingface.co/papers/2605.20176

Abstract

ClinSeekAgent is an automated agentic framework that enables large language models to actively acquire and synthesize multimodal clinical evidence from raw data sources, improving decision-making accuracy in both text-only and multimodal tasks.

Large language models(LLMs) andagentic systemshave shown promise forclinical decision support, but existing works largely assume that evidence has already been curated and handed to the model. Real-world clinical workflows instead require agents to actively seek, iteratively plan, and synthesize multimodal evidence from heterogeneous sources. In this paper, we introduce ClinSeekAgent, anautomated agentic frameworkfor dynamicmultimodal evidence seekingthat shifts the paradigm from passive evidence consumption to active evidence acquisition. Given only a clinical query and access to raw data sources, ClinSeekAgent gathers evidence by queryingmedical knowledge bases, navigating raw EHRs, and invokingmedical imaging tools; refines its hypotheses as new information emerges; and integrates the collected evidence intogrounded clinical decisions. ClinSeekAgent serves both as aninference-time agentfor frontier LLMs and as atraining-time pipelinefor distilling high-qualityagent trajectoriesintocompact open-source models. To validate its inference-time effectiveness, we constructClinSeek-Bench, which pairs Curated Input reasoning from fixed pre-selected evidence with Automated Evidence-Seeking over raw clinical data. On text-only EHR tasks, ClinSeekAgent improves Claude Opus 4.6 from 60.0 to 63.2 overall F1 and MiniMax M2.5 from 43.1 to 47.3, with positive risk-prediction gains in 7 out of 9 evaluated host models. On multimodal tasks, ClinSeekAgent improves Claude Opus 4.6 from 47.5 to 62.6 (+15.1); all evaluated models improve across the three CXR-related task groups. We further validate ClinSeekAgent as a training pipeline by distilling agentic evidence-seeking trajectories into ClinSeek-35B-A3B, which achieves 34.0 average F1 on existingAgentEHR-Bench, improving over its Qwen3.5-35B-A3B baseline by +11.9 points and approaching Claude Opus 4.6.

View arXiv pageView PDFProject pageGitHub3Add to collection

Get this paper in your agent:

hf papers read 2605\.20176

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper1

#### UCSC-VLAA/ClinSeek-35B-A3B Text Generation• 35B• Updated1 day ago • 44

Datasets citing this paper1

#### UCSC-VLAA/ClinSeek-Bench Viewer• Updated1 day ago • 2.79k • 26

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2605.20176 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

Apriel Voice 27B Preview: An Open Model for Speech, Reasoning, and Tool Use

arXiv cs.CL

Apriel Voice 27B Preview 是一个开源语音-语言模型,基于 Gemma 4 26B-A4B 后训练检查点构建,通过两阶段训练将语音理解、推理与工具调用统一到共享推理骨干中,并在 Big Bench Audio、Speech-BFCL 和 τ-Voice 等基准上取得有竞争力的成绩。

DecisionRank: On-Policy Distillation for Decision-Model Rerankers

arXiv cs.CL

Meta's DecisionRank paper introduces item-space on-policy distillation to transfer a generative LLM teacher's ranking knowledge into a single-token decision-model reranker, achieving state-of-the-art results on TREC DL, BEIR, and BRIGHT while running up to 24.5x faster than its generative counterpart and surpassing its 27B teacher at just 1.7B parameters.

PersonaChatBench: Evaluating Chat Assistants with Diverse Simulated Users

arXiv cs.CL

The paper introduces PersonaChatBench, a framework that evaluates 20 language models across six domains by pairing fixed tasks with diverse simulated users guided by private persona cards, measuring task outcomes, persona need fulfillment, and simulator fidelity. Results show that strong task performance does not consistently translate into satisfying individual user needs, with model strengths varying across personas and domains.