Robust Summarization of Doctor-Patient Conversations: TalTech Systems for the Beyond Transcription Challenge
Summary
This paper describes TalTech's systems for generating SOAP notes directly from doctor-patient conversation audio, using Voxtral models fine-tuned with supervised learning and DAPO reinforcement learning. Their submissions ranked first in both tracks of the BeTraC challenge, achieving high concept accuracy and low hallucination rates.
View Cached Full Text
Cached at: 07/21/26, 06:44 AM
# Robust Summarization of Doctor-Patient Conversations: TalTech Systems for the Beyond Transcription Challenge Source: [https://arxiv.org/html/2607.17230](https://arxiv.org/html/2607.17230) ###### Abstract This paper describes TalTech’s submissions to the Beyond Transcription Challenge \(BeTraC\), which requires generating SOAP notes directly from long doctor\-patient conversation recordings, without intermediate transcription\. After screening open\-weight speech LLMs for long\-audio robustness, we adapted Voxtral Mini \(lightweight track\) and Voxtral Small \(heavyweight track\) with LoRA supervised fine\-tuning followed by DAPO reinforcement learning that uses the challenge metric, Open Medical Concept F1, as its reward\. Our systems ranked first in both tracks, and an independent LLM\-as\-a\-judge evaluation showed the lowest hallucination rate among all submissions, indicating that reinforcement learning against a concept\-matching metric need not compromise factual reliability\. We also find that fine\-tuning on text transcripts transfers well to speech input and appears to improve robustness on out\-of\-domain real recordings\. ## IIntroduction Clinical note generation from doctor\-patient dialogue recordings is attractive because it can reduce documentation burden without requiring a separate transcription step\. However, such systems must accurately preserve clinical facts, because hallucinated symptoms, diagnoses, or treatment plans can render an otherwise well\-written note unsafe\. The BeTraC challenge targets this setting by requiring systems to generate plain\-text medical SOAP \(subjective, objective, assessment, and plan\) notes from audio while disallowing intermediate transcription as an explicit system component\[[2](https://arxiv.org/html/2607.17230#bib.bib11)\]\. Team TalTech submitted direct audio\-to\-SOAP systems to both BeTraC tracks\. We built around Voxtral, a family of open\-weight speech understanding models with strong audio and text capabilities\[[6](https://arxiv.org/html/2607.17230#bib.bib1)\], selected after a zero\-shot study on the validation split in which Voxtral showed the best speech\-to\-summary and speech recognition behavior of the speech LLMs tested\. We then adapted Voxtral Mini for the lightweight track and Voxtral Small for the heavyweight track using supervised fine\-tuning \(SFT\) followed by DAPO reinforcement learning\. ## IIChallenge, Data, and Metrics BeTraC uses the SynthDoPaCo corpus, a fully synthetic dataset of two\-speaker doctor\-patient conversations with ambient noise, room reverberation, and compression artifacts\[[5](https://arxiv.org/html/2607.17230#bib.bib2)\]\. It contains 8,800 conversations, approximately 1,329 hours of audio, about nine minutes per conversation, split into 7,200 training and 400 validation dialogues\. The final leaderboard is based on a blind testset of 875 audio examples\. Both tracks require open\-weight models and prohibit intermediate transcripts; the lightweight track limits total model size to 6B parameters and disallows tool use or agentic pipelines, while the heavyweight track allows up to 36B parameters\. Submissions are ranked by Open Medical Concept F1, computed with MeSH keyword matching and scispaCy\-based named entity recognition; ROUGE\-2 and ROUGE\-3 F1 are secondary metrics\[[1](https://arxiv.org/html/2607.17230#bib.bib12)\]\. ## IIISelection of Base Models Before fine\-tuning, we compared several open\-weight speech\-capable LLMs on zero\-shot speech\-to\-SOAP generation and speech recognition, asking whether a model can generate the required SOAP\-note format from audio alone and process long audio robustly enough to support task\-specific fine\-tuning\. Table[I](https://arxiv.org/html/2607.17230#S3.T1)contains the results\. We also considered Phi\-4\-multimodal\-instruct \(rejected for high GPU VRAM requirements on long audio\) and Gemma\-4\-E2B/E4B \(limited to 30\-second audio inputs\)\. TABLE I:Zero\-shot summarization and ASR results of audio LLMs\.ModelC\-F1↑\\uparrowR\-2↑\\uparrowMean WER↓\\downarrowMedian WER↓\\downarrowLightweight modelsQwen2\.5\-Omni\-3B\[[9](https://arxiv.org/html/2607.17230#bib.bib7)\]0\.2600\.09239\.143\.3MOSS\-Audio\-4B\-Instruct\[[10](https://arxiv.org/html/2607.17230#bib.bib8)\]0\.3140\.14010\.02\.3Voxtral\-Mini\-3B\-2507\[[6](https://arxiv.org/html/2607.17230#bib.bib1)\]0\.3540\.1212\.51\.3Heavyweight modelsQwen2\.5\-Omni\-7B\[[9](https://arxiv.org/html/2607.17230#bib.bib7)\]0\.2640\.10741\.343\.6Voxtral\-Small\-24B\-2507\[[6](https://arxiv.org/html/2607.17230#bib.bib1)\]0\.3840\.1962\.80\.9Although BeTraC is not an ASR challenge, transcription quality was a useful diagnostic: a model that cannot reliably follow the long clinical conversation is unlikely to produce faithful SOAP notes\. Voxtral’s low validation WER and stronger zero\-shot SOAP outputs made it a clear choice for both tracks\. WER analysis also explains the other models’ weak SOAP generation: Qwen2\.5\-Omni transcribes only roughly the first five minutes of audio, while MOSS\-Audio\-4B\-Instruct’s low median but high mean WER reflects hallucination loops on some inputs\. Voxtral’s long\-audio robustness likely stems from its internal chunking of input into 30\-second segments, which bounds GPU VRAM use and allows reusing Whisper’s encoder without context\-lengthening training\. ## IVSystem Description ### IV\-ASupervised Fine\-Tuning In the SFT phase, the base model is finetuned on the provided training set with cross\-entropy loss\. Voxtral\-Mini was finetuned on speech inputs and Voxtral\-Small on normalized dialogue transcripts, with speaker turn prefixes and non\-speech event markers such as “\[sigh\]” removed\. Finetuning used LoRA with the audio encoder and audio projector of the base Voxtral model frozen, allowing both models to be trained on a single Nvidia H200 GPU \(141 GB VRAM\)\. Training used the ms\-swift toolkit\[[12](https://arxiv.org/html/2607.17230#bib.bib4)\]via a custom Voxtral plugin; hyperparameters are listed in Table[II\(a\)](https://arxiv.org/html/2607.17230#S4.T2.st1)\. After training, the LoRA adaptors were merged into the model\. TABLE II:Training hyperparameters\.\(a\)Supervised finetuning\. \(b\)Reinforcement learning\. ### IV\-BReinforcement Learning After SFT, we applied reinforcement learning with Open Medical Concept F1 as the reward and DAPO as the loss type\. DAPO is a GRPO\-family\[[8](https://arxiv.org/html/2607.17230#bib.bib6)\]refinement that improves learning efficiency and stability for long generated responses through token\-level loss aggregation and modified clipping\[[11](https://arxiv.org/html/2607.17230#bib.bib5)\]\. This suits SOAP notes, which are long enough that response\-level rewards can otherwise be diluted across many tokens\. Table[II\(b\)](https://arxiv.org/html/2607.17230#S4.T2.st2)lists the RL\-specific hyperparameters; the others match SFT\. ### IV\-CContrastive Facts\-and\-SOAP model We also explored a fact\-table\-augmented variant of the lightweight model\. For each training dialogue, DeepSeek\-V4\-Flash generated a structured table of clinically relevant facts supported by short transcript excerpts, each assigned to a SOAP\-related category\. SFT targets were then formed by concatenating the fact table with the reference SOAP note, so the fact table acts as an intermediate reasoning trace emitted by the model itself rather than a pipeline component\. In the subsequent RL stage, the reward was computed only on the SOAP\-summary portion, so the fact table shapes the model’s internal organization during supervised learning while the RL objective stays aligned with the official scoring target\. ### IV\-DResults on validation data Table[III](https://arxiv.org/html/2607.17230#S4.T3)lists model performance after the main fine\-tuning stages, comparing speech inputs to the corresponding textual transcripts\. We draw three conclusions\. First, RL gives consistent improvements over SFT, even though both stages use the same training examples\. Second, summarization capability learned from text inputs transfers to speech input with only a small decrease in performance, consistent with earlier findings on cross\-modal transfer in speech LLMs\[[7](https://arxiv.org/html/2607.17230#bib.bib9),[3](https://arxiv.org/html/2607.17230#bib.bib10)\]\. Third, speech\-input fine\-tuning adds only a small further gain over text\-input fine\-tuning, suggesting it can be omitted for larger models when training cost is the main constraint\. TABLE III:Results on validation data after finetuning\. Primary submissions inbold; contrastive lightweight model initalic bold\.ModelInput typeC\-F1R\-2R\-3Voxtral MiniSFT transcript→\\rightarrowSOAPTranscript0\.5070\.3420\.229SFT\+RL transcript→\\rightarrowSOAPTranscript0\.5550\.3710\.253SFT transcript→\\rightarrowSOAPAudio0\.4860\.3200\.210SFT\+RL transcript→\\rightarrowSOAPAudio0\.5440\.3590\.242SFT audio→\\rightarrowSOAPAudio0\.4960\.3400\.229SFT\+RL audio→\\rightarrowSOAPAudio0\.5470\.3640\.247SFT\+RL transcript→\\rightarrowFacts\+SOAPAudio0\.5400\.3620\.247Voxtral SmallSFT transcript→\\rightarrowSOAPTranscript0\.5370\.3820\.268SFT\+RL transcript→\\rightarrowSOAPTranscript0\.5760\.4090\.289SFT\+RL transcript→\\rightarrowSOAPAudio0\.5710\.4010\.282Based on these results, we selected the SFT\+RL audio→\\rightarrowSOAP model as the lightweight primary submission and the SFT\+RL transcript→\\rightarrowSOAP Voxtral Small model, applied to audio, as the heavyweight primary; the lightweight contrastive submission uses the facts\-and\-SOAP model\. ## VResults and Discussion ### V\-AOfficial test\-set results Table[IV](https://arxiv.org/html/2607.17230#S5.T4)summarizes the official automated evaluation, computed by the organizers against reference notes generated by a Kimi\-K2\-based system from the gold dialogue transcripts\[[5](https://arxiv.org/html/2607.17230#bib.bib2)\]\. The blind test set combines the SynthDoPaCo test split \(EE, 600 synthetic dialogues\), acted patient\-physician interviews from\[[4](https://arxiv.org/html/2607.17230#bib.bib3)\]\(mock, 272 scored dialogues\), and three realistic dialogues recorded for the challenge; submissions were ranked by Concept F1 on EE\. TABLE IV:Official test\-set results \(top\-3 teams per track by the ranking metric, C\-F1 on EE with 600 dialogues, plus our contrastive submission and the organizers’ baseline\)\. Mock has 272 scored dialogues, Real\. only 3; R\-2 and mean note length cover all 875 dialogues\.C\-F1↑\\uparrowTeamEEMockReal\.AllR\-2↑\\uparrowWordsLightweight trackTalTech \(ours\)0\.5430\.5050\.5340\.5310\.351297NTT\-HI\-CS0\.5400\.5110\.4870\.5310\.370290TalTech \(contrast\)0\.5260\.5100\.5490\.5210\.339306KUSLP0\.5150\.4650\.4310\.4990\.355297Heavyweight trackTalTech \(ours\)0\.5630\.5550\.6070\.5600\.395295KUSLP0\.5440\.5300\.5160\.5400\.387291NTT\-HI\-CS0\.5390\.5170\.5100\.5320\.368294Baseline \(Qwen2\.5\-Omni\-3B\)0\.2450\.2540\.2440\.2480\.080409Our primary submissions obtained the highest Concept F1 in both tracks \(0\.563 heavyweight, 0\.543 lightweight\)\. The lightweight margin over NTT\-HI\-CS is narrow \(0\.543 vs\. 0\.540\), and NTT\-HI\-CS achieves a higher ROUGE\-2, an expected side effect of our RL stage, which optimizes Concept F1 rather thannn\-gram overlap\. Both systems more than double the baseline’s Concept F1, consistent with our zero\-shot screening in Table[I](https://arxiv.org/html/2607.17230#S3.T1)\. Two observations stand out\. First, test\-set results transfer almost perfectly from validation\. The heavyweight system scores 0\.571 C\-F1 / 0\.401 R\-2 on validation audio and 0\.563 / 0\.401 on EE, the lightweight system 0\.547 / 0\.364 versus 0\.543 / 0\.366; there is essentially no generalization gap, despite using the validation split for model, checkpoint, and reward selection\. Second, model scale was not decisive, as our Voxtral Mini\-based lightweight system \(0\.543\) effectively matches the second\-best heavyweight submission \(0\.544\), and the gain from Voxtral Mini to Voxtral Small within our recipe \(\+0\.02 C\-F1\) is smaller than the gain from RL itself \(\+0\.04–0\.05 on validation\)\. ### V\-BRobustness across test domains The three test subsets probe different distances from the synthetic training distribution: EE matches it, mock contains real acted recordings, and the realistic subset genuine spontaneous ones\. Our heavyweight system degrades least among the top systems when moving from synthetic to acted audio, losing 0\.008 C\-F1 \(0\.563→\\rightarrow0\.555\) versus 0\.038 for our own lightweight primary\. A plausible contributing factor is that this model was fine\-tuned on normalized*transcripts*, with audio entering only at inference through the frozen Whisper\-initialized encoder, so fine\-tuning could not overfit to the synthetic TTS training audio; the audio\-fine\-tuned lightweight primary lacks this protection \(though model capacity is a confound\)\. The facts\-and\-SOAP contrastive submission \(Section[IV\-C](https://arxiv.org/html/2607.17230#S4.SS3)\) also holds up better under domain shift: it trails the lightweight primary in\-domain \(0\.526 vs\. 0\.543 on EE\) yet matches it on mock \(0\.510 vs\. 0\.505\) and scores higher on the realistic subset \(0\.549\); its intermediate fact\-extraction step appears likewise less tied to the synthetic domain\. On the realistic subset the heavyweight system reaches 0\.607, although with only three dialogues this is anecdotal\. ### V\-CLLM\-as\-judge evaluation TABLE V:LLM\-as\-judge scores on EE \(scale 1–5, higher better; hallucination/contradiction rates are fractions of atomic claims, lower better\) for top\-3 systems per track plus our contrastive submission\.The organizers additionally scored all submissions with an LLM\-as\-judge pipeline\[[5](https://arxiv.org/html/2607.17230#bib.bib2)\]: each note is decomposed into atomic claims that a Gemma 4 31B judge verifies against the gold transcript rather than the Kimi\-K2 reference notes, making it partially independent of the automated metrics; Table[V](https://arxiv.org/html/2607.17230#S5.T5)shows results on the ranking subset\. Our heavyweight system obtains the lowest hallucination rate of any scored submission \(0\.08% on EE\), the best coverage and conciseness in its track, and faithfulness indistinguishable from the best \(4\.80 vs\. 4\.81\); our lightweight primary achieves the highest faithfulness \(4\.71\) and coverage \(4\.49\) in its track\. This addresses the main risk of our recipe\. Optimizing Concept F1 directly with RL invites a degenerate strategy of enumerating plausible medical concepts to inflate recall, yielding long, noisy notes\. The judge scores show this did not happen\. Our notes remain average\-length \(295–297 words\), concept precision stays*above*recall \(0\.59 vs\. 0\.54, heavyweight\), and hallucination rates stay low; the F1 reward’s precision term suffices to prevent concept stuffing\. Finally, since the ranking metric matches keywords and entities against LLM\-generated references, one may ask whether it measures note quality or mere surface overlap\. Across the 21 judged submissions, system\-level Concept F1 on EE correlates strongly with judge faithfulness \(Spearmanρ=0\.91\\rho=0\.91\) and inversely with hallucination rate \(ρ=−0\.93\\rho=\-0\.93\), supporting the metric choice, though both signals ultimately derive from LLMs and per\-note agreement may be weaker\. ## VIConclusion We presented TalTech’s winning systems for both BeTraC tracks: Voxtral models adapted to direct audio\-to\-SOAP generation with LoRA SFT and DAPO RL against the challenge metric\. Zero\-shot screening for long\-audio robustness proved an effective model\-selection criterion; RL added 0\.04–0\.05 Concept F1 over SFT without inflating note length or hallucinations; transcript\-based fine\-tuning transferred to speech input and appears to help under domain shift; model scale was secondary\. Future work includes validation on real clinical recordings, mixed transcript\-audio supervision, and faithfulness\-aware rewards\. ## Acknowledgment Generative AI tools \(Anthropic Claude Fable and OpenAI GPT\-5\.5\) were used for grammar and style correction of the manuscript text\. AI was not used to write any significant part of the paper\. ## References - \[1\]\(2026\)BeTraC 2026 — evaluation metrics\.Note:https://github\.com/betrac/betrac\-metricsCited by:[§II](https://arxiv.org/html/2607.17230#S2.p2.1)\. - \[2\]\(2026\)BeTraC: Beyond Transcription Challenge\.Note:https://betrac\.github\.ioCited by:[§I](https://arxiv.org/html/2607.17230#S1.p1.1)\. - \[3\]Y\. Choi, J\. Jung, H\. Kim, H\. Nguyen, and H\. Kim\(2026\)Exploring fine\-tuning of large audio language models for spoken language understanding under limited speech data\.InProc\. ICASSP,Cited by:[§IV\-D](https://arxiv.org/html/2607.17230#S4.SS4.p1.1)\. - \[4\]F\. Fareez, T\. Parikh, C\. Wavell, S\. Shahab, M\. Chevalier, S\. Good, I\. De Blasi, R\. Rhouma, C\. McMahon, J\. Lam, T\. Lo, and C\. W\. Smith\(2022\-06\)A dataset of simulated patient\-physician medical interviews with a focus on respiratory cases\.Scientific Data9\(1\),pp\. 313\.External Links:[Document](https://dx.doi.org/10.1038/s41597-022-01423-1),[Link](https://doi.org/10.1038/s41597-022-01423-1),ISSN 2052\-4463Cited by:[§V\-A](https://arxiv.org/html/2607.17230#S5.SS1.p1.1)\. - \[5\]Y\. Labrak, D\. Grünert, S\. Baroudi, J\. Chun, P\. Cyrta, S\. Burdisso, A\. Hassoon, D\. Liu, A\. Rothschild, R\. Van Deusen, P\. Motlicek, A\. Perrault, R\. Marxer, and T\. Schaaf\(2026\)Generating synthetic doctor\-patient conversations for long\-form audio summarization\.InProc\. Interspeech,External Links:2604\.06138Cited by:[§II](https://arxiv.org/html/2607.17230#S2.p1.1),[§V\-A](https://arxiv.org/html/2607.17230#S5.SS1.p1.1),[§V\-C](https://arxiv.org/html/2607.17230#S5.SS3.p1.1)\. - \[6\]A\. H\. Liu, A\. Ehrenberg, A\. Lo, C\. Denoix, C\. Barreau, G\. Lample, J\. Delignon, K\. R\. Chandu, P\. von Platen, P\. R\. Muddireddy, S\. Gandhi, S\. Ghosh, S\. Mishra, T\. Foubert, A\. Rastogi, A\. Yang, A\. Q\. Jiang, A\. Sablayrolles, A\. Héliou, A\. Martin, A\. Agarwal, A\. Roux, A\. Darcet, A\. Mensch, B\. Bout, B\. Rozière, B\. D\. Monicault, C\. Bamford, C\. Wallenwein, C\. Renaudin, C\. Lanfranchi, D\. Dabert, D\. S\. Chaplot, D\. Mizelle, D\. de las Casas, E\. Chane\-Sane, E\. Fugier, E\. B\. Hanna, G\. Berrada, G\. Delerce, G\. Guinet, G\. Novikov, G\. Martin, H\. Jaju, J\. Ludziejewski, J\. Rute, J\. Chabran, J\. Chudnovsky, J\. Studnia, J\. Barmentlo, J\. Amar, J\. S\. Roberts, J\. Denize, K\. Saxena, K\. Yadav, K\. Khandelwal, K\. Jain, L\. R\. Lavaud, L\. Blier, L\. Zhao, L\. Martin, L\. Saulnier, L\. Gao, M\. Pellat, M\. Guillaumin, M\. Felardos, M\. Dinot, M\. Darrin, M\. Augustin, M\. Seznec, N\. Gupta, N\. Raghuraman, O\. Duchenne, P\. Wang, P\. Saffer, P\. Jacob, P\. Wambergue, P\. Kurylowicz, P\. Chagniot, P\. Stock, P\. Agrawal, R\. Delacourt, R\. Sauvestre, R\. Soletskyi, S\. Vaze, S\. Subramanian, S\. Garg, S\. Dalal, S\. Gandhi, S\. Aithal, S\. Antoniak, T\. L\. Scao, T\. Schueller, T\. Lavril, T\. Robert, T\. Wang, T\. Lacroix, T\. Bewley, V\. Nemychnikova, V\. Paltz, V\. Richard, W\. Li, W\. Marshall, X\. Zhang, Y\. Wan, and Y\. Tang\(2025\)Voxtral\.arXiv preprint arXiv:2507\.13264\.External Links:[Link](https://arxiv.org/abs/2507.13264)Cited by:[§I](https://arxiv.org/html/2607.17230#S1.p2.1),[TABLE I](https://arxiv.org/html/2607.17230#S3.T1.4.11.7.1),[TABLE I](https://arxiv.org/html/2607.17230#S3.T1.4.8.4.1)\. - \[7\]A\. Rouditchenko, S\. Bhati, E\. Araujo, S\. Thomas, H\. Kuehne, R\. Feris, and J\. Glass\(2025\)Omni\-R1: do you really need audio to fine\-tune your audio llm?\.InProc\. ASRU,External Links:[Document](https://dx.doi.org/10.1109/ASRU65441.2025.11434780)Cited by:[§IV\-D](https://arxiv.org/html/2607.17230#S4.SS4.p1.1)\. - \[8\]Z\. Shao, P\. Wang, Q\. Zhu, R\. Xu, J\. Song, X\. Bi, H\. Zhang, M\. Zhang, Y\. K\. Li, Y\. Wu, and D\. Guo\(2024\)DeepSeekMath: pushing the limits of mathematical reasoning in open language models\.arXiv preprint arXiv:2402\.03300\.Cited by:[§IV\-B](https://arxiv.org/html/2607.17230#S4.SS2.p1.1)\. - \[9\]J\. Xu, Z\. Guo, J\. He, H\. Hu, T\. He, S\. Bai, K\. Chen, J\. Wang, Y\. Fan, K\. Dang, B\. Zhang, X\. Wang, Y\. Chu, and J\. Lin\(2025\)Qwen2\.5\-Omni technical report\.arXiv preprint arXiv:2503\.20215\.Cited by:[TABLE I](https://arxiv.org/html/2607.17230#S3.T1.4.10.6.1),[TABLE I](https://arxiv.org/html/2607.17230#S3.T1.4.6.2.1)\. - \[10\]C\. Yang, C\. Yu, H\. Chen, J\. Zhu, J\. Chen, K\. Chen, W\. Wang, Y\. Wang, Y\. Jiang, Y\. Jiang, Z\. Lin, Z\. Chen, Z\. Fei, C\. Liu, J\. Zhan, K\. Yu, K\. Huang, M\. Chen, Q\. Cheng, R\. Li, S\. Li, S\. Wang, Y\. Gao, Y\. Zhang, and X\. Qiu\(2026\)MOSS\-Audio technical report\.External Links:2606\.01802,[Link](https://arxiv.org/abs/2606.01802)Cited by:[TABLE I](https://arxiv.org/html/2607.17230#S3.T1.4.7.3.1)\. - \[11\]Q\. Yu, Z\. Zhang, R\. Zhu, Y\. Yuan, X\. Zuo, Y\. Yue, W\. Dai, T\. Fan, G\. Liu, L\. Liu, X\. Liu, H\. Lin, Z\. Lin, B\. Ma, G\. Sheng, Y\. Tong, C\. Zhang, M\. Zhang, W\. Zhang, H\. Zhu, J\. Zhu, J\. Chen, J\. Chen, C\. Wang, H\. Yu, Y\. Song, X\. Wei, H\. Zhou, J\. Liu, W\. Ma, Y\. Zhang, L\. Yan, M\. Qiao, Y\. Wu, and M\. Wang\(2025\)DAPO: an open\-source llm reinforcement learning system at scale\.Advances in Neural Information Processing Systems38,pp\. 113222–113244\.Cited by:[§IV\-B](https://arxiv.org/html/2607.17230#S4.SS2.p1.1)\. - \[12\]Y\. Zhao, J\. Huang, J\. Hu, X\. Wang, Y\. Mao, D\. Zhang, Z\. Jiang, Z\. Wu, B\. Ai, A\. Wang, W\. Zhou, and Y\. Chen\(2024\)SWIFT: a scalable lightweight infrastructure for fine\-tuning\.External Links:2408\.05517,[Link](https://arxiv.org/abs/2408.05517)Cited by:[§IV\-A](https://arxiv.org/html/2607.17230#S4.SS1.p1.1)\.
Similar Articles
A Dataset of Robot-Patient and Doctor-Patient Medical Dialogues for Spoken Language Processing Tasks
This paper introduces MeDial-Speech, a dataset of robot-patient and doctor-patient medical dialogues for spoken language processing, and evaluates three LLMs on a sentence selection benchmark, finding Claude Sonnet 4 most accurate.
Synthesis and Evaluation of Long-term History-aware Medical Dialogue
This paper introduces a framework for synthesizing long-term medical dialogue datasets using LLMs, and creates MediLongChat with three benchmark tasks to evaluate healthcare agents' memory and reasoning capabilities. Experiments show that even state-of-the-art LLMs struggle with these tasks.
The Daily Dose: Workflow-Integrated Large Language Model Automation for Clinical Summarization and Trial Identification in Radiation Oncology
This paper presents The Daily Dose (TDD), an LLM-driven system for automated clinical summarization and clinical-trial identification integrated into routine radiation oncology practice, with early evaluation showing positive usability and time savings.
VoxMind: An End-to-End Agentic Spoken Dialogue System
VoxMind introduces an end-to-end spoken dialogue system with agentic capabilities, using a "Think-before-Speak" mechanism and dynamic tool management to boost task completion from 34.88% to 74.57% while preserving conversational quality.
Improving Medical Communication using Rubric-Guided Counterfactual Recommendations
This paper introduces an LM-guided counterfactual recommendation pipeline for improving doctor-patient communication in text-based telemedicine. It identifies interpretable features like tone and actionability, and suggests minimal changes that increase positive patient feedback without altering medical content, achieving a mean 6.41% gain in predicted positive feedback.