Tag
This paper proposes a method for curating a Cardiology Interface Terminology (CIT) to highlight details in electronic health record notes using a machine learning technique. The approach involves three phases, including deriving training data and training an ML model to identify candidate concepts, achieving high completeness and coverage on test data.
This paper presents a deployment-focused study comparing LoRA fine-tuning of 24 model variants (270M–8B parameters) for merchant information extraction from financial transaction strings. The authors find that smaller models like Qwen 3.5 4B achieve 96.6% F1, within 0.35 points of the 8B baseline, while offering significant reductions in latency and cost.
Introduces UniQL, a human-verified executable benchmark for cross-dialect text-to-SQL evaluation, addressing the lack of dialect diversity in existing benchmarks like Spider and BIRD.
This paper evaluates the open-weight LLM LLaMA 3.1 for automatic extraction of structured data from Dutch brain MRI reports, achieving high performance on visual rating scores and accurate detection of findings, with few-shot prompting improving extraction of numerical variables.
UrduMMLU is a new benchmark of 26,431 multiple-choice questions across 26 subjects for evaluating LLMs on Urdu language understanding, sourced from native educational materials. Evaluation of 30 LLMs reveals Gemini-3.5-Flash performs best, while open-source models and region-specific subjects pose significant challenges.
This paper introduces a four-condition diagnostic protocol to separate no-evidence answerability, oracle-evidence recoverability, full-context utilization, and retrieval-conditioned utilization in long-context and retrieval-augmented language models, tested on five open-weight models across multiple datasets.
This paper compares joint and stepwise approaches for estimating learning under competing cognitive diagnostic models, using data from reading games. It shows that the choice of approach can change conclusions about learner progress, and joint analysis is more reliable when item-skill structure is uncertain.
Recommends the 'NLP Zero to Hero' YouTube playlist as a structured course map for learning natural language processing, covering topics from tokenization to LSTM.
Introduces GATE (Grounding After Test from Execution), a method that bootstraps missing semantic groundings from execution feedback to handle under-specified user phrases in text-to-SQL tasks, consistently improving over strong baselines.
This paper investigates how LLMs rely on morphological cues (affixes) to make pharmacological inferences, demonstrating that models can confidently generate plausible content for fictitious drug names based solely on affix heuristics, which poses a subtle safety risk.
Proposes a non-autoregressive scoring method for punctuation restoration in streaming ASR that preserves the input transcript and outperforms prompt-based and fine-tuned baselines under a limited lookahead budget.
SANE is a novel schema-aware evaluation paradigm for natural-language (text-to-SQL) querying of biological/pharmacological datasets, enabling automatic benchmark generation tied to real experimental schemas. The study shows that few-shot LLMs with structured prompting can achieve accurate SQL generation without fine-tuning, with most failures stemming from ambiguous inputs rather than incorrect query generation.
This paper examines the integration of multi-modal clinical data, including treatment records, pathology reports, and clinician notes, using rule-based extraction and machine learning to improve breast cancer recurrence prediction compared to single-modal approaches.
Introduces Padyam2Gadyam, a dataset for translating 13th-17th century Telugu classical poetry into modern Telugu and English prose, and evaluates five LLMs on the task.
IdiomX is a large-scale multilingual benchmark for idiom understanding, retrieval, and interpretation, containing over 190K examples across English, Arabic, and French, with four tasks for evaluating language models on idiomatic expressions.
This paper reexamines the role of temperature in large language model distillation, revealing that temperature asymmetrically benefits forward KL divergence over reverse KL, allowing simple KL methods to match state-of-the-art distillation approaches at higher temperatures.
This article evaluates the integration of data from the French syntactic lexicon Lexicon-Grammar into a probabilistic parser, using word clustering methods on verbs to improve parsing accuracy for French.
This paper explores which agreement statistics for LLM judge validation are redundant when criteria are binary, and provides a checklist for proper reporting including abstention handling.
An analysis of half-duplex vs full-duplex architecture in AI voice models, discussing key features like overlap, backchannels, and barge-in that make voice agents sound robotic.
CobSeg is a multi-branch architecture for dialogue topic segmentation that models coherence boundaries and improves lexical transition detection, outperforming prior non-LLM approaches on multiple benchmarks.