Tag
Sumi is a 7B uniform diffusion language model pretrained from scratch on 1.5T tokens, achieving competitive performance on knowledge and reasoning tasks while being fully open-source with released weights and training recipe.
This paper introduces the Call Playbook dataset for classifying real-world B2B conversations and proposes methods to distill examples into compact, interpretable task instructions, achieving 99% token reduction and up to 7% AUC improvement over traditional in-context learning.
This study investigates whether instruction-tuned LLMs (Llama-3.1-8B, Qwen2.5-7B, Mistral-7B, Phi-3-mini) can reliably classify Correct Information Units in aphasic discourse transcripts. Few-shot prompting yields competitive F1 scores (0.776–0.817) for three models, but performance varies by severity and human agreement remains insufficient for fully autonomous use.
Proposes CoCoGEC, a counterfactual generation framework that alters error-irrelevant contexts in GEC training data to improve model robustness, achieving significant F0.5 gains on perturbed benchmarks.
This paper introduces the task of extracting applicability conditions for therapeutic drug-disease relations from biomedical literature, creates a manually annotated dataset of triples, and proposes a LoRA-enhanced method that outperforms existing baselines.
This paper presents a computational model for analyzing coping styles in digital crisis discourse, specifically applied to the 2023 Turkiye earthquake.
This paper proposes a continual learning approach to integrate disfluency tokens into pretrained ASR models, addressing catastrophic forgetting and improving recognition of disfluent speech.
This paper proposes using data from Linguistics Olympiads to create a new corpus for linguistics research, aiming to advance the field.
Google releases Gemini-SQL2, a text-to-SQL model powered by Gemini 3.1 Pro, achieving state-of-the-art results on the BIRD benchmark for translating natural language into accurate SQL queries.
This paper presents an end-to-end hybrid framework for rumour detection in low-resource Algerian dialect social media content, achieving an F1-score of 0.84 by combining transformer embeddings with a classical classifier.
HyPE introduces a hypergraph-based persona encoder that models high-order relations among persona attributes via category-aware hyperedges and persistent edge embeddings, achieving consistent improvements over flat pooling baselines on PersonaChat across multiple backbone models.
This paper introduces NaturalFlow, a fluency-aware optimization framework that reduces disruptive pauses in simultaneous speech-to-speech translation by leveraging model-internal signals, achieving a balance between low latency and natural speech flow.
This paper proposes SafeLLM, an extraction-based approach for retrieving information from safety-critical documents, showing that line-number selection outperforms rewriting-based RAG methods in reducing hallucinations while maintaining high recall.
EDEN is a large-scale corpus of anonymized clinical notes from Italian emergency departments, with a subset manually annotated for structured information extraction. It aims to support LLM development for medical applications in Italian.
Introduces GraphInfer-Bench, a benchmark to evaluate whether LLMs can perform graph inference—producing open-ended answers about a node and its neighborhood that cannot be retrieved from a single node or path. Experiments show that even frontier LLMs lag behind plain GNNs on these tasks, revealing a capability gap.
This paper proposes an attention expansion mechanism to enhance keyphrase extraction from long documents by augmenting PLM token representations with out-of-context information, achieving consistent improvements over state-of-the-art models without requiring full-document attention or expensive LLM inference.
This paper investigates automated detection of speculative language in biomedical articles using distributed sentence representations, comparing Recursive Neural Tensor Networks and Paragraph Vectors against SVM and other baselines, finding RNTN achieves the best F1 score of 0.885.
LakeQA is a new benchmark for exploratory question answering over a million-scale data lake, evaluating multi-hop reasoning and compositionality across text, tables, and knowledge graphs.
This paper investigates sequential fine-tuning of LLaMA-3.1-8B for automated essay scoring using a curriculum aligned with discourse structure, showing improved coherence and performance compared to independent or randomized training.
A literature review examining LLM-based approaches for automatic scoring of Arabic text, covering short answer grading and essay scoring, with a proposed taxonomy and comparative analysis.