nli

Tag

Cards List
#nli

HeRE: A Novel Benchmark for Hebrew Relation Extraction via LLM-Guided Denoising of Knowledge Graph Alignments

arXiv cs.CL ↗ · 4d ago Cached

论文提出 HeRE,一个通过 LLM 引导的知识图谱对齐去噪构建的希伯来语关系抽取基准与 150 万条银标数据集,并提出可推广至其他低资源语言的可复现流水线。研究发现多语言模型在少样本场景优于特定语言模型,而 Gemma-4-31B-it (F1=0.915) 已接近 GPT-5.4 (0.921) 的表现。

0 favorites 0 likes
#nli

How Many Humans Is a Judge Panel Worth?

arXiv cs.CL ↗ · 2026-09-21 Cached

This paper introduces methods to quantify how effectively a panel of language models approximates human judgments, using spectral diversity and distribution recovery metrics to measure effective representation.

0 favorites 0 likes
#nli

The Imperfective Paradox Is Not Necessarily in Large Language Models: A Benchmark Failure Before a Model Failure

arXiv cs.CL ↗ · 2026-08-27 Cached

This paper reevaluates the imperfective paradox benchmark for large language models, identifying conceptual and evaluation mis-specifications, and introduces lexically matched minimal pairs to reveal sufficiency bias in models' semantic reasoning.

0 favorites 0 likes
#nli

Selection Shapes the Boundary: A Preregistered Replication of Monotonicity and Label Agreement in Unselected NLI Populations

arXiv cs.CL ↗ · 2026-07-22 Cached

This preregistered replication tests whether the monotonicity effect on label agreement in NLI generalizes from selected low-agreement items to unselected populations, finding that the effect reverses and is small, suggesting the earlier finding was conditional on selection.

0 favorites 0 likes
#nli

RLearner-LLM: Balancing Logical Grounding and Fluency in Large Language Models via Hybrid Direct Preference Optimization

arXiv cs.CL ↗ · 2026-07-20 Cached

This paper introduces RLearner-LLM, a framework using Hybrid-DPO to balance logical correctness and fluency in LLM-generated explanations, achieving significant NLI entailment improvements across multiple domains and base models while mitigating the verbosity bias of standard preference signals.

0 favorites 0 likes
#nli

How Much Human Label Variation Does Formal Semantic Structure Explain?: Group-Level Effects and Item-Level Ceilings in NLI

arXiv cs.CL ↗ · 2026-07-20 Cached

This paper measures how much formal semantic structure explains human label variation in natural language inference (NLI) using ChaosNLI data, finding group-level effects on entropy but item-level ceilings and null composition effects.

0 favorites 0 likes
#nli

ProvenanceGuard: Source-Aware Factuality Verification for MCP-Based LLM Agents

arXiv cs.AI ↗ · 2026-06-17 Cached

ProvenanceGuard是一种用于MCP驱动的LLM代理的源感知事实性验证器,它通过分解回答为原子声明、路由到特定源证据、检查支持并验证归因,解决了跨源混淆问题。在医疗领域的评估中,它达到了0.802的块F1和0.858的源准确率。

0 favorites 0 likes
#nli

StepGap: A Hybrid NLI-LLM Checker for Step-Level Evidence-Gap Detectionin Multi-Hop Question Answering

arXiv cs.CL ↗ · 2026-05-26 Cached

StepGap is a hybrid NLI-LLM decision tree that detects step-level evidence gaps in multi-hop QA, labeling them as Contradicted Claim, Irrelevant Evidence, or Missing Bridge. It achieves competitive F1 while providing a decomposable structure that improves downstream QA performance when used as a process reward for reinforcement learning.

0 favorites 0 likes
#nli

Bridging Legal Interpretation and Formal Logic: Faithfulness, Assumption, and the Future of AI Legal Reasoning

arXiv cs.AI ↗ · 2026-05-15 Cached

This paper identifies a systematic gap between legal interpretation and formal logic in AI legal reasoning, proposes a neuro-symbolic approach to bridge it, and demonstrates substantial label shifts when re-annotating legal NLI data under strict formal entailment.

0 favorites 0 likes
← Back to home

Submit Feedback