question-answering

Tag

Cards List
#question-answering

TalentRL: Strategy-Guided Reinforcement Learning for Hierarchical Skill Routing

arXiv cs.LG ↗ · 2026-11-02 Cached

Microsoft AI introduces TalentRL, a strategy-guided reinforcement learning framework for hierarchical routing over procedural memory in LLM agents, where coarse-grained 'talents' guide selection of fine-grained skills. It improves success rates across seven QA benchmarks and achieves 99.3% on ALFWorld and 90.7 on WebShop across Qwen and Llama backbones.

0 favorites 0 likes
#question-answering

Encode Once, Answer Many: Internalizing Context via Parametric Flow

arXiv cs.AI ↗ · 2026-10-31 Cached

提出 CLIK,一个上下文条件化的参数生成器,通过单次前向传播将上下文映射为 LoRA 参数,把知识内化到模型权重中,无需测试时梯度更新,在文档问答和多轮对话上优于现有超网络方法。

0 favorites 0 likes
#question-answering

Detect Before You Disambiguate: Perturbation-Based Input Ambiguity Detection in LLMs

arXiv cs.CL ↗ · 2026-10-28 Cached

本文提出了一种基于标签保持扰动的输入歧义检测框架,先检测再消歧,包含黑盒规则库与白盒重要性引导两种检测器,在四类问答数据集上优于输出侧不确定性基线与LLM改写扰动基线。

0 favorites 0 likes
#question-answering

Each Insufficient in Its Own Way: Calibrating Language Models Across Varying Evidence States

arXiv cs.CL ↗ · 2026-10-27 Cached

提出证据状态校准(evidence-state calibration)概念与SuffiCE方法,通过微调模型下一token分布中的置信度,使其随证据变化而准确反映答对概率,在临床诊断和多跳问答上将Brier分数降低最高60%、AUROC提升最高0.16。

0 favorites 0 likes
#question-answering

GEMS-RAG: Graph-grounded Engineering Multimodal Standards Retrieval-Augmented Generation

arXiv cs.AI ↗ · 2026-10-27 Cached

GEMS-RAG 是一个面向工程标准文档的图驱动多模态检索增强生成框架,通过层级解析、视觉实体抽取、多模态知识图谱构建与图驱动混合检索,在 MUTCD 数据集上相较文本、多模态和图基 RAG 基线提升了检索与问答效果。

0 favorites 0 likes
#question-answering

MoveBench: A Rubric-Based Benchmark for Evaluating Large Language Models in Sports and Health Coaching

Hugging Face Daily Papers ↗ · 2026-10-26 Cached

MoveBench introduces the first rubric-based benchmark for evaluating large language models in sports and health coaching, covering safety, scientific validity, and personalization across multiple-choice and open-ended tasks. An evaluation of 15 LLMs on 809 questions with 5,012 rubric criteria reveals significant gaps in safety awareness and personalized program design.

0 favorites 0 likes
#question-answering

Joint Constraint Aggregation for Qualifier-Sensitive Retrieval-Augmented QA

arXiv cs.CL ↗ · 2026-10-21 Cached

论文提出联合约束聚合(JCA)方法,通过将问题要求表示为共享约束并逐一核对候选答案,缓解检索偏向导致的限定词敏感问答失败,在三种评测设置和多个指令微调模型上提升准确率。

0 favorites 0 likes
#question-answering

The Bottleneck Is Retrieval, Not Reading: Diagnosing Evidence-Based Generation with RAG for Long Context Question Answering

arXiv cs.CL ↗ · 2026-10-21 Cached

This paper introduces evidence-based generation (EBG) with a joint Ans+Evid metric and reformed benchmarks (MultiHop-RAG, QASPER-MP) to show that RAG's similarity-driven chunked retrieval—not reading—is the key bottleneck for long-context multi-hop question answering across frontier and open-weight LLMs.

0 favorites 0 likes
#question-answering

An unanswered RAG question can mean three very different things

Reddit r/AI_Agents ↗ · 2026-10-19

The author explores how RAG evaluations should distinguish three different reasons a system answers "I don't know" — retrieval failure, missing evidence, and conflicting sources — and proposes evals that label the expected unresolved state rather than just scoring answers as correct, incorrect, or refused.

0 favorites 0 likes
#question-answering

A Self-Improving Agent that Grows its Own DSL: Oracle-Free Operator Induction for Exact Question Answering

arXiv cs.AI ↗ · 2026-10-16 Cached

提出一个无奖励、无裁判、无答案键的自改进代理框架,通过双层循环在小型精确DSL上进行算子归纳,实现精确问答能力的自我扩展,并在多个领域验证其可靠性与跨模型迁移能力。

0 favorites 0 likes
#question-answering

When Reasoning Traces Conflict with Evidence: How Answer Configuration Shapes Evidence Following

arXiv cs.AI ↗ · 2026-10-16 Cached

该研究通过交叉验证证据与推理轨迹,探讨答案配置(续接自身思考 vs. 独立答案调用)如何影响模型对证据的遵循。结果表明独立调用在证据遵循上比续接高出29.9至60.6个百分点,但两者在去除轨迹后的准确率下降幅度相近,说明从轨迹中获益与顺从轨迹是两种不同属性。

0 favorites 0 likes
#question-answering

Can Visual Generation Expand What Unified Multimodal Models Know?

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

该论文提出了 Knowledge Transfer Probing (KTP) 协议,研究通过图像生成训练是否能扩展预训练统一多模态模型的知识,并引入文本对齐与图文交错对齐方法以提升文本端知识访问能力。

0 favorites 0 likes
#question-answering

JevGPT: Thinking Fast and Slow in Autonomous Research

Hugging Face Daily Papers ↗ · 2026-10-13 Cached

JevGPT: Thinking Fast and Slow in Autonomous Research 提出了一种用于自主研究的双系统架构,将快速的证据处理(系统一)与审慎的研究规划(系统二)耦合,在固定语料问答和文档排序任务上实现了领先的性能,同时比同类研究代理更快、成本更低。

0 favorites 0 likes
#question-answering

COFFEQA: Counterfactual-Guided Few-Shot Distillation for LLM Question Answering

arXiv cs.CL ↗ · 2026-10-12 Cached

提出CofFeQA,一种基于反事实样本的少样本知识蒸馏方法,用于开放域问答任务;在TriviaQA等基准上,相比仅用事实样本的蒸馏基线在T5设置下以32个少样本对提升约8.77 EM和9.98 F1分。

0 favorites 0 likes
#question-answering

GeopoliticalQA: Benchmarking Retrieval and Generation over Intelligence Reports

arXiv cs.CL ↗ · 2026-10-12 Cached

Researchers introduce GeopoliticalQA, a benchmark of 5,525 QA pairs over 415 geopolitical and strategic intelligence reports, evaluating 15 retrieval systems and six open-weight LLMs. They find mid-size encoder bge-m3 matches or beats much larger and commercial embedding models at chunk-level retrieval, while answer generation remains hard even with gold evidence for inferential and risk-oriented questions.

0 favorites 0 likes
#question-answering

Arctic Questions, Missing Answers: A Dataset and Benchmark for LLM Abstention in Arctic Science

arXiv cs.CL ↗ · 2026-10-08 Cached

ArcticQA/ArcticAbstain introduces a dataset and paired benchmark evaluating whether LLMs appropriately abstain on Arctic science multiple-choice questions, finding large baseline differences and only modest increases in abstention when correct answers are removed.

0 favorites 0 likes
#question-answering

Ontology-Grounded, Reasoner-Verified Benchmarks for Evaluating LLM Reasoning in Scientific AI

arXiv cs.AI ↗ · 2026-10-02 Cached

The paper proposes a pipeline that automatically generates ontology-grounded, reasoner-verified multiple-choice benchmarks for evaluating LLM logical reasoning in scientific AI, validated on three ontologies (Pizza, PMDco, DOID) across six LLMs.

0 favorites 0 likes
#question-answering

What Do Rationales Communicate? A Message-Intervention Study in Role-Specialized QA

arXiv cs.AI ↗ · 2026-10-02 Cached

A message-intervention study showing that rationales passed between reasoner and verifier LLMs barely improve answer accuracy but substantially alter support judgments, especially when corrupted — suggesting rationale sharing should be evaluated as a verification mechanism rather than an accuracy booster.

0 favorites 0 likes
#question-answering

Investigating the Role of Reasoning-Language Alignment in Monolingual Retrieval-Augmented Generation

Hugging Face Daily Papers ↗ · 2026-10-02 Cached

该论文研究了在单语检索增强生成(RAG)中推理语言与查询/检索文档语言对齐的作用,构建了一个基于虚构桌游世界《The DarkEye》的德语 RAG 问答测试集,发现对齐推理语言能提升表现,但仅能达到模型原生英语推理的水平。

0 favorites 0 likes
#question-answering

Halluscoring 2026: The first shared task on llms hallucination detection and answer verification

arXiv cs.CL ↗ · 2026-10-01 Cached

HalluScoring 2026 presents the first shared task on LLM hallucination detection and factual verification for Arabic question answering, with 13 teams competing across four subtasks covering binary hallucination detection and answer selection on the HalluScore and HalluTruthQA datasets.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback