robustness

Tag

Cards List
#robustness

A Missing Piece for Trustworthy AI Reviewers: From Benchmarking Rhetorical Robustness to SciCore Review

arXiv cs.CL ↗ · 2026-10-01 Cached

The paper introduces Rhetorical Robustness as an evaluation target for AI scientific reviewers, proposes the RobustReview benchmark with 1,260 manuscript versions, and presents SciCore, a dual-branch reviewer that combines full-manuscript assessment with a science-core-extracted judgment to improve stability while maintaining human alignment.

0 favorites 0 likes
#robustness

Sense and Sensitivity: Benchmarking LLM Clinical Triage Recommendations with Physician Experts

arXiv cs.AI ↗ · 2026-10-01 Cached

MIT researchers introduce a benchmark of 6,000+ clinical scenarios and 7,000 physician annotations showing that LLMs recommend more unnecessary care than physicians and are more sensitive to gender and tone perturbations in triage settings.

0 favorites 0 likes
#robustness

Generalization Is Stability, Not Accuracy: Multi-Axis Evaluation of LLMs

Hugging Face Daily Papers ↗ · 2026-10-01 Cached

该论文提出 Stability-Aware Generalization Objective(SAGO)框架,主张 LLM 的泛化应评估为稳定性而非准确率,通过生成一致性、内部激活、置信度和响应镜像等多维度变异测量揭示了现有模型普遍存在且与排名相关的泛化不稳定问题。

0 favorites 0 likes
#robustness

Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions

arXiv cs.CL ↗ · 2026-09-30 Cached

BreakingWeb is a benchmark framework from Amazon and Duke that constructs challenging browser-use tasks via controlled, deterministic environment interventions on tasks agents already solve, cutting agent pass rates by 22.9% while humans lose only 10.0%, revealing widespread 'belief failure' where agents falsely declare success.

0 favorites 0 likes
#robustness

Evaluating the Effects of Prompt Perturbation on Bias and Hallucination in Large Language Models

arXiv cs.CL ↗ · 2026-09-30 Cached

This arXiv paper evaluates how prompt perturbations affect bias and hallucination in LLMs used for decision-making tasks, finding that perturbations can mitigate these issues in some models, with Claude 3 outperforming GPT-3.5 across most datasets.

0 favorites 0 likes
#robustness

Representational Simplicity and Circuit Size Dissociate in a Threshold-Dependent Way: A Controlled Test via Adversarial Training

arXiv cs.AI ↗ · 2026-09-30 Cached

This preprint uses adversarial training as a controlled instrument on GPT-2 Small to test whether representational simplicity (SAE decomposability, concentrated attribution) implies causal circuit simplicity. It finds that robust models are more SAE-decomposable, while circuit size is regime-dependent: robustness helps at high faithfulness levels (90-95%) but not below 85%.

0 favorites 0 likes
#robustness

Reliability-aware Cross-sample Enhancement for Robust Multimodal Sentiment Analysis

arXiv cs.LG ↗ · 2026-09-29 Cached

The paper introduces a Reliability-aware Cross-sample Enhancement (RCE) framework for robust multimodal sentiment analysis, addressing noise and missing modalities through adaptive information bottleneck and cross-sample enhancement, demonstrating superior performance across various settings.

0 favorites 0 likes
#robustness

Auditing System-1 Models on Biosecurity-Relevant Benchmarks: Calibration, Selective Prediction, and Permutation Instability in a Non-Generative Model

arXiv cs.LG ↗ · 2026-09-29 Cached

This paper audits a non-generative 'System-1' model on biosecurity-relevant benchmarks, measuring accuracy, calibration, and sensitivity to answer option order, with implications for AI safety pipelines.

0 favorites 0 likes
#robustness

Parameters vs. Context: TRACE Fine-Tuning for Robust Retrieval-Augmented Generation

arXiv cs.LG ↗ · 2026-09-29 Cached

This paper proposes TRACE, a fine-tuning framework for Retrieval-Augmented Generation (RAG) that uses multi-agent debate traces and answer completeness regularization to handle knowledge conflicts, improving robustness against misleading context and reducing incomplete answers.

0 favorites 0 likes
#robustness

It's Not What the Image Shows: Irrelevant Context Destabilises VLM Judges Without Informing Them

Hugging Face Daily Papers ↗ · 2026-09-29 Cached

论文提出 MIST(Misleading Image Stress Test)基准,测试 13 个 VLM judge 在存在对齐、误导或缺失图像时标签的稳定性,发现图像是否出现而非图像内容才是改变判断的主要因素,说明可替代性结论对评测配置同样敏感。

0 favorites 0 likes
#robustness

Where a Model Sends Its Own Repeated Token

arXiv cs.CL ↗ · 2026-09-28 Cached

This paper investigates black-box model identification by using a repeated token as degenerate input to map token destinations, showing that non-fixed-point tokens can accurately distinguish model families and measuring robustness across quantization levels.

0 favorites 0 likes
#robustness

Backbone-Adaptive Evidence Routing for Robust Pairwise LLM Judging

arXiv cs.AI ↗ · 2026-09-28 Cached

BAER introduces a backbone-adaptive evidence routing method for robust pairwise LLM judging, achieving higher accuracy across benchmarks by dynamically selecting evidence mechanisms per condition.

0 favorites 0 likes
#robustness

BaRe-Mem: Bayesian Reliability Memory for Robust and Adaptive Agent Consultation

Hugging Face Daily Papers ↗ · 2026-09-28 Cached

BaRe-Mem introduces a Bayesian online reliability memory for multi-agent consultation, enhancing robustness against misleading advisor information and guiding the choice between consultation and autonomous reasoning.

0 favorites 0 likes
#robustness

Upholding Robustness in Federated Learning: Trends, Emerging Strategies, and Research Opportunities

arXiv cs.LG ↗ · 2026-09-25 Cached

This paper provides a comprehensive survey of robustness in federated learning, covering threat models, aggregation strategies, defensive tactics, and future research directions.

0 favorites 0 likes
#robustness

Learning When Not to Listen: Selective Anti-Interference Pretraining for Language Models

arXiv cs.CL ↗ · 2026-09-24 Cached

SPAR is a pretraining objective that uses a gated KL loss to stabilize language model predictions against irrelevant prefix text, improving robustness in long-context scenarios as demonstrated on multiple benchmarks.

0 favorites 0 likes
#robustness

CAVEAT: Towards Robust Computer-Use Agents in Incentive-Misaligned Environments

arXiv cs.AI ↗ · 2026-09-24 Cached

This paper introduces CAVEAT, a benchmark for evaluating computer-use agents in incentive-misaligned environments, revealing that agents often fail to preserve user objectives and proposes interventions to improve robustness.

0 favorites 0 likes
#robustness

Hallucination-R1: Robustness-Oriented Paraphrase Generation for Factual Consistency

arXiv cs.CL ↗ · 2026-09-21 Cached

This paper introduces Hallucination-R1, a robustness-oriented paraphrase generation framework designed to identify and improve factual consistency in large language models by creating semantically equivalent yet challenging paraphrases.

0 favorites 0 likes
#robustness

MME-Safety: A Fine-grained Benchmark for Safety Evaluation of MLLMs

arXiv cs.CL ↗ · 2026-09-21 Cached

MME-Safety is a rigorously verified benchmark for evaluating the safety of Multimodal Large Language Models, featuring a four-dimensional annotation schema and a hierarchical framework to assess risk scenarios, harm severity, and modality-specific stealth levels.

0 favorites 0 likes
#robustness

Contagion on the Trading Floor: How Adversarial Signals Spread in Multi-Agent Trading Systems

arXiv cs.AI ↗ · 2026-09-18 Cached

This paper introduces the Generic Multi-Agent Trading System (GMATS) framework to study adversarial attacks on LLM-based trading systems, showing that even simple input attacks can degrade performance but robust system designs can improve robustness.

0 favorites 0 likes
#robustness

SAM-on-the-Curve: Sharpness-Aware Mode Connectivity for Robust Weight-Space Interpolation

arXiv cs.LG ↗ · 2026-09-17 Cached

The paper introduces Sharp Mode Connectivity (SMC) to enhance the robustness of weight-space interpolation in neural networks by optimizing for flatness along entire paths, achieving significant accuracy improvements under distribution shifts.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback