robustness

Tag

Cards List
#robustness

Towards Robust Federated Multimodal Graph Learning under Modality Heterogeneity

arXiv cs.LG ↗ · 2026-05-14 Cached

This paper proposes FedMPO, a robust federated multimodal graph learning method that addresses modality heterogeneity and missing modalities through topology-aware cross-modal generation, missing-aware expert routing, and reliability-aware aggregation, achieving performance gains on multiple datasets.

0 favorites 0 likes
#robustness

Beyond Cooperative Simulators: Generating Realistic User Personas for Robust Evaluation of LLM Agents

arXiv cs.AI ↗ · 2026-05-14 Cached

Introduces Persona Policies (PPol), a plug-and-play control layer that uses LLM-driven evolutionary program search to generate diverse, human-like user personas for evaluating LLM agents. Achieves 33–62% fitness gains over baseline, with human-likeness rated at 80.4%, and improves agent robustness with +17% task success.

0 favorites 0 likes
#robustness

Think Twice, Act Once: Verifier-Guided Action Selection For Embodied Agents

arXiv cs.AI ↗ · 2026-05-14 Cached

Proposes VeGAS, a test-time framework for MLLM-based embodied agents that samples multiple candidate actions and uses a generative verifier to select the most reliable, achieving up to 36% relative improvement over CoT baselines on challenging tasks.

0 favorites 0 likes
#robustness

SAGE: Scalable Automated Robustness Augmentation for LLM Knowledge Evaluation

arXiv cs.CL ↗ · 2026-05-13 Cached

This paper introduces SAGE, a framework for scalable automated robustness augmentation of LLM knowledge evaluation benchmarks. It uses fine-tuned smaller models with reinforcement learning to generate and verify question variants at a lower cost than existing methods.

0 favorites 0 likes
#robustness

Robust Biomedical Publication Type and Study Design Classification with Knowledge-Guided Perturbations

arXiv cs.CL ↗ · 2026-05-13 Cached

This paper presents a robust evaluation framework and training strategies for biomedical publication type and study design classification, using knowledge-guided perturbations to mitigate reliance on spurious features.

0 favorites 0 likes
#robustness

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

Hugging Face Daily Papers ↗ · 2026-05-13 Cached

EVA-Bench introduces a comprehensive end-to-end framework for evaluating voice agents, simulating realistic multi-turn conversations and measuring performance across voice-specific failure modes with novel accuracy (EVA-A) and experience (EVA-X) metrics. The benchmark includes 213 scenarios across enterprise domains and a perturbation suite for accent and noise robustness, revealing substantial gaps in current systems.

0 favorites 0 likes
#robustness

Context Training with Active Information Seeking

Hugging Face Daily Papers ↗ · 2026-05-13 Cached

This paper introduces a context optimization method that uses active information seeking via Wikipedia search and browser tools, combined with a search-based training procedure, to achieve robust performance improvements across diverse domains without updating model weights.

0 favorites 0 likes
#robustness

Sanity Checks for Long-Form Hallucination Detection

arXiv cs.CL ↗ · 2026-05-12 Cached

This paper introduces a controlled-invariance methodology and two oracle tests (Force and Remove) to determine if LLM hallucination detectors rely on reasoning traces or final answer artifacts. It proposes TRACT, a lightweight scorer using lexical features, which demonstrates robust performance independent of answer-level cues.

0 favorites 0 likes
#robustness

Robustness of Refugee-Matching Gains to Off-Policy Evaluation Choices

arXiv cs.LG ↗ · 2026-05-11 Cached

This paper demonstrates the robustness of refugee matching impact evaluations using off-policy methods like IPW and AIPW, confirming previous findings on algorithmic refugee assignment.

0 favorites 0 likes
#robustness

Reinforcing Multimodal Reasoning Against Visual Degradation

Hugging Face Daily Papers ↗ · 2026-05-10 Cached

This paper introduces ROMA, an RL fine-tuning framework that enhances the robustness of multimodal large language models against visual degradations like blur and compression artifacts. It achieves this through a dual-forward-pass strategy and specialized regularization techniques, improving performance on reasoning benchmarks without sacrificing accuracy on clean inputs.

0 favorites 0 likes
#robustness

Robustness of Graph Self-Supervised Learning to Real-World Noise: A Case Study on Text-Driven Biomedical Graphs

arXiv cs.LG ↗ · 2026-05-08 Cached

This paper introduces NATD-GSSL, a framework evaluating the robustness of Graph Self-Supervised Learning on noisy, text-driven biomedical graphs. It demonstrates that certain GNN architectures and pretext tasks maintain performance despite real-world noise, offering practical guidance for unsupervised learning in imperfect datasets.

0 favorites 0 likes
#robustness

Chainwash: Multi-Step Rewriting Attacks on Diffusion Language Model Watermarks

arXiv cs.CL ↗ · 2026-05-08 Cached

This research paper introduces Chainwash, a multi-step rewriting attack that effectively removes statistical watermarks from diffusion language model (LLaDA-8B-Instruct) outputs, reducing detection rates from 87.9% to 4.86% after five chained rewrites.

0 favorites 0 likes
#robustness

Are We Making Progress in Multimodal Domain Generalization? A Comprehensive Benchmark Study

Hugging Face Daily Papers ↗ · 2026-05-07 Cached

This paper introduces MMDG-Bench, a unified benchmark for multimodal domain generalization that reveals limited progress in current methods and significant robustness challenges across diverse tasks.

0 favorites 0 likes
#robustness

Experiments or Outcomes? Probing Scientific Feasibility in Large Language Models

arXiv cs.CL ↗ · 2026-04-22 Cached

UMBC researchers show LLMs judge scientific claim feasibility better when given outcome data than experiment descriptions, and that incomplete experimental context can hurt accuracy.

0 favorites 0 likes
#robustness

When Informal Text Breaks NLI: Tokenization Failure, Distribution Shift, and Targeted Mitigations

arXiv cs.CL ↗ · 2026-04-21 Cached

This paper investigates how informal text (slang, emoji, Gen-Z filler tokens) degrades NLI accuracy in ELECTRA-small and RoBERTa-large models, identifying two distinct failure mechanisms—tokenization failure (emoji mapped to [UNK]) and distribution shift (out-of-domain noise tokens)—and proposes targeted mitigations that recover accuracy without harming clean-text performance.

0 favorites 0 likes
#robustness

Measuring Representation Robustness in Large Language Models for Geometry

arXiv cs.CL ↗ · 2026-04-21 Cached

Researchers introduce GeoRepEval, a framework to evaluate LLM robustness across equivalent geometric problem representations (Euclidean, coordinate, vector). Testing 11 LLMs on 158 geometry problems, they find accuracy gaps up to 14 percentage points based solely on representation choice, with vector formulations being a consistent failure point.

0 favorites 0 likes
#robustness

On the Robustness of LLM-Based Dense Retrievers: A Systematic Analysis of Generalizability and Stability

Hugging Face Daily Papers ↗ · 2026-04-17 Cached

Systematic study shows LLM-based dense retrievers outperform BERT baselines on typos and poisoning but remain vulnerable to semantic perturbations, with embedding geometry predicting robustness.

0 favorites 0 likes
#robustness

stable-worldmodel-v1: Reproducible World Modeling Research and Evaluation

Papers with Code Trending ↗ · 2026-02-09 Cached

Stable-Worldmodel (SWM) is a modular and standardized research framework for developing and evaluating world models, designed to improve reproducibility and support robustness and continual learning research.

0 favorites 0 likes
#robustness

The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

OpenAI Blog ↗ · 2024-04-19 Cached

OpenAI proposes an instruction hierarchy approach to defend LLMs against prompt injection and jailbreak attacks by training models to prioritize system instructions over user inputs. The method significantly improves robustness without degrading standard capabilities.

0 favorites 0 likes
#robustness

Robust adversarial inputs

OpenAI Blog ↗ · 2017-07-17

Researchers demonstrated adversarial images that reliably fool neural network classifiers across multiple scales and perspectives, challenging assumptions about the robustness of multi-scale image capture systems used in autonomous vehicles.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback