safety-critical

Tag

Cards List
#safety-critical

NEBench R1: a Reasoning Benchmark for Evaluating Nuclear Domain Competence in Large Language Models

arXiv cs.AI ↗ · 2d ago Cached

NEBench R1 introduces a reasoning-oriented benchmark of 7,546 multiple-choice questions from NRC reactor operator licensing exams to evaluate both answer accuracy and reasoning quality in LLMs, finding that six tested models ranged from 34.0% to 73.9% accuracy and that longer reasoning traces correlated with lower accuracy.

0 favorites 0 likes
#safety-critical

Avoiding the babbling-idiot failure in a time-triggered communication system

Hacker News Top ↗ · 2026-09-21

This article discusses methods to prevent the babbling-idiot failure in time-triggered communication systems, enhancing reliability and safety.

0 favorites 0 likes
#safety-critical

@aelluswamy: For those who don’t know, these robot moves are essentially remote controlled. The robot rather blindly performs those …

X AI KOLs Following ↗ · 2026-09-20 Cached

The tweet explains that robot movements are often remote-controlled and argues that AI safety for physical robots is more critical than for large language models.

0 favorites 0 likes
#safety-critical

Toward a Decision-Assurance Layer for AI-Assisted Flight Planning in Air Traffic Management

arXiv cs.AI ↗ · 2026-09-15 Cached

The paper proposes ATAL, a decision assurance framework that assesses the reliability of AI-generated outputs in air traffic management to ensure safety and operational consistency.

0 favorites 0 likes
#safety-critical

Do Agents Know When They Succeed? Calibrating Agent Confidence from Internal Representations

arXiv cs.AI ↗ · 2026-09-11 Cached

This paper introduces methods to calibrate confidence in agentic systems using internal representations, demonstrating improved performance over baselines in multi-turn benchmarks.

0 favorites 0 likes
#safety-critical

ReactHuman: A Physics-Grounded Benchmark for Human-Like Reactive Decision-Making in Embodied Multimodal LLMs

Hugging Face Daily Papers ↗ · 2026-09-09 Cached

ReactHuman is a physics-grounded benchmark that evaluates multimodal large language models for human-like reactive decision-making in simulated humanoid robots facing household hazards, revealing persistent safety failures and offering a scalable diagnostic tool.

0 favorites 0 likes
#safety-critical

Rethinking World Models for Safety-Critical Embodied Systems

arXiv cs.AI ↗ · 2026-09-04 Cached

The paper proposes a Risk-Informed World Model (RIWM) to enhance safety in critical embodied systems by prioritizing decision-relevant consequences and recovery over predictive likelihood.

0 favorites 0 likes
#safety-critical

The Power of Ten: Rules for Safety Critical Coding

Lobsters Hottest ↗ · 2026-08-27 Cached

A NASA/JPL researcher discusses the ineffectiveness of traditional coding standards and introduces 'The Power of Ten' rules to prevent defects in safety-critical software through simplicity and metrics-driven practices.

0 favorites 0 likes
#safety-critical

Agentic AI for Safety-critical Multi-drone Systems: Challenges and Opportunities

arXiv cs.AI ↗ · 2026-08-25 Cached

This position paper discusses the challenges and opportunities of integrating agentic AI into safety-critical multi-drone systems, advocating for human-centered, socio-technical design approaches to ensure trust, governance, and adoption in professional contexts.

0 favorites 0 likes
#safety-critical

Air Traffic Control Using Large Language Models: Prompt Engineering, Architecture, and Evaluation

arXiv cs.AI ↗ · 2026-08-21 Cached

An experimental study evaluating the use of large language models for air traffic control communication, showing that lighter prompts and in-context examples improve performance while highlighting limitations in error accumulation.

0 favorites 0 likes
#safety-critical

Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning

arXiv cs.AI ↗ · 2026-08-12 Cached

This paper proposes Threat-guided Policy-aware Scene Perturbation (TPSP), a method that augments online reinforcement learning for safe autonomous driving by perturbing scenes in a policy-aware, targeted manner to generate high-value safety-critical experiences. Experiments on NAVSIM v2 show improved safety learning efficiency with about 4 million kilometers of simulated driving data.

0 favorites 0 likes
#safety-critical

Short-term load forecasting under EU-AI Act Requirements in Safety-Critical Environments: Results from a 41-day live challenge on the aggregated German transmission-grid load

arXiv cs.AI ↗ · 2026-08-06 Cached

The paper presents results from a 41-day live challenge evaluating a short-term load forecasting pipeline for the aggregated German transmission-grid load, designed to meet EU AI Act requirements in safety-critical environments. The open-source spotforecast2-safe pipeline outperforms the ENTSO-E baseline and remains competitive with large foundation models.

0 favorites 0 likes
#safety-critical

Benchmarking Large Language Models on Multi-Sensor Physical Hazard Assessment

arXiv cs.AI ↗ · 2026-07-24 Cached

The paper benchmarks five large language models on multi-sensor physical hazard assessment, revealing that all tested models fail to produce precautionary warnings when multiple sensors are simultaneously elevated below their individual safety limits, while achieving near-perfect accuracy on single-sensor violations.

0 favorites 0 likes
#safety-critical

CoG-Guided Weight Correction for Fault-Tolerant Deep Neural Networks

arXiv cs.LG ↗ · 2026-07-20 Cached

Proposes a Center of Gravity guided weight correction method for fault-tolerant deep neural networks, achieving significant fault tolerance improvements on LSTM and CNN models without retraining.

0 favorites 0 likes
#safety-critical

Lazy Arithmetic using Systolic Arrays for Closing the Verification Gap on Embedded Systems

arXiv cs.AI ↗ · 2026-07-20 Cached

This paper proposes a lazy arithmetic approach using systolic arrays to close the verification gap for deep neural networks on embedded systems, addressing numerical incompatibilities and hardware vulnerabilities.

0 favorites 0 likes
#safety-critical

G-SHARE: A Guideline-Based Structured Reasoning Framework for Human-Factor Event Diagnosis

arXiv cs.CL ↗ · 2026-07-15 Cached

G-SHARE is a guideline-based structured reasoning framework for human-factor event diagnosis in nuclear power plants. It operationalizes a nine-step diagnostic guideline into a multi-stage pipeline with evidence extraction, stepwise reasoning, and consistency repair, outperforming one-shot LLM prompting and traditional baselines.

0 favorites 0 likes
#safety-critical

Pre-Flight: A Benchmark for Evaluating Large Language Models on Aviation Operational Knowledge

arXiv cs.AI ↗ · 2026-07-03 Cached

This paper introduces Pre-Flight, an open-source benchmark of 300 multiple choice questions designed to evaluate large language models on aviation operational knowledge, covering international regulations and ground operations. Results show even the best models in 2026 score 82.7%, significantly below the expert reference of ~95%, highlighting a persistent reliability gap.

0 favorites 0 likes
#safety-critical

The Inattentional Gap: Task-Conditioned Language and Vision Models Omit the Safety-Critical Signals They Can Otherwise Report

arXiv cs.CL ↗ · 2026-06-26 Cached

This paper identifies the 'Inattentional Gap' where task-conditioned AI models suppress reporting of safety-critical signals they can otherwise detect, analogous to human inattentional blindness, challenging the assumption that benchmark performance ensures real-world safety.

0 favorites 0 likes
#safety-critical

Built a Paninian Retrieval-Augmented Generation (PRAG) framework for safer medical AI — seeking feedback

Reddit r/artificial ↗ · 2026-06-16

The PRAG framework combines traditional RAG with a Paninian rule engine for safer medical AI, achieving a 71% reduction in unsafe answers on MedQA. It provides auditable rule traces and is open-sourced.

0 favorites 0 likes
#safety-critical

ESBMC-PLC: Formal Verification of IEC 61131-3 Ladder Diagram Programs Using SMT-Based Model Checking

arXiv cs.CL ↗ · 2026-06-16 Cached

This paper presents ESBMC-PLC, the first open-source formal verifier with native support for IEC 61131-3 Ladder Diagram programs using SMT-based model checking, enabling automated verification of safety-critical industrial control logic.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback