negative-results

Tag

Cards List
#negative-results

I put a conformal risk control gate between an LLM agent and its write actions on tau-bench. The bound held. The gate didn't beat asking every time [R]

Reddit r/MachineLearning ↗ · 2026-10-15

作者实现了一个基于 conformal risk control 的写操作安全闸门 gate-calibrated,在 tau-bench retail 上验证了风险上界成立(α=0.02 时 1.7% 错误写入未询问,达标),但闸门在每错误写入避免率上并未优于简单地每次询问用户。诊断显示模型的 verbalized confidence 和自采样一致性信号均已饱和(错误步骤上置信度也≥0.9),真正起作用的特征只是对话步数位置,说明该方案在易基准上也难以产生有区分度的置信信号。

0 favorites 0 likes
#negative-results

When better traffic forecasts fail to improve signal control: a layered diagnostic study of forecast-to-decision value

arXiv cs.AI ↗ · 2026-10-08 Cached

这篇论文通过分层诊断研究探讨了交通预测精度提升为何未能改善信号控制决策,发现预测价值取决于时间可观测性、动作可识别性、动力学一致性和目标对齐,并提出了一套实用的诊断协议。

0 favorites 0 likes
#negative-results

Modeling Shared and Individual Structure for Cross-Subject Continuous Affect Regression from EEG-fNIRS

arXiv cs.AI ↗ · 2026-10-05 Cached

The paper studies zero-shot cross-subject continuous valence-arousal regression from synchronized EEG-fNIRS data, decomposing affect into a stimulus-shared component and an individual component calibrated via label-free alpha-band cross-channel synchrony, outperforming EEGNet and ASAC-Net baselines while reporting a systematic negative-result search over alternative architectures and features.

0 favorites 0 likes
#negative-results

Characterizing a Configuration Where Inference-Time PRM-Pruned Fragment Grafting Is Inert: Evidence from Three Reasoning LMs

arXiv cs.AI ↗ · 2026-10-02 Cached

The paper shows that PRM-Pruned Fragment Grafting (PPFG), a cost-minimal inference-time cross-trajectory transfer technique, is statistically indistinguishable from independent parallel CoT across three reasoning LMs and six benchmarks, with the inertness traced to poor injection targeting and selection-dominated pruning dynamics.

0 favorites 0 likes
#negative-results

Decision Shifts, Lost Label Functionality, and an Inconclusive Grounding Audit in Correctness-Gated Multi-Teacher Distillation

arXiv cs.AI ↗ · 2026-09-11 Cached

The paper examines correctness-gated multi-teacher distillation, finding decision shifts, lost label functionality, and an inconclusive grounding audit, with no incremental benefit over hard filtering.

0 favorites 0 likes
#negative-results

Can LLMs Use Relational Transformer Embeddings?

arXiv cs.LG ↗ · 2026-09-02 Cached

The paper investigates injecting frozen relational transformer embeddings into an LLM via soft tokens, reporting negative results due to performance instability and sensitivity to serialization formats.

0 favorites 0 likes
#negative-results

Located but Not Releasable: Silent Gate Inversion and Bounded Linear Release

arXiv cs.CL ↗ · 2026-08-13 Cached

A preregistered stress test on a small transformer shows that while latent causal structure can be localized, releasing it into behavior fails: the gate detector inverts out-of-distribution and linear release directions are bounded below sufficiency, dissociating localization from behavioral release.

0 favorites 0 likes
#negative-results

@tarat_211: I made a video about my first real attempt at ML research. I started with a simple question about pruning vision-langua…

X AI KOLs Timeline ↗ · 2026-07-20 Cached

A researcher made a video about their first ML research attempt on pruning vision-language models, including negative results, and submitted a paper to arXiv.

0 favorites 0 likes
#negative-results

Ontology-Amplified Distillation and Contextuality Auditing for Sovereign Enterprise Language Models: A Combined Proof-of-Mechanism and Negative-Results Method Study

arXiv cs.AI ↗ · 2026-07-15 Cached

This paper presents a combined proof-of-mechanism study of ontology-amplified distillation for sovereign enterprise language models and a contextuality-audit method, using a Qwen3.6-27B student adapted via supervised fine-tuning and DPO. The results are underpowered and negative, showing no superiority over frontier baselines and zero contextuality in routing.

0 favorites 0 likes
← Back to home

Submit Feedback