The Schema Coherence Inventory: Measuring Whether an Assigned Belief Organizes a Language Model's Cognition
Summary
This paper introduces the Schema Coherence Inventory (SCI), a 96-item forced-choice psychometric tool measuring whether beliefs assigned to persona-conditioned language models actually organize their cognition versus merely inducing a mood, validated across 107 conditions and five model backbones.
Similar Articles
What Qwen is thinking when it gets stuck saying "Wait"
An experiment analyzes why Qwen3.5-0.8B gets stuck repeating 'Wait' by using an interpretability lens on the 'Wait' token, showing doubt-related features dominating near stopping points, and applies a tiny weight edit (0.016% of weights) that converts 'Wrong/Nope/Hmm' into 'Verification/Completion/Result' while sharply improving MATH-500 performance; code and data are released.
@FinanceYF5: Much of the “common knowledge” about LLMs may have a shelf life of just 15 months. Stanford researchers used 20 new models to retest 50 widely cited findings: 44% no longer held, 34% had significantly weakened, and only 16% still held true. Fabricated citations, hallucinations, and stereotypes are declining, but sycophancy toward users and…
Stanford researchers retested 50 widely cited findings about LLMs using 20 new models and found that 44% no longer held, 34% had significantly weakened, and only 16% still held, suggesting that LLM research findings may have a “shelf life” of only about 15 months.
@rohanpaul_ai: New Google and University of Hong Kong paper argues that when AI agents use computers, their own “task done” message sh…
A Google and University of Hong Kong paper proposes VeriCUA, which verifies computer-use agent tasks by checking saved files and app state instead of trusting the agent's own completion report, cutting false positives to 5.4% versus 24.8% for a VLM judge.
Epistemically Isolated Artificial Intelligence (EIAI)
The author introduces the concept of Epistemically Isolated Artificial Intelligence (EIAI) — AI systems deliberately limited to a defined knowledge environment — highlighting "Talkie: an LM from 1930," a language model trained only on pre-1931 text, as a fascinating example of temporally bounded epistemic reasoning.
What should a benchmark of agent direction do when the assignment itself is broken?
HyperHat's founder shares a design sketch for benchmarking whether AI agents can identify contradictory task requirements and ask clarifying questions rather than blindly executing, pairing broken tasks with satisfiable controls to prevent trivial gaming of the eval.