misalignment-detection

Tag

Cards List
#misalignment-detection

Probing the Misaligned Thinking Process of Language Models

arXiv cs.AI · 2026-06-24 Cached

This paper proposes monitoring LLM misalignment by decomposing it into fine-grained cognitive processes (misalignment indicators) and detecting them via linear probes on internal activations, achieving high AUROC on out-of-distribution transcripts.

0 favorites 0 likes
#misalignment-detection

How we monitor internal coding agents for misalignment

OpenAI Blog · 2026-03-19 Cached

OpenAI describes its internal monitoring system for coding agents designed to detect and mitigate misalignment, using GPT-5.4 Thinking to review agent interactions and flag problematic behaviors within 30 minutes of completion.

0 favorites 0 likes
← Back to home

Submit Feedback