diagnostic-feedback

Tag

Cards List
#diagnostic-feedback

When Aggregate Alignment Misleads: Auditing Policy Repair Without Per-State Expert Actions

arXiv cs.AI · 2026-07-07 Cached

This paper studies the evaluation of agentic AI systems that repair decision policies when per-state expert action labels are unavailable, using a hotel-pricing simulator with region-level diagnostic feedback. It finds that aggregate alignment can be misleading and proposes evaluating policy repair by closed-loop outcome rather than behavioral distance.

0 favorites 0 likes
← Back to home

Submit Feedback