Tag
The article discusses the importance of addressing model errors in AI workflows, noting that handling cases where AI is unsure or wrong is as critical as the task itself in production environments.
The paper introduces RA-DPO, a reliability-aware direct preference optimization method that combines annotator agreement, model confidence, and token-level uncertainty for sexism detection, improving training efficiency and enabling selective prediction.
Introduces Flows, an execution and verification layer for software-building agents, arguing that agents need a separate completion signal alongside model confidence, demonstrated by a multi-module app with 59/59 checks passing.