When Does AI Supervision Help? A Role-Aware Study of Network Fraud Decision Management with Blockchain Auditability

arXiv cs.AI Papers

Summary

This arXiv paper introduces a role-aware Decider-Supervisor framework combining centralized ML, a FedAvg-trained federated meta-model, and Base/QLoRA LLM variants with blockchain auditability, finding that AI supervision only reduces fraud-decision errors under specific roles, calibration, and traffic conditions rather than by default.

arXiv:2610.07434v1 Announce Type: new Abstract: When does a second artificial intelligence (AI) component improve a primary network-fraud decision rather than add operational burden? We study this question through a role-aware Decider-Supervisor (DS) framework with blockchain auditability, evaluating four directional configurations that combine centralised machine learning, a Federated Averaging (FedAvg)-trained federated meta-model, and Base or Quantized Low-Rank Adaptation (QLoRA) large language model variants. The analysis compares primary-only and supervised decisions using non-hard fraud performance, intervention burden, conditional calibration, traffic-mix and Review-capacity sensitivity, dependability tests, and blockchain lifecycle controls. The deterministic hard gate resolves 89.994% of fraudulent requests, leaving the non-hard population as the main AI decision setting. Conditional validation calibration does not produce a consistently transferable supervisory advantage on deployment replay. DS-3 QLoRA is the least disruptive supervised configuration, but it still underperforms its primary FedAvg stage in F1 and total errors. Across 36 reweighted traffic mixtures, supervision reduces total errors only for DS-4 Base in two extreme high-fraud scenarios. Blockchain tests support digest verification, tamper detection, authorisation, single-use review resolution, and post-finalisation integrity, while exposing a pre-finalisation single-write limitation. The results show that the value of AI supervision depends on role assignment, calibration, escalation policy, traffic composition, and lifecycle controls rather than on the presence of a second model alone.
Original Article

Similar Articles

Anyone else struggling with AI auditability?

Reddit r/AI_Agents

The author describes a challenge with AI auditability where an agent's decision lacked traceability to the active policy version, and asks for advice on building effective decision trails for AI agent decisions.

AuditFL: A Contract-Backed Clearing Layer for Open Federated Learning

Hugging Face Daily Papers

The paper proposes AuditFL, a blockchain-backed clearing layer for open federated learning that keeps training and aggregation off-chain while recording content identifiers and economic state on-chain to make coordinator decisions attributable and auditable, preserving model accuracy even under client dropout and invalid updates on MNIST experiments.