Agentic Data Cleaning Without a Clean Reference: An Experimental Study of Capabilities and Trade-offs

arXiv cs.AI Papers

Summary

This paper investigates agentic data cleaning without a clean reference, proposing an evidence-grounded framework and evaluating trade-offs across multiple configurations.

arXiv:2608.14765v1 Announce Type: new Abstract: Data cleaning without a trusted clean reference is challenging because unusual values may represent either genuine errors or valid observations. This paper studies how different agent capabilities affect reference-free data cleaning and proposes an evidence-grounded framework that combines structured context, profiling, LLM reasoning, executable checks, controlled evidence retrieval, source ranking, citation alignment, conservative repair, reversible scripts, and provenance logging. Seven configurations are evaluated across financial, clinical, and environmental-monitoring datasets using controlled synthetic corruption and original-data descriptive analysis, resulting in 126 completed runs. The evaluation includes two comparison baselines and a progressive LLM-based sequence that adds executable tools, evidence retrieval, evidence controls, and conservative repair. In the synthetic evaluation, the deterministic profiling baseline achieved the highest detection F1-score of 0.561. Among the LLM-based configurations, the full conservative configuration achieved the highest F1-score of 0.421, but no configuration performed best across all evaluation criteria. The source-ranked configurations achieved the lowest unsupported-rule rates, while decision-level citation alignment remained weak. The full conservative configuration produced no unsafe or unnecessary modifications, although these rates were already zero before the conservative policy was added, and it performed no direct repairs. Overall, the results show that additional capabilities introduce trade-offs among detection, repair, evidence grounding, conservative behaviour, reproducibility, and operational cost rather than producing consistent improvements. The study provides a structured framework and empirical methodology for evaluating these trade-offs in reference-free agentic data cleaning.
Original Article
View Cached Full Text

Cached at: 08/18/26, 10:06 AM

# Agentic Data Cleaning Without a Clean Reference: An Experimental Study of Capabilities and Trade-offs
Source: [https://arxiv.org/html/2608.14765](https://arxiv.org/html/2608.14765)
Hadi FadlallahAffiliation:Faculty of Arts and SciencesAffiliation:University of Sciences and Arts in LebanonAffiliation:Beirut, LebanonEmail:[ha\.fadlallah@usal\.edu\.lb](mailto:)Affiliation:ORCID: 0000\-0003\-1160\-5980

###### Abstract

Data cleaning without a trusted clean reference is challenging because unusual values may represent either genuine errors or valid observations\. This paper studies how different agent capabilities affect reference\-free data cleaning and proposes an evidence\-grounded framework that combines structured context, profiling, LLM reasoning, executable checks, controlled evidence retrieval, source ranking, citation alignment, conservative repair, reversible scripts, and provenance logging\. Seven configurations are evaluated across financial, clinical, and environmental\-monitoring datasets using controlled synthetic corruption and original\-data descriptive analysis, resulting in 126 completed runs\. The evaluation includes two comparison baselines and a progressive LLM\-based sequence that adds executable tools, evidence retrieval, evidence controls, and conservative repair\. In the synthetic evaluation, the deterministic profiling baseline achieved the highest detection F1\-score of 0\.561\. Among the LLM\-based configurations, the full conservative configuration achieved the highest F1\-score of 0\.421, but no configuration performed best across all evaluation criteria\. The source\-ranked configurations achieved the lowest unsupported\-rule rates, while decision\-level citation alignment remained weak\. The full conservative configuration produced no unsafe or unnecessary modifications, although these rates were already zero before the conservative policy was added, and it performed no direct repairs\. Overall, the results show that additional capabilities introduce trade\-offs among detection, repair, evidence grounding, conservative behaviour, reproducibility, and operational cost rather than producing consistent improvements\. The study provides a structured framework and empirical methodology for evaluating these trade\-offs in reference\-free agentic data cleaning\.

*K*eywordsdata cleaning⋅\\cdotdata quality⋅\\cdotagentic AI⋅\\cdotlarge language models⋅\\cdotreference\-free evaluation

## 1Introduction

Data cleaning is essential in analytics, scientific computing, data management, and machine\-learning pipelines, but errors are rarely purely syntactic\. Missing values, invalid formats, implausible codes, temporal irregularities, duplicates, and unusual measurements must be interpreted relative to task, consumer, and context\. Foundational data\-quality research frames quality as multidimensional and dependent on data consumers rather than as a single correctness property\[[38](https://arxiv.org/html/2608.14765#bib.bib1)\]\. Ontological and methodological perspectives further show that data\-quality dimensions must be interpreted with respect to the represented real\-world entities and the intended assessment context\[[37](https://arxiv.org/html/2608.14765#bib.bib2),[27](https://arxiv.org/html/2608.14765#bib.bib3)\]\. Broader data\-quality methodologies likewise treat assessment and improvement as context\-sensitive processes involving dimensions, data types, techniques, and organizational requirements\[[3](https://arxiv.org/html/2608.14765#bib.bib4)\]\. Classical cleaning work shows that profiling, constraints, external information, and human judgment are needed because no single technique detects or repairs all quality problems\[[29](https://arxiv.org/html/2608.14765#bib.bib5)\]\. Subsequent surveys and systems reinforce this view by highlighting the complementary roles of error detection, profiling, rule discovery, repair, and user involvement\[[1](https://arxiv.org/html/2608.14765#bib.bib6),[18](https://arxiv.org/html/2608.14765#bib.bib11)\]\.

Large language models \(LLMs\) and agentic systems can infer column semantics, propose rules, generate scripts, explain anomalies, and coordinate multi\-step workflows\. Recent work has explored LLM\-supported cleaning workflows and automated data\-cleaning pipelines\[[23](https://arxiv.org/html/2608.14765#bib.bib20),[4](https://arxiv.org/html/2608.14765#bib.bib21)\]\. Other studies examine retrieval\-supported repair and agentic cleaning workflows that combine reasoning with external evidence or actions\[[24](https://arxiv.org/html/2608.14765#bib.bib22),[28](https://arxiv.org/html/2608.14765#bib.bib23)\]\. Related work also investigates contextual rule generation, semantic table profiling, and LLM\-assisted data standardisation\[[17](https://arxiv.org/html/2608.14765#bib.bib24),[41](https://arxiv.org/html/2608.14765#bib.bib25)\]\. These capabilities are promising, but they do not solve the central reference\-free problem: a suspicious value may be a true error, a rare but valid signal, an undocumented convention, or a case requiring expert review\. In domains such as clinical records, finance, and radiation monitoring, unsupported modification can damage scientific, operational, or regulatory meaning\.

This paper therefore studies reference\-free cleaning as evidence\-grounded decision\-making rather than as direct transformation\. The proposed framework asks an agent to detect candidate issues, gather internal and external evidence, construct requirements, classify repair risk, generate reversible transformations only when justified, and preserve or escalate ambiguous cases\. The study evaluates this design using two comparison baselines, A0 and A1, followed by a progressive ablation from A2 to A6\. The evaluation covers three datasets, two evaluation settings, and three repeated runs, producing 126 successful runs\. The aim is to measure configuration trade\-offs under the tested datasets and controlled evidence setting, not to claim that one configuration is universally superior\. Controlled synthetic\-corruption runs provide ground truth for detection, repair, and valid\-signal preservation, while original\-data runs are interpreted descriptively because no trusted clean reference or manual adjudication is available\.

The main contribution is threefold\. First, the paper formalises the contextual knowledge, tool capabilities, evidence sources, and decision classes that may support reference\-free data cleaning\. Second, it proposes an evidence\-grounded framework that combines profiling, tools, controlled evidence retrieval, source ranking, citation alignment, conservative repair, reversibility, and provenance\. Third, it reports an exploratory ablation study that measures how these capabilities affect cleaning behavior\. The results show clear trade\-offs: A1 achieved the highest synthetic detection F1\-score, A5 and A6 had the lowest unsupported\-rule rates, and A6 showed more conservative repair behavior\. However, the most complete configuration was not consistently better in detection, repair, reproducibility, runtime, or token cost\.

The study is intentionally cautious in its claims\. It does not assume that more agent capabilities necessarily produce better cleaning, and it does not evaluate original\-data outputs as if they had hidden ground truth\. Instead, it asks which components change observable behavior under controlled conditions and which uncertainties remain when the reference\-free assumption is respected\.

The paper is organised as follows\. Section[2](https://arxiv.org/html/2608.14765#S2)positions the study in relation to data\-quality, cleaning, retrieval, provenance, and LLM\-agent research\. Sections[4](https://arxiv.org/html/2608.14765#S4)and[5](https://arxiv.org/html/2608.14765#S5)define the reference\-free setting and the taxonomy of contextual knowledge, tools, evidence, and decision classes\. Sections[6](https://arxiv.org/html/2608.14765#S6)–[8](https://arxiv.org/html/2608.14765#S8)present the framework, implementation, and metrics\. Sections[9](https://arxiv.org/html/2608.14765#S9)and[10](https://arxiv.org/html/2608.14765#S10)report and interpret the ablation results, followed by threats to validity and the conclusion\.

## 2Background and Related Work

Research on data quality provides the conceptual basis for this study\. Quality dimensions such as accuracy, completeness, consistency, timeliness, believability, and interpretability depend on the consumer, intended use, and represented real\-world entities\[[38](https://arxiv.org/html/2608.14765#bib.bib1),[37](https://arxiv.org/html/2608.14765#bib.bib2),[27](https://arxiv.org/html/2608.14765#bib.bib3)\]\. Broader methodologies organise assessment and improvement across dimensions, data types, techniques, and systems\[[3](https://arxiv.org/html/2608.14765#bib.bib4),[2](https://arxiv.org/html/2608.14765#bib.bib30)\]\. Context\-aware data\-quality work further argues that assessment rules must be selected with respect to usage context and domain constraints\[[12](https://arxiv.org/html/2608.14765#bib.bib8),[34](https://arxiv.org/html/2608.14765#bib.bib19)\]\. The CTXDQ model provides a computational interpretation of this view by representing contextual characteristics and matching them to relevant quality dimensions and assessment techniques\[[13](https://arxiv.org/html/2608.14765#bib.bib35)\]\. These ideas motivate the explicit cleaning context used in this paper\.

Classical cleaning and repair systems show why reference\-free cleaning cannot rely on natural\-language reasoning alone\. Profiling identifies distributions, types, missingness, duplicates, and dependencies\[[26](https://arxiv.org/html/2608.14765#bib.bib36)\]; duplicate and entity\-resolution methods require specialised matching logic\[[9](https://arxiv.org/html/2608.14765#bib.bib37)\]; and anomaly detection treats unusual observations as deviations from expectations, not automatically as errors\[[7](https://arxiv.org/html/2608.14765#bib.bib38)\]\. Systems such as Potter’s Wheel and Wrangler emphasise interactive transformation and user feedback\[[30](https://arxiv.org/html/2608.14765#bib.bib39),[19](https://arxiv.org/html/2608.14765#bib.bib18)\], while NADEEF and constraint\-based repair work formalise rule\-driven detection and repair\[[11](https://arxiv.org/html/2608.14765#bib.bib12),[5](https://arxiv.org/html/2608.14765#bib.bib13),[15](https://arxiv.org/html/2608.14765#bib.bib14)\]\. Probabilistic systems such as HoloClean and PClean incorporate uncertainty, signals, and domain knowledge\[[32](https://arxiv.org/html/2608.14765#bib.bib15),[21](https://arxiv.org/html/2608.14765#bib.bib16)\]\. ActiveClean and related interactive approaches further show that human guidance remains important when cleaning choices affect downstream analysis\[[20](https://arxiv.org/html/2608.14765#bib.bib40)\]\.

Knowledge\-based and retrieval\-based approaches are especially relevant when table content is insufficient to interpret a value\. KATARA uses knowledge bases and crowdsourcing to support cleaning decisions\[[10](https://arxiv.org/html/2608.14765#bib.bib17)\]; RetClean uses retrieval to support LLM\-assisted cleaning\[[24](https://arxiv.org/html/2608.14765#bib.bib22)\]; and retrieval\-augmented generation separates retrieved evidence from generated output\[[22](https://arxiv.org/html/2608.14765#bib.bib26)\]\. Work on attribution and fact verification motivates explicit checks that a cited source supports the generated claim\[[31](https://arxiv.org/html/2608.14765#bib.bib33),[36](https://arxiv.org/html/2608.14765#bib.bib41)\]\. Provenance research further motivates recording why and where a decision originated, including data, rules, tools, and evidence\[[6](https://arxiv.org/html/2608.14765#bib.bib29),[8](https://arxiv.org/html/2608.14765#bib.bib31),[39](https://arxiv.org/html/2608.14765#bib.bib32)\]\.

Recent LLM and agent research extends these ideas with reasoning and tool use\. ReAct and Toolformer show how language models can combine reasoning with external actions or tools\[[40](https://arxiv.org/html/2608.14765#bib.bib27),[33](https://arxiv.org/html/2608.14765#bib.bib28)\]\. In data preparation, foundation models and LLM\-based systems can wrangle tables, profile semantics, generate workflows, and standardise values\[[25](https://arxiv.org/html/2608.14765#bib.bib34),[23](https://arxiv.org/html/2608.14765#bib.bib20),[28](https://arxiv.org/html/2608.14765#bib.bib23),[17](https://arxiv.org/html/2608.14765#bib.bib24)\]\. However, empirical studies also show sensitivity to prompts, domain context, and verification mechanisms\[[4](https://arxiv.org/html/2608.14765#bib.bib21),[41](https://arxiv.org/html/2608.14765#bib.bib25)\]\. The gap addressed here is therefore not whether LLMs can propose cleaning actions, but how profiling, executable tools, evidence controls, and conservative repair policies affect cleaning decisions when no clean reference is available\.

Two implications follow from this literature\. First, reference\-free cleaning requires an explicit distinction between detecting a possible issue and modifying a value\. Detection can be supported by profiling, constraints, and anomaly indicators, but repair requires stronger evidence because a value may be unusual and still valid\. Second, evidence grounding must be operationalised rather than asserted\. A system that retrieves a source or produces a citation is not necessarily source\-grounded unless the final decision can be traced to evidence that is relevant, specific, current, and consistent with the proposed rule\. These implications motivate the taxonomies, framework, and experimental design used in the present study\.

## 3Research Questions and Hypotheses

The study addresses five research questions:RQ1asks how different baseline and agent configurations affect reference\-free data\-cleaning behavior;RQ2asks which tool capabilities change cleaning decisions;RQ3asks whether source\-ranking and citation\-alignment controls reduce unsupported rules or unsafe repairs;RQ4asks whether a conservative repair policy improves valid\-signal preservation and reduces unnecessary modification; andRQ5asks what operational cost is introduced as additional agent capabilities are enabled\.

The corresponding hypotheses are that profiling and executable validation improve structural and syntactic issue detection \(H1\); source\-ranking and citation\-alignment controls reduce unsupported\-rule behavior but may not guarantee strong citation support for every decision \(H2\); conservative repair policies reduce unsafe repairs and unnecessary modifications \(H3\); the full conservative evidence\-grounded configuration shifts behavior toward more conservative and auditable decisions but may introduce trade\-offs in detection, direct repair, runtime, and token cost \(H4\); and the relative effectiveness of agent configurations depends on dataset characteristics and cleaning requirements \(H5\)\.

## 4Problem Definition

LetXXdenote the raw dataset\. It may be accompanied by schemaSS, optional metadataMM, sample recordsRR, profiling summariesPP, and optional documentationGG\. Following context\-driven data\-quality assessment, the dataset is associated with a structured cleaning context

ΓX=⟨Cs​r​c,Cs​t​r,Cs​e​m,Ct​e​m​p,Cu​s​e,Cr​i​s​k,Cp​o​l​i​c​y,Cp​r​o​v⟩,\\Gamma\_\{X\}=\\langle C\_\{src\},C\_\{str\},C\_\{sem\},C\_\{temp\},C\_\{use\},C\_\{risk\},C\_\{policy\},C\_\{prov\}\\rangle,\(1\)where the components represent source, structural, semantic, temporal, use, risk, policy, and provenance characteristics\. In supervised evaluation, a clean reference tableX∗X^\{\*\}may be available\. In the reference\-free setting considered here, however,X∗X^\{\*\}is unavailable\. The agent must therefore infer cleaning requirements from the available decision context

K=\{X,S,M,R,P,G,ΓX,Ee​x​t,T\},K=\\\{X,S,M,R,P,G,\\Gamma\_\{X\},E\_\{ext\},T\\\},\(2\)whereEe​x​tE\_\{ext\}denotes retrieved evidence andTTdenotes tool outputs such as parsing, duplicate, unit, temporal, and consistency checks\. The setKKrepresents the information and outputs that may support a cleaning decision; it does not imply that every component is required in every cleaning task\. In the completed experiment, retrieval used a controlled local evidence corpus rather than online retrieval\.

The agent produces cleaning decisions

𝒞=\{c1,c2,…,cn\},\\mathcal\{C\}=\\\{c\_\{1\},c\_\{2\},\\ldots,c\_\{n\}\\\},\(3\)with each decision represented as

ci=⟨issuei,evidencei,requirementi,rulei,actioni,confidencei,provenancei⟩\.c\_\{i\}=\\langle\\text\{issue\}\_\{i\},\\text\{evidence\}\_\{i\},\\text\{requirement\}\_\{i\},\\text\{rule\}\_\{i\},\\text\{action\}\_\{i\},\\text\{confidence\}\_\{i\},\\text\{provenance\}\_\{i\}\\rangle\.\(4\)The action belongs to

𝒜=\{safe\-repair,conditional\-repair,flag\-only,preserve,human\-review,reject\-repair\}\.\\begin\{array\}\[\]\{l\}\\mathcal\{A\}=\\\{\\text\{safe\-repair\},\\text\{conditional\-repair\},\\text\{flag\-only\},\\\\ \\quad\\text\{preserve\},\\text\{human\-review\},\\text\{reject\-repair\}\\\}\.\\end\{array\}\(5\)This notation separates the raw datasetXXfrom the decision set𝒞\\mathcal\{C\}\. A repair is permitted only when the evidence is sufficient, the rule is operationally checkable, the transformation is reversible, and the conservative cleaning policy is not violated\. The formulation also separates a cleaning requirement from an applied transformation\. A requirement may state that a timestamp should be parseable, a code should belong to a documented set, or a measurement should respect a unit convention, but the corresponding action may still be flagging or preservation when the evidence is incomplete\. This separation is central to avoiding unsupported repair in the absence ofX∗X^\{\*\}\.

The framework follows six principles: repairs should be evidence\-grounded; rare or extreme values should not be modified solely because they are unusual; executable checks should be used where deterministic validation is more reliable than natural\-language judgement; external sources should be ranked and aligned with the decisions they support; transformations should preserve provenance and reversibility; and the effects of added agent capabilities should be evaluated empirically rather than assumed beneficial\.

## 5Knowledge and Decision Taxonomies

The proposed framework uses five taxonomies to specify what the agent should produce, what contextual knowledge may support its decisions, which tools it can use, which evidence can support decisions, and which conservative action classes are available\. These taxonomies synthesize prior work on multidimensional data quality, context\-aware assessment, profiling, knowledge\-based cleaning, retrieval, attribution, provenance, constraint\-based repair, probabilistic cleaning, and anomaly detection\. Data\-quality and context\-aware assessment work motivate the schema, semantic, usage, policy, and risk categories\[[38](https://arxiv.org/html/2608.14765#bib.bib1),[3](https://arxiv.org/html/2608.14765#bib.bib4)\]\. Profiling and classical cleaning systems motivate tool\-mediated detection outputs and executable checks\[[29](https://arxiv.org/html/2608.14765#bib.bib5),[1](https://arxiv.org/html/2608.14765#bib.bib6)\]\. Knowledge\-based and retrieval\-based systems motivate the evidence taxonomy\[[10](https://arxiv.org/html/2608.14765#bib.bib17),[22](https://arxiv.org/html/2608.14765#bib.bib26)\], while attribution and provenance research motivate citation alignment and decision traceability\[[31](https://arxiv.org/html/2608.14765#bib.bib33),[6](https://arxiv.org/html/2608.14765#bib.bib29)\]\. Constraint\-based repair, probabilistic cleaning, and anomaly\-detection research motivate the conservative distinction between repair, flagging, preservation, review, and rejection\[[5](https://arxiv.org/html/2608.14765#bib.bib13),[32](https://arxiv.org/html/2608.14765#bib.bib15),[7](https://arxiv.org/html/2608.14765#bib.bib38)\]\. The aim is not to claim that every category is necessary or equally important for every dataset, but to make the knowledge, capabilities, evidence, and decision requirements of the framework explicit\.

### 5\.1Taxonomy\-to\-Implementation Mapping

Table[1](https://arxiv.org/html/2608.14765#S5.T1)summarizes how the taxonomy is operationalized in the reported ablation\. This mapping is included to avoid overclaiming: some categories are directly measured, some are partly implemented through context and logging, and others define framework\-level concepts or referral mechanisms rather than independently adjudicated experimental variables\.

Table 1:Mapping between taxonomy components and the reported experimental implementation\.Taxonomy componentFramework roleImplementation statusConfigurations and evaluationRequired outputsExpose issues, requirements, rules, decisions, evidence, provenance, scripts, and audit summaries\.Logged in the output schema; capability\-specific fields are absent when not enabled\.A0–A6; checked through counts, repair metrics, schema/JSON validity, reproducibility, and auditability\.Prior knowledgeProvide schema, unit, temporal, policy, purpose, and risk context that may support repair decisions\.Partly implemented through context profiles, schema/samples, profiling summaries, and risk descriptions; not separately ablated by knowledge type\.Context is available to different degrees across configurations, but individual knowledge types are not evaluated independently\.Tool capabilitiesDelegate profiling, parsing, validation, temporal/constraint checks, and reversible scripts to tools\.Implemented for profiling/checking in A1 and for executable validation/script generation from A3 onward\.A1 tests deterministic profiling; A3–A6 test executable checks and reversible scripts; evaluated through detection, repair, execution, and operational metrics\.Evidence and citation controlsDistinguish evidence types, rank sources, and align cited claims with decisions\.Controlled local evidence retrieval is used in A4; source\-ranking and citation\-alignment checks are used in A5–A6\.A4 tests evidence availability; A5–A6 test ranking/alignment; evaluated through evidence coverage, unsupported\-rule rate, citation alignment, runtime, and token use\.Decision classes and conservative policyConvert suspected issues into repair, flagging, preservation, human review, or rejected repair\.Decision labels are logged across configurations; explicit conservative policy and provenance control are enabled most fully in A6\.A5–A6 isolate conservative control; evaluated through repair/safety metrics, valid\-signal preservation, human\-review rate, and reproducibility\.Human review and expert adjudicationProvide a high\-authority pathway for ambiguous or high\-risk cases\.Implemented only as a referral/decision class; no external expert adjudication of original\-data cases was performed\.Mainly visible in A6 original\-data behavior; reported descriptively through referral rate and discussed as a limitation/future\-work need\.
### 5\.2Required\-Output Taxonomy

The required\-output taxonomy in Table[2](https://arxiv.org/html/2608.14765#S5.T2)defines the artefacts that must be produced for an auditable cleaning decision\. It separates candidate issues, requirements, rules, decisions, repairs, provenance, and escalation outputs so that a detected anomaly is not automatically treated as a repairable error\.

Table 2:Required outputs of the evidence\-grounded cleaning agent\.OutputDefinitionPurposeIssue inventoryStructured list of suspected quality issues, including affected columns, rows, entities, timestamps, and issue contexts\.Identifies what may be wrong\.Issue typeClassification of the issue, such as missing value, duplicate, invalid unit, impossible value, inconsistent category, temporal gap, entity mismatch, or suspicious anomaly\.Supports systematic analysis\.Evidence recordDataset\-derived or externally retrieved evidence used to support the issue or repair decision\.Reduces hallucinated cleaning\.Cleaning requirementA requirement inferred from schema, profiling, documentation, standards, or authoritative sources\.Defines what the data should satisfy\.Validation ruleA machine\-checkable rule derived from a cleaning requirement\.Enables repeatable validation\.Repair proposalA suggested transformation, imputation, normalization, deletion, or correction\.Generates candidate repairs when safe\.Decision classFinal action category: safe repair, conditional repair, flag only, preserve, human review, or reject repair\.Prevents over\-cleaning\.Confidence and evidence strengthNumeric or ordinal estimate of decision reliability based on evidence quality and rule support\.Supports prioritization\.Provenance logRecord of prompt context, source, tool output, rule, affected records, and transformation\.Ensures auditability\.Reversible scriptScript that applies approved transformations while preserving original values\.Enables rollback and review\.Audit reportHuman\-readable summary of issues, decisions, repairs, rejected repairs, evidence quality, and remaining uncertainties\.Supports scientific reporting\.These outputs support auditability\. A reviewer, data owner, or downstream analyst should be able to see what issue was detected, what requirement was inferred, which evidence supported it, what action was chosen, and whether any value was changed\. The taxonomy therefore treats provenance and escalation as first\-class outputs rather than optional metadata\.

### 5\.3Prior\-Knowledge Taxonomy

The prior\-knowledge taxonomy in Table[3](https://arxiv.org/html/2608.14765#S5.T3)identifies contextual information that may support the interpretation of a dataset before repair decisions are made\. It includes schema, semantic, temporal, entity, risk, policy, and provenance knowledge because reference\-free decisions may depend on both data\-derived patterns and external interpretation\. The current experiment does not evaluate these knowledge categories independently\.

Table 3:Taxonomy of prior knowledge required by an autonomous cleaning agent\.Knowledge TypeDefinitionDomain\-Independent ExampleSchema knowledgeColumn names, data types, key fields, expected structural constraints, and valid formats\.Identifier fields, timestamps, categorical codes, numeric measures\.Unit and scale knowledgeMeaning, unit, scale, and compatibility of measured values\.Currency units, medical units, sensor units, percentages, rates\.Temporal knowledgeExpected frequency, ordering, allowable time gaps, duplicate timestamps, and continuity constraints\.Hourly readings, admission/discharge dates, transaction sequences\.Entity knowledgeEntities represented in the dataset and valid relationships among them\.Patient ID, station ID, customer ID, product ID, location ID\.Domain\-threshold knowledgeExpected ranges, warning limits, legal limits, operational thresholds, or plausible bounds\.Valid age range, sensor range, maximum transaction amount\.Contextual\-event knowledgeExternal events or domain conditions that may explain unusual values\.Maintenance event, market shock, public\-health event, environmental event\.Missingness knowledgeMeaning of nulls, placeholders, censored values, unavailable observations, and not\-applicable values\.“NA”, “unknown”, below\-detection values, empty codes\.Constraint knowledgeFunctional, relational, temporal, arithmetic, or semantic constraints that should hold\.End date follows start date; total equals sum of parts\.Cleaning\-policy knowledgeRules defining when to repair, flag, preserve, or escalate\.Do not modify high\-impact values without evidence\.Evidence\-provenance knowledgeAuthority, date, source type, citation alignment, and source reliability\.Official documentation preferred over unsupported web pages\.Task\-purpose knowledgeIntended downstream use of the data, including whether cleaning is for reporting, modeling, compliance, or exploration\.Preserve anomalies for anomaly detection; normalize for reporting\.Risk knowledgeConsequences of false repair, false preservation, deletion, or imputation\.Clinical, financial, safety, regulatory, or scientific impact\.This taxonomy is deliberately broader than schema metadata because many cleaning decisions may depend on semantic, temporal, or policy context\. For example, a radiation spike, clinical measurement, or financial transaction cannot always be judged safely from column names alone\. Interpreting such values may require information about how the data were produced, how they are used, and what risks are associated with an incorrect repair or a missed issue\.

### 5\.4Tool\-Capability Taxonomy

The tool\-capability taxonomy in Table[4](https://arxiv.org/html/2608.14765#S5.T4)distinguishes computations that should be delegated to deterministic or executable tools from judgements that require evidence\-aware reasoning\. Tool outputs are treated as evidence records rather than as unverified suggestions\.

Table 4:Tool\-capability taxonomy for evidence\-grounded data cleaning\.Tool ClassFunctionExample OutputProfiling toolsSummarize types, missingness, uniqueness, distributions, outliers, patterns, and correlations\.Missingness rate, duplicate count, value ranges\.Parsing and type toolsValidate dates, numbers, codes, units, regular expressions, and encodings\.Invalid timestamp list\.Duplicate and entity\-resolution toolsDetect exact duplicates, near duplicates, and possible entity conflicts\.Candidate duplicate clusters\.Temporal validation toolsCheck ordering, gaps, repeated timestamps, rolling statistics, and frequency expectations\.Gap intervals and repeated measurements\.Constraint\-checking toolsExecute functional, arithmetic, relational, and semantic constraints\.Rule violation table\.Unit and conversion toolsValidate unit compatibility and perform documented conversions\.Converted values with original unit preserved\.Controlled evidence\-retrieval toolsRetrieve supporting evidence from a controlled evidence collection; online evidence retrieval can be used in future replications when source volatility and reproducibility are explicitly controlled\.Candidate evidence sources\.Source\-ranking toolsScore retrieved sources by authority, relevance, recency, specificity, and consistency\.Ranked evidence list\.Citation\-alignment toolsCheck whether a cited statement supports a generated requirement or repair\.Supported, partially supported, unsupported\.Script\-generation toolsGenerate reversible cleaning scripts and execution logs\.Python or SQL transformation script\.Script\-execution toolsRun generated validation or repair scripts in a controlled environment and capture errors, modified records, rollback information, and execution status\.Execution log, error trace, affected\-row count, rollback file\.The taxonomy assigns tools to verification roles rather than treating the LLM as the sole decision\-maker\. Deterministic checks are appropriate for parsing, type validation, duplicate detection, and script execution, while the agent is responsible for interpreting those outputs with respect to domain context and repair risk\.

### 5\.5Evidence Taxonomy

For evidence itemee, the framework represents evidence strength as

E​S​\(e\)=α​A​\(e\)\+β​R​\(e\)\+γ​S​p​\(e\)\+δ​C​\(e\)\+η​T​\(e\),ES\(e\)=\\alpha A\(e\)\+\\beta R\(e\)\+\\gamma Sp\(e\)\+\\delta C\(e\)\+\\eta T\(e\),\(6\)whereA⁡\(e\)A\(e\)denotes source authority,R⁡\(e\)R\(e\)relevance to the cleaning decision,S​p​\(e\)Sp\(e\)specificity,C⁡\(e\)C\(e\)consistency with other available evidence, andT⁡\(e\)T\(e\)temporal validity\. The coefficientsα\\alpha,β\\beta,γ\\gamma,δ\\delta, andη\\etarepresent the relative importance assigned to these dimensions\. The formulation provides a structured way to compare evidence sources; it is not intended as a universal evidence\-quality model\.

Table 5:Evidence taxonomy for cleaning decisions\.Evidence TypeDefinitionTypical StrengthSchema evidenceEvidence from names, declared types, primary keys, foreign keys, and constraints\.Medium to high\.Profile evidenceEvidence from distributions, missingness, duplicates, type errors, and statistical summaries\.Medium; weaker for semantic repair\.Executable evidenceEvidence from deterministic validation, parsing, rule execution, and reproducible checks\.High for syntactic and structural issues\.Dataset documentationOfficial metadata, data dictionary, README, or provider documentation\.High when specific and current\.Institutional or regulatory sourceGovernment, standards body, organizational documentation, or domain authority\.High when directly relevant\.Scientific literaturePeer\-reviewed source providing domain thresholds, measurement interpretation, or methods\.Medium to high depending on specificity\.Technical manualDevice, software, or system manual explaining units, codes, or valid ranges\.High for instrumentation\-specific rules\.General web sourceBlog, forum, or unverified page\.Low; should not justify high\-impact repairs alone\.Human expert reviewDomain expert judgment or adjudication\.High, but may be subjective and should be logged\.The evidence\-strength equation is not intended as a universal scoring formula\. It defines the dimensions that should be logged and made explicit when a decision depends on evidence\. Different domains may weight the dimensions differently; for example, clinical and regulatory settings may require stronger authority and specificity than exploratory data analysis\.

### 5\.6Cleaning Decision Taxonomy

The decision classes in Table[6](https://arxiv.org/html/2608.14765#S5.T6)are defined by evidence sufficiency and repair risk\. This taxonomy is the main bridge between the conceptual problem and the executable experiment: it determines whether a candidate issue becomes a repair, a flag, a preservation decision, a human\-review referral, or a rejected repair proposal\. Because no reference value is available, the taxonomy gives the agent conservative alternatives to modification: flagging, preserving possible valid signals, escalating to human review, or rejecting unsupported repair\.

Table 6:Cleaning decision classes used by the proposed framework\.Decision ClassDefinitionExampleSafe repairThe issue is clearly erroneous and the correction is directly supported by rules, documentation, executable checks, or strong evidence\.Standardizing timestamp format; replacing documented placeholder codes with null\.Conditional repairA repair is plausible but depends on an explicit documented assumption\.Converting units when the source unit is strongly inferred but not directly stated\.Flag onlyThe value is suspicious but evidence is insufficient for modification\.Sudden spike, unusual transaction, or unexpected sensor value\.Preserve as possible valid signalThe value is unusual but may represent a meaningful rare event or domain signal\.Rare clinical result, extreme environmental reading, valid financial shock\.Needs human reviewThe issue is high\-risk, ambiguous, or unresolved by available evidence\.Conflicting evidence or uncertain domain interpretation\.Reject unsupported repairA repair proposal lacks sufficient support or violates policy\.Replacing an outlier only because it is statistically extreme\.

## 6Methodology: Evidence\-Grounded Agentic Cleaning Framework

The framework translates the problem definition into a multi\-stage process: issue detection, evidence acquisition, requirement generation, rule construction, decision classification, reversible repair execution, and provenance logging\. The process begins with the raw dataset, schema, metadata, and sample records\. Profiling derives structural and statistical summaries; the issue detector identifies candidate quality problems; and the agent planner decides whether internal evidence is sufficient or whether additional tool use or controlled evidence retrieval is required\. Figure[1](https://arxiv.org/html/2608.14765#S6.F1)summarises the architecture\.

![Refer to caption](https://arxiv.org/html/2608.14765v1/cleaning-flow-grayscale.png)Figure 1:Architecture of the evidence\-grounded agentic data\-cleaning framework\.The framework distinguishes dataset\-derived evidence from retrieved evidence\. Dataset\-derived evidence includes schema constraints, profiling summaries, missingness, duplicates, temporal behavior, distributions, and executable validation results\. Retrieved evidence includes documentation, standards, manuals, domain references, or other configured sources\. Both forms of evidence can support the requirements and rules used to evaluate candidate cleaning decisions\.

The agent workflow has five steps\. First, it constructsΓX\\Gamma\_\{X\}and profiles the dataset\. Second, it proposes candidate issues and identifies the contextual knowledge relevant to their interpretation\. Third, it invokes tools for deterministic checks where applicable\. Fourth, it creates evidence\-backed requirements and rules, with evidence assessed according to authority, relevance, specificity, consistency, and temporal validity\. Fifth, it classifies each decision into the conservative action set and generates reversible scripts only when the policy allows repair\. All decisions record provenance, including evidence identifiers, rule text, tool outputs, and the original value\.

The conservative repair policy acts as a control layer over candidate transformations\. A decision may be classified as safe repair only when the candidate issue is clear, the rule is supported by available evidence, and the transformation can be reversed\. When evidence is partial, conflicting, or high risk, the policy favours conditional repair, flagging, preservation, human review, or rejection of unsupported repair\. This approach may reduce direct repair because uncertain cases can be preserved or escalated instead of being modified automatically\.

The framework also separates planning from execution\. The agent may propose a requirement or rule, but executable checks and reversible scripts determine whether the proposal can be operationalised\. This reduces reliance on fluent natural\-language explanations when deterministic validation is available\. In the same way, evidence records are not treated as decorations for the report; they are intended to be linked to requirements and actions so that reviewers can distinguish supported repairs from unsupported or ambiguous suggestions\.

When a repair is executed, the framework uses reversible scripts that preserve original values and produce logs that can be inspected after execution\. This separates the agent’s recommendation from the deterministic effect of the generated transformation and supports auditability and reproducibility\.

## 7Experimental Design and Implementation

The exploratory experiment evaluates seven configurations across three datasets and two run modes\. A0 and A1 serve as comparison baselines, while A2–A6 form the progressive LLM\-based ablation\. Three repeated runs were performed for each dataset–mode–configuration combination, resulting in 126 completed runs\. The datasets represent financial decision support\[[16](https://arxiv.org/html/2608.14765#bib.bib10)\], clinical records\[[35](https://arxiv.org/html/2608.14765#bib.bib7)\], and environmental radiation monitoring\[[14](https://arxiv.org/html/2608.14765#bib.bib9)\]\. Each dataset was supplied with a context profile describing its domain, operational setting, schema, risk level, and relevant cleaning context\. Table[7](https://arxiv.org/html/2608.14765#S7.T7)summarises the dataset roles\.

Table 7:Datasets and context profiles used in the experimental study\.The controlled synthetic\-corruption mode injects known errors and plausible valid\-signal cases, allowing detection, repair, and preservation metrics to be computed against ground truth\. The original\-data mode applies the same configurations to the unmodified datasets\. Because the original datasets do not have a trusted clean reference or manual adjudication in the verified outputs, original\-data results are descriptive only\. Table[8](https://arxiv.org/html/2608.14765#S7.T8)summarises the corruption and valid\-signal protocol\.

Table 8:Synthetic corruption and valid\-signal protocol used in the completed experiment\. Counts are per dataset and repeated run; the same ground\-truth file for a given dataset and run was used across all A0–A6 configurations\.The experiment uses two comparison baselines followed by a progressive capability ablation\. A0 is a schema\-and\-sample LLM baseline without profiling, executable tools, evidence retrieval, or conservative repair controls\. A1 is a deterministic profiling\-and\-checking baseline and does not use an LLM\. A2 combines profiling summaries with LLM reasoning and serves as the starting point of the progressive LLM\-based sequence\. A3 adds executable Python checks and reversible\-script generation, A4 adds controlled evidence retrieval, A5 adds source ranking and citation\-alignment checks, and A6 adds the conservative repair policy\.

A0 and A1 should therefore be interpreted as contrasting baselines rather than consecutive steps of a single\-factor ablation\. The more direct capability comparisons are A2 to A3 for executable tools, A3 to A4 for evidence retrieval, A4 to A5 for source\-ranking and citation\-alignment controls, and A5 to A6 for the conservative repair policy\.

The LLM\-based configurations used OpenRouter withopenai/gpt\-oss\-20b, while A1 was deterministic and did not use an LLM\. The temperature was fixed at 0\.2 and the maximum output length at 3000 tokens\. The prompt context included the dataset schema, metadata, context profile, up to 10 sample records, and the profiling, tool, or evidence information enabled for each configuration\. Model settings, retry logic, output constraints, and postprocessing were kept fixed across all LLM\-based configurations\.

The output followed a fixed JSON schema containing candidate issues, requirements, validation rules, decisions, evidence references, provenance information, and audit indicators\. This common schema made outputs comparable across configurations and allowed systematic postprocessing without manually interpreting free\-form responses\. When a response was malformed, the saved postprocessing pipeline applied schema normalization or JSON repair where needed, and these events were retained in the execution audit\. The experiment was not rerun after analysis, and all reported results were computed from the saved postprocessed artifacts\.

Table 9:Controlled local evidence corpus used in the completed experiment\.For A5 and A6, retrieved evidence was ranked using the evidence\-strength formulation introduced in Section[5](https://arxiv.org/html/2608.14765#S5)\. The implemented weights were 0\.30 for authority, 0\.25 for relevance, 0\.20 for specificity, 0\.15 for consistency, and 0\.10 for temporal validity\. These weights were fixed for all source\-ranked runs and were used as an operational ranking heuristic rather than as a universally validated evidence\-quality model\. In the controlled local corpus, consistency was not separately annotated and therefore used a fixed value of 0\.7 for all evidence records\. Consequently, the consistency component did not differentiate evidence sources in the reported experiment\.

## 8Evaluation Protocol

The evaluation separates detection and repair effectiveness, safety, evidence grounding, operational cost, and reproducibility\. Synthetic\-corruption runs support detection, repair, and valid\-signal preservation metrics because injected ground truth is available\. Original\-data runs are interpreted descriptively because no trusted clean reference or manual adjudication is available\. Execution indicators such as retries, JSON repair, schema normalization, and reversible\-script execution are reported separately as an audit and are not treated as measures of cleaning effectiveness\.

Table 10:Evaluation metrics for reference\-free evidence\-grounded cleaning\.Metric GroupMetricDefinitionDetectionPrecisionIn the controlled synthetic\-corruption setting, the fraction of detected issues that match injected error ground truth\. Original\-data precision is not interpreted because no injected or manually validated ground truth is available\.DetectionRecallIn the controlled synthetic\-corruption setting, the fraction of injected errors detected by the agent\. Original\-data recall is not interpreted because no ground\-truth error set is available\.DetectionF1\-scoreHarmonic mean of synthetic detection precision and recall\.RepairExpected\-repair match rateAmong repair decisions matched to injected errors for which repair is expected, the fraction whose proposed repair contains the known expected correction\.RepairSafe repair rateFraction of repair\-class decisions that match synthetic ground\-truth cases for which repair is appropriate, excluding repairs applied to valid\-signal or non\-repair cases and repairs with no matching ground\-truth issue\.RepairUnsafe repair rateFraction of repair\-class decisions applied to synthetic cases marked as valid signals or cases whose expected action is preservation, flagging, or human review\.RepairUnnecessary modification rateFraction of repair\-class decisions whose associated issue does not match any synthetic ground\-truth case\.EvidenceEvidence coverageFraction of decisions that reference at least one evidence record available in the agent output\.EvidenceMean evidence\-strength scoreMean evidence\-strength value across the evidence records available in the agent output, including profiling, tool, and controlled retrieved evidence\.EvidenceUnsupported\-rule rateFraction of generated validation rules that do not reference available evidence\.EvidenceCitation alignmentMean, across decisions, of the maximum Jaccard similarity between the decision text and its cited evidence statements, reported for configurations with citation\-alignment checks enabled\.SafetyConservative flag rateFraction of decisions classified as flag\-only, preserve, human\-review, or reject\-repair\.SafetyValid\-signal preservation rateAmong injected valid\-signal cases detected as issues, the fraction assigned to preserve, flag\-only, or human\-review rather than repair\.SafetyHuman\-review referral rateFraction of decisions escalated for human review\.OperationalRuntimePer\-run execution time recorded in seconds and aggregated by dataset, mode, and configuration\.OperationalToken usePrompt, completion, and total token usage recorded for LLM\-based runs\.OperationalReproducibilityPairwise exact agreement across repeated runs of decision signatures constructed from issue identifiers and their assigned decision classes within each dataset–mode–configuration group\.Table[11](https://arxiv.org/html/2608.14765#S8.T11)summarises the roles and limitations of A0–A6\. A0 and A1 provide contrasting LLM and deterministic baselines and are not treated as a single\-factor ablation\. A2 provides the profiling\-aware LLM starting point for the progressive capability analysis\. The more direct comparisons are A2 versus A3 for executable Python validation, A3 versus A4 for controlled evidence retrieval, A4 versus A5 for source ranking and citation alignment, and A5 versus A6 for the conservative repair policy\.

Table 11:Comparison baselines and progressive ablation configurations\.ConfigurationImplemented descriptionExpected limitationA0: Schema\-only LLM baselineLLM with schema and sample records only; no profiling summaries, executable checks, evidence retrieval, ranking/alignment, conservative policy, reversibility, or provenance logging\.May hallucinate requirements, miss data\-derived patterns, or overinterpret values without profiling and executable evidence\.A1: Deterministic profiling\-and\-checking baselineDeterministic profiling, missingness analysis, duplicate detection, type inference, range checks, and provenance logging; no LLM call, retrieval, ranking/alignment, conservative policy, or reversible scripts\.Can detect structural/statistical patterns efficiently, but may treat statistical anomalies as errors without semantic, contextual, or conservative reasoning\.A2: LLM with profiling summariesLLM reasoning over profiling summaries with provenance logging; no executable Python validation, retrieval, ranking/alignment, conservative policy, or reversible scripts\.May support explanation and contextual reasoning, but still lacks executable validation and retrieved evidence support\.A3: LLM with profiling and Python toolsAdds executable Python checks for validation, parsing, duplicates, consistency, reversible\-script generation, and provenance logging; no retrieval, ranking/alignment, or conservative policy\.Can validate candidate issues through executable checks, but may still decide without retrieved contextual evidence or source\-ranking controls\.A4: Local\-corpus evidence\-retrieval configurationAdds retrieval from the controlled local evidence corpus while keeping profiling, Python tools, reversible scripts, and provenance logging; no source ranking or citation\-alignment checks\.Makes evidence records available, but retrieved evidence may not be strictly ranked, filtered, or aligned with final decisions\.A5: Source\-ranked evidence configurationAdds source ranking, filtering, evidence extraction, and citation\-alignment checks on top of A4; the full conservative repair policy is not enabled\.Can reduce unsupported\-rule behavior through evidence controls, but citation alignment may remain weak and repair behavior may still be insufficiently conservative\.A6: Full conservative evidence\-grounded configurationAdds the conservative repair policy on top of A5 while retaining profiling, executable tools, controlled evidence retrieval, source ranking, citation alignment, reversibility, and provenance logging\.More expensive and may flag, preserve, refer, or reject uncertain cases instead of performing direct repair; not expected to dominate all simpler configurations\.No p\-values, confidence intervals, or statistical significance tests are reported because they were not part of the completed analysis\. The evaluation therefore focuses on observed means, execution\-audit indicators, and exact reproducibility across repeated runs\. The hypotheses are interpreted using the observed directional patterns rather than statistical significance\. Original\-data results are kept separate from the controlled synthetic evaluation because original\-data issues may represent true errors, unusual but valid values, or undocumented conventions and cannot be scored as correct or incorrect without independent adjudication\.

## 9Results

The results are organised around execution validity, synthetic\-corruption performance, original\-data descriptive behavior, evidence grounding, safety, operational cost, and reproducibility\. They should be read as observed configuration trade\-offs in the completed exploratory ablation\. Synthetic\-corruption results use injected ground truth and can support detection, repair, and valid\-signal preservation metrics\. Original\-data results are descriptive because no trusted clean reference or manual adjudication exists\.

The experiment produced the expected 126 successful runs, with no final failed runs\. Table[12](https://arxiv.org/html/2608.14765#S9.T12)shows that JSON repair was used in 30 runs, postprocessing changed 31 saved outputs, and all 126 final outputs were schema\-valid after normalization\. These are implementation and reproducibility facts; no agent was rerun and no new cleaning decisions were introduced during postprocessing\.

Table 12:Experiment completion and postprocessing audit\.Audit itemVerified valueExpected design3×2×7×3=1263\\times 2\\times 7\\times 3=126runsRows in final run\-level metrics126Rows in final aggregate metrics42Successful final runs126Failed final runs0Runs requiring retry before success4Runs with JSON repair used30Outputs changed by postprocessing31Schema\-invalid outputs before normalization25Schema\-invalid outputs after normalization0Final schema\-valid outputs126/126Successful reversible\-script executions72/72Tables[13](https://arxiv.org/html/2608.14765#S9.T13)and[14](https://arxiv.org/html/2608.14765#S9.T14)report the controlled synthetic\-corruption results, while Figure[2](https://arxiv.org/html/2608.14765#S9.F2)provides a direct comparison of detection F1\-score across configurations\. A1, the deterministic profiling\-and\-checking baseline, achieved the highest detection F1\-score at 0\.561, with precision 0\.687 and recall 0\.484\. Among the LLM\-based configurations, A6 achieved the highest F1\-score at 0\.421, while A4 achieved the highest precision at 0\.928\. A0 performed poorly, with an F1\-score of 0\.013\. Within the progressive LLM\-based sequence, adding executable tools increased F1\-score from 0\.307 in A2 to 0\.402 in A3\. This pattern is consistent with H1, while the later configurations show that adding more capabilities does not consistently improve detection performance\.

Table 13:Controlled synthetic\-corruption detection and repair metrics by configuration\.A0A1A2A3A4A5A6000\.20\.20\.40\.40\.60\.60\.0130\.0130\.5610\.5610\.3070\.3070\.4020\.4020\.4070\.4070\.3760\.3760\.4210\.421ConfigurationSynthetic detection F1\-scoreFigure 2:Synthetic detection F1\-score across the seven evaluated configurations\. A0 and A1 are comparison baselines, while A2–A6 represent the progressive LLM\-based capability sequence\.Table 14:Controlled synthetic\-corruption safety and valid\-signal metrics by configuration\.A zero valid\-signal preservation rate should be interpreted with care because the metric is defined only over injected valid\-signal cases that were detected as issues\. A value of zero may therefore also occur when no injected valid\-signal case was detected\.

The repair and safety metrics require joint interpretation\. A1 achieved the highest safe\-repair rate at 0\.770 and the highest valid\-signal preservation rate at 1\.000, but it also produced unsafe repairs and unnecessary modifications\. The high safe\-repair rate does not mean that the proposed corrections were accurate: its repair\-match rate was 0\.000\. In fact, only A3 achieved a non\-zero repair\-match rate, at 0\.028, showing that successful direct correction remained very limited across all configurations\.

A6 produced no unsafe or unnecessary modifications in the synthetic summary, but it also produced no repair\-class decisions and therefore had zero safe repair and zero repair match\. Its behavior is better interpreted as conservative non\-repair rather than successful direct repair\. These results show a clear trade\-off between attempting repair and avoiding inappropriate modification\.

At dataset level, averaged over configurations and repetitions, EHR achieved the highest synthetic detection F1\-score at 0\.405, followed by German Credit at 0\.380 and Radiation at 0\.280\. These differences are consistent with H5, showing that the relative effectiveness of the evaluated configurations varies across datasets\. The current experiment does not isolate which specific dataset characteristics caused these differences\.

Original\-data results are shown in Tables[15](https://arxiv.org/html/2608.14765#S9.T15)and[16](https://arxiv.org/html/2608.14765#S9.T16)\. These values describe agent behavior, not accuracy\. A1 produced the largest mean number of issues and decisions, 10\.000 for both, while A5 produced the fewest decisions, 2\.222\. A6 had evidence coverage of 0\.556 and a human\-review rate of 0\.111 in the original\-data summary, but it also had the highest original\-data runtime and token consumption\.

Table 15:Original\-data descriptive behavior and evidence indicators by configuration\. Values are means over nine original\-data runs per configuration: three datasets and three repeated runs\.Table 16:Original\-data operational cost and structured\-output repair by configuration\. Values are means over nine original\-data runs per configuration\.Evidence metrics show partial but limited grounding\. In synthetic runs, evidence coverage was 0\.870 for A1, 0\.778 for A4, and 0\.722 for A2\. A5 and A6 had lower evidence coverage, at 0\.630 and 0\.519, but achieved the lowest unsupported\-rule rates, both at 0\.037\. Citation alignment was non\-zero only for the configurations with citation\-alignment checks enabled, reaching 0\.036 for A5 and 0\.041 for A6\. These low values show that retrieving, ranking, and recording evidence did not result in strong decision\-level citation alignment\. The results therefore distinguish evidence availability and rule support from direct alignment between cited evidence and individual cleaning decisions\.

Operational cost varied across configurations\. A1 was the fastest because it used deterministic profiling and no LLM calls\. Among the LLM\-based configurations, token use generally increased as additional capabilities were enabled, while runtime did not increase monotonically\. Across all runs, A6 had the highest mean runtime and token use, at 77\.466 seconds and 12916\.222 tokens\. In original\-data runs, A6 reached 138\.938 seconds and 14803\.000 tokens\. Reproducibility, measured as exact agreement of decision signatures, was highest for A1 at 0\.500, followed by A5 and A6 at 0\.444\. Because this metric requires exact agreement of issue identifiers and decision classes, it may count semantically similar outputs as different\. Figure[3](https://arxiv.org/html/2608.14765#S9.F3)visualises the configuration\-level trade\-off between synthetic detection performance and mean runtime across all runs\.

0010102020303040405050606070708080000\.20\.20\.40\.40\.60\.6A0A1A2A3A4A5A6Mean runtime across all runs \(s\)Synthetic detection F1\-scoreComparison baselinesProgressive LLM sequenceFigure 3:Configuration\-level trade\-off between synthetic detection performance and mean runtime across all 18 runs per configuration\. Filled squares denote the comparison baselines, while open circles denote the progressive LLM\-based sequence\.Four runs required a second attempt before success, but all completed successfully\. Structured\-output enforcement was needed for consistent metric computation, as reflected by the JSON repair and postprocessing counts in Table[12](https://arxiv.org/html/2608.14765#S9.T12)\. No separate qualitative case analysis was performed, so qualitative interpretation is limited to patterns recorded in the saved run artifacts and metrics\.

## 10Discussion

The results highlight a central characteristic of reference\-free agentic data cleaning: adding capabilities changes different aspects of system behaviour, but does not lead to a monotonic improvement in overall cleaning performance\. The strongest synthetic detection result was obtained by A1, the deterministic profiling\-and\-checking baseline, rather than by the most complete LLM configuration\. At the same time, the schema\-only LLM baseline A0 performed poorly, while incorporating profiling information in A2 substantially improved detection behaviour\. This suggests that structured, data\-derived evidence plays an important role in effective cleaning decisions and that LLM reasoning alone is not sufficient\. However, because A0 and A1 differ in both reasoning mechanism and available capabilities, their difference should not be interpreted as a single\-factor causal effect\.

Within the progressive LLM sequence, the clearest capability\-level improvement appeared when executable tools were introduced\. Moving from A2 to A3 increased synthetic detection F1\-score from 0\.307 to 0\.402, and the generated reversible scripts were successfully executed\. Even so, the repair\-match rate remained only 0\.028\. Tool access therefore improved the agent’s ability to validate suspected problems without resolving the more difficult question of what the correct replacement value should be\. This distinction is important in reference\-free cleaning because identifying that a value may be problematic and determining how it should be repaired are separate tasks that require different levels of evidence\. These observations are directionally consistent with H1 and help answer RQ1 and RQ2\.

The evidence\-related configurations show a similar distinction between having evidence available and actually grounding decisions in that evidence\. A5 and A6 achieved the lowest synthetic unsupported\-rule rates, both at 0\.037, suggesting that source\-ranking and citation controls were associated with better\-supported validation rules\. Their decision\-level citation\-alignment scores, however, remained very low at 0\.036 and 0\.041\. The controlled local corpus improved reproducibility by keeping the available evidence fixed across runs, but retrieval, ranking, and provenance logging did not ensure that the evidence cited for a decision directly supported that decision\. Evidence retrieval should therefore not be treated as equivalent to evidence grounding\. In its current form, the system is better characterised as evidence\-controlled and provenance\-aware than as a mature citation\-grounded autonomous repair system\. Stronger decision\-level alignment and independent validation of supporting evidence would be needed before such mechanisms could justify autonomous high\-impact repairs\. These findings address RQ3 and are consistent with H2\.

The conservative policy introduced in A6 produced another important trade\-off\. A6 made no unsafe or unnecessary modifications in the synthetic evaluation, but A5 had already achieved zero on both indicators before the conservative policy was added\. The A5–A6 comparison therefore does not provide clear support for H3 on these two safety measures\. The more noticeable effect of A6 was behavioural: it shifted the system toward abstention and escalation, producing no repair\-class decisions in the synthetic setting and referring some original\-data cases for human review\. This behaviour is broadly consistent with H4 and addresses RQ4, but it is better interpreted as conservative non\-repair than as improved repair effectiveness\. In applications where an incorrect modification may be more harmful than leaving an anomaly unresolved, this type of behaviour may still be desirable\.

These additional controls also came with operational costs\. A6 had the highest overall runtime and token consumption, whereas the deterministic A1 baseline was considerably less expensive because it required no LLM inference\. Runtime did not increase monotonically across the intermediate LLM configurations, indicating that cost depends not only on how many capabilities are enabled but also on inference behaviour, retrieval, and tool execution\. The results for RQ5 reinforce the multi\-objective nature of reference\-free cleaning: detection effectiveness, repair accuracy, evidence support, safety, reproducibility, and operational cost cannot be optimised independently\. Simpler configurations may be sufficient for exploratory detection, whereas stronger evidence controls and conservative decision policies may be more appropriate when the consequences of an incorrect repair are greater\.

The dataset\-level results also suggest that configuration effectiveness depends on data characteristics and cleaning context\. Mean synthetic detection F1\-score was highest for EHR at 0\.405, followed by German Credit at 0\.380 and Radiation at 0\.280, which is directionally consistent with H5\. The experiment does not isolate the causes of these differences\. Temporal patterns and rare events, for example, may contribute to the lower Radiation results, while the prompt sample of up to 10 records may provide insufficient information for longer temporal patterns, rare environmental events, or entity\-level relationships\. These explanations remain hypotheses and would require targeted experiments before they could be attributed to specific dataset properties\.

The original\-data runs provide a complementary view of system behaviour, but they should not be interpreted as an accuracy evaluation\. Without a trusted clean reference or independent adjudication, these runs show how the configurations detect issues, use evidence, make conservative decisions, escalate cases, and consume resources rather than whether the resulting decisions are objectively correct\. Keeping this distinction between controlled synthetic evaluation and original\-data behavioural auditing is important for avoiding unsupported accuracy claims in a reference\-free setting\.

Taken together, the hypotheses receive different levels of directional support\. The A2–A3 improvement is consistent with the executable\-validation component of H1, while the lower unsupported\-rule rates of the source\-ranked configurations, together with weak citation alignment, are consistent with H2\. H3 is not clearly supported by the A5–A6 comparison because A5 already had zero unsafe and unnecessary modifications before the conservative policy was introduced\. H4 is broadly consistent with the more conservative behaviour of A6 and its associated trade\-offs in direct repair and operational cost\. Finally, the differences across datasets are consistent with H5, although the specific dataset characteristics responsible for those differences were not isolated\.

Overall, the findings suggest that agentic data\-cleaning systems are better viewed as combinations of separately evaluable capabilities than as monolithic agents whose performance is expected to improve simply by adding more reasoning, retrieval, or tools\. Profiling, executable validation, evidence controls, conservative decision policies, and abstention affected different aspects of behaviour, and no configuration dominated across detection, repair, safety, evidence grounding, reproducibility, and operational cost\. Capability composition should therefore be selected according to the cleaning objective, the evidence available, and the consequences of an incorrect modification\. The main contribution of this study is an auditable framework and evaluation methodology for examining these trade\-offs, rather than a claim that an autonomous agent can safely clean arbitrary datasets without expert oversight\.

## 11Threats to Validity

The findings should be interpreted in light of several threats to validity that reflect the exploratory ablation design, the reference\-free setting, and the controlled implementation choices used in the experiment\.

- •Construct validity\.The metrics are operational approximations of safe reference\-free cleaning and do not capture every downstream use of a cleaned dataset\. Synthetic precision, recall, F1\-score, expected\-repair match, and valid\-signal preservation are meaningful only when injected ground truth is available\. Original\-data metrics describe behavior, evidence use, cost, and reproducibility, not accuracy\. Safe repair is also context\-dependent: a transformation may be acceptable for reporting but unsafe for anomaly detection, auditing, or forensic analysis\. In addition, the individual knowledge categories defined in the taxonomy were not independently ablated, so the experiment cannot determine whether any single category is necessary or sufficient\. The structured contextΓX\\Gamma\_\{X\}helps represent these factors but cannot replace domain judgement\.
- •Evidence and citation validity\.Evidence retrieval used a controlled local corpus rather than live online retrieval\. Evidence\-strength and citation\-alignment scores therefore reflect the implemented evidence records and automated scoring procedures, not independent human verification of source quality or decision support\. The low citation\-alignment values, and the fact that many final decisions cited profiling or executable\-check evidence, limit claims about external evidence grounding\.
- •Internal validity\.Synthetic corruption provides partial ground truth, but injected errors may be more regular, visible, or reversible than natural errors\. Original\-data outputs were not manually adjudicated, so they cannot support detection or repair accuracy claims\. A0 and A1 are contrasting baselines rather than a single\-factor ablation because they differ in both reasoning mechanism and available profiling capabilities\. Component\-level interpretation is therefore stronger for the progressive A2–A6 comparisons\. Prompt wording, output schema, temperature, model version, provider behavior, and postprocessing rules may also affect LLM\-based decisions\. Fixed prompts, three repeated runs, saved artifacts, and postprocessed metrics reduce these effects but do not remove them\. Three repetitions are also insufficient for strong inferential claims about run\-to\-run variability\.
- •External validity\.The experiment uses three datasets from finance, healthcare, and environmental monitoring, but the results may not generalise to legal, geospatial, multilingual, relational, streaming, or image\-derived data\. The sample of up to 10 records supplied to the LLM may be insufficient for long temporal patterns, rare events, or entity\-level constraints\. The study also used one LLM and provider setting for all LLM\-based runs, so generalisation across models and providers remains to be evaluated\.
- •Reproducibility and temporal validity\.The controlled local evidence corpus improves reproducibility compared with live online retrieval but limits the range and freshness of available evidence\. LLM services may also change because of model updates, routing, moderation, or infrastructure changes\. The experiment records the model configuration, provider, inference parameters, retry behavior, responses, run metadata, and postprocessed metrics needed to audit the reported runs\. Future experiments using online retrieval should preserve source snapshots or archived documents, while locally hosted or pinned open\-weight models could further reduce model\-version variability\.
- •Implementation and evaluation bias\.Profiling scripts, corruption generators, source\-ranking functions, citation\-alignment checks, reversible\-script generation, JSON repair, postprocessing, and metric computations may contain bugs or hidden assumptions\. Taxonomy definitions, corruption scenarios, conservative policies, evaluation metrics, and evidence\-ranking weights also reflect researcher judgement\. Saved intermediate artifacts, execution logs, output audits, and explicit scoring logic reduce this risk but do not eliminate it\. Independent domain experts and multiple reviewers should evaluate the framework in future replications\.

## 12Conclusion

This study examined how different capabilities affect reference\-free data cleaning with LLM agents\. It proposed an evidence\-grounded framework that combines structured context, profiling, LLM reasoning, executable checks, controlled local evidence retrieval, source ranking, citation alignment, conservative repair, reversible scripts, and provenance logging\. The experiment produced 126 successful runs across three datasets, two evaluation settings, and seven configurations\. By separating controlled synthetic\-corruption evaluation from original\-data descriptive auditing, the study avoids treating unverified anomalies in the original data as ground\-truth errors\.

The results show that the evaluated capabilities affect different aspects of the cleaning process and do not produce consistent improvements across all metrics\. The deterministic profiling baseline achieved the highest synthetic detection F1\-score, while adding executable tools improved detection within the progressive LLM\-based sequence\. Source\-ranking and citation controls were associated with low unsupported\-rule rates, although citation alignment remained weak\. The full conservative configuration avoided unsafe and unnecessary modifications in the synthetic summary, but these values were already zero in A5, and A6 performed no successful direct repairs\. It also introduced the highest overall runtime and token use\. Overall, no configuration dominated across detection, repair, safety, evidence grounding, reproducibility, and operational cost\. Reference\-free agentic data cleaning should therefore be viewed as a multi\-objective problem involving trade\-offs among these criteria\.

Future work should evaluate additional datasets, models, and evidence providers; compare controlled local and online evidence retrieval; include independent domain\-expert review of original\-data outputs; improve decision\-level evidence alignment, repair evaluation, and semantic reproducibility measures; and examine individual knowledge categories through controlled ablation\. In particular, independently adding or removing schema, temporal, entity, domain, policy, task, and risk knowledge would help determine which forms of knowledge are useful for different classes of reference\-free cleaning decisions\.

## Declarations

### Conflict of Interest

The author declares that there are no conflicts of interest\.

### Ethics, Informed Consent, and Data Use

This study did not recruit human participants or collect new human\-subject data\. The experiments used publicly available datasets obtained from the sources cited in the manuscript\. No additional informed consent was sought for this secondary analysis\.

### Use of AI Technology

AI\-based tools, including ChatGPT, were used to assist with language editing, clarity, manuscript organisation, and consistency checking\. The author independently reviewed and verified all scientific claims, analyses, interpretations, and conclusions and remains fully responsible for the manuscript content\. AI tools were not used to execute the reported experiments or generate the experimental data or results\.

## Data and Code Availability

The datasets used in this study are publicly available from the sources cited in the manuscript\. A blinded repository containing the source code, experiment scripts, configuration files, controlled evidence corpus, and saved experimental artefacts used to produce and inspect the reported results is available for review at:[https://drive\.google\.com/drive/folders/1Cqfxg\_BxLBh\_eMnMsFyTDPSQuSmo2uTW?usp=sharing](https://drive.google.com/drive/folders/1Cqfxg_BxLBh_eMnMsFyTDPSQuSmo2uTW?usp=sharing)\. The blinded repository will be replaced by a permanent public archival record after acceptance\.

## References

- \[1\]Z\. Abedjan, X\. Chu, D\. Deng, R\. C\. Fernandez, I\. F\. Ilyas, M\. Ouzzani, P\. Papotti, M\. Stonebraker, and N\. Tang\(2016\)Detecting data errors: where are we and what needs to be done?\.Proceedings of the VLDB Endowment9\(12\),pp\. 993–1004\.External Links:[Document](https://dx.doi.org/10.14778/2994509.2994518)Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p1.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[2\]\(2009\)Methodologies for data quality assessment and improvement\.ACM Computing Surveys41\(3\),pp\. 16:1–16:52\.External Links:[Document](https://dx.doi.org/10.1145/1541880.1541883)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p1.1)\.
- \[3\]C\. Batini and M\. Scannapieco\(2006\)Data quality: concepts, methodologies and techniques\.Springer,Berlin, Heidelberg\.External Links:[Document](https://dx.doi.org/10.1007/3-540-33173-5),ISBN 978\-3\-540\-33172\-8Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p1.1),[§2](https://arxiv.org/html/2608.14765#S2.p1.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[4\]F\. Biester, M\. Abdelaal, and D\. Del Gaudio\(2024\)LLMClean: context\-aware tabular data cleaning via LLM\-generated OFDs\.arXiv preprint arXiv:2404\.18681\.External Links:[Document](https://dx.doi.org/10.48550/arXiv.2404.18681),2404\.18681Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p2.1),[§2](https://arxiv.org/html/2608.14765#S2.p4.1)\.
- \[5\]P\. Bohannon, M\. Flaster, W\. Fan, and R\. Rastogi\(2005\)A cost\-based model and effective heuristic for repairing constraints by value modification\.InProceedings of the 2005 ACM SIGMOD International Conference on Management of Data,pp\. 143–154\.External Links:[Document](https://dx.doi.org/10.1145/1066157.1066175)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[6\]P\. Buneman, S\. Khanna, and W\. Tan\(2001\)Why and where: a characterization of data provenance\.InDatabase Theory – ICDT 2001,Lecture Notes in Computer Science, Vol\.1973,pp\. 316–330\.External Links:[Document](https://dx.doi.org/10.1007/3-540-44503-X%5F20)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p3.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[7\]V\. Chandola, A\. Banerjee, and V\. Kumar\(2009\)Anomaly detection: a survey\.ACM Computing Surveys41\(3\),pp\. 15:1–15:58\.External Links:[Document](https://dx.doi.org/10.1145/1541880.1541882)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[8\]J\. Cheney, L\. Chiticariu, and W\. Tan\(2009\)Provenance in databases: why, how, and where\.Foundations and Trends in Databases1\(4\),pp\. 379–474\.External Links:[Document](https://dx.doi.org/10.1561/1900000006)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p3.1)\.
- \[9\]P\. Christen\(2012\)Data matching: concepts and techniques for record linkage, entity resolution, and duplicate detection\.Data\-Centric Systems and Applications,Springer Berlin Heidelberg\.External Links:[Document](https://dx.doi.org/10.1007/978-3-642-31164-2)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1)\.
- \[10\]X\. Chu, J\. Morcos, I\. F\. Ilyas, M\. Ouzzani, P\. Papotti, N\. Tang, and Y\. Ye\(2015\)KATARA: a data cleaning system powered by knowledge bases and crowdsourcing\.InProceedings of the 2015 ACM SIGMOD International Conference on Management of Data,pp\. 1247–1261\.External Links:[Document](https://dx.doi.org/10.1145/2723372.2749431)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p3.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[11\]A\. Ebaid, A\. K\. Elmagarmid, I\. F\. Ilyas, M\. Ouzzani, J\. Quiané\-Ruiz, N\. Tang, and S\. Yin\(2013\)NADEEF: a generalized data cleaning system\.Proceedings of the VLDB Endowment6\(12\),pp\. 1218–1221\.External Links:[Document](https://dx.doi.org/10.14778/2536274.2536280)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1)\.
- \[12\]H\. Fadlallah, R\. Kilany, H\. Dhayne, R\. El Haddad, R\. Haque, Y\. Taher, and A\. Jaber\(2023\)Context\-aware big data quality assessment: a scoping review\.Journal of Data and Information Quality15\(3\),pp\. 1–33\.External Links:[Document](https://dx.doi.org/10.1145/3603707)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p1.1)\.
- \[13\]H\. Fadlallah, R\. Kilany, M\. Haber, and A\. Jaber\(2023\)CTXDQ: an automated context\-driven data quality assessment\.In2023 IEEE 4th International Multidisciplinary Conference on Engineering Technology \(IMCET\),pp\. 32–37\.External Links:[Document](https://dx.doi.org/10.1109/IMCET59736.2023.10368231)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p1.1)\.
- \[14\]H\. Fadlallah, Y\. Taher, and A\. Jaber\(2018\)RaDEn: a scalable and efficient radiation data engineering\.InProceedings of the 1st International Conference on Big Data and Cyber\-Security Intelligence,CEUR Workshop Proceedings, Vol\.2343,pp\. 89–93\.Cited by:[§7](https://arxiv.org/html/2608.14765#S7.p1.1)\.
- \[15\]W\. Fan and F\. Geerts\(2012\)Foundations of data quality management\.Synthesis Lectures on Data Management, Vol\.4,Morgan & Claypool Publishers\.External Links:[Document](https://dx.doi.org/10.2200/S00439ED1V01Y201207DTM030)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1)\.
- \[16\]H\. Hofmann\(1994\)Statlog \(German Credit Data\)\.Note:UCI Machine Learning Repository[https://doi\.org/10\.24432/C5NC77](https://doi.org/10.24432/C5NC77)Cited by:[§7](https://arxiv.org/html/2608.14765#S7.p1.1)\.
- \[17\]Z\. Huang and E\. Wu\(2024\)Cocoon: semantic table profiling using large language models\.arXiv preprint arXiv:2404\.12552\.External Links:[Document](https://dx.doi.org/10.48550/arXiv.2404.12552),2404\.12552Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p2.1),[§2](https://arxiv.org/html/2608.14765#S2.p4.1)\.
- \[18\]I\. F\. Ilyas and X\. Chu\(2019\)Data cleaning\.ACM Books,New York, NY, USA\.External Links:[Document](https://dx.doi.org/10.1145/3310205),ISBN 978\-1\-4503\-7152\-0Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p1.1)\.
- \[19\]S\. Kandel, A\. Paepcke, J\. M\. Hellerstein, and J\. Heer\(2011\)Wrangler: interactive visual specification of data transformation scripts\.InProceedings of the SIGCHI Conference on Human Factors in Computing Systems,pp\. 3363–3372\.External Links:[Document](https://dx.doi.org/10.1145/1978942.1979444)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1)\.
- \[20\]S\. Krishnan, J\. Wang, E\. Wu, M\. J\. Franklin, and K\. Goldberg\(2016\)ActiveClean: interactive data cleaning for statistical modeling\.Proceedings of the VLDB Endowment9\(12\),pp\. 948–959\.External Links:[Document](https://dx.doi.org/10.14778/2994509.2994514)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1)\.
- \[21\]A\. K\. Lew, M\. Agrawal, D\. Sontag, and V\. K\. Mansinghka\(2021\)PClean: bayesian data cleaning at scale with domain\-specific probabilistic programming\.InProceedings of the 24th International Conference on Artificial Intelligence and Statistics,Proceedings of Machine Learning Research, Vol\.130,pp\. 1927–1935\.Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1)\.
- \[22\]P\. Lewis, E\. Perez, A\. Piktus, F\. Petroni, V\. Karpukhin, N\. Goyal, H\. Küttler, M\. Lewis, W\. Yih, T\. Rocktäschel, S\. Riedel, and D\. Kiela\(2020\)Retrieval\-augmented generation for knowledge\-intensive NLP tasks\.InAdvances in Neural Information Processing Systems,Vol\.33,pp\. 9459–9474\.Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p3.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[23\]L\. Li, L\. Fang, B\. Ludäscher, and V\. I\. Torvik\(2025\)AutoDCWorkflow: LLM\-based data cleaning workflow auto\-generation and benchmark\.InFindings of the Association for Computational Linguistics: EMNLP 2025,Suzhou, China,pp\. 7766–7780\.External Links:[Document](https://dx.doi.org/10.18653/v1/2025.findings-emnlp.410)Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p2.1),[§2](https://arxiv.org/html/2608.14765#S2.p4.1)\.
- \[24\]Z\. A\. Naeem, M\. S\. Ahmad, M\. Eltabakh, M\. Ouzzani, and N\. Tang\(2024\)RetClean: retrieval\-based data cleaning using LLMs and data lakes\.Proceedings of the VLDB Endowment17\(12\),pp\. 4421–4424\.External Links:[Document](https://dx.doi.org/10.14778/3685800.3685890)Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p2.1),[§2](https://arxiv.org/html/2608.14765#S2.p3.1)\.
- \[25\]A\. Narayan, I\. Chami, L\. Orr, S\. Arora, and C\. Ré\(2022\)Can foundation models wrangle your data?\.Proceedings of the VLDB Endowment16\(4\),pp\. 738–746\.External Links:[Document](https://dx.doi.org/10.14778/3574245.3574258)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p4.1)\.
- \[26\]F\. Naumann\(2014\)Data profiling revisited\.ACM SIGMOD Record42\(4\),pp\. 40–49\.External Links:[Document](https://dx.doi.org/10.1145/2590989.2590995)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1)\.
- \[27\]L\. L\. Pipino, Y\. W\. Lee, and R\. Y\. Wang\(2002\)Data quality assessment\.Communications of the ACM45\(4\),pp\. 211–218\.External Links:[Document](https://dx.doi.org/10.1145/505248.506010)Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p1.1),[§2](https://arxiv.org/html/2608.14765#S2.p1.1)\.
- \[28\]D\. Qi, Z\. Miao, and J\. Wang\(2024\)CleanAgent: automating data standardization with LLM\-based agents\.arXiv preprint arXiv:2403\.08291\.External Links:[Document](https://dx.doi.org/10.48550/arXiv.2403.08291),2403\.08291Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p2.1),[§2](https://arxiv.org/html/2608.14765#S2.p4.1)\.
- \[29\]E\. Rahm and H\. H\. Do\(2000\)Data cleaning: problems and current approaches\.IEEE Data Engineering Bulletin23\(4\),pp\. 3–13\.Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p1.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[30\]V\. Raman and J\. M\. Hellerstein\(2001\)Potter’s wheel: an interactive data cleaning system\.InProceedings of the 27th International Conference on Very Large Data Bases,pp\. 381–390\.Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1)\.
- \[31\]H\. Rashkin, V\. Nikolaev, M\. Lamm, L\. Aroyo, M\. Collins, D\. Das, S\. Petrov, G\. S\. Tomar, I\. Turc, and D\. Reitter\(2023\)Measuring attribution in natural language generation models\.Computational Linguistics49\(4\),pp\. 777–840\.External Links:[Document](https://dx.doi.org/10.1162/coli%5Fa%5F00486)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p3.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[32\]T\. Rekatsinas, X\. Chu, I\. F\. Ilyas, and C\. Ré\(2017\)HoloClean: holistic data repairs with probabilistic inference\.Proceedings of the VLDB Endowment10\(11\),pp\. 1190–1201\.External Links:[Document](https://dx.doi.org/10.14778/3137628.3137631)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p2.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[33\]T\. Schick, J\. Dwivedi\-Yu, R\. Dessì, R\. Raileanu, M\. Lomeli, E\. Hambro, L\. Zettlemoyer, N\. Cancedda, and T\. Scialom\(2023\)Toolformer: language models can teach themselves to use tools\.InAdvances in Neural Information Processing Systems,Vol\.36\.Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p4.1)\.
- \[34\]F\. Serra, V\. Peralta, A\. Marotta, and P\. Marcel\(2024\)Use of context in data quality management: a systematic literature review\.ACM Journal of Data and Information Quality16\(3\),pp\. 19:1–19:41\.External Links:[Document](https://dx.doi.org/10.1145/3672082)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p1.1)\.
- \[35\]G\. Srivastav\(2024\)EHR Dataset\.Note:Kaggle[https://kaggle\.com/datasets/gauravsrivastav2507/ehr\-dataset](https://kaggle.com/datasets/gauravsrivastav2507/ehr-dataset)Cited by:[§7](https://arxiv.org/html/2608.14765#S7.p1.1)\.
- \[36\]J\. Thorne, A\. Vlachos, C\. Christodoulopoulos, and A\. Mittal\(2018\)FEVER: a large\-scale dataset for fact extraction and VERification\.InProceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,pp\. 809–819\.External Links:[Document](https://dx.doi.org/10.18653/v1/N18-1074)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p3.1)\.
- \[37\]Y\. Wand and R\. Y\. Wang\(1996\)Anchoring data quality dimensions in ontological foundations\.Communications of the ACM39\(11\),pp\. 86–95\.External Links:[Document](https://dx.doi.org/10.1145/240455.240479)Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p1.1),[§2](https://arxiv.org/html/2608.14765#S2.p1.1)\.
- \[38\]R\. Y\. Wang and D\. M\. Strong\(1996\)Beyond accuracy: what data quality means to data consumers\.Journal of Management Information Systems12\(4\),pp\. 5–33\.External Links:[Document](https://dx.doi.org/10.1080/07421222.1996.11518099)Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p1.1),[§2](https://arxiv.org/html/2608.14765#S2.p1.1),[§5](https://arxiv.org/html/2608.14765#S5.p1.1)\.
- \[39\]World Wide Web Consortium\(2013\)PROV\-DM: the PROV data model\.W3C RecommendationWorld Wide Web Consortium\.External Links:[Link](https://www.w3.org/TR/prov-dm/)Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p3.1)\.
- \[40\]S\. Yao, J\. Zhao, D\. Yu, N\. Du, I\. Shafran, K\. Narasimhan, and Y\. Cao\(2023\)ReAct: synergizing reasoning and acting in language models\.InInternational Conference on Learning Representations,Cited by:[§2](https://arxiv.org/html/2608.14765#S2.p4.1)\.
- \[41\]S\. Zhang, Z\. Huang, and E\. Wu\(2024\)Data cleaning using large language models\.arXiv preprint arXiv:2410\.15547\.External Links:[Document](https://dx.doi.org/10.48550/arXiv.2410.15547),2410\.15547Cited by:[§1](https://arxiv.org/html/2608.14765#S1.p2.1),[§2](https://arxiv.org/html/2608.14765#S2.p4.1)\.

Similar Articles

When Helping Hurts and How to Fix It: Multi-Agent Debate for Data Cleaning

arXiv cs.AI

This paper investigates when multi-agent debate helps or hurts data cleaning, finding that debate degrades generation due to critique-induced confusion but improves error detection. It proposes a debate benefit condition and shows that adversarial separation with code-execution grounding produces the first configuration to significantly exceed single-agent performance on a generative task.

Agentic Data Environments

arXiv cs.AI

This paper introduces Agentic Data Environments, focusing on the shift from read-only agents to read-write agents that mutate environments with consequences. It discusses the value proposition of agentic automation and the asymmetry between benefits and catastrophic costs of failures.

Neurodata Without Boredom: Benchmarking Agentic AI for Data Reuse

arXiv cs.LG

This paper benchmarks agentic AI systems on the task of loading, understanding, and reformatting fragmented neuroscience data, finding that while agents perform well on subtasks, they rarely achieve fully error-free end-to-end solutions and human oversight remains necessary.

AgenticDataBench: A Comprehensive Benchmark for Data Agents

Hugging Face Daily Papers

Introduces AgenticDataBench, a comprehensive benchmark for evaluating LLM-based data agents across diverse domains with fine-grained skill-based metrics, including real-world B2B use cases and synthetic tasks.