RGLD: Randomized Global-Local Density Estimation for Tabular Anomaly Detection
Summary
RGLD combines global random-feature density estimation with local neighbor analysis for efficient unsupervised tabular anomaly detection, achieving top AUROC performance on 47 datasets while being 50x-580x faster than deep detectors.
View Cached Full Text
Cached at: 06/30/26, 05:30 AM
# RGLD: Randomized Global-Local Density Estimation for Tabular Anomaly Detection
Source: [https://arxiv.org/html/2606.28970](https://arxiv.org/html/2606.28970)
Quanling Zhao1Jiaying Yang1Ye Tian1Josh Victoria1Zhijun Wang1 Pietro Mercati2Onat Gungor1Tajana Rosing1 1Computer Science and Engineering, University of California San Diego 2Intel Corporation \{quzhao,jiy018,yet002,jvictoria,zhw106,ogungor,tajana\}@ucsd\.edu pietro\.mercati@intel\.com
###### Abstract
Unsupervised tabular anomaly detection requires methods that are accurate, robust across heterogeneous datasets, and computationally efficient\. Classical statistical detectors are often efficient, but they usually rely on a fixed data view and a single notion of abnormality\. Deep anomaly detectors can learn more flexible scoring functions, but they are substantially slower and difficult to tune in unsupervised settings due to the lack of a reliable supervisory signal\. We proposeRGLD, a randomized global\-local density estimator for efficient unsupervised tabular anomaly detection\. RGLD combines a global random\-feature density branch, which identifies samples in broadly low\-density regions, with a local neighbor branch, which detects samples that are weakly supported by nearby observations\. Both branches operate over feature\-bagged randomized views, allowing RGLD to expose anomaly evidence that may be hidden in any single representation\. We conduct experiments on 47 tabular datasets against 23 statistical and deep anomaly detection baselines under fully unsupervised setting\. RGLD achieves the strongest dataset\-level AUROC performance, ranking 1st in dataset wins, and ranks 2nd in AUPRC wins\. RGLD is also faster than all evaluated deep detectors, achieving 50×\\times–580×\\timesspeedups, and remains competitive with statistical methods in runtime, yielding a favorable accuracy\-efficiency tradeoff\.
## 1Introduction
Unsupervised anomaly detection is a fundamental problem in machine learning with wide\-ranging applications\(Hanet al\.,[2022](https://arxiv.org/html/2606.28970#bib.bib40); Jianget al\.,[2023](https://arxiv.org/html/2606.28970#bib.bib41); Gungoret al\.,[2024](https://arxiv.org/html/2606.28970#bib.bib3); Chenet al\.,[2025](https://arxiv.org/html/2606.28970#bib.bib42); Chatterjee and Ahmed,[2022](https://arxiv.org/html/2606.28970#bib.bib49)\)\. Given a dataset dominated by normal samples, the goal is to assign high anomaly scores to rare, irregular, or structurally inconsistent observations, without access to labels\. As datasets continue to grow and anomaly detection is increasingly deployed in time\-sensitive applications, efficiency and scalability become central requirements\.
A long\-standing principle in anomaly detection is that anomalies are associated with low\-density or weakly supported regions of the data distribution\(Chandolaet al\.,[2009](https://arxiv.org/html/2606.28970#bib.bib43); Ruffet al\.,[2021](https://arxiv.org/html/2606.28970#bib.bib44)\)\. This idea motivates many statistical methods, including nearest\-neighbor detectors\(Ramaswamyet al\.,[2000](https://arxiv.org/html/2606.28970#bib.bib26)\), local density estimators\(Breuniget al\.,[2000](https://arxiv.org/html/2606.28970#bib.bib2)\), kernel methods\(Schölkopfet al\.,[2001](https://arxiv.org/html/2606.28970#bib.bib6)\), isolation\-based methods\(Liuet al\.,[2008](https://arxiv.org/html/2606.28970#bib.bib7)\), and histogram\-based approaches\(Goldstein and Dengel,[2012](https://arxiv.org/html/2606.28970#bib.bib10)\)\. These methods are attractive because they are often simple, interpretable, and applicable without supervision\. However, many statistical detectors are limited by two fixed choices: how abnormality is defined and where it is measured\. First, each method typically adopts a particular notion of abnormality\. For example, density\-based methods treat anomalies as points in low\-density regions, while nearest\-neighbor methods treat anomalies as points with weak local support\. These criteria are complementary: a point may be globally rare but not locally isolated, or locally isolated without being globally extreme\. Second, a given notion of abnormality is often evaluated in a fixed view of the data, such as the full feature space, a chosen distance metric, and a scale\. This can fail when the anomaly signal is visible only in a subset of features or under a different projection\. In such cases, irrelevant or high\-variance features can dilute the anomaly signal, making a point appear well supported in the full space even though it is clearly isolated in an informative subspace\(Aggarwal and Yu,[2001](https://arxiv.org/html/2606.28970#bib.bib39); Kriegelet al\.,[2009](https://arxiv.org/html/2606.28970#bib.bib15)\)\. Thus, robust tabular anomaly detection requires both diverse notions of abnormality and diverse views in which those notions are evaluated\.
Deep anomaly detectors offer another route by learning nonlinear representations or anomaly scoring functions\(Ruffet al\.,[2018](https://arxiv.org/html/2606.28970#bib.bib45); Zonget al\.,[2018](https://arxiv.org/html/2606.28970#bib.bib17); Panget al\.,[2021](https://arxiv.org/html/2606.28970#bib.bib46)\)\. This flexibility can be valuable when anomalies are not well captured by a rigid notion of abnormality\. However, in fully unsupervised settings, the same flexibility also creates a practical challenge as there is no reliable supervisory signal for training or choosing objectives\. As a result, deep detectors often rely on proxy learning tasks whose effectiveness can vary substantially across datasets\. They also introduce additional training cost and optimization variability, and benchmark studies have found that they can be orders of magnitude slower than lightweight statistical methods\(Hanet al\.,[2022](https://arxiv.org/html/2606.28970#bib.bib40); Jianget al\.,[2023](https://arxiv.org/html/2606.28970#bib.bib41)\)\.
This motivates a different question: can we obtain diverse multi\-view anomaly signals without the computational burden of deep anomaly detectors? We argue that for tabular anomaly detection, a promising path is to revisit classical density principles through randomized computation\. Instead of relying on a single view or a single notion of abnormality, we can generate many inexpensive randomized views of the data and aggregate their anomaly signals\. Each view provides a partial estimate of abnormality, but the diversity across views and anomaly mechanisms can expose different anomalies and reduce dependence on any single notion of abnormality\.
Built around this idea, we proposeRGLD:RandomizedGlobal\-LocalDensity Estimation for Tabular Anomaly Detection, an efficient and scalable detector for fully unsupervised tabular anomaly detection\. RGLD combines two complementary scoring branches\. The global branch uses random\-feature density estimation to identify samples in broadly low\-density regions, capturing global rarity while avoiding expensive pairwise density computation\. The local neighbor branch measures neighborhood support in randomized projected spaces, capturing locally isolated samples that may not be globally extreme\. RGLD further ensembles these scores over feature\-bagged randomized views, revealing anomalies hidden in the full feature space\. Finally, rank\-based aggregation combines the resulting heterogeneous scores into a stable anomaly ranking\. This design yields a simple, parallelizable, and highly efficient unsupervised detector for settings where both detection accuracy and runtime matter\.
- •We proposeRGLD, a fully unsupervised framework that turns classical density and neighborhood principles into scalable randomized estimators for tabular anomaly detection\.
- •We provide an analysis showing how feature\-bagged views can strengthen sparse anomaly contrast, while random\-feature density estimation and sampled\-reference neighbor scoring preserve useful support signals without conventional quadratic pairwise costs\.
- •Finally, we evaluate RGLD on 47 ADBench datasets against 23 statistical and deep baselines under fully unsupervised setting\. RGLD ranks 1st in AUROC wins and 2nd in AUPRC wins across datasets, while running 50×\\times–580×\\timesfaster than evaluated deep anomaly detectors, yielding a favorable accuracy\-efficiency tradeoff\.
More broadly, RGLD estimates two complementary density\-derived signals \(global KDE\-like support and local neighborhood support\) across feature\-bagged randomized views, showing that simple statistical principles can remain highly competitive when redesigned around randomized computation\.
## 2Related Work
Statistical and Randomized Anomaly Detection:Statistical detectors define anomaly scores from explicit assumptions about distance, density, support, isolation, or distributional tails\. Distance\- and neighborhood\-based methods such askkNN outlier detection\(Ramaswamyet al\.,[2000](https://arxiv.org/html/2606.28970#bib.bib26)\), LOF\(Breuniget al\.,[2000](https://arxiv.org/html/2606.28970#bib.bib2)\), COF\(Tanget al\.,[2002](https://arxiv.org/html/2606.28970#bib.bib4)\), and subspace outlier scoring\(Kriegelet al\.,[2009](https://arxiv.org/html/2606.28970#bib.bib15)\)identify samples with weak local support or abnormal behavior in selected subspaces\. Other methods rely on cluster structure, as in CBLOF\(Heet al\.,[2003](https://arxiv.org/html/2606.28970#bib.bib5)\), one\-class support estimation, as in one\-class SVM\(Schölkopfet al\.,[2001](https://arxiv.org/html/2606.28970#bib.bib6)\), or low\-dimensional projection and reconstruction, as in PCA\-based detection\(Shyuet al\.,[2003](https://arxiv.org/html/2606.28970#bib.bib14)\)\. Efficient distributional detectors such as HBOS\(Goldstein and Dengel,[2012](https://arxiv.org/html/2606.28970#bib.bib10)\), COPOD\(Liet al\.,[2020](https://arxiv.org/html/2606.28970#bib.bib11)\), and ECOD\(Liet al\.,[2022](https://arxiv.org/html/2606.28970#bib.bib12)\)score deviations from marginal, copula\-based, or empirical feature distributions\. Randomized and ensemble methods reduce dependence on a single detector or data view: Feature Bagging\(Lazarevic and Kumar,[2005](https://arxiv.org/html/2606.28970#bib.bib8)\)ensembles detectors over feature subsets, Isolation Forest\(Liuet al\.,[2008](https://arxiv.org/html/2606.28970#bib.bib7)\)uses randomized partitions, LODA\(Pevnỳ,[2016](https://arxiv.org/html/2606.28970#bib.bib9)\)aggregates random\-projection histograms, and ADERH\(Duraniet al\.,[2026](https://arxiv.org/html/2606.28970#bib.bib13)\)builds an ensemble from randomized hypersphere pairs\. Zimek et al\.\(Zimeket al\.,[2014](https://arxiv.org/html/2606.28970#bib.bib16)\)provide a broader discussion of ensemble methods for unsupervised outlier detection\. These methods demonstrate the strength of lightweight statistical scoring and randomization\. However, most emphasize a primary scoring principle, such as local density, isolation, marginal tail behavior, or projection\-based histograms\. RGLD instead explicitly combines global density support and local neighborhood support, and evaluates both across feature\-bagged randomized views and multiple density scales\.
Deep Unsupervised Anomaly Detection:Deep anomaly detectors replace fixed statistical scores with learned representations or proxy objectives\. Deep SVDD\(Ruffet al\.,[2018](https://arxiv.org/html/2606.28970#bib.bib45)\)learns a representation that concentrates training samples around a hypersphere center, while REPEN\(Panget al\.,[2018](https://arxiv.org/html/2606.28970#bib.bib27)\)learns representations for random distance\-based outlier scoring\. Reconstruction\- and density\-based approaches include DAGMM\(Zonget al\.,[2018](https://arxiv.org/html/2606.28970#bib.bib17)\), which combines an autoencoder with a Gaussian mixture density estimator, and RCA\(Liuet al\.,[2021](https://arxiv.org/html/2606.28970#bib.bib23)\), which uses a collaborative autoencoder for anomaly detection\. Other methods construct self\-supervised objectives for tabular or general data: RDP\(Wanget al\.,[2019](https://arxiv.org/html/2606.28970#bib.bib22)\)predicts random distances, GOAD\(Bergman and Hoshen,[2020](https://arxiv.org/html/2606.28970#bib.bib18)\)performs transformation classification, NeuTraL\(Qiuet al\.,[2021](https://arxiv.org/html/2606.28970#bib.bib19)\)learns neural transformations, ICL\(Shenkar and Wolf,[2022](https://arxiv.org/html/2606.28970#bib.bib20)\)uses internal contrastive learning, and SLAD\(Xuet al\.,[2023b](https://arxiv.org/html/2606.28970#bib.bib21)\)constructs scale\-based supervisory signals\. DIF\(Xuet al\.,[2023a](https://arxiv.org/html/2606.28970#bib.bib47)\)further combines deep representations with isolation\-based scoring\. Although these methods can learn flexible anomaly scores, fully unsupervised tabular anomaly detection provides limited guidance for selecting architectures, proxy tasks, and optimization objectives, and introduces substantial computational cost\. RGLD instead seeks flexible anomaly evidence through randomized statistical computation: it combines different anomaly signals and views without requiring a deep learned representation\.
## 3Why Randomized Global\-Local Density Estimation?
Figure 1:Unknown anomaly scale\.Left:Fine\-scale anomalies occur near a dense cluster, while broad\-scale anomalies occur around a diffuse cluster\.Right:Small and large bandwidths favor different anomaly scales, while multi\-sigma scoring provides a more balanced signal when the correct scale is unknown\.We first use simple synthetic examples to motivate why RGLD is built around randomized global\-local density estimation\. In fully unsupervised anomaly detection, labels are unavailable, so one of the most general principles is to measure how well each sample is supported by the observed data distribution\. Under this view, normal samples tend to lie in high\-support regions, while anomalies are weakly supported, either because they occur in globally low\-density regions or because they are locally isolated from nearby samples\(Chandolaet al\.,[2009](https://arxiv.org/html/2606.28970#bib.bib43); Ruffet al\.,[2021](https://arxiv.org/html/2606.28970#bib.bib44)\)\. This support\-based perspective is attractive for tabular data because it is label\-free, model\-agnostic, and closely connected to many statistical detectors\. However, turning this principle into a robust detector is nontrivial: the relevant density scale is unknown, global and local notions of support capture different anomaly mechanisms, and the feature view in which the anomaly is visible is usually unknown\. The examples below illustrate these three challenges and motivate the main design choices of RGLD\.
Unknown Anomaly Scale:A central difficulty in density\-based anomaly detection is that the appropriate density scale is unknown\. As shown in Figure[1](https://arxiv.org/html/2606.28970#S3.F1), KDE\-style density scoring requires a bandwidthσ\\sigmathat controls the resolution of the density estimate\(Silverman,[2018](https://arxiv.org/html/2606.28970#bib.bib38)\)\. However, anomalies may appear at different resolutions\. Fine\-scale anomalies may occur near a dense normal cluster, while broad\-scale anomalies may be unusual only relative to a more diffuse normal structure\. A single bandwidth can therefore emphasize one anomaly type while suppressing another\. This motivates the multi\-σ\\sigmadesign of RGLD’s global density branch, which aggregates density evidence across several bandwidths instead of committing to one fixed resolution\.
Figure 2:Complementary evidence and view dependence\.A\.Global density scoring detects broadly low\-density anomalies, while localkkNN isolation detects samples that are weakly supported by nearby observations\. Their combination captures complementary anomaly mechanisms\.B\.Anomalies can be hidden in a poor view but become apparent in an informative projected view\. Randomized view ensembling improves robustness by aggregating evidence across many perspectives\.Global Rarity and Local Isolation Are Complementary:A second challenge is that abnormality can take different forms\. Some anomalies are globally rare and lie in broadly low\-density regions of the data distribution\. Other anomalies are locally isolated as they may not be globally extreme, but they are poorly supported relative to nearby samples\. A detector based only on global density or only on local isolation can miss one of these cases\. Here, local isolation is measured using akkNN isolation score\(Ramaswamyet al\.,[2000](https://arxiv.org/html/2606.28970#bib.bib26)\), which assigns higher anomaly scores to points with larger average distances to their k nearest neighbors\. Figure[2](https://arxiv.org/html/2606.28970#S3.F2)A shows this complementarity\. The global density score assigns high anomaly values to points far from the main distribution, capturing broad low\-density structure\. In contrast, the localkkNN isolation score emphasizes points that are poorly supported by nearby samples, including anomalies between or near normal clusters\.
Anomalies Are View\-Dependent:A third challenge is that anomalies may be visible only under certain feature views\. In tabular data, the relevant abnormal structure often lies in a subset of features or along a particular direction\. Irrelevant features or high\-variance nuisance directions can obscure the anomaly signal in the full space\(Aggarwal and Yu,[2001](https://arxiv.org/html/2606.28970#bib.bib39); Kriegelet al\.,[2009](https://arxiv.org/html/2606.28970#bib.bib15)\)\. Thus, a fixed representation can make an anomaly appear normal even when another view separates it clearly\. Figure[2](https://arxiv.org/html/2606.28970#S3.F2)B illustrates this issue\. In the original two\-dimensional data, the anomaly signal depends strongly on the projection direction\. A poor one\-dimensional view largely hides the anomalies, while an informative view separates them more clearly\. An ensemble over randomized views increases the chance that some views expose the relevant abnormal structure, even when the correct view is unknown in advance\.
## 4RGLD Algorithm
The previous section motivates three design principles: collect density evidence across multiple scales, combine global rarity with local isolation, and evaluate anomaly scores across randomized views\. We now describeRGLD, a fully unsupervised anomaly detector that implements these principles through randomized global\-local density estimation\. Figure[3](https://arxiv.org/html/2606.28970#S4.F3)summarizes the RGLD pipeline\. Given an unlabeled datasetX=\{xi\}i=1n⊂ℝdX=\\\{x\_\{i\}\\\}\_\{i=1\}^\{n\}\\subset\\mathbb\{R\}^\{d\}, RGLD produces an anomaly scores\(x\)s\(x\), where larger values indicate more anomalous samples\. RGLD consists of two complementary branches\. The global random\-feature density branch estimates broad distributional support using randomized kernel density surrogates\. The local neighbor branch estimates local support using sampled nearest\-neighbor distances in randomized projected spaces\. Following prior work on feature bagging for outlier detection\(Lazarevic and Kumar,[2005](https://arxiv.org/html/2606.28970#bib.bib8)\), randomized feature subsets increase view diversity and help expose subspace\-specific anomalies\. Both branches operate over independently sampled randomized feature subsets and projections, and their scores are combined through rank\-based aggregation\.
Randomized Views:For each viewtt, RGLD samples a feature subsetSt⊆\{1,…,d\}S\_\{t\}\\subseteq\\\{1,\\ldots,d\\\}and a random projection matrixRt∈ℝ\|St\|×rR\_\{t\}\\in\\mathbb\{R\}^\{\|S\_\{t\}\|\\times r\}, representing a samplexxaszt\(x\)=xStRtz\_\{t\}\(x\)=x\_\{S\_\{t\}\}R\_\{t\}\. This feature\-bagged projection serves two roles: feature subsets help expose subspace\-specific anomalies that may be diluted in the full feature space, and random projections reduce dimensionality for high\-dimensional data while approximately preserving the geometry needed for anomaly detection\(Johnsonet al\.,[1984](https://arxiv.org/html/2606.28970#bib.bib29); Dasgupta and Gupta,[2003](https://arxiv.org/html/2606.28970#bib.bib28)\)\. The global branch uses each view to define a random\-feature density estimator, whereas the local neighbor branch uses independently sampled views to define local isolation estimators\. Because any single view may be incomplete or noisy, RGLD aggregates scores across many views rather than relying on one fixed representation\.
Figure 3:RGLD Overview\.RGLD constructs feature\-bagged random views and processes them through two complementary branches\. The global density branch uses random projections and density surrogates for multi\-scale density scoring, capturing global rarity\. The local neighbor branch uses projected views and sampled reference sets to measure local isolation\. Scores are rank\-aggregated within each branch and then rank\-aggregated again to produce the final anomaly score\.Global Density Branch:The global branch measures whether a sample lies in a broadly supported region of the data distribution\. A natural nonparametric density\-based score is kernel density estimation \(KDE\)\(Rosenblatt,[1956](https://arxiv.org/html/2606.28970#bib.bib30); Parzen,[1962](https://arxiv.org/html/2606.28970#bib.bib31)\): for bandwidthσ\\sigma, one may score a samplexxbyp^σ\(x\)=1n∑i=1nkσ\(x,xi\)\\widehat\{p\}\_\{\\sigma\}\(x\)=\\frac\{1\}\{n\}\\sum\_\{i=1\}^\{n\}k\_\{\\sigma\}\(x,x\_\{i\}\), wherekσk\_\{\\sigma\}is a Gaussian kernel\. Low values ofp^σ\(x\)\\widehat\{p\}\_\{\\sigma\}\(x\)indicate weak distributional support and therefore high anomaly likelihood\. However, evaluating this score for all samples requires pairwise kernel comparisons, leading toO\(n2\)O\(n^\{2\}\)cost per view and bandwidth\. This becomes expensive when density scoring is repeated across many randomized views and multiple density scales\. RGLD avoids this pairwise computation by replacing explicit KDE with random\-feature density estimation\. For a randomized viewtt, letzi\(t\)=zt\(xi\)z\_\{i\}^\{\(t\)\}=z\_\{t\}\(x\_\{i\}\)\. Random features approximate shift\-invariant kernels by finite\-dimensional inner products\(Rahimi and Recht,[2007](https://arxiv.org/html/2606.28970#bib.bib32)\)kσ\(z,z′\)≈⟨ϕt,σ\(z\),ϕt,σ\(z′\)⟩k\_\{\\sigma\}\(z,z^\{\\prime\}\)\\approx\\langle\\phi\_\{t,\\sigma\}\(z\),\\phi\_\{t,\\sigma\}\(z^\{\\prime\}\)\\rangle\. Substituting this approximation into KDE yields the key density estimator:
p^t,σ\(x\)≈p~t,σ\(x\)=⟨ϕt,σ\(zt\(x\)\),μt,σ⟩,μt,σ=1n∑i=1nϕt,σ\(zi\(t\)\)\\widehat\{p\}\_\{t,\\sigma\}\(x\)\\approx\\widetilde\{p\}\_\{t,\\sigma\}\(x\)=\\left\\langle\\phi\_\{t,\\sigma\}\(z\_\{t\}\(x\)\),\\mu\_\{t,\\sigma\}\\right\\rangle,\\qquad\\mu\_\{t,\\sigma\}=\\frac\{1\}\{n\}\\sum\_\{i=1\}^\{n\}\\phi\_\{t,\\sigma\}\(z\_\{i\}^\{\(t\)\}\)Thus, the full training set is compressed into one mean embeddingμt,σ\\mu\_\{t,\\sigma\}\(Muandetet al\.,[2016](https://arxiv.org/html/2606.28970#bib.bib33)\)per randomized view and bandwidth\. Scoring a sample only requires an inner product with this stored vector, rather than comparisons to all training samples, reducing the complexity of density estimation over all data points fromO\(n2\)O\(n^\{2\}\)toO\(n\)O\(n\)\. This mean\-embedding form is the main efficiency gain of the global branch\. To achieve the kernel sum approximation required for KDE, RGLD uses cosine random features\. For a viewtt, letWtW\_\{t\}be a random frequency matrix,btb\_\{t\}a random phase vector, andDDthe random\-feature dimension\. The random frequencies are sampled using quasi\-Monte Carlo \(QMC\)\(Yanget al\.,[2014](https://arxiv.org/html/2606.28970#bib.bib34)\)to reduce approximation variance at smallDD\. Then, the random\-feature map at bandwidthσ\\sigmais:
ϕt,σ\(z\)=2Dcos\(Wtzσ\+bt\)\\phi\_\{t,\\sigma\}\(z\)=\\sqrt\{\\frac\{2\}\{D\}\}\\cos\\left\(\\frac\{W\_\{t\}z\}\{\\sigma\}\+b\_\{t\}\\right\)This form also makes multi\-scale density scoring cheap\. For each randomized view, RGLD first computes the linear random\-feature projectionPt\(z\)=WtzP\_\{t\}\(z\)=W\_\{t\}z\. Different bandwidths only rescale this same projection inside the cosine map\. Therefore, for bandwidthsσt,m=αmσ^t\\sigma\_\{t,m\}=\\alpha\_\{m\}\\widehat\{\\sigma\}\_\{t\}, whereσ^t\\widehat\{\\sigma\}\_\{t\}is a base bandwidth estimated from sampled projected distances, RGLD reusesPt\(z\)P\_\{t\}\(z\)and changes onlyPt\(z\)/σt,mP\_\{t\}\(z\)/\\sigma\_\{t,m\}\. The resulting density support score is:
dt,m\(x\)=⟨2Dcos\(Pt\(zt\(x\)\)σt,m\+bt\),μt,m⟩,σt,m=αmσ^td\_\{t,m\}\(x\)=\\left\\langle\\sqrt\{\\frac\{2\}\{D\}\}\\cos\\left\(\\frac\{P\_\{t\}\(z\_\{t\}\(x\)\)\}\{\\sigma\_\{t,m\}\}\+b\_\{t\}\\right\),\\mu\_\{t,m\}\\right\\rangle,\\qquad\\sigma\_\{t,m\}=\\alpha\_\{m\}\\widehat\{\\sigma\}\_\{t\}The support scoredt,m\(x\)d\_\{t,m\}\(x\)is large whenxxis well supported under viewttand scalemm\. RGLD converts it to an anomaly score by negation,at,mglob\(x\)=−dt,m\(x\)a\_\{t,m\}^\{\\mathrm\{glob\}\}\(x\)=\-d\_\{t,m\}\(x\)\. Within each global view, scores from different bandwidths can have different scales\. RGLD therefore standardizes the negative density scores for each bandwidth and averages them:
atglob\(x\)=1M∑m=1M𝒵\(at,mglob\(x\)\)a\_\{t\}^\{\\mathrm\{glob\}\}\(x\)=\\frac\{1\}\{M\}\\sum\_\{m=1\}^\{M\}\\mathcal\{Z\}\\left\(a\_\{t,m\}^\{\\mathrm\{glob\}\}\(x\)\\right\)where𝒵\\mathcal\{Z\}denotes standardization across samples for a fixed bandwidth\. The view\-level scoresatgloba\_\{t\}^\{\\mathrm\{glob\}\}are then rank\-aggregated across randomized global views to obtainsglobs\_\{\\mathrm\{glob\}\}\. In this way, the global branch acts as an efficient multi\-view, multi\-scale approximation to KDE\.
Local Neighbor Branch:The global branch captures broad low\-density structure, but some anomalies are better characterized by local isolation\. RGLD, therefore, includes a local neighbor branch that measures whether a sample is weakly supported by nearby reference points in randomized projected spaces\. For each local viewtt, RGLD samples a feature subset and random projection, producingzi\(t\)=zt\(xi\)z\_\{i\}^\{\(t\)\}=z\_\{t\}\(x\_\{i\}\)\. The reference setCtC\_\{t\}is sampled uniformly without replacement from the projected training samples\{zi\(t\)\}i=1n\\\{z\_\{i\}^\{\(t\)\}\\\}\_\{i=1\}^\{n\}\. We use𝒩k\(zt\(x\);Ct\)\\mathcal\{N\}\_\{k\}\(z\_\{t\}\(x\);C\_\{t\}\)to denote the set of the k nearest reference points tozt\(x\)z\_\{t\}\(x\)withinCtC\_\{t\}\. For a samplexx, the projected\-neighbor score is the root mean squared distance fromzt\(x\)z\_\{t\}\(x\)to its k nearest points inCtC\_\{t\}:
atloc\(x\)=\(1k∑u∈𝒩k\(zt\(x\);Ct\)‖zt\(x\)−u‖22\)1/2a\_\{t\}^\{\\mathrm\{loc\}\}\(x\)=\\left\(\\frac\{1\}\{k\}\\sum\_\{u\\in\\mathcal\{N\}\_\{k\}\(z\_\{t\}\(x\);C\_\{t\}\)\}\\\|z\_\{t\}\(x\)\-u\\\|\_\{2\}^\{2\}\\right\)^\{1/2\}Larger values indicate weaker local support and therefore higher anomaly likelihood\. This branch differs from a standard full\-spacekkNN detector\(Ramaswamyet al\.,[2000](https://arxiv.org/html/2606.28970#bib.bib26)\)in three ways\. First, distances are computed in feature\-bagged projected spaces rather than in the original feature space\. Second, each local view uses a sampled reference set rather than the full training set, reducing the cost of neighbor scoring\. Third, RGLD aggregates local isolation scores across randomized views, reducing dependence on any single projection, feature subset, or reference sample\. The local neighbor branch scoreslocs\_\{\\mathrm\{loc\}\}is obtained by rank\-aggregatingatloca\_\{t\}^\{\\mathrm\{loc\}\}across local views\.
Rank\-Based Aggregation:The global and local branches produce scores with different meanings and expose anomalies of different mechanisms\. The global branch produces negative density\-support scores, while the local neighbor branch produces distance\-based isolation scores\. Directly averaging raw scores can therefore be unstable\. RGLD instead aggregates scores by rank\. For a score vectorv∈ℝnv\\in\\mathbb\{R\}^\{n\}, RGLD maps each score to its normalized rankρi\(v\)=rank\(vi\)−1n−1\\rho\_\{i\}\(v\)=\\frac\{\\operatorname\{rank\}\(v\_\{i\}\)\-1\}\{n\-1\}where larger ranks correspond to more anomalous samples\. Given score vectorsv\(1\),…,v\(T\)v^\{\(1\)\},\\ldots,v^\{\(T\)\}, rank aggregation is
RankAggi\(v\(1\),…,v\(T\)\)=1T∑t=1Tρi\(v\(t\)\)\\operatorname\{RankAgg\}\_\{i\}\\left\(v^\{\(1\)\},\\ldots,v^\{\(T\)\}\\right\)=\\frac\{1\}\{T\}\\sum\_\{t=1\}^\{T\}\\rho\_\{i\}\(v^\{\(t\)\}\)This converts heterogeneous scores into a common scale and emphasizes consistency in anomaly ranking rather than raw score magnitude\. The global branch score issglobs\_\{\\mathrm\{glob\}\}, and the local neighbor branch score isslocs\_\{\\mathrm\{loc\}\}\. The final RGLD score is:
s\(xi\)=RankAggi\(sglob,sloc\)wheresglob\(xi\)=RankAggi\(a1glob,…,aTgglob\),sloc\(xi\)=RankAggi\(a1loc,…,aTℓloc\)\\begin\{split\}&s\(x\_\{i\}\)=\\operatorname\{RankAgg\}\_\{i\}\\left\(s\_\{\\mathrm\{glob\}\},s\_\{\\mathrm\{loc\}\}\\right\)\\\\ \\text\{\{where\}\}\\quad s\_\{\\mathrm\{glob\}\}\(x\_\{i\}\)=\\operatorname\{RankAgg\}\_\{i\}&\(a\_\{1\}^\{\\mathrm\{glob\}\},\\ldots,a\_\{T\_\{g\}\}^\{\\mathrm\{glob\}\}\),\\quad s\_\{\\mathrm\{loc\}\}\(x\_\{i\}\)=\\operatorname\{RankAgg\}\_\{i\}\(a\_\{1\}^\{\\mathrm\{loc\}\},\\ldots,a\_\{T\_\{\\ell\}\}^\{\\mathrm\{loc\}\}\)\\end\{split\}A sample receives a high RGLD score if it is consistently low\-density across randomized global density views, locally isolated across projected\-neighbor views, or both\. This final aggregation treats global rarity and local isolation as complementary evidence while remaining insensitive to the score\-scale mismatch between the two branches\. Complete pseudo\-code and implementation details are provided in Appendix[D](https://arxiv.org/html/2606.28970#A4)\.
## 5Analysis: Subspace Contrast, Approximation, and Complexity
RGLD relies on randomized views and efficient approximations to obtain global\-local anomaly scores\. We provide an analysis of why feature\-bagged views can increase anomaly contrast when the anomaly signal is sparse, and bound the approximation gaps introduced by the two main computational shortcuts: random\-feature global density estimation and sampled\-reference local neighbor scoring\. These results are not intended as end\-to\-end anomaly detection guarantees, which would require assumptions on the anomaly\-generating process\. Instead, they clarify the conditions under which RGLD preserves useful density and locality signals while avoiding quadratic computation\.
Feature\-Bagged Subspace Contrast:We first formalize the mechanism by which feature\-bagged views used by RGLD can yield stronger anomaly contrast than the full feature space when the anomaly signal is concentrated in a small set of informative coordinates\. Consider an anomaly\-normal pair\(xa,xn\)\(x\_\{a\},x\_\{n\}\)\. Suppose the anomaly signal lies in an unknown informative feature setS⋆⊆\[d\]S^\{\\star\}\\subseteq\[d\]with\|S⋆\|=s\|S^\{\\star\}\|=s, while the remaining features are nuisance coordinates\.
###### Proposition 1\(Feature\-bagged subspaces can improve anomaly contrast\)\.
Letμsig\\mu\_\{\\mathrm\{sig\}\}andμnoise\\mu\_\{\\mathrm\{noise\}\}denote the average squared anomaly\-normal separation on informative and nuisance coordinates, respectively, withμsig\>μnoise\\mu\_\{\\mathrm\{sig\}\}\>\\mu\_\{\\mathrm\{noise\}\}\. For a feature subsetS⊆\[d\]S\\subseteq\[d\]of sizemm, defineπ\(S\)=\|S∩S⋆\|m,C\(S\)=1m𝔼‖\(xa−xn\)S‖22\\pi\(S\)=\\frac\{\|S\\cap S^\{\\star\}\|\}\{m\},C\(S\)=\\frac\{1\}\{m\}\\mathbb\{E\}\\\|\(x\_\{a\}\-x\_\{n\}\)\_\{S\}\\\|\_\{2\}^\{2\}\. Ifπ\(S\)\>sd\\pi\(S\)\>\\frac\{s\}\{d\}, thenC\(S\)\>C\(\[d\]\)C\(S\)\>C\(\[d\]\)\. i\.e\., has a larger average anomaly contrast than full space\. Furthermore,Pr\(π\(S\)\>sd\)=Pr\(\|S∩S⋆\|\>msd\)\\Pr\\left\(\\pi\(S\)\>\\frac\{s\}\{d\}\\right\)=\\Pr\\left\(\|S\\cap S^\{\\star\}\|\>\\frac\{ms\}\{d\}\\right\)\. \(See Appendix[F](https://arxiv.org/html/2606.28970#A6)for proof\)
Proposition[1](https://arxiv.org/html/2606.28970#Thmproposition1)motivates the randomized\-view design of RGLD\. A fixed full\-space representation can dilute sparse anomaly signals with nuisance features, while feature bagging increases the chance of seeing a view where the relevant coordinates are more concentrated\. Random projection then provides an efficient alternative geometry within each selected subspace, preserving useful distance\-based density and neighborhood signals while reducing cost\.
Global Density Approximation Gap:Here, we analyze the approximation gap introduced by the global random\-feature density branch\. The method section defines the exact projected KDE scorep^t,σ\(x\)\\widehat\{p\}\_\{t,\\sigma\}\(x\)and its random\-feature approximationp~t,σ\(x\)\\widetilde\{p\}\_\{t,\\sigma\}\(x\)\. Here, we ask how far the surrogate can deviate from the exact KDE score for a fixed randomized viewttand bandwidthσ\\sigma\. The following proposition is a direct consequence of the classical random Fourier feature approximation bound\(Rahimi and Recht,[2007](https://arxiv.org/html/2606.28970#bib.bib32); Sutherland and Schneider,[2015](https://arxiv.org/html/2606.28970#bib.bib37)\):
###### Proposition 2\(RFF approximation of KDE scores\)\.
Fix a randomized viewtt, bandwidthσ\\sigma, and training set\{zi\(t\)\}i=1N\\\{z\_\{i\}^\{\(t\)\}\\\}\_\{i=1\}^\{N\}\. Then for any fixed evaluation pointxx, with probability at least1−δ1\-\\delta,
\|p~t,σ\(x\)−p^t,σ\(x\)\|≤O\(log\(1/δ\)D\)\(See Appendix[G](https://arxiv.org/html/2606.28970#A7)for proof\)\\left\|\\widetilde\{p\}\_\{t,\\sigma\}\(x\)\-\\widehat\{p\}\_\{t,\\sigma\}\(x\)\\right\|\\leq O\\left\(\\sqrt\{\\frac\{\\log\(1/\\delta\)\}\{D\}\}\\right\)\\quad\\text\{\{\(See Appendix\\penalty 10000\\ \\ref\{app:prop2\} for proof\}\)\}
Proposition[2](https://arxiv.org/html/2606.28970#Thmproposition2)shows that the global branch remains close to the exact KDE score in each fixed view and bandwidth, with error decreasing asD−1/2D^\{\-1/2\}\. Thus, RGLD can use many inexpensive random\-feature density estimators while retaining a controlled approximation to KDE density scoring\.
Local Support Approximation Gap:We next analyze the approximation introduced by the local neighbor branch\. In a fixed projected viewtt, fullkkNN scoring compares each point against allnnprojected training samples\. RGLD instead samples a reference setCtC\_\{t\}and computeskkNN distances only against this subset\. This reduces computation but introduces a sampling gap: nearby training samples may be missed if they are not included inCtC\_\{t\}\.
###### Proposition 3\(Reference coverage for local support\)\.
Fix a projected viewtt, an evaluation pointxx, and radiusρ\>0\\rho\>0\. LetBt\(x,ρ\)=\{zi\(t\):‖zt\(x\)−zi\(t\)‖2≤ρ\}B\_\{t\}\(x,\\rho\)=\\\{z\_\{i\}^\{\(t\)\}:\\\|z\_\{t\}\(x\)\-z\_\{i\}^\{\(t\)\}\\\|\_\{2\}\\leq\\rho\\\}be the set of projected training samples within radiusρ\\rho, and letqt\(x,ρ\)=\|Bt\(x,ρ\)\|/nq\_\{t\}\(x,\\rho\)=\|B\_\{t\}\(x,\\rho\)\|/nbe its empirical mass\. IfCtC\_\{t\}is sampled uniformly without replacement from the projected training samples, then
Pr\[Ct∩Bt\(x,ρ\)=∅\]≤exp\(−\|Ct\|qt\(x,ρ\)\)\(See Appendix[H](https://arxiv.org/html/2606.28970#A8)for proof\)\\Pr\\left\[C\_\{t\}\\cap B\_\{t\}\(x,\\rho\)=\\emptyset\\right\]\\leq\\exp\\left\(\-\|C\_\{t\}\|q\_\{t\}\(x,\\rho\)\\right\)\\quad\\text\{\{\(See Appendix\\penalty 10000\\ \\ref\{app:prop3\} for proof\)\}\}Equivalently, with probability at least1−exp\(−\|Ct\|qt\(x,ρ\)\)1\-\\exp\(\-\|C\_\{t\}\|q\_\{t\}\(x,\\rho\)\), the reference set contains at least one point within distanceρ\\rhoofzt\(x\)z\_\{t\}\(x\)\.
Proposition[3](https://arxiv.org/html/2606.28970#Thmproposition3)shows that the probability of missing a local neighborhood decreases exponentially with the reference size\|Ct\|\|C\_\{t\}\|and the empirical local massqt\(x,ρ\)q\_\{t\}\(x,\\rho\)\. Thus, sampled\-referencekkNN preserves local support when nearby samples are not too rare, while assigning large scores to points with weak local support\. Fork\>1k\>1, the same argument extends by considering the probability thatCtC\_\{t\}contains at leastkkpoints inBt\(x,ρ\)B\_\{t\}\(x,\\rho\), which follows a hypergeometric tail bound\(Hoeffding,[1963](https://arxiv.org/html/2606.28970#bib.bib35); Serfling,[1974](https://arxiv.org/html/2606.28970#bib.bib36)\)\. Aggregating across multiple projected\-neighbor views and independently sampled reference sets further reduces dependence on any single reference sample\.
Computational Complexity:Letnnbe the number of samples,dtd\_\{t\}the number of selected features in a view,rrthe projection dimension,DDthe random\-feature dimension,MMthe number of bandwidths,TgT\_\{g\}the number of global views,TℓT\_\{\\ell\}the number of projected\-neighbor views, and\|Ct\|\|C\_\{t\}\|the reference\-set size\. For one global view, exact multi\-scale KDE requiresO\(Mn2r\)O\(Mn^\{2\}r\)kernel computations\. RGLD replaces this with random\-feature estimation: feature\-bagged projection costsO\(ndtr\)O\(nd\_\{t\}r\), the random\-feature projection costsO\(nrD\)O\(nrD\), and evaluatingMMbandwidths costsO\(MnD\)O\(MnD\)\. Across global views, the cost isO\(Tg\(ndtr\+nrD\+MnD\)\)O\\left\(T\_\{g\}\(nd\_\{t\}r\+nrD\+MnD\)\\right\)\. The key saving is avoiding then2n^\{2\}KDE term\. For projected\-neighbor views, fullkkNN costsO\(n2r\)O\(n^\{2\}r\)\. RGLD instead compares each point to a sampled reference set of size\|Ct\|\|C\_\{t\}\|, givingO\(Tℓ\(ndtr\+n\|Ct\|r\)\)O\\left\(T\_\{\\ell\}\(nd\_\{t\}r\+n\|C\_\{t\}\|r\)\\right\)across local views\. Rank aggregation addsO\(Tgnlogn\+Tℓnlogn\)O\(T\_\{g\}n\\log n\+T\_\{\\ell\}n\\log n\)sorting cost\. Overall, RGLD replaces the quadratic costs of exact KDE and fullkkNN with near linear\-in\-nnrandomized approximations, up to rank\-sorting overhead, controlled byDD,\|Ct\|\|C\_\{t\}\|,rr\. Since randomized views are independent, both branches are naturally parallelizable\.
## 6Experimental Analysis
Experimental Setup:We evaluate RGLD on 47 tabular datasets from ADBench\(Hanet al\.,[2022](https://arxiv.org/html/2606.28970#bib.bib40)\), which span diverse real\-world anomaly detection settings including healthcare, finance, network/web security, image\-derived features, documents, and scientific measurements\. We compare against 23 baselines from ADBench\(Hanet al\.,[2022](https://arxiv.org/html/2606.28970#bib.bib40)\), DeepOD\(Xuet al\.,[2023a](https://arxiv.org/html/2606.28970#bib.bib47);[2024](https://arxiv.org/html/2606.28970#bib.bib48)\), and the recently proposed ADERH\(Duraniet al\.,[2026](https://arxiv.org/html/2606.28970#bib.bib13)\), covering both statistical and deep anomaly detectors\. All methods are evaluated in the fully unsupervised setting without using labels for model selection or hyperparameter tuning\. Baselines use the official ADBench/DeepOD default configurations\. We report Area Under the Receiver Operating Characteristic Curve \(AUROC\), Area Under the Precision\-Recall Curve \(AUPRC\), and average runtime across datasets\. Statistical methods are run on an Intel Core i7\-155H CPU, while deep methods are run on an NVIDIA RTX 4070 Laptop GPU\. RGLD uses one fixed default configuration across all datasets\. The global random\-feature density branch usesTg=40T\_\{g\}=40randomized views, QMC random features with dimensionD=10D=10, median\-distance bandwidth estimation from8,1928,192sampled pairs, and multi\-scale bandwidth multipliers\{0\.25,0\.5,1\.0,2\.0\}\\\{0\.25,0\.5,1\.0,2\.0\\\}\. The local neighbor branch usesTℓ=10T\_\{\\ell\}=10randomized views, reference set size400400, and sampled reference size\|Ct\|=400\|C\_\{t\}\|=400andk=10k=10\. For both the global and local neighbor branches, each randomized view samples30%30\\%of the input features before applying a random projection\. Full RGLD configurations are provided in Appendix[E](https://arxiv.org/html/2606.28970#A5)\.
Anomaly Detection Results:
Table 1:Main benchmark results\.On 47 ADBench tabular datasets across RGLD and 23 statistical and deep learning methods, all evaluated under the same fully unsupervised protocol\.Marks 1st, 2nd and 3rd place respectively\.Table[1](https://arxiv.org/html/2606.28970#S6.T1)summarizes the main results on 47 ADBench tabular datasets against 23 baselines\. RGLD shows strong robustness across datasets, obtaining the most AUROC wins with88first\-place results\. It also ranks second in mean AUROC with77\.5077\.50, third in mean AUPRC with38\.5938\.59, and second in AUPRC wins with55wins\. These results show that RGLD is consistently competitive across both ranking\-based anomaly detection metrics\. RGLD is also substantially more efficient than deep anomaly detectors, achieving 50×\\times–580×\\timesspeedups\. While ADERH obtains the best mean AUROC and AUPRC, RGLD is approximately5×5\\timesfaster and achieves twice as many AUROC wins\. Compared with SLAD, which has the most AUPRC wins, RGLD is roughly two orders of magnitude faster\. Although a few simple statistical methods are faster, they generally sacrifice accuracy and dataset\-level wins\. Overall, RGLD provides one of the strongest accuracy\-efficiency tradeoffs among all evaluated methods, combining top\-tier detection performance with lightweight runtime\. Because ADERH is the strongest baseline in mean AUROC and AUPRC, we provide a detailed paired comparison in Appendix[J](https://arxiv.org/html/2606.28970#A10)\. The comparison shows that RGLD is statistically competitive with ADERH in AUROC and AUPRC, while being significantly faster\.
Accuracy\-Efficiency Tradeoff:Table[1](https://arxiv.org/html/2606.28970#S6.T1)shows that RGLD achieves top\-tier detection accuracy\. We next examine its accuracy\-efficiency tradeoff\. Figure[4](https://arxiv.org/html/2606.28970#S6.F4)plots mean AUROC and mean AUPRC against average runtime across the 47 datasets, with runtime on a logarithmic scale\. The figure compares the baselines with two RGLD variants \(RGLD\-Fast variant uses a reduced number of views\)\. RGLD occupies a favorable accuracy\-efficiency region in both metrics\. In AUROC, RGLD performs close to the strongest method, ADERH, while running substantially faster\. RGLD\-Fast further shifts the tradeoff toward lower runtime while retaining high AUROC\. In contrast, deep methods such as SLAD, REPEN, NeuTraL, GOAD, and ICL require much longer runtime while giving lower or comparable AUROC\. Fast statistical methods are efficient, but many fall below RGLD in accuracy\. The AUPRC plot shows a similar pattern, where RGLD remains among the top\-performing methods and ahead of most statistical and deep baselines, while being highly efficient\. RGLD\-Fast again provides a faster variant with only a modest AUPRC reduction\. These results support RGLD’s central efficiency claim: randomized global\-local density estimation can achieve competitive detection accuracy without the high training cost of deep anomaly detectors\.
Figure 4:Accuracy\-efficiency tradeoff\.Mean AUROC and AUPRC versus average runtime across 47 ADBench tabular datasets\. Runtime is shown on a logarithmic scale\. For the RGLD\-fast variant, we reduced the number of views, random feature dimension, andkkNN reference set to half of the default RGLD\. The full Pareto front graph can be found in Appendix[K](https://arxiv.org/html/2606.28970#A11)Ablation Study on Different RGLD Components:
Table 2:Ablation study on different RGLD components\.We report mean AUROC, mean AUPRC, average runtime, and changes relative to full RGLD\. Removing any major component degrades performance, with the largest drop coming from removing the randomized\-view ensemble\.Table[2](https://arxiv.org/html/2606.28970#S6.T2)studies the contribution of RGLD’s main components\. The full model achieves the best AUROC and AUPRC, indicating that the proposed components are complementary rather than redundant\. Removing multi\-scale density scoring causes a modest drop, suggesting that aggregating multiple bandwidths improves robustness to unknown anomaly scale\. Removing feature bagging leads to a larger AUPRC degradation, supporting the importance of subspace diversity\. The local neighbor branch also contributes substantially: removing it reduces AUROC by1\.981\.98, showing that local isolation provides useful information beyond global density estimation\. The largest degradation occurs when removing the randomized\-view ensemble, which reduces AUROC by4\.334\.33and AUPRC by6\.36\.3\. Although this variant is faster, the large accuracy drop confirms the central design principle of RGLD: many inexpensive randomized views are essential for producing a robust anomaly ranking\.
Sensitivity to Ensemble Size and Random\-Feature Dimension:
Figure 5:Sensitivity to randomized views and random\-feature dimension\.A\.Increasing the number of randomized views improves AUROC and AUPRC for sparse subspace anomalies\.B\.Increasing the random\-feature dimensionDDimproves accuracy with diminishing returns, illustrating the accuracy\-efficiency tradeoff of the global density branch\.To isolate the mechanisms behind RGLD, we conduct controlled synthetic experiments in addition to the ADBench\. The synthetic data contain sparse subspace anomalies: normal samples are drawn from an isotropic Gaussian distribution, while anomalies are shifted along a small subset of informative dimensions\. This setup allows us to test whether increasing the number of randomized views helps expose subspace\-specific anomaly signals\. Figure[5](https://arxiv.org/html/2606.28970#S6.F5)studies two key efficiency parameters in RGLD: the number of randomized views and the random\-feature dimensionDD\. Panel A shows that increasing the number of randomized views improves both AUROC and AUPRC, indicating that the ensemble contributes complementary anomaly evidence rather than merely adding redundant detectors\. Runtime grows smoothly with the number of views, and the default configuration lies near the high\-performance region of the curve\. This supports the central design principle of RGLD: aggregating many inexpensive randomized views yields a stronger anomaly ranking\. Panel B studies the accuracy\-efficiency tradeoff controlled by the random\-feature dimensionDD\. LargerDDimproves both AUROC and AUPRC, consistent with the random\-feature approximation analysis in Section[5](https://arxiv.org/html/2606.28970#S5)\. The improvement is largest when increasingDDfrom very small values and then gradually saturates, indicating diminishing returns at larger feature dimensions\. Together, these results show that RGLD provides a controllable accuracy\-efficiency tradeoff through both the number of randomized views and the random\-feature dimension\.
## 7Conclusion
We introducedRGLD, a randomized global\-local density estimator for fully unsupervised tabular anomaly detection\. RGLD estimates complementary global and local anomaly signals from feature\-bagged randomized views, allowing it to capture multiple anomaly mechanisms with efficiency\. Empirically, RGLD achieves a strong accuracy\-efficiency tradeoff on 47 ADBench tabular datasets against 23 statistical and deep baselines under a fully unsupervised setting, ranking 1st in AUROC wins, and 2nd in AUPRC wins while running 50×\\times–580×\\timesfaster than evaluated deep anomaly detectors\. Ablations show that randomized views, feature bagging, multi\-scale density scoring, and projected\-neighbor scoring each contribute to performance\. These results suggest that the gains come not from a single component, but from combining many weak randomized density and locality signals into a stable ensemble\. More broadly, RGLD shows that well\-designed statistical methods can remain highly competitive for tabular anomaly detection when equipped with the right randomized inductive biases\.
## Acknowledgment
This work was supported in part by PRISM and CoCoSys, centers in JUMP 2\.0, an SRC program sponsored by DARPA \(SRC grant number \- 2023\-JU\-3135\)\. This work was also supported by NSF grants \#2003279, \#1911095, \#2112167, \#2052809, \#2112665, \#2120019, \#2211386\.
## References
- Outlier detection for high dimensional data\.InProceedings of the 2001 ACM SIGMOD international conference on Management of data,pp\. 37–46\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p2.1),[§3](https://arxiv.org/html/2606.28970#S3.p4.1)\.
- L\. Bergman and Y\. Hoshen \(2020\)Classification\-based anomaly detection for general data\.arXiv preprint arXiv:2005\.02359\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p2.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.12.10.1)\.
- M\. M\. Breunig, H\. Kriegel, R\. T\. Ng, and J\. Sander \(2000\)LOF: identifying density\-based local outliers\.InProceedings of the 2000 ACM SIGMOD international conference on Management of data,pp\. 93–104\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p2.1),[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.19.17.1)\.
- V\. Chandola, A\. Banerjee, and V\. Kumar \(2009\)Anomaly detection: a survey\.ACM computing surveys \(CSUR\)41\(3\),pp\. 1–58\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p2.1),[§3](https://arxiv.org/html/2606.28970#S3.p1.1)\.
- A\. Chatterjee and B\. S\. Ahmed \(2022\)IoT anomaly detection methods and applications: a survey\.Internet of Things19,pp\. 100568\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p1.1)\.
- S\. Chen, Z\. Qian, W\. Siu, X\. Hu, J\. Li, S\. Li, Y\. Qin, T\. Yang, Z\. Xiao, W\. Ye,et al\.\(2025\)Pyod 2: a python library for outlier detection with llm\-powered model selection\.InCompanion Proceedings of the ACM on Web Conference 2025,pp\. 2807–2810\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p1.1)\.
- S\. Dasgupta and A\. Gupta \(2003\)An elementary proof of a theorem of johnson and lindenstrauss\.Random Structures & Algorithms22\(1\),pp\. 60–65\.Cited by:[§4](https://arxiv.org/html/2606.28970#S4.p2.5)\.
- W\. Durani, C\. Leiber, K\. Durani, C\. Plant, and C\. Böhm \(2026\)Anomaly detection by an ensemble of random pairs of hyperspheres\.Advances in Neural Information Processing Systems38,pp\. 166168–166207\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.5.3.1),[§6](https://arxiv.org/html/2606.28970#S6.p1.9)\.
- M\. Goldstein and A\. Dengel \(2012\)Histogram\-based outlier score \(hbos\): a fast unsupervised anomaly detection algorithm\.KI\-2012: poster and demo track1,pp\. 59–63\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p2.1),[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.11.9.1)\.
- O\. Gungor, A\. Rios, P\. Mudgal, N\. Ahuja, and T\. Rosing \(2024\)A robust framework for evaluation of unsupervised time\-series anomaly detection\.InInternational Conference on Pattern Recognition,pp\. 48–64\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p1.1)\.
- S\. Han, X\. Hu, H\. Huang, M\. Jiang, and Y\. Zhao \(2022\)Adbench: anomaly detection benchmark\.Advances in neural information processing systems35,pp\. 32142–32159\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p1.1),[§1](https://arxiv.org/html/2606.28970#S1.p3.1),[§6](https://arxiv.org/html/2606.28970#S6.p1.9)\.
- Z\. He, X\. Xu, and S\. Deng \(2003\)Discovering cluster\-based local outliers\.Pattern recognition letters24\(9\-10\),pp\. 1641–1650\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.15.13.1)\.
- W\. Hoeffding \(1963\)Probability inequalities for sums of bounded random variables\.Journal of the American statistical association58\(301\),pp\. 13–30\.Cited by:[§5](https://arxiv.org/html/2606.28970#S5.p7.7)\.
- M\. Jiang, C\. Hou, A\. Zheng, S\. Han, H\. Huang, Q\. Wen, X\. Hu, and Y\. Zhao \(2023\)Adgym: design choices for deep anomaly detection\.Advances in Neural Information Processing Systems36,pp\. 70179–70207\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p1.1),[§1](https://arxiv.org/html/2606.28970#S1.p3.1)\.
- W\. B\. Johnson, J\. Lindenstrauss,et al\.\(1984\)Extensions of lipschitz mappings into a hilbert space\.Contemporary mathematics26\(189\-206\),pp\. 1\.Cited by:[Appendix B](https://arxiv.org/html/2606.28970#A2.p2.1),[§4](https://arxiv.org/html/2606.28970#S4.p2.5)\.
- H\. Kriegel, P\. Kröger, E\. Schubert, and A\. Zimek \(2009\)Outlier detection in axis\-parallel subspaces of high dimensional data\.InPacific\-asia conference on knowledge discovery and data mining,pp\. 831–838\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p2.1),[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[§3](https://arxiv.org/html/2606.28970#S3.p4.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.23.21.1)\.
- A\. Lazarevic and V\. Kumar \(2005\)Feature bagging for outlier detection\.InProceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining,pp\. 157–166\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[§4](https://arxiv.org/html/2606.28970#S4.p1.2)\.
- Z\. Li, Y\. Zhao, N\. Botta, C\. Ionescu, and X\. Hu \(2020\)Copod: copula\-based outlier detection\.In2020 IEEE international conference on data mining \(ICDM\),pp\. 1118–1123\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.7.5.1)\.
- Z\. Li, Y\. Zhao, X\. Hu, N\. Botta, C\. Ionescu, and G\. H\. Chen \(2022\)Ecod: unsupervised outlier detection using empirical cumulative distribution functions\.IEEE Transactions on Knowledge and Data Engineering35\(12\),pp\. 12181–12193\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.16.14.1)\.
- B\. Liu, D\. Wang, K\. Lin, P\. Tan, and J\. Zhou \(2021\)Rca: a deep collaborative autoencoder approach for anomaly detection\.InIJCAI: proceedings of the conference,Vol\.2021,pp\. 1505\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p2.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.22.20.1)\.
- F\. T\. Liu, K\. M\. Ting, and Z\. Zhou \(2008\)Isolation forest\.In2008 eighth ieee international conference on data mining,pp\. 413–422\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p2.1),[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.13.11.1)\.
- K\. Muandet, K\. Fukumizu, B\. Sriperumbudur, and B\. Schölkopf \(2016\)Kernel mean embedding of distributions: a review and beyond\.arXiv preprint arXiv:1605\.09522\.Cited by:[§4](https://arxiv.org/html/2606.28970#S4.p3.18)\.
- G\. Pang, L\. Cao, L\. Chen, and H\. Liu \(2018\)Learning representations of ultrahigh\-dimensional data for random distance\-based outlier detection\.InProceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining,pp\. 2041–2050\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p2.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.6.4.1)\.
- G\. Pang, C\. Shen, L\. Cao, and A\. V\. D\. Hengel \(2021\)Deep learning for anomaly detection: a review\.ACM computing surveys \(CSUR\)54\(2\),pp\. 1–38\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p3.1)\.
- E\. Parzen \(1962\)On estimation of a probability density function and mode\.The annals of mathematical statistics33\(3\),pp\. 1065–1076\.Cited by:[§4](https://arxiv.org/html/2606.28970#S4.p3.9)\.
- T\. Pevnỳ \(2016\)Loda: lightweight on\-line detector of anomalies\.Machine Learning102\(2\),pp\. 275–304\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.24.22.1)\.
- C\. Qiu, T\. Pfrommer, M\. Kloft, S\. Mandt, and M\. Rudolph \(2021\)Neural transformation learning for deep anomaly detection beyond images\.InInternational conference on machine learning,pp\. 8703–8714\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p2.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.8.6.1)\.
- A\. Rahimi and B\. Recht \(2007\)Random features for large\-scale kernel machines\.Advances in neural information processing systems20\.Cited by:[§4](https://arxiv.org/html/2606.28970#S4.p3.9),[§5](https://arxiv.org/html/2606.28970#S5.p4.4)\.
- S\. Ramaswamy, R\. Rastogi, and K\. Shim \(2000\)Efficient algorithms for mining outliers from large data sets\.InProceedings of the 2000 ACM SIGMOD international conference on Management of data,pp\. 427–438\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p2.1),[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[§3](https://arxiv.org/html/2606.28970#S3.p3.2),[§4](https://arxiv.org/html/2606.28970#S4.p4.13),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.1.1)\.
- M\. Rosenblatt \(1956\)Remarks on some nonparametric estimates of a density function\.The Annals of Mathematical Statistics,pp\. 832–837\.Cited by:[§4](https://arxiv.org/html/2606.28970#S4.p3.9)\.
- L\. Ruff, J\. R\. Kauffmann, R\. A\. Vandermeulen, G\. Montavon, W\. Samek, M\. Kloft, T\. G\. Dietterich, and K\. Müller \(2021\)A unifying review of deep and shallow anomaly detection\.Proceedings of the IEEE109\(5\),pp\. 756–795\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p2.1),[§3](https://arxiv.org/html/2606.28970#S3.p1.1)\.
- L\. Ruff, R\. Vandermeulen, N\. Goernitz, L\. Deecke, S\. A\. Siddiqui, A\. Binder, E\. Müller, and M\. Kloft \(2018\)Deep one\-class classification\.InInternational conference on machine learning,pp\. 4393–4402\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p3.1),[§2](https://arxiv.org/html/2606.28970#S2.p2.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.21.19.1)\.
- B\. Schölkopf, J\. C\. Platt, J\. Shawe\-Taylor, A\. J\. Smola, and R\. C\. Williamson \(2001\)Estimating the support of a high\-dimensional distribution\.Neural computation13\(7\),pp\. 1443–1471\.Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p2.1),[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.18.16.1)\.
- R\. J\. Serfling \(1974\)Probability inequalities for the sum in sampling without replacement\.The Annals of Statistics,pp\. 39–48\.Cited by:[§5](https://arxiv.org/html/2606.28970#S5.p7.7)\.
- T\. Shenkar and L\. Wolf \(2022\)Anomaly detection for tabular data with internal contrastive learning\.InInternational conference on learning representations,Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p2.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.9.7.1)\.
- M\. Shyu, S\. Chen, K\. Sarinnapakorn, and L\. Chang \(2003\)A novel anomaly detection scheme based on principal component classifier\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.10.8.1)\.
- B\. W\. Silverman \(2018\)Density estimation for statistics and data analysis\.Routledge\.Cited by:[Appendix B](https://arxiv.org/html/2606.28970#A2.p2.1),[§3](https://arxiv.org/html/2606.28970#S3.p2.2)\.
- D\. J\. Sutherland and J\. Schneider \(2015\)On the error of random fourier features\.arXiv preprint arXiv:1506\.02785\.Cited by:[§5](https://arxiv.org/html/2606.28970#S5.p4.4)\.
- J\. Tang, Z\. Chen, A\. W\. Fu, and D\. W\. Cheung \(2002\)Enhancing effectiveness of outlier detections for low density patterns\.InPacific\-Asia conference on knowledge discovery and data mining,pp\. 535–548\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p1.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.20.18.1)\.
- H\. Wang, G\. Pang, C\. Shen, and C\. Ma \(2019\)Unsupervised representation learning by predicting random distances\.arXiv preprint arXiv:1912\.12186\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p2.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.17.15.1)\.
- H\. Xu, G\. Pang, Y\. Wang, and Y\. Wang \(2023a\)Deep isolation forest for anomaly detection\.IEEE Transactions on Knowledge and Data Engineering35\(12\),pp\. 12591–12604\.External Links:[Document](https://dx.doi.org/10.1109/TKDE.2023.3270293)Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p2.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.14.12.1),[§6](https://arxiv.org/html/2606.28970#S6.p1.9)\.
- H\. Xu, Y\. Wang, S\. Jian, Q\. Liao, Y\. Wang, and G\. Pang \(2024\)Calibrated one\-class classification for unsupervised time series anomaly detection\.IEEE Transactions on Knowledge and Data Engineering\.Cited by:[§6](https://arxiv.org/html/2606.28970#S6.p1.9)\.
- H\. Xu, Y\. Wang, J\. Wei, S\. Jian, Y\. Li, and N\. Liu \(2023b\)Fascinating supervisory signals and where to find them: deep anomaly detection with scale learning\.InInternational Conference on Machine Learning,pp\. 38655–38673\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p2.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.4.2.1)\.
- J\. Yang, V\. Sindhwani, H\. Avron, and M\. Mahoney \(2014\)Quasi\-monte carlo feature maps for shift\-invariant kernels\.InInternational Conference on Machine Learning,pp\. 485–493\.Cited by:[§4](https://arxiv.org/html/2606.28970#S4.p3.18)\.
- A\. Zimek, R\. J\. Campello, and J\. Sander \(2014\)Ensembles for unsupervised outlier detection: challenges and research questions a position paper\.Acm Sigkdd Explorations Newsletter15\(1\),pp\. 11–22\.Cited by:[§2](https://arxiv.org/html/2606.28970#S2.p1.1)\.
- B\. Zong, Q\. Song, M\. R\. Min, W\. Cheng, C\. Lumezanu, D\. Cho, and H\. Chen \(2018\)Deep autoencoding gaussian mixture model for unsupervised anomaly detection\.InInternational conference on learning representations,Cited by:[§1](https://arxiv.org/html/2606.28970#S1.p3.1),[§2](https://arxiv.org/html/2606.28970#S2.p2.1),[Table 1](https://arxiv.org/html/2606.28970#S6.T1.1.25.23.1)\.
The appendix here provides additional details for the submission titled: “RGLD: Randomized Global\-Local Density Estimation for Tabular Anomaly Detection”\. The appendix is organized as follows:
1. A\.
2. B\.
3. C\.
4. D\.
5. E\.
6. F\.
7. G\.
8. H\.
9. I\.
10. J\.
11. K\.
12. L\.
13. M\.
14. N\.
## Appendix AList of Notation
We hereby provide a list of notations used in this paper:
Table 3:List of notations\.
## Appendix BDiscussion
Practical Guide for Hyperparameter Selection:RGLD’s hyperparameters mainly control the tradeoff between approximation fidelity, ensemble diversity, and runtime\. The random\-feature dimensionDDcontrols the global density approximation: by Proposition[2](https://arxiv.org/html/2606.28970#Thmproposition2), the random\-feature KDE error decreases asO\(D−1/2\)O\(D^\{\-1/2\}\), so largerDDimproves approximation quality with diminishing returns\. In our experiments, a modest value such as 10 was sufficient to provide a strong accuracy\-efficiency tradeoff\. The reference set size\|Ct\|\|C\_\{t\}\|controls the local\-support approximation: by Proposition[3](https://arxiv.org/html/2606.28970#Thmproposition3), the probability of missing a radius\-rrneighborhood is at mostexp\(−\|Ct\|qt\(x,ρ\)\)\\exp\(\-\|C\_\{t\}\|q\_\{t\}\(x,\\rho\)\), so larger\|Ct\|\|C\_\{t\}\|improves local coverage exponentially while increasing neighbor\-scoring cost linearly\. Thus, within a computational budget, largerDDand\|Ct\|\|C\_\{t\}\|generally improve the fidelity of the global and local branch approximations\. The number of global and local views,TgT\_\{g\}andTℓT\_\{\\ell\}, increases ensemble diversity and the chance of observing informative views, with runtime growing approximately linearly in the number of views\. The bandwidth multipliersαm\\alpha\_\{m\}define the density scales used by the global branch; a small grid such as\{0\.25,0\.5,1\.0,2\.0\}\\\{0\.25,0\.5,1\.0,2\.0\\\}covers both fine and coarse anomaly scales without high cost\. Finally, the number of neighborskkcontrols the locality of the projected\-neighbor score, smallerkkemphasizes fine local isolation, while a largerkkgives smoother but less local support estimates\.
The Need for Random Projection:Random projection is used in RGLD to make both scoring branches cheaper while retaining useful geometric information\. By the Johnson\-Lindenstrauss principle, random projections can approximately preserve pairwise distances in a lower\-dimensional space\(Johnsonet al\.,[1984](https://arxiv.org/html/2606.28970#bib.bib29)\), which is important because both density and neighbor\-based anomaly scores depend on this geometry\. In the global branch, projecting the data reduces the cost of random\-feature density estimation and helps avoid directly applying KDE\-style scoring in the original high\-dimensional space, where density estimates are sensitive to dimension and bandwidth choice\(Silverman,[2018](https://arxiv.org/html/2606.28970#bib.bib38)\)\. In the local branch, projection reduces the cost of neighbor\-distance computation by replacing full\-dimensional distances with low\-dimensional projected distances\. RGLD therefore uses random projection as a lightweight mechanism for producing inexpensive density and neighborhood estimates across multiple randomized views\.
## Appendix CLimitations
Potential Failure Mode:RGLD relies on the assumption that useful anomaly evidence can be exposed through randomized views of the observed tabular feature space\. This makes the method efficient and fully unsupervised, but it may be less effective when anomaly signals are extremely weak, highly diffuse across many features, or only visible through complex nonlinear representations\. Feature bagging is most helpful when some subsets of features provide stronger anomaly contrast than the full space; when the raw features do not contain meaningful density or neighborhood structure, representation\-learning methods or domain\-specific features may be more suitable\.
Anomaly Signals:RGLD focuses on scalable approximations to density\-based and neighborhood\-based anomaly signals\. This covers a broad and effective class of unsupervised detectors, but abnormality can also appear through other mechanisms\. For example, anomalies may be characterized by reconstruction error, violation of feature dependencies, abnormal marginal tail behavior, or inconsistency with learned semantic representations\. RGLD’s randomized ensemble framework is compatible with these signals in principle, but this paper focuses on global density and local neighbor support\. Future work could extend RGLD by incorporating additional scalable score approximations into the same randomized rank\-aggregation framework\.
Extension to Broader Data Modalities or Settings:Our experiments focus on static tabular anomaly detection\. Extending RGLD to time series, graphs, images, streaming data, or semi\-supervised settings would require additional design choices, such as temporal modeling, graph\-aware decisions, and online updates\. We view these directions as complementary to the present work and as promising paths toward more broadly applicable, scalable anomaly detection\.
## Appendix DRGLD Pseudocode
Algorithm[1](https://arxiv.org/html/2606.28970#algorithm1)summarizes RGLD\. The global branch fits randomized density estimators using random\-feature mean embeddings, while the local neighbor branch fits sampled\-reference local isolation estimators\. Scores are rank\-aggregated within each branch and then across branches\.
Input:Unlabeled data
X=\{xi\}i=1nX=\\\{x\_\{i\}\\\}\_\{i=1\}^\{n\}; global views
TgT\_\{g\}; local views
TℓT\_\{\\ell\}; bandwidth multipliers
\{αm\}m=1M\\\{\\alpha\_\{m\}\\\}\_\{m=1\}^\{M\}; reference size
cc; neighbors
kk; Random feature dimension
DD
Output:Anomaly scores
s\(xi\)s\(x\_\{i\}\)
1
2Preprocess
XXwith dataset statistics;
3Global density branch
4for*t=1,…,Tgt=1,\\ldots,T\_\{g\}*do
5Sample feature subset and random projection; obtain projected data
ZtZ\_\{t\}
6Estimate base bandwidth
σ^t\\widehat\{\\sigma\}\_\{t\}from sampled pairwise distances in
ZtZ\_\{t\}
7Construct multi\-scale bandwidths
σt,m=αmσ^t\\sigma\_\{t,m\}=\\alpha\_\{m\}\\widehat\{\\sigma\}\_\{t\}
8Fit random\-feature mean embeddings
\{μt,m\}m=1M\\\{\\mu\_\{t,m\}\\\}\_\{m=1\}^\{M\}
9Score samples by negative random\-feature density at each scale
10Standardize and average multi\-scale scores to obtain
atgloba\_\{t\}^\{\\mathrm\{glob\}\}
11
12end for
13Aggregate global scores:
sglob=RankAgg\(a1glob,…,aTgglob\)s\_\{\\mathrm\{glob\}\}=\\operatorname\{RankAgg\}\(a\_\{1\}^\{\\mathrm\{glob\}\},\\ldots,a\_\{T\_\{g\}\}^\{\\mathrm\{glob\}\}\)
14
15local neighbor branch
16for*t=1,…,Tℓt=1,\\ldots,T\_\{\\ell\}*do
17Sample feature subset and random projection; obtain projected data
ZtℓZ\_\{t\}^\{\\ell\}
18Sample reference set
Ct⊂ZtℓC\_\{t\}\\subset Z\_\{t\}^\{\\ell\}with
\|Ct\|=c\|C\_\{t\}\|=c
19Score each sample by its average distance to the
kknearest points in
CtC\_\{t\}
20Store the resulting local score vector
atloca\_\{t\}^\{\\mathrm\{loc\}\}
21
22end for
23Aggregate local scores:
sloc=RankAgg\(a1loc,…,aTℓloc\)s\_\{\\mathrm\{loc\}\}=\\operatorname\{RankAgg\}\(a\_\{1\}^\{\\mathrm\{loc\}\},\\ldots,a\_\{T\_\{\\ell\}\}^\{\\mathrm\{loc\}\}\)
24
25Final score
26Return
s=RankAgg\(sglob,sloc\)s=\\operatorname\{RankAgg\}\(s\_\{\\mathrm\{glob\}\},s\_\{\\mathrm\{loc\}\}\)
Algorithm 1RGLDLabel\-free preprocessing selection:RGLD selects preprocessing using only training\-set statistics\. It chooses among standard scaling, robust scaling, and quantile transformation based on scale heterogeneity, tail heaviness, skewness, sparsity, and discreteness\. Robust scaling is used as the safe default when feature geometry may be distorted by outliers or scale mismatch; quantile transformation is used for strongly skewed continuous data; otherwise, standard scaling is used\.
### Automatic projection dimension:
RGLD uses a fixed rule for random projection dimension based only on input dimensiondd:r=2r=2ford≤3d\\leq 3,r=5r=5ford≤20d\\leq 20,r=8r=8ford≤40d\\leq 40,r=12r=12ford≤100d\\leq 100, andr=16r=16otherwise\. The local neighbor branch uses the same rule\.
## Appendix EHyperparameters for Two RGLD Variants
We use two RGLD variants in the experiments:RGLDandRGLD\-Fast\. RGLD is the default configuration used for the main benchmark, while RGLD\-Fast reduces the number of randomized views, random\-feature dimension, reference size to improve runtime\. The hyperparameters used for each variant are shown in Table[4](https://arxiv.org/html/2606.28970#A5.T4)\.
Table 4:Hyperparameters for RGLD and RGLD\-Fast\.RGLD\-Fast keeps the same design as RGLD but reduces the ensemble and random\-feature budgets for lower runtime\.For both variants, each randomized view samples approximately30%30\\%of the input features, subject to a minimum of33selected features, before applying a random projection\. For each global randomized view, the base bandwidth is estimated as the median Euclidean distance over 8192 sampled pairs in the projected space, and the final set of bandwidths is obtained by multiplying this view\-specific base bandwidth by the fixed scale multipliers\.
## Appendix FProof of Proposition[1](https://arxiv.org/html/2606.28970#Thmproposition1)
LetS⋆S^\{\\star\}be the informative feature set andSSbe a feature subset with\|S\|=m\|S\|=m\. By definition,
π\(S\)=\|S∩S⋆\|m\\pi\(S\)=\\frac\{\|S\\cap S^\{\\star\}\|\}\{m\}The expected squared anomaly\-normal separation inSSdecomposes into informative and nuisance coordinates:
𝔼‖\(xa−xn\)S‖22=\|S∩S⋆\|μsig\+\|S∖S⋆\|μnoise\\mathbb\{E\}\\\|\(x\_\{a\}\-x\_\{n\}\)\_\{S\}\\\|\_\{2\}^\{2\}=\|S\\cap S^\{\\star\}\|\\mu\_\{\\mathrm\{sig\}\}\+\|S\\setminus S^\{\\star\}\|\\mu\_\{\\mathrm\{noise\}\}Dividing bymmgives
C\(S\)=\|S∩S⋆\|mμsig\+\(1−\|S∩S⋆\|m\)μnoise=π\(S\)μsig\+\(1−π\(S\)\)μnoise\.C\(S\)=\\frac\{\|S\\cap S^\{\\star\}\|\}\{m\}\\mu\_\{\\mathrm\{sig\}\}\+\\left\(1\-\\frac\{\|S\\cap S^\{\\star\}\|\}\{m\}\\right\)\\mu\_\{\\mathrm\{noise\}\}=\\pi\(S\)\\mu\_\{\\mathrm\{sig\}\}\+\(1\-\\pi\(S\)\)\\mu\_\{\\mathrm\{noise\}\}\.For the full feature space\[d\]\[d\], the informative\-feature fraction isπ\(\[d\]\)=s/d\\pi\(\[d\]\)=s/d, so
C\(\[d\]\)=sdμsig\+\(1−sd\)μnoiseC\(\[d\]\)=\\frac\{s\}\{d\}\\mu\_\{\\mathrm\{sig\}\}\+\\left\(1\-\\frac\{s\}\{d\}\\right\)\\mu\_\{\\mathrm\{noise\}\}Therefore,
C\(S\)−C\(\[d\]\)=\(π\(S\)−sd\)\(μsig−μnoise\)C\(S\)\-C\(\[d\]\)=\\left\(\\pi\(S\)\-\\frac\{s\}\{d\}\\right\)\(\\mu\_\{\\mathrm\{sig\}\}\-\\mu\_\{\\mathrm\{noise\}\}\)Sinceμsig\>μnoise\\mu\_\{\\mathrm\{sig\}\}\>\\mu\_\{\\mathrm\{noise\}\}, ifπ\(S\)\>s/d\\pi\(S\)\>s/d, then
C\(S\)−C\(\[d\]\)\>0C\(S\)\-C\(\[d\]\)\>0and henceC\(S\)\>C\(\[d\]\)C\(S\)\>C\(\[d\]\)\.
Finally, sinceπ\(S\)=\|S∩S⋆\|/m\\pi\(S\)=\|S\\cap S^\{\\star\}\|/m, we have
π\(S\)\>sd⟺\|S∩S⋆\|m\>sd⟺\|S∩S⋆\|\>msd\\pi\(S\)\>\\frac\{s\}\{d\}\\quad\\Longleftrightarrow\\quad\\frac\{\|S\\cap S^\{\\star\}\|\}\{m\}\>\\frac\{s\}\{d\}\\quad\\Longleftrightarrow\\quad\|S\\cap S^\{\\star\}\|\>\\frac\{ms\}\{d\}Thus,
Pr\(π\(S\)\>sd\)=Pr\(\|S∩S⋆\|\>msd\)\\Pr\\left\(\\pi\(S\)\>\\frac\{s\}\{d\}\\right\)=\\Pr\\left\(\|S\\cap S^\{\\star\}\|\>\\frac\{ms\}\{d\}\\right\)
■\\blacksquare
When the feature subsetSSis sampled uniformly without replacement from\[d\]\[d\], the random variableJ=\|S∩S⋆\|J=\|S\\cap S^\{\\star\}\|follows a hypergeometric distribution\. Therefore, the probability that a randomized feature subset is enriched relative to the full feature space is:
penrich=Pr\(π\(S\)\>sd\)=Pr\(J\>msd\)=∑j\>msd\(sj\)\(d−sm−j\)\(dm\)p\_\{\\mathrm\{enrich\}\}=\\Pr\\left\(\\pi\(S\)\>\\frac\{s\}\{d\}\\right\)=\\Pr\\left\(J\>\\frac\{ms\}\{d\}\\right\)=\\sum\_\{j\>\\frac\{ms\}\{d\}\}\\frac\{\\binom\{s\}\{j\}\\binom\{d\-s\}\{m\-j\}\}\{\\binom\{d\}\{m\}\}This quantity characterizes how often randomized views are expected to have higher informative feature concentration than the full space\. AcrossTTindependently sampled views, the expected number of enriched views isTpenrichTp\_\{\\mathrm\{enrich\}\}, and the observed fraction concentrates aroundpenrichp\_\{\\mathrm\{enrich\}\}by standard concentration inequalities\. Thus, whenpenrichp\_\{\\mathrm\{enrich\}\}is non\-negligible, RGLD can include a meaningful fraction of feature\-bagged detectors with stronger subspace contrast, allowing these views to contribute consistently to the rank\-aggregated anomaly score\.
## Appendix GProof of Proposition[2](https://arxiv.org/html/2606.28970#Thmproposition2)
We prove the result for a fixed randomized viewttand bandwidthσ\\sigma\. Conditioning on the sampled feature subset and projection, the projected sampleszi\(t\)z\_\{i\}^\{\(t\)\}are fixed\. Thus, the only randomness comes from the random features used to approximate the Gaussian kernel\.
For simplicity, writez=zt\(x\)z=z\_\{t\}\(x\)andzi=zi\(t\)z\_\{i\}=z\_\{i\}^\{\(t\)\}\. The exact projected KDE score is
p^t,σ\(x\)=1N∑i=1Nkσ\(z,zi\)\\widehat\{p\}\_\{t,\\sigma\}\(x\)=\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}k\_\{\\sigma\}\(z,z\_\{i\}\)Using cosine random features, the RGLD approximation can be written as
p~t,σ\(x\)=1D∑ℓ=1Dhℓ\(x\)\\widetilde\{p\}\_\{t,\\sigma\}\(x\)=\\frac\{1\}\{D\}\\sum\_\{\\ell=1\}^\{D\}h\_\{\\ell\}\(x\)where
hℓ\(x\)=2N∑i=1Ncos\(ωℓ⊤zσ\+bℓ\)cos\(ωℓ⊤ziσ\+bℓ\)h\_\{\\ell\}\(x\)=\\frac\{2\}\{N\}\\sum\_\{i=1\}^\{N\}\\cos\\left\(\\frac\{\\omega\_\{\\ell\}^\{\\top\}z\}\{\\sigma\}\+b\_\{\\ell\}\\right\)\\cos\\left\(\\frac\{\\omega\_\{\\ell\}^\{\\top\}z\_\{i\}\}\{\\sigma\}\+b\_\{\\ell\}\\right\)By the standard random Fourier feature theory, each feature gives an unbiased estimate of the Gaussian kernel, so
𝔼\[hℓ\(x\)\]=1N∑i=1Nkσ\(z,zi\)=p^t,σ\(x\)\\mathbb\{E\}\[h\_\{\\ell\}\(x\)\]=\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}k\_\{\\sigma\}\(z,z\_\{i\}\)=\\widehat\{p\}\_\{t,\\sigma\}\(x\)Therefore,p~t,σ\(x\)\\widetilde\{p\}\_\{t,\\sigma\}\(x\)is an unbiased estimator ofp^t,σ\(x\)\\widehat\{p\}\_\{t,\\sigma\}\(x\)\.
It remains to bound its deviation\. Since each cosine term lies in\[−1,1\]\[\-1,1\], we havehℓ\(x\)∈\[−2,2\]h\_\{\\ell\}\(x\)\\in\[\-2,2\]\. The variables\{hℓ\(x\)\}ℓ=1D\\\{h\_\{\\ell\}\(x\)\\\}\_\{\\ell=1\}^\{D\}are independent across random features\. Applying Hoeffding’s inequality to the average1D∑ℓ=1Dhℓ\(x\)\\frac\{1\}\{D\}\\sum\_\{\\ell=1\}^\{D\}h\_\{\\ell\}\(x\), for anyϵ\>0\\epsilon\>0,
Pr\(\|p~t,σ\(x\)−p^t,σ\(x\)\|≥ϵ\)≤2exp\(−Dϵ28\)\\Pr\\left\(\\left\|\\widetilde\{p\}\_\{t,\\sigma\}\(x\)\-\\widehat\{p\}\_\{t,\\sigma\}\(x\)\\right\|\\geq\\epsilon\\right\)\\leq 2\\exp\\left\(\-\\frac\{D\\epsilon^\{2\}\}\{8\}\\right\)Setting the right\-hand side equal toδ\\deltagives, with probability at least1−δ1\-\\delta,
\|p~t,σ\(x\)−p^t,σ\(x\)\|≤8log\(2/δ\)D=O\(log\(1/δ\)D\)\\left\|\\widetilde\{p\}\_\{t,\\sigma\}\(x\)\-\\widehat\{p\}\_\{t,\\sigma\}\(x\)\\right\|\\leq\\sqrt\{\\frac\{8\\log\(2/\\delta\)\}\{D\}\}=O\\left\(\\sqrt\{\\frac\{\\log\(1/\\delta\)\}\{D\}\}\\right\)
■\\blacksquare
This proves the stated bound\. The proposition is stated for original cosine random Fourier features; in our implementation, QMC features are used as a variance\-reduced alternative, while the bound serves as the standard RFF approximation upper bound\.
## Appendix HProof of Proposition[3](https://arxiv.org/html/2606.28970#Thmproposition3)
Fix a projected viewtt, an evaluation pointxx, and radiusρ\>0\\rho\>0\. LetBt\(x,ρ\)B\_\{t\}\(x,\\rho\)be the set of projected training samples within distanceρ\\rhoofzt\(x\)z\_\{t\}\(x\), and letb=\|Bt\(x,ρ\)\|b=\|B\_\{t\}\(x,\\rho\)\|\. By definition,qt\(x,ρ\)=b/nq\_\{t\}\(x,\\rho\)=b/n\. Letm=\|Ct\|m=\|C\_\{t\}\|be the sampled reference\-set size\.
SinceCtC\_\{t\}is sampled uniformly without replacement from thennprojected training samples, the probability that it contains no point fromBt\(x,ρ\)B\_\{t\}\(x,\\rho\)is
Pr\[Ct∩Bt\(x,ρ\)=∅\]=\(n−bm\)\(nm\)\\Pr\\left\[C\_\{t\}\\cap B\_\{t\}\(x,\\rho\)=\\emptyset\\right\]=\\frac\{\\binom\{n\-b\}\{m\}\}\{\\binom\{n\}\{m\}\}Ifm\>n−bm\>n\-b, the probability is0, and the desired bound holds trivially\. Assumingm≤n−bm\\leq n\-b, expanding the ratio gives
\(n−bm\)\(nm\)=∏j=0m−1n−b−jn−j\\frac\{\\binom\{n\-b\}\{m\}\}\{\\binom\{n\}\{m\}\}=\\prod\_\{j=0\}^\{m\-1\}\\frac\{n\-b\-j\}\{n\-j\}For eachj≥0j\\geq 0, we have
n−b−jn−j≤n−bn=1−bn=1−qt\(x,ρ\)\\frac\{n\-b\-j\}\{n\-j\}\\leq\\frac\{n\-b\}\{n\}=1\-\\frac\{b\}\{n\}=1\-q\_\{t\}\(x,\\rho\)Therefore,
Pr\[Ct∩Bt\(x,ρ\)=∅\]≤\(1−qt\(x,ρ\)\)m\\Pr\\left\[C\_\{t\}\\cap B\_\{t\}\(x,\\rho\)=\\emptyset\\right\]\\leq\\left\(1\-q\_\{t\}\(x,\\rho\)\\right\)^\{m\}Using1−u≤e−u1\-u\\leq e^\{\-u\}foru∈\[0,1\]u\\in\[0,1\], we obtain
Pr\[Ct∩Bt\(x,ρ\)=∅\]≤exp\(−mqt\(x,ρ\)\)=exp\(−\|Ct\|qt\(x,ρ\)\)\\Pr\\left\[C\_\{t\}\\cap B\_\{t\}\(x,\\rho\)=\\emptyset\\right\]\\leq\\exp\\left\(\-mq\_\{t\}\(x,\\rho\)\\right\)=\\exp\\left\(\-\|C\_\{t\}\|q\_\{t\}\(x,\\rho\)\\right\)Thus, with probability at least1−exp\(−\|Ct\|qt\(x,ρ\)\)1\-\\exp\(\-\|C\_\{t\}\|q\_\{t\}\(x,\\rho\)\), the reference set contains at least one projected training sample within distanceρ\\rhoofzt\(x\)z\_\{t\}\(x\)\. This proves the proposition\.
■\\blacksquare
Proposition[3](https://arxiv.org/html/2606.28970#Thmproposition3)characterizes the sampling gap introduced by replacing full\-referencekkNN with sampled\-referencekkNN\. In the fullkkNN score, a pointxxcan use all training samples to find nearby support\. In RGLD,xxonly searches within the sampled reference setCtC\_\{t\}\. The bound shows that if the projected neighborhoodBt\(x,ρ\)B\_\{t\}\(x,\\rho\)contains non\-negligible empirical massqt\(x,ρ\)q\_\{t\}\(x,\\rho\), thenCtC\_\{t\}is unlikely to miss this neighborhood; the miss probability decays exponentially in\|Ct\|qt\(x,ρ\)\|C\_\{t\}\|q\_\{t\}\(x,\\rho\)\. Thus, whenxxis well supported in a projected view, the sampled\-reference score is likely to find nearby points and remain small\. Conversely, if the sampled\-reference score is large, this suggests either thatxxhas genuinely weak local support in that view or that the reference sample missed a very small neighborhood\. RGLD mitigates the latter failure mode by aggregating multiple independently sampled projected\-neighbor views and reference sets\. Therefore, the proposition justifies sampled\-referencekkNN as a scalable approximation to local support\.
## Appendix IScaling in Dataset Size and Dataset Dimension
Figure 6:Scaling with dataset size and ambient dimension\.Top: runtime, AUROC, and AUPRC as the number of samplesnnincreases\. Bottom: runtime, AUROC, and AUPRC as the ambient dimensionddincreases\. RGLD and RGLD\-Fast maintain strong performance and smooth runtime growth withnn\. Asddbecomes very large, accuracy decreases due to dilution of sparse anomaly signals by nuisance dimensions\.We further evaluate how RGLD scales with the number of samplesnnand the ambient dimensionddusing controlled synthetic data\. We use controlled synthetic data to isolate scaling behavior\. Normal samples are drawn from a Gaussian mixture, while anomalies follow a local\-shift mechanism where they are sampled from the same cluster structure and then shifted along a small randomly chosen subset of informative dimensions\. We vary either the number of samplesnnor the ambient dimensiondd, keeping the anomaly ratio and shift magnitude fixed\. In the dimension\-scaling experiment, the anomaly signal remains confined to a small number of informative features asddgrows, making detection increasingly challenging\. The goal of this experiment is to complement the main benchmark by isolating runtime and accuracy trends under increasing dataset size and dimensionality\.
Figure[6](https://arxiv.org/html/2606.28970#A9.F6)shows the results\. When scaling the number of samplesnn, RGLD and RGLD\-Fast maintain high AUROC and AUPRC across the full range while runtime grows smoothly\. This behavior is consistent with the complexity analysis in Section[5](https://arxiv.org/html/2606.28970#S5): RGLD avoids explicit pairwise KDE and full\-referencekkNN computations, replacing them with randomized density and sampled\-reference local\-support estimates\. RGLD\-Fast further reduces runtime while preserving similar accuracy, illustrating the controllable accuracy–efficiency tradeoff of the randomized\-view design\.
When scaling the ambient dimensiondd, runtime increases for all methods, but RGLD remains efficient over most of the range\. Accuracy decreases at very largedd, especially in AUPRC, reflecting the increasing difficulty of detecting sparse anomaly signals as they are diluted by many nuisance dimensions\. This stress test highlights both the benefit and limitation of randomized feature\-bagged views: they improve efficiency and can expose subspace anomalies, but extremely high ambient dimension remains challenging when the informative anomaly signal occupies only a small fraction of features\.
Interestingly, several deep methods \(DIF, DeepSVDD\) exhibit flatter runtime growth than statistical methods as the ambient dimensionddincreases\. This likely reflects their use of fixed neural architectures, whose runtime is less sensitive to large input dimension\. By contrast, statistical detectors often operate directly on distances, projections, or neighborhoods in the input space\. Therefore, RGLD’s main scaling advantage is most evident in sample sizenn, while very high\-dimensional inputs suggest a direction for further optimization through sparser or more adaptive projections\.
## Appendix JDetailed Comparison with ADERH
ADERH is the strongest statistical baseline in our main benchmark, achieving the highest mean AUROC and AUPRC among the evaluated methods\. Since both ADERH and RGLD are randomized statistical detectors, we provide a more detailed comparison between the two methods\. Table[5](https://arxiv.org/html/2606.28970#A10.T5)summarizes their aggregate performance over the 47 ADBench datasets\. ADERH obtains slightly higher mean AUROC and AUPRC\. In contrast, RGLD achieves more first\-place wins among all evaluated methods in both AUROC and AUPRC, while being substantially faster\. In particular, RGLD runs in 0\.22 seconds on average, compared with 1\.06 seconds for ADERH, corresponding to an average runtime advantage of approximately 4\.86x\.
Table 5:Head\-to\-head comparison between RGLD and ADERH over 47 ADBench datasets\.To assess whether the observed differences are statistically meaningful, we perform paired Wilcoxon signed\-rank tests across the 47 datasets\. For AUROC and AUPRC, paired differences are computed as RGLD minus ADERH, so positive values indicate that RGLD has higher detection accuracy\. For runtime, paired differences are computed as ADERH runtime minus RGLD runtime, so positive values indicate that RGLD is faster\. The results are shown in Table[6](https://arxiv.org/html/2606.28970#A10.T6)\.
Table 6:Paired statistical comparison between RGLD and ADERH across 47 datasets\. Positive differences favor RGLD\.The paired tests show that ADERH has slightly higher mean AUROC and AUPRC, but the differences are not statistically significant at the conventional 0\.05 level\. By contrast, the runtime difference is highly significant, with RGLD being faster across the benchmark\. These results support the main accuracy\-efficiency claim of the paper: RGLD is statistically competitive with the strongest statistical baseline in detection accuracy, while offering substantially lower runtime\.
The two methods also rely on different randomized inductive biases\. ADERH builds an ensemble from randomized hypersphere\-pair comparisons, whereas RGLD explicitly combines global random\-feature density support with local projected\-neighbor isolation across feature\-bagged randomized views\. Thus, RGLD provides a complementary randomized statistical approach: rather than relying on a single randomized scoring principle, it aggregates global and local density evidence across multiple views and scales\.
## Appendix KFull Pareto Frontier Graph
Figure 7:Full Pareto frontier graph of RGLD and 23 unsupervised anomaly detection methods using the average AUROC and time over 47 ADBench Datasets\.Figure 8:Full Pareto frontier graph of RGLD and 23 unsupervised anomaly detection methods using the average AUPRC and time over 47 ADBench Datasets\.
## Appendix LDataset Detail
## Appendix MFull Benchmark Results
This appendix reports the full per\-dataset benchmark results across RGLD and 23 deep learning and statistical baselines\. We report AUROC, AUPRC, and total runtime\.
Table 7:Full benchmark AUROC results over 47 ADBench tabular datasets\.
Table 8:Full benchmark AUPRC results over 47 ADBench tabular datasets\.
Table 9:Full benchmark Runtime \(s\) results over 47 ADBench tabular datasets\.
## Appendix NReproducibility / Code Availability
We value the availability and reproducibility of our work\. The code and all the hyperparameters used in the experiment section are supplied as part of the supplemental material\. We will also make our code publicly available upon acceptance of the paper\.Similar Articles
TabLoRA: Parameter-Efficient Low-Rank Ensemble Learning for Large-Scale Tabular Data
TabLoRA proposes a parameter-efficient neural ensemble method for large-scale tabular data by sharing a common backbone with predictor-specific low-rank adaptations, achieving competitive performance against GBDTs and deep learning baselines.
Towards Anomaly Detection on Relational Data
This paper introduces RelAD, a reconstruction-based framework for detecting anomalies in relational databases by jointly modeling attribute and relational edge reconstruction. Extensive experiments on six new benchmarks show RelAD outperforms existing methods.
RAGognizer: Hallucination-Aware Fine-Tuning via Detection Head Integration
RAGognizer introduces a hallucination-aware fine-tuning approach that integrates a lightweight detection head into LLMs for joint optimization of language modeling and hallucination detection in RAG systems. The paper presents RAGognize, a dataset of naturally occurring closed-domain hallucinations with token-level annotations, and demonstrates state-of-the-art hallucination detection while reducing hallucination rates without degrading language quality.
RDP LoRA: Geometry-Driven Identification for Parameter-Efficient Adaptation in Large Language Models
RDP-LoRA uses geometric trajectory analysis and the Ramer-Douglas-Peucker algorithm to automatically select the most impactful layers for parameter-efficient fine-tuning, outperforming full-layer and random LoRA baselines.
Geometry-Aware Tabular Diffusion
Introduces Geometry-Aware Tabular Diffusion (GATD), which augments tabular diffusion denoisers with explicit pairwise geometric features. Achieves state-of-the-art performance on ten benchmarks while using significantly fewer parameters.