Spectral Energy Centroid: a Metric for Improving Performance and Analyzing Spectral Bias in Implicit Neural Representations
Summary
This paper introduces the Spectral Energy Centroid (SEC) metric to analyze and improve spectral bias in implicit neural representations, demonstrating its utility for hyperparameter selection, signal complexity measurement, and cross-architecture alignment.
View Cached Full Text
Cached at: 05/14/26, 06:17 AM
# Spectral Energy Centroid: a Metric for Improving Performance and Analyzing Spectral Bias in Implicit Neural Representations Source: [https://arxiv.org/abs/2605.12709](https://arxiv.org/abs/2605.12709) [View PDF](https://arxiv.org/pdf/2605.12709) > Abstract:Implicit Neural Representations \(INRs\) model continuous signals using multilayer perceptrons \(MLPs\), enabling compact, differentiable, and high\-fidelity representations of data across diverse domains\. However, due to the low\-frequency bias of MLPs that prevents effective learning of small details, the model's frequency must be carefully tuned through the embedding layer\. Prior work established that this tuning can be performed before training based on the target signal, but it did not account for the significant effect of model depth, indicating that our understanding of the relationship between frequency and INR performance remains limited\. To gain insights into this relationship, we utilize the Spectral Energy Centroid \(SEC\) metric that quantifies the frequency of target images and the spectral bias of INR models\. We show that SEC is a versatile tool for INR analysis, demonstrating its utility across three tasks: \(1\) a data\-driven strategy \(SEC\-Conf\) for hyperparameter selection that outperforms existing heuristics and is robust to model depth, \(2\) a reliable proxy for signal complexity, and \(3\) effective alignment of spectral biases across diverse INR architectures\. ## Submission history From: Adam Kania \[[view email](https://arxiv.org/show-email/60a367fc/2605.12709)\] **\[v1\]**Tue, 12 May 2026 20:16:48 UTC \(4,686 KB\)
Similar Articles
Beyond Output-Space Calibration: Spectral Evidence Bundling for Selective Reliability Estimation in Time-Series Classification
This paper introduces SEB-Cal, a method that augments output-space calibration with spectral features (band energy, entropy, peak dominance, phase stability) to improve selective reliability estimation in time-series classification, achieving higher Corr-AUROC and lower [email protected] across multiple datasets.
Quantifying Explainable AI-introduced signal noise on ECG data with Spectral Entropy
The paper proposes using spectral entropy as a metric to quantify noise introduced by explainability techniques in ECG arrhythmia classification, helping to distinguish true model signal from XAI-generated artifacts.
Spectral Prior for Reducing Exposure Bias in Diffusion Models
This paper proposes Spectral Alignment (SPA), a lightweight guidance-based method that reduces exposure bias in diffusion models by calibrating the power spectrum of intermediate predictions, showing consistent improvements across pixel-space, latent, and flow-matching models with minimal computational overhead.
SEGA: Spectral-Energy Guided Attention for Resolution Extrapolation in Diffusion Transformers
SEGA is a training-free method that improves high-resolution text-to-image generation by adaptively scaling attention across RoPE components based on spatial-frequency structure during denoising steps.
Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Models
This paper identifies and explains a spectral bias in reconstruction-based EEG foundation models, where embeddings over-represent aperiodic and low-frequency components while under-representing oscillatory components, especially at higher frequencies, leading to poor performance in low-resource settings.