Spectral Energy Centroid: a Metric for Improving Performance and Analyzing Spectral Bias in Implicit Neural Representations

arXiv cs.LG Papers

Summary

This paper introduces the Spectral Energy Centroid (SEC) metric to analyze and improve spectral bias in implicit neural representations, demonstrating its utility for hyperparameter selection, signal complexity measurement, and cross-architecture alignment.

arXiv:2605.12709v1 Announce Type: new Abstract: Implicit Neural Representations (INRs) model continuous signals using multilayer perceptrons (MLPs), enabling compact, differentiable, and high-fidelity representations of data across diverse domains. However, due to the low-frequency bias of MLPs that prevents effective learning of small details, the model's frequency must be carefully tuned through the embedding layer. Prior work established that this tuning can be performed before training based on the target signal, but it did not account for the significant effect of model depth, indicating that our understanding of the relationship between frequency and INR performance remains limited. To gain insights into this relationship, we utilize the Spectral Energy Centroid (SEC) metric that quantifies the frequency of target images and the spectral bias of INR models. We show that SEC is a versatile tool for INR analysis, demonstrating its utility across three tasks: (1) a data-driven strategy (SEC-Conf) for hyperparameter selection that outperforms existing heuristics and is robust to model depth, (2) a reliable proxy for signal complexity, and (3) effective alignment of spectral biases across diverse INR architectures.
Original Article
View Cached Full Text

Cached at: 05/14/26, 06:17 AM

# Spectral Energy Centroid: a Metric for Improving Performance and Analyzing Spectral Bias in Implicit Neural Representations
Source: [https://arxiv.org/abs/2605.12709](https://arxiv.org/abs/2605.12709)
[View PDF](https://arxiv.org/pdf/2605.12709)

> Abstract:Implicit Neural Representations \(INRs\) model continuous signals using multilayer perceptrons \(MLPs\), enabling compact, differentiable, and high\-fidelity representations of data across diverse domains\. However, due to the low\-frequency bias of MLPs that prevents effective learning of small details, the model's frequency must be carefully tuned through the embedding layer\. Prior work established that this tuning can be performed before training based on the target signal, but it did not account for the significant effect of model depth, indicating that our understanding of the relationship between frequency and INR performance remains limited\. To gain insights into this relationship, we utilize the Spectral Energy Centroid \(SEC\) metric that quantifies the frequency of target images and the spectral bias of INR models\. We show that SEC is a versatile tool for INR analysis, demonstrating its utility across three tasks: \(1\) a data\-driven strategy \(SEC\-Conf\) for hyperparameter selection that outperforms existing heuristics and is robust to model depth, \(2\) a reliable proxy for signal complexity, and \(3\) effective alignment of spectral biases across diverse INR architectures\.

## Submission history

From: Adam Kania \[[view email](https://arxiv.org/show-email/60a367fc/2605.12709)\] **\[v1\]**Tue, 12 May 2026 20:16:48 UTC \(4,686 KB\)

Similar Articles

Spectral Prior for Reducing Exposure Bias in Diffusion Models

Hugging Face Daily Papers

This paper proposes Spectral Alignment (SPA), a lightweight guidance-based method that reduces exposure bias in diffusion models by calibrating the power spectrum of intermediate predictions, showing consistent improvements across pixel-space, latent, and flow-matching models with minimal computational overhead.