Sparsity Induced Identifiability in Matrix Tri-Factorisation

arXiv cs.LG Papers

Summary

This paper studies identifiability in matrix tri-factorisation, showing that sparsity constraints can induce unique solutions for the factorisation problem.

arXiv:2607.27507v1 Announce Type: new Abstract: Matrix factorisation is a fundamental tool for exploiting low-dimensional structure in high-dimensional data, with applications such as data compression, denoising, structure discovery, interpretable representation learning, and dimensionality reduction. Compared to conventional two-factor models, matrix tri-factorisation provides greater modelling flexibility, while sparsity constraints often improve both interpretability and recovery performance. Although the role of sparsity has been extensively studied for two-factor matrix factorisation, rigorous theoretical guarantees for general real-valued matrix tri-factorisation remain largely unexplored. To address this gap, we establish, to the best of our knowledge, the first rigorous theoretical study for sparsity-induced identifiability in general real-valued matrix tri-factorisation. Our analysis is enabled by a novel decomposition strategy that transforms the original problem into two coupled auxiliary factorisation problems, while preserving the structural information necessary to the recovery of the original factor matrices from the observations. Building upon this decomposition, we derive recovery guarantees and structural consistency results that characterise how coefficient sparsity influences the sufficient recovery conditions, convergence behaviour, spectral approximation error, high-probability bounds, and structure preservation. Comprehensive Monte Carlo experiments validate the proposed theory and demonstrate close agreement between the theoretical results and empirical observations.
Original Article
View Cached Full Text

Cached at: 07/31/26, 10:03 AM

# Sparsity Induced Identifiability in Matrix Tri-Factorisation
Source: [https://arxiv.org/abs/2607.27507](https://arxiv.org/abs/2607.27507)
Bibliographic Tools

## Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Code, Data, Media

## Code, Data and Media Associated with this Article

Demos

## Demos

Related Papers

## Recommenders and Search Tools

IArxiv recommender toggle

About arXivLabs

## arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website\.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy\. arXiv is committed to these values and only works with partners that adhere to them\.

Have an idea for a project that will add value for arXiv's community?[**Learn more about arXivLabs**](https://info.arxiv.org/labs/index.html)\.

Similar Articles

From Generalist to Specialist Representation

Hugging Face Daily Papers

This paper establishes nonparametric identifiability guarantees for extracting task-relevant representations from generalist models, proving that task structure is identifiable across time steps and latent representations are identifiable within each step under sparsity regularization.

Sparse Cholesky Elimination Tree

Hacker News Top

The article derives the column elimination tree for the right-looking sparse Cholesky algorithm, explaining how it predicts fill-in and task dependencies without performing dense factorization.

Attractor Geometry Determines the Identifiability Limits of System Discovery

arXiv cs.LG

This paper shows that the smallest eigenvalue of the invariant-measure moment matrix determines the identifiability ceiling for system discovery methods like SINDy and PySR, based on attractor geometry. It introduces a framework that predicts discovery limits from a short reference trajectory without refitting.