CPCANet: Deep Unfolding Common Principal Component Analysis for Domain Generalization

Hugging Face Daily Papers Papers

Summary

CPCANet is a domain generalization framework that uses Common Principal Component Analysis to discover structured domain-invariant subspaces, achieving state-of-the-art performance in zero-shot transfer.

Domain Generalization (DG) aims to learn representations that remain robust under out-of-distribution (OOD) shifts and generalize effectively to unseen target domains. While recent invariant learning strategies and architectural advances have achieved strong performance, explicitly discovering a structured domain-invariant subspace through second-order statistics remains underexplored. In this work, we propose CPCANet, a novel framework grounded in Common Principal Component Analysis (CPCA), which unrolls the iterative Flury-Gautschi (FG) algorithm into fully differentiable neural layers. This approach integrates the statistical properties of CPCA into an end-to-end trainable framework, enforcing the discovery of a shared subspace across diverse domains while preserving interpretability. Experiments on four standard DG benchmarks demonstrate that CPCANet achieves state-of-the-art (SOTA) performance in zero-shot transfer. Moreover, CPCANet is architecture-agnostic and requires no dataset-specific tuning, providing a simple and efficient approach to learning robust representations under distribution shift. Code is available at https://github.com/wish44165/CPCANet.
Original Article
View Cached Full Text

Cached at: 05/11/26, 07:20 AM

Paper page - CPCANet: Deep Unfolding Common Principal Component Analysis for Domain Generalization

Source: https://huggingface.co/papers/2605.05136

Abstract

CPCANet is a domain generalization framework that uses Common Principal Component Analysis to discover structured domain-invariant subspaces through differentiable neural layers, achieving state-of-the-art performance in zero-shot transfer.

Domain Generalization(DG) aims to learn representations that remain robust under out-of-distribution (OOD) shifts and generalize effectively to unseen target domains. While recentinvariant learningstrategies and architectural advances have achieved strong performance, explicitly discovering a structureddomain-invariant subspacethrough second-order statistics remains underexplored. In this work, we propose CPCANet, a novel framework grounded inCommon Principal Component Analysis(CPCA), which unrolls the iterative Flury-Gautschi (FG) algorithm into fully differentiable neural layers. This approach integrates the statistical properties of CPCA into an end-to-end trainable framework, enforcing the discovery of a shared subspace across diverse domains while preserving interpretability. Experiments on four standard DG benchmarks demonstrate that CPCANet achieves state-of-the-art (SOTA) performance inzero-shot transfer. Moreover, CPCANet is architecture-agnostic and requires no dataset-specific tuning, providing a simple and efficient approach to learning robust representations under distribution shift. Code is available at https://github.com/wish44165/CPCANet.

View arXiv pageView PDFProject pageGitHub0Add to collection

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2605.05136 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2605.05136 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2605.05136 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

Learning High Coverage Discriminative Parsimonious Rulesets

arXiv cs.LG

This paper introduces CDPR, a new approach for learning highly accurate and interpretable rule sets for classification using submodular maximization, achieving over 2.5x improvement in coverage compared to existing methods.

Generalized Category Discovery in Federated Graph Learning

arXiv cs.LG

This paper introduces GCD-FGL, a federated graph learning framework designed for generalized category discovery in dynamic environments. It addresses challenges like the neighborhood absorption effect and global semantic inconsistency to improve novel category detection across distributed clients.