Bounded Adjustment with Reliability-Guided Embedding for Imbalanced Learning with Noisy Labels

arXiv cs.LG Papers

Summary

Barge introduces a single-stage objective combining bounded adjustment and reliability-guided embeddings to address imbalanced learning with noisy labels, achieving competitive performance on benchmarks like CIFAR-10 and Tiny ImageNet.

arXiv:2609.16380v1 Announce Type: new Abstract: Class-balanced learning and label noise create a coupled failure mode: frequency correction prevents majority classes from dominating the decision rule, but can amplify incorrectly labeled minority examples. We introduce BARGE (Bounded Adjustment with Reliability-Guided Embeddings), a single-stage objective combining a bounded, prior-adjusted density-power score with reliability-guided angular geometry. Its classification score is strictly proper in the adjusted probability space and recovers balanced Bayes ordering under clean supervision and the true class prior. Under label contamination, its finite range bounds classification-risk perturbation at a fixed predictor, while its logit gradient redescends when the model confidently contradicts the supplied label. The adjusted target probability also weights class-equal feature compactness, and a one-sided separation term discourages aligned class directions. BARGE requires neither a noise rate nor a transition matrix, uses one network, and leaves inference unchanged. We evaluate it on CIFAR-10, CIFAR-100, and Tiny ImageNet under long-tail and step imbalance, clean labels, and 20% and 40% random incorrect-label replacement. Across 12 clean settings, BARGE ranks second overall and attains the lowest error in four. Under corruption, it achieves the lowest mean balanced error in all six dataset-corruption settings, reducing the six-setting average from 72.32% for the strongest competitor to 70.00%. It also obtains the highest macro-F1 and macro-AUPRC in every corrupted-label setting. Ablations show that class-equal angular compactness improves on the bounded score alone. These results support bounded predictive influence and reliability-guided geometry as complementary mechanisms for imbalanced learning with uncertain labels.
Original Article
View Cached Full Text

Cached at: 09/16/26, 08:50 AM

# Bounded Adjustment with Reliability-Guided Embeddingfor Imbalanced Learning with Noisy Labels
Source: [https://arxiv.org/html/2609.16380](https://arxiv.org/html/2609.16380)
Akarsh JAffiliation:Department of Electrical Engineering, Indian Institute of Technology Indore, IndiaM\. TanveerAffiliation:Department of Mathematics, Indian Institute of Technology Indore, IndiaMohd\. ArshadAffiliation:Department of Mathematics, Indian Institute of Technology Indore, India

###### Abstract

Class\-balanced learning and label noise create a coupled failure mode: frequency correction is needed to prevent majority classes from dominating the decision rule, but it can magnify the influence of incorrectly labeled minority examples\. We introduceBarge\(Bounded Adjustment with Reliability\-Guided Embeddings\), a single\-stage objective that combines a bounded, prior\-adjusted density\-power score with reliability\-guided angular geometry\. The classification score is strictly proper in the adjusted probability space and recovers the balanced Bayes ordering under clean supervision and the true class prior\. Under supplied\-label contamination, its finite range bounds the change in classification risk at any fixed predictor, and its logit gradient redescends when the model confidently contradicts the supplied label\. The adjusted target probability also provides a detached reliability weight for class\-equal feature compactness, while a one\-sided separation term discourages positively aligned class directions\. The resulting objective requires neither a noise rate nor a transition matrix, uses one network, and leaves inference unchanged\. We evaluateBargeon CIFAR\-10, CIFAR\-100, and Tiny ImageNet under long\-tail and step imbalance, clean supervision, and 20% and 40% random incorrect\-label replacement\. Across 12 clean\-label settings,Bargeis competitive with strong imbalance\-learning baselines, ranking second overall and attaining the lowest error in four settings\. Under label corruption, it achieves the lowest mean balanced error in all six dataset–corruption settings and reduces the six\-setting average from 72\.32% for the strongest competing method to 70\.00%\. It also attains the highest macro\-F1 and macro\-AUPRC in every corrupted\-label setting\. Component ablations show that class\-equal angular compactness improves on the bounded score alone\. These findings identify bounded predictive influence and reliability\-guided geometry as complementary mechanisms for learning from imbalanced data with uncertain labels\.

## 1Introduction

Balanced classification asks a learner to treat every class as equally consequential even when the training set does not\. This objective is common in medical screening, fault recognition, and ecological monitoring, where the event of interest is often the least frequent one\. It is also a distinct statistical target\. Empirical risk under the observed training prior favors head classes, whereas balanced error corresponds to a uniform target prior\. The mismatch changes the Bayes decision rule and the dynamics by which class\-specific features are learned\([He and Garcia, 2009](https://arxiv.org/html/2609.16380#bib.bib1);[Buda et al\., 2018](https://arxiv.org/html/2609.16380#bib.bib2);[Francazi et al\., 2023](https://arxiv.org/html/2609.16380#bib.bib22)\)\. In applications with asymmetric consequences, long\-tailed learning may additionally require an explicit decision utility rather than a single aggregate accuracy measure\([Li and Zhang, 2025](https://arxiv.org/html/2609.16380#bib.bib17)\)\.

Modern long\-tail learning attacks this mismatch at several levels\. Reweighting modifies the empirical contribution of each class\([Cui et al\., 2019](https://arxiv.org/html/2609.16380#bib.bib4);[Ren et al\., 2018](https://arxiv.org/html/2609.16380#bib.bib26)\); margin and logit methods reshape class decisions\([Cao et al\., 2019](https://arxiv.org/html/2609.16380#bib.bib5);[Menon et al\., 2021](https://arxiv.org/html/2609.16380#bib.bib6)\); decoupled and contrastive methods strengthen representations before or alongside classifier balancing\([Kang et al\., 2020](https://arxiv.org/html/2609.16380#bib.bib27);[Zhu et al\., 2022](https://arxiv.org/html/2609.16380#bib.bib30)\)\. Recent work has moved beyond heuristic corrections\. Generalized logit\-adjusted and class\-aware losses establish balanced\-risk consistency for broad hypothesis classes\([Cortes et al\., 2025b](https://arxiv.org/html/2609.16380#bib.bib8)\), while an imbalance\-sensitive margin framework provides strongℋ\\mathcal\{H\}\-consistency guarantees and class\-sensitive generalization bounds\([Cortes et al\., 2025a](https://arxiv.org/html/2609.16380#bib.bib11)\)\. Difficulty\-aware margins refine which minority examples receive emphasis\([Son et al\., 2025](https://arxiv.org/html/2609.16380#bib.bib9)\), and model rebalancing directly reallocates parameter capacity toward tail classes\([Luo et al\., 2025](https://arxiv.org/html/2609.16380#bib.bib12)\)\. These advances clarify how to correct class frequency\. They leave a second question unresolved: what should happen when the emphasized label is wrong?

That question matters because imbalance and annotation error reinforce one another\. Rare classes are often assembled from weak retrieval, limited expert review, or heterogeneous data sources\. An inverse\-frequency weight can then amplify an incorrect minority label\. Cross\-entropy has a different failure mode: its gradient does not vanish when the network becomes confident that the supplied label is wrong\. Noisy\-label learning addresses these effects through transition correction, sample selection, co\-training, or robust losses\([Patrini et al\., 2017](https://arxiv.org/html/2609.16380#bib.bib31);[Han et al\., 2018](https://arxiv.org/html/2609.16380#bib.bib33);[Zhang and Sabuncu, 2018](https://arxiv.org/html/2609.16380#bib.bib7);[Ma et al\., 2020](https://arxiv.org/html/2609.16380#bib.bib35)\)\. Recent methods jointly address long\-tail imbalance and label noise through label correction, expert specialization, or multimodal consensus\([Chen et al\., 2025](https://arxiv.org/html/2609.16380#bib.bib10);[Li et al\., 2025a](https://arxiv.org/html/2609.16380#bib.bib13);[Li et al\., 2026](https://arxiv.org/html/2609.16380#bib.bib14)\)\. This motivates a complementary loss\-level question: can predictive and representation\-level influence be controlled within a single\-network training protocol, without estimating a noise rate or transition matrix?

To address this setting, we introduceBarge\(Bounded Adjustment with Reliability\-Guided Embeddings\), a single\-stage objective that combines a prior\-adjusted density\-power proper score with reliability\-guided angular geometry\. Under clean supervision, propriety recovers the training posterior in the adjusted probability space, while the raw logits retain the balanced Bayes ordering after removal of the prior contribution\. Under label corruption, boundedness and a redescending gradient limit the influence of a supplied label that strongly conflicts with the current evidence; these properties do not imply recovery of the clean posterior under arbitrary corruption\. The adjusted target probability also serves as a detached reliability signal for representation learning\. It modulates angular contraction toward the supplied class direction, while within\-class normalization maintains class\-equal geometric influence\. A complementary one\-sided penalty separates positively aligned classifier directions\. Thus, the predictive and geometric components are coupled through a common measure of agreement between the model and the supplied label\.

The paper makes the following key contributions\.

- •We derive a prior\-adjusted density\-power objective that is strictly proper in the adjusted probability vector and, under clean supervision and the true prior, induces the balanced Bayes rule in the raw logits\.
- •We establish a finite per\-sample range, a bounded classification\-risk perturbation at a fixed predictor under label contamination, and a redescending logit gradient in the confident\-contradiction limit\. These are targeted influence properties, not a blanket guarantee under arbitrary label noise\.
- •We introduce reliability\-guided, class\-equal angular compactness together with one\-sided classifier separation\. Both geometric terms are bounded and avoid a quadratic sample\-pair matrix\.
- •We evaluate the complete objective under clean and corrupted supervision using a common architecture, optimization procedure, data partitions, tuning protocol, and metric suite\. The study separates clean balanced classification, scaling to 200 classes, label\-corruption behavior, calibration, computational cost, and the contributions of the score and geometric terms\.

The remainder of the paper is structured as follows\.[Section2](https://arxiv.org/html/2609.16380#S2)reviews related work;[section3](https://arxiv.org/html/2609.16380#S3)formalizes the problem;[sections4](https://arxiv.org/html/2609.16380#S4)and[5](https://arxiv.org/html/2609.16380#S5)presentBargeand its theoretical properties;[section6](https://arxiv.org/html/2609.16380#S6)reports the empirical evaluation; and[sections7](https://arxiv.org/html/2609.16380#S7),[8](https://arxiv.org/html/2609.16380#S8)and[9](https://arxiv.org/html/2609.16380#S9)provide the discussion, limitations, and conclusions\.

## 2Related Work

##### Balanced classification\.

Sampling and loss weighting are the most direct corrections for skewed class frequencies\. Class\-balanced loss replaces raw frequency with an effective\-number estimate\([Cui et al\., 2019](https://arxiv.org/html/2609.16380#bib.bib4)\), meta\-reweighting learns example contributions from validation data\([Ren et al\., 2018](https://arxiv.org/html/2609.16380#bib.bib26)\), and Balanced Meta\-Softmax embeds the class prior in the softmax formulation\([Ren et al\., 2020](https://arxiv.org/html/2609.16380#bib.bib28)\)\. Focal loss was introduced for foreground–background imbalance and downweights easy predictions rather than classes themselves\([Lin et al\., 2017](https://arxiv.org/html/2609.16380#bib.bib3)\)\. Equalization losses and related gradient controls suppress head\-class domination in detection\([Tan et al\., 2020](https://arxiv.org/html/2609.16380#bib.bib29)\)\. Margin\-based methods such as LDAM enlarge minority margins\([Cao et al\., 2019](https://arxiv.org/html/2609.16380#bib.bib5)\), while logit adjustment directly corrects the decision rule under prior shift\([Menon et al\., 2021](https://arxiv.org/html/2609.16380#bib.bib6)\)\. Cortes et al\.\([Cortes et al\., 2025b](https://arxiv.org/html/2609.16380#bib.bib8)\)generalize logit\-adjusted and class\-aware losses and prove balanced\-risk consistency under explicit conditions\. A complementary margin framework establishes strongℋ\\mathcal\{H\}\-consistency and class\-sensitive generalization guarantees\([Cortes et al\., 2025a](https://arxiv.org/html/2609.16380#bib.bib11)\)\. A recent high\-dimensional analysis further shows that the effect of reweighting on learned features depends on the symmetry and geometry of the problem\([Obuchi and Tanaka, 2025](https://arxiv.org/html/2609.16380#bib.bib18)\)\. Recent alternatives also intervene outside the loss: distribution\-matched synthesis augments minority classes\([Li et al\., 2025b](https://arxiv.org/html/2609.16380#bib.bib15)\), while model rebalancing redistributes parameter capacity\([Luo et al\., 2025](https://arxiv.org/html/2609.16380#bib.bib12)\)\.Bargeshares the concern with the population target, but adds bounded sample influence and feature geometry\.

##### Long\-tail representations\.

Class imbalance affects the learned representation as well as the final classifier\. Decoupled training shows that a strong representation can coexist with a biased classifier and can often be rebalanced in a second stage\([Kang et al\., 2020](https://arxiv.org/html/2609.16380#bib.bib27)\)\. Balanced contrastive learning modifies class complements and prototypes to improve minority structure\([Zhu et al\., 2022](https://arxiv.org/html/2609.16380#bib.bib30)\)\. Balanced information bottlenecks combine loss rebalancing and self\-distillation across multiple feature levels to preserve label\-relevant information under long\-tailed sampling\([Lan et al\., 2025](https://arxiv.org/html/2609.16380#bib.bib16)\)\. Center loss and angular\-margin objectives likewise demonstrate the value of compact within\-class features and separated class directions\([Wen et al\., 2016](https://arxiv.org/html/2609.16380#bib.bib37);[Liu et al\., 2017](https://arxiv.org/html/2609.16380#bib.bib38);[Wang et al\., 2018](https://arxiv.org/html/2609.16380#bib.bib39);[Deng et al\., 2019](https://arxiv.org/html/2609.16380#bib.bib40)\)\. Supervised contrastive learning provides a general pairwise route to discriminative geometry\([Khosla et al\., 2020](https://arxiv.org/html/2609.16380#bib.bib41)\)\.Bargeuses the final classifier directions as class anchors\. This avoids sample\-pair storage and allows the geometry assigned to an observed label to be moderated by its current reliability\.

##### Learning from corrupted labels\.

Noise\-transition correction is statistically appealing when the transition matrix can be identified\([Patrini et al\., 2017](https://arxiv.org/html/2609.16380#bib.bib31)\)\. Co\-teaching instead relies on two networks exchanging small\-loss examples\([Han et al\., 2018](https://arxiv.org/html/2609.16380#bib.bib33)\); peer loss constructs comparisons without knowing the noise rates\([Liu and Guo, 2020](https://arxiv.org/html/2609.16380#bib.bib34)\)\. Robust\-loss analyses connect symmetry, boundedness, and normalization to tolerance under specified noise models\([Ghosh et al\., 2017](https://arxiv.org/html/2609.16380#bib.bib32);[Zhang and Sabuncu, 2018](https://arxiv.org/html/2609.16380#bib.bib7);[Ma et al\., 2020](https://arxiv.org/html/2609.16380#bib.bib35)\)\. Later work emphasizes that robustness and reliable probability estimation are not the same property\([Olmin and Lindsten, 2022](https://arxiv.org/html/2609.16380#bib.bib36)\)\. Representation\-based analyses provide another perspective: self\-supervised features can distribute label noise more uniformly and preserve compact class structure before noisy\-label fitting\([Xu et al\., 2025](https://arxiv.org/html/2609.16380#bib.bib19)\)\. Recent long\-tailed noisy\-label pipelines combine label correction with prior estimation, semantic expert training, or multimodal consensus\([Chen et al\., 2025](https://arxiv.org/html/2609.16380#bib.bib10);[Li et al\., 2025a](https://arxiv.org/html/2609.16380#bib.bib13);[Li et al\., 2026](https://arxiv.org/html/2609.16380#bib.bib14)\)\.Bargetakes a complementary objective\-level approach: it does not estimate clean labels or a transition model, and uses adjusted confidence only as a stopped\-gradient relative weight\.

##### Positioning\.

Bargebuilds on four principles: prior correction for balanced decision rules, density\-power divergence for robust estimation\([Basu et al\., 1998](https://arxiv.org/html/2609.16380#bib.bib20)\), proper scoring rules for probabilistic prediction\([Gneiting and Raftery, 2007](https://arxiv.org/html/2609.16380#bib.bib21)\), and angular regularization for representation learning\. The same prior\-adjusted target probability defines both the bounded classification score and the detached reliability weight used in the compactness term\. Consequently, predictive influence and label\-conditioned feature contraction are governed by a common measure of agreement between the model and the supplied label\. A complementary one\-sided penalty discourages alignment between class directions\. This coupling distinguishesBargefrom approaches that apply prior correction, robust scoring, or feature regularization independently\.

## 3Problem Setting and Design Requirements

Let𝒟=\{\(𝒙i,y~i\)\}i=1N\\mathcal\{D\}=\\\{\(\\bm\{x\}\_\{i\},\\widetilde\{y\}\_\{i\}\)\\\}\_\{i=1\}^\{N\}be a training sample, where𝒙i∈𝒳⊆ℝdx\\bm\{x\}\_\{i\}\\in\\mathcal\{X\}\\subseteq\\mathbb\{R\}^\{d\_\{x\}\}and the observed labely~i∈\{1,…,C\}\\widetilde\{y\}\_\{i\}\\in\\\{1,\\ldots,C\\\}\. Its unobserved clean counterpart isyiy\_\{i\}\. The observed class count and empirical prior are

nc=∑i=1N𝕀\[y~i=c\],π^c=ncN,𝝅^∈ΔC−1\.n\_\{c\}=\\sum\_\{i=1\}^\{N\}\\mathbb\{I\}\[\\widetilde\{y\}\_\{i\}=c\],\\qquad\\widehat\{\\pi\}\_\{c\}=\\frac\{n\_\{c\}\}\{N\},\\qquad\\widehat\{\\bm\{\\pi\}\}\\in\\Delta^\{C\-1\}\.\(1\)We assume that every observed class is represented in the training distribution, soπ^c\>0\\widehat\{\\pi\}\_\{c\}\>0for allc∈\{1,…,C\}c\\in\\\{1,\\ldots,C\\\}\.

Evaluation gives equal weight to theCCclean classes\. For a classifierg:𝒳→\{1,…,C\}g:\\mathcal\{X\}\\rightarrow\\\{1,\\ldots,C\\\}, the balanced risk is

ℛbal​\(g\)=1C​∑c=1CPr⁡\(g⁡\(X\)≠c∣Y=c\)\.\\mathcal\{R\}\_\{\\mathrm\{bal\}\}\(g\)=\\frac\{1\}\{C\}\\sum\_\{c=1\}^\{C\}\\Pr\\\!\\left\(g\(X\)\\neq c\\mid Y=c\\right\)\.\(2\)Writeqc​\(𝒙\)=Pr⁡\(Y=c∣X=𝒙\)q\_\{c\}\(\\bm\{x\}\)=\\Pr\(Y=c\\mid X=\\bm\{x\}\)andπc=Pr⁡\(Y=c\)\\pi\_\{c\}=\\Pr\(Y=c\)under the clean training distribution\. For later use, letq~c​\(𝒙\)=Pr⁡\(Y~=c∣X=𝒙\)\\widetilde\{q\}\_\{c\}\(\\bm\{x\}\)=\\Pr\(\\widetilde\{Y\}=c\\mid X=\\bm\{x\}\)andπ~c=Pr⁡\(Y~=c\)\\widetilde\{\\pi\}\_\{c\}=\\Pr\(\\widetilde\{Y\}=c\)denote their observed\-label counterparts\. If the clean class\-conditionalsp⁡\(𝒙∣y=c\)p\(\\bm\{x\}\\mid y=c\)are shared between training and evaluation and the target prior is uniform, the balanced Bayes rule is

gbal∗​\(𝒙\)∈arg⁡maxc∈\{1,…,C\}⁡qc​\(𝒙\)πc\.g^\{\*\}\_\{\\mathrm\{bal\}\}\(\\bm\{x\}\)\\in\\arg\\max\_\{c\\in\\\{1,\\ldots,C\\\}\}\\frac\{q\_\{c\}\(\\bm\{x\}\)\}\{\\pi\_\{c\}\}\.\(3\)
The network contains a feature map and a linear classifier,

𝒉i=fθ​\(𝒙i\)∈ℝd,𝒛i=W​𝒉i\+𝒃∈ℝC,\\bm\{h\}\_\{i\}=f\_\{\\theta\}\(\\bm\{x\}\_\{i\}\)\\in\\mathbb\{R\}^\{d\},\\qquad\\bm\{z\}\_\{i\}=W\\bm\{h\}\_\{i\}\+\\bm\{b\}\\in\\mathbb\{R\}^\{C\},\(4\)whereW=\[𝒘1⊤;…;𝒘C⊤\]∈ℝC×dW=\[\\bm\{w\}\_\{1\}^\{\\top\};\\ldots;\\bm\{w\}\_\{C\}^\{\\top\}\]\\in\\mathbb\{R\}^\{C\\times d\}and𝒃∈ℝC\\bm\{b\}\\in\\mathbb\{R\}^\{C\}\. We seek raw logits whose ordering approaches[equation3](https://arxiv.org/html/2609.16380#S3.E3)\. At the same time, one low\-probability observed label should neither create an unbounded sample loss nor pull its feature toward a class direction as strongly as a consistent label\. The noise rate and transition matrix are unknown\.

These constraints lead to three design requirements\. Under clean supervision, the predictive term must have the correct balanced population target\. For any supplied label, its response to confident contradiction must be bounded and eventually diminish\. Finally, the feature regularizer must give classes equal influence while allowing examples within a class to contribute according to current evidence\.

## 4Bounded Adjustment with Reliability\-Guided Embeddings

### 4\.1Overview

The construction follows a single principle: class frequency determines the desired decision rule, while the model’s agreement with a supplied label determines how strongly that label may reshape the representation\. For a minibatchℬ\\mathcal\{B\}of sizeBB,Bargecombines a prior\-adjusted classification score, class\-equal compactness, and class\-direction separation:

ℒBARGE=ℒcls\+η⁡\(ℒcomp\+ℒsep\),η\>0\.\\mathcal\{L\}\_\{\\mathrm\{BARGE\}\}=\\mathcal\{L\}\_\{\\mathrm\{cls\}\}\+\\eta\\bigl\(\\mathcal\{L\}\_\{\\mathrm\{comp\}\}\+\\mathcal\{L\}\_\{\\mathrm\{sep\}\}\\bigr\),\\qquad\\eta\>0\.\(5\)The coefficientη\\etacontrols the overall strength of the geometric terms, while the class\-count\-dependent exponent defined in[section4\.3](https://arxiv.org/html/2609.16380#S4.SS3)adapts the classification response analytically to the number of classes\. Classification supplies the statistical target, compactness organizes examples around their class directions, and separation prevents those directions from becoming indistinguishable\.[Figure1](https://arxiv.org/html/2609.16380#S4.F1)summarizes these roles\.

### 4\.2Prior\-adjusted probability

Class prevalence and class evidence play different roles\. Adding the empirical log prior during training maps the raw logits to probabilities on the observed training distribution:

ri​c=π^c​exp⁡\(zi​c\)∑k=1Cπ^k​exp⁡\(zi​k\),𝒓i=softmax⁡\(𝒛i\+log⁡𝝅^\)∈ΔC−1\.r\_\{ic\}=\\frac\{\\widehat\{\\pi\}\_\{c\}\\exp\(z\_\{ic\}\)\}\{\\sum\_\{k=1\}^\{C\}\\widehat\{\\pi\}\_\{k\}\\exp\(z\_\{ik\}\)\},\\qquad\\bm\{r\}\_\{i\}=\\operatorname\{softmax\}\(\\bm\{z\}\_\{i\}\+\\log\\widehat\{\\bm\{\\pi\}\}\)\\in\\Delta^\{C\-1\}\.\(6\)Prediction usesarg⁡maxc⁡zi​c\\arg\\max\_\{c\}z\_\{ic\}without the adjustment\. Under clean supervision, a proper score can therefore identify the training posterior in𝒓\\bm\{r\}, while the raw logits remove the prior contribution required for balanced decisions\. Under corrupted supervision,𝒓\\bm\{r\}targets the observed\-label posterior instead; the distinction is made explicit in[section5](https://arxiv.org/html/2609.16380#S5)\.

### 4\.3Bounded density\-power score

For𝒓∈ΔC−1\\bm\{r\}\\in\\Delta^\{C\-1\}, supplied labely∈\{1,…,C\}y\\in\\\{1,\\ldots,C\\\}, and exponentβ\>0\\beta\>0, define

ℓβ​\(𝒓,y\)=1β\+∑c=1Crc1\+β−1\+ββ​ryβ\.\\ell\_\{\\beta\}\(\\bm\{r\},y\)=\\frac\{1\}\{\\beta\}\+\\sum\_\{c=1\}^\{C\}r\_\{c\}^\{1\+\\beta\}\-\\frac\{1\+\\beta\}\{\\beta\}r\_\{y\}^\{\\beta\}\.\(7\)The minibatch classification term is

ℒcls=1B​∑i∈ℬℓβC​\(𝒓i,y~i\),βC=min⁡\{12,1log⁡C\}\.\\mathcal\{L\}\_\{\\mathrm\{cls\}\}=\\frac\{1\}\{B\}\\sum\_\{i\\in\\mathcal\{B\}\}\\ell\_\{\\beta\_\{C\}\}\(\\bm\{r\}\_\{i\},\\widetilde\{y\}\_\{i\}\),\\qquad\\beta\_\{C\}=\\min\\\!\\left\\\{\\frac\{1\}\{2\},\\frac\{1\}\{\\log C\}\\right\\\}\.\(8\)The density\-power score is proper, like cross\-entropy, but has finite range and a gradient that vanishes under confident contradiction\. The exponent controls how quickly this attenuation begins\. Its decrease withCCavoids suppressing a small target probability too aggressively when probability mass is distributed over more classes\.

### 4\.4Reliability\-guided class\-equal compactness

The classification score controls the logits but does not directly organize the feature space\. For nonzero features and classifier rows, we use each normalized classifier row as a class direction and normalize the feature,

𝒉^i=𝒉i∥𝒉i∥2∈ℝd,𝒘^c=𝒘c∥𝒘c∥2∈ℝd,\\widehat\{\\bm\{h\}\}\_\{i\}=\\frac\{\\bm\{h\}\_\{i\}\}\{\\lVert\\bm\{h\}\_\{i\}\\rVert\_\{2\}\}\\in\\mathbb\{R\}^\{d\},\\qquad\\widehat\{\\bm\{w\}\}\_\{c\}=\\frac\{\\bm\{w\}\_\{c\}\}\{\\lVert\\bm\{w\}\_\{c\}\\rVert\_\{2\}\}\\in\\mathbb\{R\}^\{d\},\(9\)for nonzero vectors\. The adjusted probability assigned to the observed label supplies the reliability weight

ωi=sg⁡\(ri​y~iβC\)∈\(0,1\]\.\\omega\_\{i\}=\\operatorname\{sg\}\\\!\\left\(r\_\{i\\widetilde\{y\}\_\{i\}\}^\{\\beta\_\{C\}\}\\right\)\\in\(0,1\]\.\(10\)The stop\-gradient operator makes the weight a measure of current agreement rather than an additional target for the probability vector\. A supplied label that agrees with the adjusted prediction may shape the embedding strongly; a confidently contradicted label receives little relative influence\.

Letℬc=\{i∈ℬ:y~i=c\}\\mathcal\{B\}\_\{c\}=\\\{i\\in\\mathcal\{B\}:\\widetilde\{y\}\_\{i\}=c\\\}and𝒞ℬ=\{c:\|ℬc\|\>0\}\\mathcal\{C\}\_\{\\mathcal\{B\}\}=\\\{c:\|\\mathcal\{B\}\_\{c\}\|\>0\\\}\. The compactness term is

ℒcomp=1\|𝒞ℬ\|​∑c∈𝒞ℬ∑i∈ℬcωi​\(1−𝒉^i⊤​𝒘^c\)∑i∈ℬcωi\.\\mathcal\{L\}\_\{\\mathrm\{comp\}\}=\\frac\{1\}\{\|\\mathcal\{C\}\_\{\\mathcal\{B\}\}\|\}\\sum\_\{c\\in\\mathcal\{C\}\_\{\\mathcal\{B\}\}\}\\frac\{\\sum\_\{i\\in\\mathcal\{B\}\_\{c\}\}\\omega\_\{i\}\\bigl\(1\-\\widehat\{\\bm\{h\}\}\_\{i\}^\{\\top\}\\widehat\{\\bm\{w\}\}\_\{c\}\\bigr\)\}\{\\sum\_\{i\\in\\mathcal\{B\}\_\{c\}\}\\omega\_\{i\}\}\.\(11\)Every class present in the minibatch contributes once, independent of its sample count\. Within that class, a label that agrees with the adjusted prediction receives more influence than one that does not\. The classwise denominator is essential: a global average would allow head classes to dominate again, whereas classwise self\-normalization preserves equal class contribution\.

### 4\.5One\-sided classifier separation

Compactness alone can pull different classes toward nearby classifier directions\. We therefore penalize acute off\-diagonal angles in the normalized classifier Gram matrix:

ℒsep=1C⁡\(C−1\)​∑c,k=1c≠kC\[max⁡\(0,𝒘^c⊤​𝒘^k\)\]2\.\\mathcal\{L\}\_\{\\mathrm\{sep\}\}=\\frac\{1\}\{C\(C\-1\)\}\\sum\_\{\\begin\{subarray\}\{c\}c,k=1\\\\ c\\neq k\\end\{subarray\}\}^\{C\}\\left\[\\max\\\!\\left\(0,\\widehat\{\\bm\{w\}\}\_\{c\}^\{\\top\}\\widehat\{\\bm\{w\}\}\_\{k\}\\right\)\\right\]^\{2\}\.\(12\)The penalty acts only when two class directions have positive cosine similarity\. Orthogonal and obtuse directions are left unchanged\. This one\-sided form creates separation where overlap is most plausible without imposing an infeasible orthogonality requirement whenC\>dC\>d\.

0\.20\.20\.40\.40\.60\.60\.80\.8002244Supplied\-label probabilityryr\_\{y\}Per\-sample loss\(a\) Bounded predictive penaltyCross\-entropyDensity\-power,β=0\.3\\beta=0\.3−10\-10−5\-500551010000\.50\.511Binary marginuy−umu\_\{y\}\-u\_\{m\}\(b\) Redescending target responseCross\-entropyDensity\-power,β=0\.3\\beta=0\.3000\.20\.20\.40\.40\.60\.60\.80\.811000\.20\.20\.40\.40\.60\.60\.80\.811Adjusted target probabilityryr\_\{y\}Reliability weightryβCr\_\{y\}^\{\\beta\_\{C\}\}\(c\) Reliability across class countsC=10C=10C=100C=100C=200C=2000045459090135135180180000\.50\.5111\.51\.522Angle \(degrees\)\(d\) Angular geometryCompactness1−cos⁡θ1\-\\cos\\thetaSeparation\[cos⁡ϕ\]\+2\[\\cos\\phi\]\_\{\+\}^\{2\}Figure 1:The four mechanisms inBarge\. The density\-power score remains finite as the supplied\-label probability approaches zero \(a\), and its target response vanishes under confident contradiction \(b\)\. The fixed exponent transfers adjusted confidence into a smooth reliability weight \(c\)\. Feature compactness acts over the full angular range, whereas class\-direction separation acts only on acute angles \(d\)\. \(a\) and \(b\) use a binary probability slice for visualization; the propositions hold for anyCC\.Table 1:Properties of representative loss functions\. “Proper” means strictly proper in the probability vector optimized by the classification score\. Boundedness and redescending behavior for GCA apply to its generalized\-cross\-entropy form withq\>0q\>0; atq=0q=0, it reduces to an unbounded weighted cross\-entropy form\. Feature compactness and class\-direction separation refer to explicit terms in the loss\.
### 4\.6Relation to representative losses

[Table1](https://arxiv.org/html/2609.16380#S4.T1)compares the properties ofBargewith those of representative classification objectives\.

### 4\.7Complexity

After logits are available, classification costsO⁡\(B​C\)O\(BC\), compactness costsO⁡\(B​d\)O\(Bd\), and separation costsO⁡\(C2​d\)O\(C^\{2\}d\)\. Additional memory isO⁡\(B​C\+C2\)O\(BC\+C^\{2\}\)\. NoB×BB\\times Bsample\-similarity matrix is formed\. The loss adds no inference\-time parameters or operations\.

## 5Theoretical Analysis

###### Proposition 1\(Properness and clean balanced decision\)\.

For anyβ\>0\\beta\>0and conditional label distribution𝐬∈ΔC−1\\bm\{s\}\\in\\Delta^\{C\-1\}, the conditional risk𝔼L∼𝐬​\[ℓβ​\(𝐫,L\)\]\\mathbb\{E\}\_\{L\\sim\\bm\{s\}\}\[\\ell\_\{\\beta\}\(\\bm\{r\},L\)\]is uniquely minimized at𝐫=𝐬\\bm\{r\}=\\bm\{s\}\. Under clean supervision, the prior\-shift assumptions in[section3](https://arxiv.org/html/2609.16380#S3), and an exact clean prior𝛑\\bm\{\\pi\}, a population minimizer satisfies

zc∗​\(𝒙\)=log⁡qc​\(𝒙\)−log⁡πc\+κ⁡\(𝒙\),z\_\{c\}^\{\*\}\(\\bm\{x\}\)=\\log q\_\{c\}\(\\bm\{x\}\)\-\\log\\pi\_\{c\}\+\\kappa\(\\bm\{x\}\),\(13\)whereκ⁡\(𝐱\)\\kappa\(\\bm\{x\}\)is independent ofcc\. Thusarg⁡maxc​zc∗​\(𝐱\)\\arg\\max\_\{c\}z\_\{c\}^\{\*\}\(\\bm\{x\}\)equals the balanced Bayes rule in[equation3](https://arxiv.org/html/2609.16380#S3.E3)\.

###### Proof\.

LetΦ⁡\(𝒓\)=β−1​∑crc1\+β\\Phi\(\\bm\{r\}\)=\\beta^\{\-1\}\\sum\_\{c\}r\_\{c\}^\{1\+\\beta\}, which is strictly convex forβ\>0\\beta\>0\. Its Bregman divergence satisfies

DΦ​\(𝒆y,𝒓\)\\displaystyle D\_\{\\Phi\}\(\\bm\{e\}\_\{y\},\\bm\{r\}\)=Φ\(𝒆y\)−Φ\(𝒓\)−∇Φ\(𝒓\)⊤\(𝒆y−𝒓\)\\displaystyle=\\Phi\(\\bm\{e\}\_\{y\}\)\-\\Phi\(\\bm\{r\}\)\-\\nabla\\Phi\(\\bm\{r\}\)^\{\\top\}\(\\bm\{e\}\_\{y\}\-\\bm\{r\}\)\(14\)=1β\+∑crc1\+β−1\+ββ​ryβ=ℓβ​\(𝒓,y\)\.\\displaystyle=\\frac\{1\}\{\\beta\}\+\\sum\_\{c\}r\_\{c\}^\{1\+\\beta\}\-\\frac\{1\+\\beta\}\{\\beta\}r\_\{y\}^\{\\beta\}=\\ell\_\{\\beta\}\(\\bm\{r\},y\)\.\(15\)Taking expectation under𝒔\\bm\{s\}and subtracting the risk at𝒔\\bm\{s\}gives

𝔼𝒔​\[ℓβ​\(𝒓,L\)\]−𝔼𝒔​\[ℓβ​\(𝒔,L\)\]=DΦ​\(𝒔,𝒓\)≥0,\\mathbb\{E\}\_\{\\bm\{s\}\}\[\\ell\_\{\\beta\}\(\\bm\{r\},L\)\]\-\\mathbb\{E\}\_\{\\bm\{s\}\}\[\\ell\_\{\\beta\}\(\\bm\{s\},L\)\]=D\_\{\\Phi\}\(\\bm\{s\},\\bm\{r\}\)\\geq 0,\(16\)with equality only at𝒓=𝒔\\bm\{r\}=\\bm\{s\}\. Under clean supervision,𝒔=𝒒\\bm\{s\}=\\bm\{q\}\. Hencesoftmax⁡\(𝒛∗\+log⁡𝝅\)=𝒒\\operatorname\{softmax\}\(\\bm\{z\}^\{\*\}\+\\log\\bm\{\\pi\}\)=\\bm\{q\}, which yields[equation13](https://arxiv.org/html/2609.16380#S5.E13)up to a class\-independent additive constant\. Taking an argmax completes the result\. ∎

###### Proposition 2\(Finite range and redescending contradiction\)\.

For every𝐫∈ΔC−1\\bm\{r\}\\in\\Delta^\{C\-1\}andy∈\{1,…,C\}y\\in\\\{1,\\ldots,C\\\},

0≤ℓβ​\(𝒓,y\)≤1\+ββ\.0\\leq\\ell\_\{\\beta\}\(\\bm\{r\},y\)\\leq\\frac\{1\+\\beta\}\{\\beta\}\.\(17\)Let𝐮=𝐳\+log⁡𝛑\\bm\{u\}=\\bm\{z\}\+\\log\\bm\{\\pi\}andSβ​\(𝐫\)=∑jrj1\+βS\_\{\\beta\}\(\\bm\{r\}\)=\\sum\_\{j\}r\_\{j\}^\{1\+\\beta\}\. Then

∂ℓβ∂uk=\(1\+β\)\[rk\(rkβ−Sβ\(𝒓\)\+ryβ\)−𝕀\[k=y\]ryβ\]\.\\frac\{\\partial\\ell\_\{\\beta\}\}\{\\partial u\_\{k\}\}=\(1\+\\beta\)\\left\[r\_\{k\}\\bigl\(r\_\{k\}^\{\\beta\}\-S\_\{\\beta\}\(\\bm\{r\}\)\+r\_\{y\}^\{\\beta\}\\bigr\)\-\\mathbb\{I\}\[k=y\]r\_\{y\}^\{\\beta\}\\right\]\.\(18\)Ifry→0r\_\{y\}\\to 0andrm→1r\_\{m\}\\to 1for onem≠ym\\neq y, every component of[equation18](https://arxiv.org/html/2609.16380#S5.E18)converges to zero\. The cross\-entropy target gradient does not\.

Moreover, let𝐬ε=\(1−ε\)​𝐬\+ε​𝐚\\bm\{s\}\_\{\\varepsilon\}=\(1\-\\varepsilon\)\\bm\{s\}\+\\varepsilon\\bm\{a\}, where𝐚∈ΔC−1\\bm\{a\}\\in\\Delta^\{C\-1\}is any contaminating conditional label distribution\. For every fixed𝐫\\bm\{r\},

\|𝔼L∼𝒔ε​ℓβ​\(𝒓,L\)−𝔼L∼𝒔​ℓβ​\(𝒓,L\)\|≤ε​1\+ββ\.\\left\|\\mathbb\{E\}\_\{L\\sim\\bm\{s\}\_\{\\varepsilon\}\}\\ell\_\{\\beta\}\(\\bm\{r\},L\)\-\\mathbb\{E\}\_\{L\\sim\\bm\{s\}\}\\ell\_\{\\beta\}\(\\bm\{r\},L\)\\right\|\\leq\\varepsilon\\frac\{1\+\\beta\}\{\\beta\}\.\(19\)

###### Proof\.

Nonnegativity follows from the Bregman representation\. Since∑crc1\+β≤1\\sum\_\{c\}r\_\{c\}^\{1\+\\beta\}\\leq 1andryβ≥0r\_\{y\}^\{\\beta\}\\geq 0, the upper bound is1/β\+11/\\beta\+1\. Differentiating through∂rj/∂uk=rj\(𝕀\[j=k\]−rk\)\\partial r\_\{j\}/\\partial u\_\{k\}=r\_\{j\}\(\\mathbb\{I\}\[j=k\]\-r\_\{k\}\)gives[equation18](https://arxiv.org/html/2609.16380#S5.E18)\. In the stated limit,Sβ​\(𝒓\)→1S\_\{\\beta\}\(\\bm\{r\}\)\\to 1,ryβ→0r\_\{y\}^\{\\beta\}\\to 0, and every non\-dominant probability vanishes\. Direct substitution gives zero fork=mk=m,k=yk=y, and all remaining coordinates\. Finally, both conditional risks in[equation19](https://arxiv.org/html/2609.16380#S5.E19)lie in\[0,\(1\+β\)/β\]\[0,\(1\+\\beta\)/\\beta\], and their mixture difference isε\\varepsilontimes their difference\. This proves the bound\. ∎

###### Proposition 3\(Bounded geometry and objective\)\.

For every nonempty minibatch,

0≤ℒcomp≤2,0≤ℒsep≤1,0\\leq\\mathcal\{L\}\_\{\\mathrm\{comp\}\}\\leq 2,\\qquad 0\\leq\\mathcal\{L\}\_\{\\mathrm\{sep\}\}\\leq 1,\(20\)and therefore

0≤ℒBARGE≤1\+βCβC\+3​η\.0\\leq\\mathcal\{L\}\_\{\\mathrm\{BARGE\}\}\\leq\\frac\{1\+\\beta\_\{C\}\}\{\\beta\_\{C\}\}\+3\\eta\.\(21\)

###### Proof\.

Normalized inner products lie in\[−1,1\]\[\-1,1\], so every compactness distance lies in\[0,2\]\[0,2\]\. Each class contribution in[equation11](https://arxiv.org/html/2609.16380#S4.E11)is a positive weighted average of such distances\. Averaging across present classes preserves the interval\. Every squared positive cosine in[equation12](https://arxiv.org/html/2609.16380#S4.E12)lies in\[0,1\]\[0,1\]\. Combining these bounds with[equation17](https://arxiv.org/html/2609.16380#S5.E17)proves[equation21](https://arxiv.org/html/2609.16380#S5.E21)\. ∎

### 5\.1What changes under corrupted supervision

LetTa​b​\(𝒙\)=Pr⁡\(Y~=b∣Y=a,X=𝒙\)T\_\{ab\}\(\\bm\{x\}\)=\\Pr\(\\widetilde\{Y\}=b\\mid Y=a,X=\\bm\{x\}\)denote a possibly instance\-dependent corruption mechanism\. The observed\-label posterior and prior are

q~b​\(𝒙\)=∑a=1CTa​b​\(𝒙\)​qa​\(𝒙\),π~b=𝔼X​\[q~b​\(X\)\]\.\\widetilde\{q\}\_\{b\}\(\\bm\{x\}\)=\\sum\_\{a=1\}^\{C\}T\_\{ab\}\(\\bm\{x\}\)q\_\{a\}\(\\bm\{x\}\),\\qquad\\widetilde\{\\pi\}\_\{b\}=\\mathbb\{E\}\_\{X\}\[\\widetilde\{q\}\_\{b\}\(X\)\]\.\(22\)Proposition[1](https://arxiv.org/html/2609.16380#Thmproposition1)then identifies𝒒~\\widetilde\{\\bm\{q\}\}, not𝒒\\bm\{q\}, because the training risk is formed fromY~\\widetilde\{Y\}\. With an exact observed prior, the raw population logits orderq~c​\(𝒙\)/π~c\\widetilde\{q\}\_\{c\}\(\\bm\{x\}\)/\\widetilde\{\\pi\}\_\{c\}\. This ratio is not generally the clean balanced ruleqc​\(𝒙\)/πcq\_\{c\}\(\\bm\{x\}\)/\\pi\_\{c\}\. The balanced\-consistency result is therefore a clean\-supervision statement and is not used to claim consistency under label corruption\.

The noise\-relevant conclusions are influence statements\. Equation \([19](https://arxiv.org/html/2609.16380#S5.E19)\) limits how much an arbitrary fraction of replaced labels can change the classification risk at any fixed predictor\. Proposition[2](https://arxiv.org/html/2609.16380#Thmproposition2)also shows that the gradient of a supplied label vanishes when the adjusted prediction confidently contradicts it\. For compactness, the normalized share of exampleiiwithin its observed class is

ai=ωi∑j∈ℬy~iωj\.a\_\{i\}=\\frac\{\\omega\_\{i\}\}\{\\sum\_\{j\\in\\mathcal\{B\}\_\{\\tilde\{y\}\_\{i\}\}\}\\omega\_\{j\}\}\.\(23\)If another example in that class has weight at leastδ\>0\\delta\>0, thenai≤ωi/δ→0a\_\{i\}\\leq\\omega\_\{i\}/\\delta\\to 0asri​y~i→0r\_\{i\\widetilde\{y\}\_\{i\}\}\\to 0\. Thus a contradicted label loses relative geometric influence when the minibatch contains supporting evidence\. The condition is essential: a singleton class, or a class in which every supplied label is unreliable, receives no such guarantee\. These results motivate the corruption experiments without asserting universal noise tolerance or recovery of the clean posterior\.

## 6Experiments

The experiments are organized around three questions\. First, does the bounded score and geometry preserve strong balanced classification when labels are clean? Second, does the method scale from 10 to 200 classes? Third, do the influence controls translate into better relative performance when the training labels are corrupted?

### 6\.1Experimental protocol

##### Datasets and imbalance\.

We use CIFAR\-10, CIFAR\-100\([Krizhevsky, 2009](https://arxiv.org/html/2609.16380#bib.bib23)\), and Tiny ImageNet\-200\([Le and Yang, 2015](https://arxiv.org/html/2609.16380#bib.bib24)\)\. A class\-balanced validation set is held out before the CIFAR training set is made imbalanced: 50 images per class for CIFAR\-10 and 5 per class for CIFAR\-100\. Tiny ImageNet uses its 100,000\-image training split and labeled 10,000\-image validation split\. Five training images per class form a balanced 1,000\-image model\-selection set; the released validation images are reserved for testing\.

ForCCclasses and maximum countnmaxn\_\{\\max\}, the requested training counts are

ncLT\\displaystyle n\_\{c\}^\{\\mathrm\{LT\}\}=max\{1,⌊nmaxρ−\(c−1\)/\(C−1\)⌋\},\\displaystyle=\\max\\\!\\left\\\{1,\\left\\lfloor n\_\{\\max\}\\rho^\{\-\(c\-1\)/\(C\-1\)\}\\right\\rfloor\\right\\\},\(24\)ncstep\\displaystyle n\_\{c\}^\{\\mathrm\{step\}\}=\{nmax,c≤C/2,max⁡\{1,⌊nmax/ρ⌋\},c\>C/2,\\displaystyle=\\begin\{cases\}n\_\{\\max\},&c\\leq C/2,\\\\ \\max\\\!\\left\\\{1,\\left\\lfloor n\_\{\\max\}/\\rho\\right\\rfloor\\right\\\},&c\>C/2,\\end\{cases\}\(25\)with classes ordered from head to tail\. Here,ρ\\rhodenotes the nominal imbalance ratio supplied to the class\-count construction\. The achieved ratio may differ because class counts are integer\-valued and are lower\-bounded by one example per class\. The lower clamp therefore retains every class even whenρ\>nmax\\rho\>n\_\{\\max\}\. We evaluate both profiles atρ∈\{100,1000\}\\rho\\in\\\{100,1000\\\}, and[table2](https://arxiv.org/html/2609.16380#S6.T2)reports the resulting count extrema and achieved ratios\.

The primary test view is constructed from each official test split using the corresponding profile, value ofρ\\rho, and one\-example lower clamp, following[Cortes et al\. \(2025b\)](https://arxiv.org/html/2609.16380#bib.bib8)\. The available per\-class maxima are 1000 for CIFAR\-10, 100 for CIFAR\-100, and 50 for Tiny ImageNet\. The achieved test ratios atρ=100\\rho=100and10001000are therefore\(100,1000\)\(100,1000\),\(100,100\)\(100,100\), and\(50,50\)\(50,50\), respectively\. Metrics on the complete balanced official test split are retained as a secondary view\.

Table 2:Clean training\-set class counts and achieved imbalance after the balanced validation holdout\. The minimum count and achieved ratio are the same for the long\-tail and step profiles; their intermediate class counts differ\.
##### Training\-label corruption\.

Noise experiments use long\-tail training data withρ=100\\rho=100\. At corruption rateε∈\{0\.2,0\.4\}\\varepsilon\\in\\\{0\.2,0\.4\\\}, each training label is independently replaced with probabilityε\\varepsilon\. The replacement is sampled uniformly from theC−1C\-1incorrect classes\. Validation and test labels remain unchanged\. This protocol models unstructured annotation error\. It does not corrupt image features and does not model class\-dependent confusions\.

All prior\-based losses use counts of the observed training labels\. A pseudocountα=1\\alpha=1is added to every class count only when at least one observed class count is zero; this condition does not occur in any reported split\. Across the common corrupted\-label partitions, the achieved observed\-label ratios after 20% and 40% replacement are 13\.17 and 5\.65 for CIFAR\-10, 19\.65 and 8\.82 for CIFAR\-100, and 26\.25 and 9\.85 for Tiny ImageNet\. These ratios differ from the clean construction because random replacement redistributes labels toward low\-count classes\. Every applicable method uses the same observed counts and priors\.

##### Architecture and optimization\.

Every method uses ResNet\-32\([He et al\., 2016](https://arxiv.org/html/2609.16380#bib.bib25)\)withd=64d=64features and classifierW∈ℝC×64W\\in\\mathbb\{R\}^\{C\\times 64\}\. Training lasts 200 epochs with SGD, initial learning rate 0\.2, momentum 0\.9, Nesterov acceleration, weight decay10−310^\{\-3\}, and cosine annealing to zero\. Training and evaluation batch sizes are 1024\. CIFAR images receive random32×3232\\times 32crops after four\-pixel padding and random horizontal flips\. Tiny ImageNet uses random64×6464\\times 64crops after eight\-pixel padding and random horizontal flips\. Dataset\-specific channel normalization is applied\. Data ordering is deterministic, and every method is evaluated on identical training, validation, and test partitions\. For each run, the epoch with the lowest validation balanced error determines the model evaluated on the test set\.

##### Baselines and tuning\.

The comparison includes cross\-entropy \(CE\), inverse\-frequency weighted cross\-entropy \(WCE\), focal loss\([Lin et al\., 2017](https://arxiv.org/html/2609.16380#bib.bib3)\), class\-balanced loss \(CB\)\([Cui et al\., 2019](https://arxiv.org/html/2609.16380#bib.bib4)\), LDAM\([Cao et al\., 2019](https://arxiv.org/html/2609.16380#bib.bib5)\), logit adjustment \(LA\)\([Menon et al\., 2021](https://arxiv.org/html/2609.16380#bib.bib6)\), and generalized class\-aware loss \(GCA\)\([Cortes et al\., 2025b](https://arxiv.org/html/2609.16380#bib.bib8)\)\. To preserve a controlled loss\-level comparison, the benchmark is restricted to objectives that operate within the same single\-network training protocol; methods that require label refurbishment, multiple experts, or external semantic signals are outside this scope\. All objectives are evaluated from the sameCC\-dimensional classifier outputs and observed labels, and methods that depend on class statistics use the same class\-count vector\. The geometric terms ofBargeadditionally use thedd\-dimensional feature vector preceding the final classifier and the classifier weight matrix inℝC×d\\mathbb\{R\}^\{C\\times d\}, as defined in[equations11](https://arxiv.org/html/2609.16380#S4.E11)and[12](https://arxiv.org/html/2609.16380#S4.E12)\. GCA uses the true\-class scaling specified by[Cortes et al\. \(2025b\)](https://arxiv.org/html/2609.16380#bib.bib8), with a single global factor that normalizes its class weights to have unit expectation under the training distribution\.

Hyperparameters for every method are selected by validation balanced error\. Baseline selection is performed for each dataset–profile–ratio setting\. The validation grids are focalγ∈\{0,0\.1,…,1\.0,1\.5,2,…,10\}\\gamma\\in\\\{0,0\.1,\\ldots,1\.0,1\.5,2,\\ldots,10\\\}on clean data and\{0,1,2,5\}\\\{0,1,2,5\\\}with corruption; CBβ∈\{0\.1,…,0\.9,0\.99,0\.999,0\.9999\}\\beta\\in\\\{0\.1,\\ldots,0\.9,0\.99,0\.999,0\.9999\\\}on clean data and\{0\.9,0\.99,0\.999,0\.9999\}\\\{0\.9,0\.99,0\.999,0\.9999\\\}with corruption; LDAM margin scale in\(\{1,5\}×\{10k:k=−4,…,3\}\)∪\{104\}\(\\\{1,5\\\}\\times\\\{10^\{k\}:k=\-4,\\ldots,3\\\}\)\\cup\\\{10^\{4\}\\\}on clean data and\{0\.1,0\.5,1,5\}\\\{0\.1,0\.5,1,5\\\}with corruption; and GCAq∈\{0,0\.1,…,0\.9\}q\\in\\\{0,0\.1,\\ldots,0\.9\\\}on clean data and\{0,0\.1,0\.3,0\.5,0\.7,0\.9\}\\\{0,0\.1,0\.3,0\.5,0\.7,0\.9\\\}with corruption\. LA usesτ=1\\tau=1\.

The only validation\-selected coefficient inBargeisη\\eta, which is evaluated using the same selection criterion as the baseline hyperparameters\. It is selected from\{0\.03,0\.1,0\.3,0\.5,1\.0\}\\\{0\.03,0\.1,0\.3,\\allowbreak 0\.5,1\.0\\\}at dataset level using seeds\{1001,1002,1003\}\\\{1001,1002,\\allowbreak 1003\\\}\. The selected values are 1\.0 for CIFAR\-10, 0\.3 for CIFAR\-100, and 0\.1 for Tiny ImageNet\. The Tiny ImageNet corruption study independently evaluates the same grid across both corruption rates and also selects 0\.1\. Equation \([8](https://arxiv.org/html/2609.16380#S4.E8)\) fixesβC\\beta\_\{C\}analytically at 0\.4343, 0\.2171, and 0\.1887 for CIFAR\-10, CIFAR\-100, and Tiny ImageNet, respectively\. Final comparisons use three seeds,\{42,1126,2025\}\\\{42,1126,\\allowbreak 2025\\\}, for every method\. All objective calculations use 32\-bit floating\-point arithmetic, and the feature and classifier normalization denominators inBargeare lower\-bounded by10−810^\{\-8\}\.

##### Metrics and comparisons\.

The primary metric is mean balanced error \(MBE\),

MBE=100​\(1−1C​∑c=1CRecallc\),\\mathrm\{MBE\}=100\\left\(1\-\\frac\{1\}\{C\}\\sum\_\{c=1\}^\{C\}\\mathrm\{Recall\}\_\{c\}\\right\),\(26\)where lower is better\. The clean benchmark table reports total balanced error,

TBE=∑c=1C\(1−Recallc\)=C100​MBE,\\mathrm\{TBE\}=\\sum\_\{c=1\}^\{C\}\\bigl\(1\-\\mathrm\{Recall\}\_\{c\}\\bigr\)=\\frac\{C\}\{100\}\\mathrm\{MBE\},\(27\)which ranges from00toCC\. Secondary metrics are macro\-F1, one\-vs\-rest macro\-AUPRC, tail recall over the lowest\-frequency third of classes, worst\-class recall, negative log\-likelihood \(NLL\), multiclass Brier score\([Brier, 1950](https://arxiv.org/html/2609.16380#bib.bib43)\), and 15\-bin expected calibration error \(ECE\)\([Guo et al\., 2017](https://arxiv.org/html/2609.16380#bib.bib42)\)\. Dispersion is the standard deviation across the three seeds\. Tiny ImageNet paired comparisons use two\-sided Wilcoxon signed\-rank tests\([Wilcoxon, 1945](https://arxiv.org/html/2609.16380#bib.bib44)\)with Holm correction\([Holm, 1979](https://arxiv.org/html/2609.16380#bib.bib45)\)\. The clean comparison contains 12 matched setting–seed blocks; the noise comparison contains six\.

### 6\.2Clean imbalanced classification

[Table3](https://arxiv.org/html/2609.16380#S6.T3)gives a useful boundary on the claim\. LA is the strongest clean\-data baseline overall and wins seven of the 12 setting means\.Bargeranks second on aggregate, wins four settings, appears in the top two in eight, and in the top three in ten\. Its clearest clean gains occur in the CIFAR\-10 long\-tail settings: relative to LA, TBE falls from 2\.87 to 2\.69 atρ=100\\rho=100and from 5\.93 to 5\.38 atρ=1000\\rho=1000\. It also achieves the lowest step\-imbalance TBE atρ=1000\\rho=1000on CIFAR\-100 and Tiny ImageNet\. LA remains clearly better on several step\-imbalanced settings\. This pattern is informative\. Prior correction is already a strong solution when labels are clean; bounded influence and geometric regularization are helpful in selected regimes, but they do not erase the advantage of a simpler prior\-adjusted classifier everywhere\.

Tiny ImageNet provides a second view because each setting contains 200 classes\. Across its 12 paired setting–seed blocks,Bargehas the best average TBE rank, 2\.67, and the second\-lowest pooled mean TBE, 146\.44, behind LA at 145\.90\. It beats GCA and WCE in all 12 blocks, Focal in 10, LDAM in 9, CE in 8, CB in 7, and LA in 6\. After Holm correction, the paired Wilcoxon comparisons are significant only against GCA and WCE \(p=0\.0034p=0\.0034each\)\. On the complete balanced test view,Bargealso has the best average ranks for TBE \(2\.17\) and macro\-F1 \(2\.08\)\. Other methods lead macro\-AUPRC and tail recall, and every method has zero worst\-class recall in at least one severe setting\. Scaling to 200 classes therefore preserves the method’s balanced\-error consistency, but does not produce uniform dominance across all minority metrics\.

Table 3:Clean\-test total balanced error \(TBE; lower is better\) under long\-tail and step imbalance\. Each entry reports the mean±\\pmstandard deviation over three seeds\. Best values are shown in bold and second\-best values are underlined\.
### 6\.3Long\-tailed classification with label noise

As summarized in[table4](https://arxiv.org/html/2609.16380#S6.T4),Bargeachieves the lowest mean balanced error in every one of the six dataset–corruption settings, improving the six\-setting average from 72\.32% \(LA\) to 70\.00%\.

The largest margin is on CIFAR\-10 with 20% corruption, where MBE decreases by 5\.21 points relative to LA and by 9\.35 points relative to CB\. The margin narrows to 0\.25 points at 40% corruption on CIFAR\-10, consistent with the two methods converging as noise dominates the signal available to any prior\-based correction\. The CIFAR\-100 margins are 0\.45 points over LDAM at 20% corruption and 2\.01 points over CE at 40%\. On Tiny ImageNet,Bargeimproves over the strongest competing mean by 0\.51 points at 20% corruption and 1\.74 points at 40%\.Bargeranks first in all six settings; a paired Wilcoxon test confirms this ordering is not due to chance in the uncorrected comparisons \(p=0\.0313p=0\.0313per baseline\), though with only six matched blocks, Holm\-corrected significance is a high bar to clear\.

Table 4:Test mean balanced error \(MBE, %; lower is better\) under long\-tail imbalance withρ=100\\rho=100and random incorrect\-label replacement\. Each entry reports the mean±\\pmstandard deviation over three seeds\. The final column averages the six dataset–corruption setting means\.To show how performance changes as corruption increases,[figure2](https://arxiv.org/html/2609.16380#S6.F2)connects the clean and corrupted\-label results for CE, LA, GCA, andBarge\.

0020204040202040406060Mean balanced error \(%\)\(a\) CIFAR\-1000202040406060707080809090100100\(b\) CIFAR\-1000020204040707080809090100100\(c\) Tiny ImageNetTraining labels replaced \(%\)[2](https://arxiv.org/html/2609.16380#S6.F2)Figure 2:Test mean balanced error under long\-tail imbalance withρ=100\\rho=100as the proportion of randomly replaced training labels increases\. Each point reports the mean over three seeds, and lines connect the evaluated corruption levels\.[Figure2](https://arxiv.org/html/2609.16380#S6.F2)makes the clean\-to\-noisy transition visible\. On CIFAR\-10, the gap betweenBargeand CE grows from 5\.59 points on clean data to 10\.18 points at 20% corruption, then narrows at 40%\. On CIFAR\-100,Bargebegins 0\.27 points behind LA, overtakes it at 20%, and leads it by 2\.24 points at 40%\. Tiny ImageNet repeats the crossover:Bargestarts 1\.50 points behind LA, then leads by 2\.20 points at 20% corruption and 2\.82 points at 40%\. This clean\-to\-noisy crossover provides empirical evidence consistent with the bounded\-contamination and redescending\-influence properties; the accompanying theory characterizes influence under contamination rather than recovery of the clean balanced rule\.

### 6\.4Minority recognition and probability quality

MBE alone does not show whether an improvement is distributed across minority classes or concentrated in a few easy ones\.[Table5](https://arxiv.org/html/2609.16380#S6.T5)therefore reports macro and tail metrics for every corruption setting\.

The CIFAR\-10 gains are not confined to the average class\. At 20% corruption,Bargeraises macro\-F1 by 5\.81 points over LA, macro\-AUPRC by 5\.87 points, tail recall by 9\.86 points over WCE, and worst\-class recall by 15\.87 points\. At 40%, it remains first on all four metrics, although the macro\-F1 and macro\-AUPRC margins over GCA are 1\.56 and 0\.62 points\. The CIFAR\-100 view is harsher\.Bargestill leads macro\-F1, macro\-AUPRC, and tail recall at both corruption levels, but LA alone has nonzero worst\-class recall at 20%, and no method recovers every class at 40%\.

Tiny ImageNet separates average discrimination from extreme\-tail recovery\.Bargeleads macro\-F1 and macro\-AUPRC at both corruption levels, including margins of 1\.63 and 1\.56 points at 20%\. It does not lead tail recall: LA is best at 20%, WCE is best at 40%, andBargefalls from 1\.66% to 0\.06%\. Worst\-class recall is zero for every method\. The lower balanced error therefore comes mainly from broader gains outside the rarest classes, not from recovering every tail class\. This qualification is central to interpreting the 200\-class result\. The regression is consistent with[section5\.1](https://arxiv.org/html/2609.16380#S5.SS1): within\-class normalization offers no recovery guarantee when every observed label in a rare class is unreliable\.

Table 5:Discrimination and minority\-recognition metrics under label noise \(higher is better\)\. Values are percentages averaged over three seeds\. Tail recall averages the lowest\-frequency third of classes\. Best and unique second\-best entries in each column are bold and underlined\.The probability metrics in[table6](https://arxiv.org/html/2609.16380#S6.T6)expose a useful distinction\.

At 20% corruption,Bargeis best on NLL, Brier score, and ECE for CIFAR\-10, and on NLL and Brier score for CIFAR\-100\. At 40% corruption, LA and WCE are marginally better calibrated on CIFAR\-10, although the Brier difference between LA andBargeis only 0\.0004\. On CIFAR\-100, GCA has the lowest ECE, whileBargehas the lowest NLL and Brier score at both corruption levels\. These results motivate reporting calibration together with distributional and class\-balanced recognition metrics\.

Tiny ImageNet is more uniform:Bargehas the lowest NLL, Brier score, and ECE at both corruption levels\. At 40%, for example, its NLL is 4\.457 versus 4\.763 for LA, while ECE falls from 0\.0877 to 0\.0613\. These gains agree with the MBE and macro metrics, even though tail recall remains weak\. ECE is therefore interpreted beside NLL, Brier score, and class\-balanced recognition rather than as a standalone measure of quality\([Guo et al\., 2017](https://arxiv.org/html/2609.16380#bib.bib42);[Olmin and Lindsten, 2022](https://arxiv.org/html/2609.16380#bib.bib36)\)\.

Table 6:Probabilistic quality under label noise \(lower is better\)\. Values are means over three seeds\. NLL is negative log\-likelihood; ECE uses 15 equal\-width confidence bins\. Best and unique second\-best entries in each column are bold and underlined\.
### 6\.5Ablation Studies

The benchmark establishes between\-method performance, but it does not identify which part ofBargeis responsible for the observed gains\. We therefore hold the CIFAR\-100 long\-tail setting fixed atρ=100\\rho=100, retain the common data partitions and final seeds\{42,1126,2025\}\\\{42,1126,2025\\\}, and repeat the 20% and 40% random incorrect\-label replacement conditions\. The coefficientη=0\.3\\eta=0\.3is the dataset\-level value selected on disjoint tuning seeds and is held fixed for every geometry\-enabled variant\. No component\-specific coefficient is tuned\.[Table7](https://arxiv.org/html/2609.16380#S6.T7)reports the resulting component comparison\.

The bounded score alone improves over CE at both corruption levels, and[table7](https://arxiv.org/html/2609.16380#S6.T7)identifies a repeated contribution from compactness\. Relative to the bounded score, uniform compactness lowers MBE from 76\.08% to 74\.72% at 20% corruption and from 82\.40% to 81\.98% at 40%\. It also raises macro\-AUPRC from 21\.15% to 21\.97% and from 14\.20% to 14\.90%, respectively\. These directions hold in all six matched seed–corruption comparisons, demonstrating that compactness repeatedly improves both class\-balanced error and class\-balanced ranking metrics when added to the bounded score\.

Reliability weighting concentrates its strongest gains in calibration and ranking\. Against uniform compactness, it lowers mean ECE from 15\.63% to 13\.73% at 20% corruption and from 13\.94% to 12\.77% at 40%, while attaining the best macro\-AUPRC in the 20% block\. Separation produces the lowest MBE in both blocks\. The full objective gives the strongest macro\-F1 at 40% corruption and remains clearly better than CE; its MBE lies between the best isolated geometry variant and the bounded\-score baseline in both blocks\. The ablation therefore supports complementary component roles: compactness improves balanced error and ranking, reliability improves probability quality, and separation most directly sharpens balanced decisions\.

Table 7:Component ablation on CIFAR\-100 under long\-tail imbalance withρ=100\\rho=100and 20% or 40% random incorrect\-label replacement\. Values are percentages reported as mean±\\pmstandard deviation over three seeds\. All geometry\-enabled variants use the fixed dataset\-level coefficientη=0\.3\\eta=0\.3\. “Bounded” denotes the prior\-adjusted density\-power score, and “Reliab\.” denotes detached reliability weighting in the compactness term\. Best values within each corruption block are shown in bold\.
### 6\.6Hyperparameter sensitivity and computational cost

[Table8](https://arxiv.org/html/2609.16380#S6.T8)summarizes the dataset\-level validation used to select the geometric coefficient\.

Table 8:Dataset\-level selection of the geometric coefficientη\\eta\. Each candidate entry reports its average within\-setting validation rank across clean and noisy tuning conditions and seeds\{1001,1002,1003\}\\\{1001,1002,1003\\\}; lower is better\. The final column reports the value selected and fixed for all final evaluations on that dataset\.Candidate coefficientη\\eta\(average validation rank\)Datasetη=0\.03\\eta=0\.03η=0\.10\\eta=0\.10η=0\.30\\eta=0\.30η=0\.50\\eta=0\.50η=1\.00\\eta=1\.00Selectedη\\etaCIFAR\-104\.023\.212\.652\.712\.42\\mathbf\{2\.42\}1\.00CIFAR\-1003\.173\.002\.65\\mathbf\{2\.65\}2\.693\.500\.30Tiny ImageNet3\.062\.06\\mathbf\{2\.06\}3\.173\.283\.440\.10The response in[table8](https://arxiv.org/html/2609.16380#S6.T8)is not sharply peaked\. CIFAR\-100 differs by 0\.04 rank units betweenη=0\.30\\eta=0\.30and 0\.50, while CIFAR\-10 favors stronger geometry and Tiny ImageNet favors a smaller coefficient\. On Tiny ImageNet, the noisy conditions alone also selectη=0\.10\\eta=0\.10, with average rank 1\.83\. These differences support dataset\-level validation ofη\\eta, while the broad response indicates limited sensitivity within the tested grid\. The exponentβC\\beta\_\{C\}remains fixed throughout\. Measured training cost is reported in[table9](https://arxiv.org/html/2609.16380#S6.T9)\.

Table 9:Measured training cost on NVIDIA A100 GPUs\. Time is the mean wall\-clock duration of a 200\-epoch run, and peak memory is the allocated GPU memory\. The CIFAR\-10/100 measurements average 24 clean setting–seed runs per method, while the Tiny ImageNet measurements average 12\. All methods use the same inference procedure and introduce no loss\-specific inference overhead\.On CIFAR,Bargeadds 7\.1% training time relative to CE and no measurable peak\-memory increase at the reported precision\. On Tiny ImageNet it is slightly faster than CE in the measured runs and uses the same peak memory\. Runtime variation at this scale is influenced by data loading and shared\-server load, so the relevant conclusion is parity within a small margin, not a speed advantage\. The empirical cost agrees with the complexity analysis: the class Gram matrix is modest forC≤200C\\leq 200, and the method introduces no second network or sample\-pair matrix\.

## 7Discussion

##### What the clean results establish\.

The clean experiments show thatBargedoes not purchase its bounded response by abandoning the balanced target\. LA remains the strongest clean baseline, as expected from a direct prior correction\.Bargeis second overall and achieves the lowest error in four settings, including CIFAR\-10 long\-tail imbalance and step imbalance on both CIFAR\-100 and Tiny ImageNet atρ=1000\\rho=1000\. The method is therefore viable as a balanced classifier even before noise is introduced\. The settings where LA or CB wins also matter: additional geometry is not automatically beneficial when prior correction already matches the dominant source of error\.

##### Why the advantage is clearer under label noise\.

Under corruption, the proper score targets the observed\-label posterior and the observed prior, not their clean counterparts\. The advantage cannot therefore be attributed to the clean balanced\-consistency result\. It is better explained by how the objective limits the action of a questionable label\. The classification score cannot grow without bound, its risk perturbation is bounded at a fixed predictor, and its logit gradient vanishes under confident contradiction\. The feature term uses the same adjusted target probability to determine relative geometric influence within the observed class\. Subject to the within\-class support condition in[section5](https://arxiv.org/html/2609.16380#S5), a contradictory label is less able to dominate either the classifier update or the direction of its feature\. This mechanism is consistent with the widening advantage at 20% corruption, the macro\-F1 and macro\-AUPRC gains on all three datasets, and the tail\-recall gains on CIFAR\. Tiny ImageNet shows that it need not recover the rarest classes\. The controlled study in[section6\.5](https://arxiv.org/html/2609.16380#S6.SS5)supplies one direct empirical link: class\-equal angular compactness improves MBE and macro\-AUPRC in all six matched comparisons with the bounded\-score\-only loss\. Reliability weighting primarily improves probability quality, while separation is the strongest isolated contribution to MBE\.

##### Balanced error and calibration tell different stories\.

The best ECE does not always accompany the best balanced error or proper\-score metrics, as illustrated by the CIFAR\-100 results\. ECE summarizes agreement between confidence and correctness inside bins; it does not reward recovery of rare classes and can be small for uniformly cautious predictions\. NLL and Brier score preserve more information about the predictive distribution, while macro\-F1 and tail recall expose minority recognition\. The joint metric view is therefore essential\.Bargeis strongest where these views agree, particularly at 20% corruption, in the CIFAR\-100 NLL/Brier comparisons, and across all six Tiny ImageNet probability columns\. Its poor Tiny ImageNet tail recall prevents those probability gains from being mistaken for universal minority recovery\.

##### What bounded influence does not imply\.

The method is not claimed to solve arbitrary noisy\-label learning\. When the model is uncertain, an incorrect label still contributes\. When all examples in an observed class are unreliable, within\-class normalization cannot make their total class contribution vanish\. Corruption also changes𝝅^\\widehat\{\\bm\{\\pi\}\}; even the uniform replacement process used here makes the observed class distribution less imbalanced than the clean construction\. The theory establishes the clean balanced target and separate influence bounds under supplied\-label contamination\. It does not make the corrupted population minimizer equal to the clean one\. The experiments show that these influence properties are useful for random incorrect\-label replacement; they do not constitute a universal noise\-tolerance theorem\.

## 8Limitations

The evaluation uses three image benchmarks, one backbone, synthetic imbalance profiles, and one controlled label\-corruption process\. Tiny ImageNet extends the class count and resolution, but higher\-resolution data, naturally occurring annotation errors, biomedical cohorts, and multiple modern architectures are needed to establish external validity\. The separation term scales quadratically inCC\. It is inexpensive at 200 classes, but sampled or blockwise approximations may be needed for vocabularies with tens of thousands of classes\. Finally, the empirical prior is formed from observed labels\. Estimating a clean prior without losing the single\-stage character of the method remains an open direction for structured noise\.

## 9Conclusions

Class rebalancing should strengthen trustworthy minority evidence without granting unchecked influence to unreliable labels\.Bargerealizes this principle through a single\-stage objective that couples balanced prior correction, bounded proper prediction, and reliability\-guided angular geometry\. Under clean supervision and the true class prior, its adjusted score identifies the training posterior while the raw logits recover the balanced Bayes ordering\. Under label corruption, bounded risk perturbation and a redescending gradient limit the predictive influence of confidently contradicted labels\. The same adjusted probability controls label\-conditioned feature contraction, while class\-equal normalization and one\-sided separation organize the representation without altering inference\. The empirical results demonstrate the value of this coupling\. Across clean imbalanced settings,Bargeremains competitive with strong specialized baselines, ranks second overall, and obtains the best average rank on Tiny ImageNet\. Under 20% and 40% incorrect\-label replacement, it achieves the lowest mean balanced error in all six dataset–corruption settings, reducing the six\-setting average from 72\.32% for the strongest competing method to 70\.00%\. It also leads macro\-F1 and macro\-AUPRC across these settings\. Controlled ablations show that class\-equal angular compactness contributes beyond the bounded classification score, while reliability weighting and classifier separation provide complementary control over discrimination and probability quality\. The remaining tail\-recall limitation on Tiny ImageNet identifies an important boundary: within\-class normalization cannot recover a rare class when all available labels for that class are unreliable\.

Bargeis therefore most suitable when class frequencies are highly skewed, annotation quality is uncertain, and neither a reliable noise\-transition model nor a clean\-label correction procedure is available\. It requires one network, introduces no loss\-specific inference overhead, and adds only one validation\-selected coefficient\. More broadly, the results establish bounded predictive influence and reliability\-guided representation learning as complementary design principles for classification under simultaneous class imbalance and label uncertainty\.

#### Broader Impact Statement

Methods for imbalanced classification can improve recognition of underrepresented classes in domains where missed rare events are consequential\. The same setting requires care: synthetic imbalance and label corruption do not capture all deployment shifts, and aggregate benchmark improvements do not establish safety for any demographic or clinical subgroup\. Applications with consequential decisions should therefore pair class\-balanced evaluation with domain\-specific validation, subgroup analysis, calibration checks, and human oversight\.Bargechanges the training objective but does not replace these safeguards\.

## References

- Basuet al\.\(1998\)A\. Basu, I\. R\. Harris, N\. L\. Hjort, and M\. C\. JonesRobust and efficient estimation by minimising a density power divergence\.Biometrika85\(3\),pp\. 549–559\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px4.p1.1)\.
- Brier \(1950\)G\. W\. BrierVerification of forecasts expressed in terms of probability\.Monthly Weather Review78\(1\),pp\. 1–3\.Cited by:[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px5.p1.3)\.
- Budaet al\.\(2018\)M\. Buda, A\. Maki, and M\. A\. MazurowskiA systematic study of the class imbalance problem in convolutional neural networks\.Neural Networks106,pp\. 249–259\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p1.1)\.
- Caoet al\.\(2019\)K\. Cao, C\. Wei, A\. Gaidon, N\. Aréchiga, and T\. MaLearning imbalanced datasets with label\-distribution\-aware margin loss\.InAdvances in Neural Information Processing Systems,Vol\.32\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p2.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1),[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px4.p1.1)\.
- Chenet al\.\(2025\)M\. Chen, Y\. Du, W\. Jiang, B\. Zhang, S\. Feng, Y\. Xin, and C\. WangRobust logit adjustment for learning with long\-tailed noisy data\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.39,pp\. 15830–15838\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p3.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1)\.
- Corteset al\.\(2025a\)C\. Cortes, A\. Mao, M\. Mohri, and Y\. ZhongBalancing the scales: a theoretical and algorithmic framework for learning from imbalanced data\.InProceedings of the 42nd International Conference on Machine Learning,Proceedings of Machine Learning Research, Vol\.267,pp\. 11255–11287\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p2.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1)\.
- Corteset al\.\(2025b\)C\. Cortes, M\. Mohri, and Y\. ZhongImproved balanced classification with theoretically grounded loss functions\.InAdvances in Neural Information Processing Systems,Vol\.38\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p2.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1),[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px1.p3.1),[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px4.p1.1)\.
- Cuiet al\.\(2019\)Y\. Cui, M\. Jia, T\. Lin, Y\. Song, and S\. BelongieClass\-balanced loss based on effective number of samples\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,pp\. 9268–9277\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p2.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1),[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px4.p1.1)\.
- Denget al\.\(2019\)J\. Deng, J\. Guo, N\. Xue, and S\. ZafeiriouArcFace: additive angular margin loss for deep face recognition\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,pp\. 4690–4699\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px2.p1.1)\.
- Francaziet al\.\(2023\)E\. Francazi, M\. Baity\-Jesi, and A\. LucchiA theoretical analysis of the learning dynamics under class imbalance\.InProceedings of the 40th International Conference on Machine Learning,pp\. 10285–10322\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p1.1)\.
- Ghoshet al\.\(2017\)A\. Ghosh, H\. Kumar, and P\. S\. SastryRobust loss functions under label noise for deep neural networks\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.31,pp\. 1919–1925\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1)\.
- Gneiting and Raftery \(2007\)T\. Gneiting and A\. E\. RafteryStrictly proper scoring rules, prediction, and estimation\.Journal of the American Statistical Association102\(477\),pp\. 359–378\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px4.p1.1)\.
- Guoet al\.\(2017\)C\. Guo, G\. Pleiss, Y\. Sun, and K\. Q\. WeinbergerOn calibration of modern neural networks\.InProceedings of the 34th International Conference on Machine Learning,Vol\.70,pp\. 1321–1330\.Cited by:[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px5.p1.3),[§6\.4](https://arxiv.org/html/2609.16380#S6.SS4.p6.1)\.
- Hanet al\.\(2018\)B\. Han, Q\. Yao, X\. Yu, G\. Niu, M\. Xu, W\. Hu, I\. Tsang, and M\. SugiyamaCo\-teaching: robust training of deep neural networks with extremely noisy labels\.InAdvances in Neural Information Processing Systems,Vol\.31\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p3.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1)\.
- He and Garcia \(2009\)H\. He and E\. A\. GarciaLearning from imbalanced data\.IEEE Transactions on Knowledge and Data Engineering21\(9\),pp\. 1263–1284\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p1.1)\.
- Heet al\.\(2016\)K\. He, X\. Zhang, S\. Ren, and J\. SunDeep residual learning for image recognition\.InProceedings of the IEEE Conference on Computer Vision and Pattern Recognition,pp\. 770–778\.Cited by:[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px3.p1.1)\.
- Holm \(1979\)S\. HolmA simple sequentially rejective multiple test procedure\.Scandinavian Journal of Statistics6\(2\),pp\. 65–70\.Cited by:[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px5.p1.3)\.
- Kanget al\.\(2020\)B\. Kang, S\. Xie, M\. Rohrbach, Z\. Yan, A\. Gordo, J\. Feng, and Y\. KalantidisDecoupling representation and classifier for long\-tailed recognition\.InInternational Conference on Learning Representations,Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p2.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px2.p1.1)\.
- Khoslaet al\.\(2020\)P\. Khosla, P\. Teterwak, C\. Wang, A\. Sarna, Y\. Tian, P\. Isola, A\. Maschinot, C\. Liu, and D\. KrishnanSupervised contrastive learning\.InAdvances in Neural Information Processing Systems,Vol\.33,pp\. 18661–18673\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px2.p1.1)\.
- Krizhevsky \(2009\)A\. KrizhevskyLearning multiple layers of features from tiny images\.Technical reportUniversity of Toronto\.Cited by:[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px1.p1.1)\.
- Lanet al\.\(2025\)Y\. Lan, X\. Cai, J\. Cheng, and S\. TanMixture of balanced information bottlenecks for long\-tailed visual recognition\.Transactions on Machine Learning Research\.External Links:ISSN 2835\-8856Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px2.p1.1)\.
- Le and Yang \(2015\)Y\. Le and X\. YangTiny ImageNet visual recognition challenge\.Note:Stanford CS231NExternal Links:[Link](https://cs231n.stanford.edu/2015/)Cited by:[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px1.p1.1)\.
- Li and Zhang \(2025\)B\. Li and R\. ZhangMaking reliable and flexible decisions in long\-tailed classification\.Transactions on Machine Learning Research\.External Links:ISSN 2835\-8856Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p1.1)\.
- Liet al\.\(2026\)M\. Li, H\. Ling, L\. Chen, Y\. Lu, Y\. Zhang, and H\. HuangCARE: class\-adaptive expert consensus for reliable learning with long\-tailed noisy labels\.InProceedings of the 43rd International Conference on Machine Learning,Proceedings of Machine Learning Research, Vol\.306\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p3.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1)\.
- Liet al\.\(2025a\)Y\. Li, Z\. Li, and Y\. JiaBoosting class representation via semantically related instances for robust long\-tailed learning with noisy labels\.InProceedings of the IEEE/CVF International Conference on Computer Vision,pp\. 1516–1525\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p3.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1)\.
- Liet al\.\(2025b\)Z\. Li, H\. Zhao, J\. Ren, A\. Gao, D\. Guo, X\. Wan, and H\. ZhaSynthesizing minority samples for long\-tailed classification via distribution matching\.Transactions on Machine Learning Research\.External Links:ISSN 2835\-8856Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1)\.
- Linet al\.\(2017\)T\. Lin, P\. Goyal, R\. Girshick, K\. He, and P\. DollárFocal loss for dense object detection\.InProceedings of the IEEE International Conference on Computer Vision,pp\. 2980–2988\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1),[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px4.p1.1)\.
- Liuet al\.\(2017\)W\. Liu, Y\. Wen, Z\. Yu, M\. Li, B\. Raj, and L\. SongSphereFace: deep hypersphere embedding for face recognition\.InProceedings of the IEEE Conference on Computer Vision and Pattern Recognition,pp\. 212–220\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px2.p1.1)\.
- Liu and Guo \(2020\)Y\. Liu and H\. GuoPeer loss functions: learning from noisy labels without knowing noise rates\.InProceedings of the 37th International Conference on Machine Learning,Vol\.119,pp\. 6226–6236\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1)\.
- Luoet al\.\(2025\)J\. Luo, F\. Hong, Q\. Hu, X\. Cao, F\. Liu, and J\. YaoLong\-tailed recognition with model rebalancing\.InAdvances in Neural Information Processing Systems,Vol\.38\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p2.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1)\.
- Maet al\.\(2020\)X\. Ma, H\. Huang, Y\. Wang, S\. Romano, S\. Erfani, and J\. BaileyNormalized loss functions for deep learning with noisy labels\.InProceedings of the 37th International Conference on Machine Learning,Vol\.119,pp\. 6543–6553\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p3.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1)\.
- Menonet al\.\(2021\)A\. K\. Menon, S\. Jayasumana, A\. S\. Rawat, H\. Jain, A\. Veit, and S\. KumarLong\-tail learning via logit adjustment\.InInternational Conference on Learning Representations,Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p2.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1),[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px4.p1.1)\.
- Obuchi and Tanaka \(2025\)T\. Obuchi and T\. TanakaWhen resampling/reweighting improves feature learning in imbalanced classification? a toy\-model study\.Transactions on Machine Learning Research\.External Links:ISSN 2835\-8856Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1)\.
- Olmin and Lindsten \(2022\)A\. Olmin and F\. LindstenRobustness and reliability when training with noisy labels\.InProceedings of the 25th International Conference on Artificial Intelligence and Statistics,Vol\.151,pp\. 922–942\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1),[§6\.4](https://arxiv.org/html/2609.16380#S6.SS4.p6.1)\.
- Patriniet al\.\(2017\)G\. Patrini, A\. Rozza, A\. Krishna Menon, R\. Nock, and L\. QuMaking deep neural networks robust to label noise: a loss correction approach\.InProceedings of the IEEE Conference on Computer Vision and Pattern Recognition,pp\. 1944–1952\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p3.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1)\.
- Renet al\.\(2020\)J\. Ren, C\. Yu, X\. Ma, H\. Zhao, and S\. YiBalanced meta\-softmax for long\-tailed visual recognition\.InAdvances in Neural Information Processing Systems,Vol\.33,pp\. 4175–4186\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1)\.
- Renet al\.\(2018\)M\. Ren, W\. Zeng, B\. Yang, and R\. UrtasunLearning to reweight examples for robust deep learning\.InProceedings of the 35th International Conference on Machine Learning,Vol\.80,pp\. 4334–4343\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p2.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1)\.
- Sonet al\.\(2025\)M\. Son, I\. Koo, J\. Park, and C\. KimDifficulty\-aware balancing margin loss for long\-tailed recognition\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.39,pp\. 20522–20530\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p2.1)\.
- Tanet al\.\(2020\)J\. Tan, C\. Wang, B\. Li, Q\. Li, W\. Ouyang, C\. Yin, and J\. YanEqualization loss for long\-tailed object recognition\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,pp\. 11662–11671\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px1.p1.1)\.
- Wanget al\.\(2018\)H\. Wang, Y\. Wang, Z\. Zhou, X\. Ji, D\. Gong, J\. Zhou, Z\. Li, and W\. LiuCosFace: large margin cosine loss for deep face recognition\.InProceedings of the IEEE Conference on Computer Vision and Pattern Recognition,pp\. 5265–5274\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px2.p1.1)\.
- Wenet al\.\(2016\)Y\. Wen, K\. Zhang, Z\. Li, and Y\. QiaoA discriminative feature learning approach for deep face recognition\.InEuropean Conference on Computer Vision,pp\. 499–515\.Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px2.p1.1)\.
- Wilcoxon \(1945\)F\. WilcoxonIndividual comparisons by ranking methods\.Biometrics Bulletin1\(6\),pp\. 80–83\.Cited by:[§6\.1](https://arxiv.org/html/2609.16380#S6.SS1.SSS0.Px5.p1.3)\.
- Xuet al\.\(2025\)P\. Xu, L\. Yi, G\. Xu, X\. Chen, I\. McLeod, C\. Ling, and B\. WangUniform noise distribution and compact clusters: unveiling the success of self\-supervised learning in label noise\.Transactions on Machine Learning Research\.External Links:ISSN 2835\-8856Cited by:[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1)\.
- Zhang and Sabuncu \(2018\)Z\. Zhang and M\. R\. SabuncuGeneralized cross entropy loss for training deep neural networks with noisy labels\.InAdvances in Neural Information Processing Systems,Vol\.31\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p3.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px3.p1.1)\.
- Zhuet al\.\(2022\)J\. Zhu, Z\. Wang, J\. Chen, Y\. P\. Chen, and Y\. JiangBalanced contrastive learning for long\-tailed visual recognition\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,pp\. 6908–6917\.Cited by:[§1](https://arxiv.org/html/2609.16380#S1.p2.1),[§2](https://arxiv.org/html/2609.16380#S2.SS0.SSS0.Px2.p1.1)\.

Similar Articles

Balancing Multimodal Learning through Label Space Reshaping

arXiv cs.LG

Introduces Balanced Multimodal Label Reshaping (BMLR), a method that addresses modality imbalance in multimodal learning by reshaping the label space to equalize mapping difficulty across modalities, improving performance across various architectures.