Tag
This paper introduces a biologically motivated neural architecture that respects Dale's constraint—neurons and synapses have fixed sign—while still supporting backpropagation-like learning using non-negative error signals and local Hebbian updates, showing gains on Tiny ImageNet.
Introduces 'Diffusing Blame', a method for neural networks to learn competitively while strictly enforcing Dale's principle, using error diffusion and modulo error routing, achieving strong results on image classification and reinforcement learning without weight transport.
The author describes implementing a biologically plausible neural network training algorithm proposed by Geoffrey Hinton.
This paper investigates how correlated noise, inspired by neural variability in the brain, can enhance the robustness of artificial neural networks against adversarial attacks and naturalistic image modifications.
Introduces Score Broadcast and Decorrelation (SBD), a principled framework for broadcast-based credit assignment that generalizes to differentiable loss families including cross-entropy, Bregman divergences, and proper scoring rules. The work provides theoretical grounding for the three-factor learning rule and demonstrates improved performance over existing broadcast approaches on CIFAR-10 and Tiny ImageNet.