How the brains learn [R]
Summary
This paper proposes a framework for neocortical learning that meets criteria for computational, algorithmic, and implementational plausibility, using error-driven predictive learning via temporal derivatives and corticothalamic circuits. It suggests potential improvements over backpropagation.
Similar Articles
[R] I built a cognitive architecture that learns like a brain — no backprop, no GPU, no forgetting
Introduces a novel cognitive architecture that learns without backpropagation, GPUs, or forgetting, mimicking biological learning.
@InnocFrancesco: Interested in local learning algorithms? In work accepted at #ICML2026 , we show that predictive coding computes the sa…
This paper shows that predictive coding networks compute the same gradients as backpropagation in the limit of width much larger than depth, bridging biological learning and standard neural network training.
Hebbian architecture AI model [R]
A side project presents a Hebbian architecture AI model that avoids backpropagation and gradients, achieving 50 epochs on CIFAR-10 with emergent behaviors like accuracy dips followed by jumps and recovery after targeted damage.
Learning in Deep Networks under Dale's Constraint
This paper introduces a biologically motivated neural architecture that respects Dale's constraint—neurons and synapses have fixed sign—while still supporting backpropagation-like learning using non-negative error signals and local Hebbian updates, showing gains on Tiny ImageNet.
@yoheinakajima: https://x.com/yoheinakajima/status/2081741659260477666
This thread explores how the brain's dual memory systems (hippocampus and neocortex) offer lessons for building long-running AI agents, arguing that agents need a fast episodic capture and slow consolidation mechanism to avoid catastrophic interference, rather than relying solely on frozen models with temporary scaffolding.