How the brains learn [R]

Reddit r/MachineLearning Papers

Summary

This paper proposes a framework for neocortical learning that meets criteria for computational, algorithmic, and implementational plausibility, using error-driven predictive learning via temporal derivatives and corticothalamic circuits. It suggests potential improvements over backpropagation.

Abstract: A sufficient account of how the neocortex learns must meet three criteria: 1. Computationally, it must approximate a powerful, general-purpose learning algorithm known to scale to human-level intelligence; 2. Algorithmically, it must be implementable using known, well-established neural circuits within the neocortex and associated brain structures; 3. Implementationally, there must be a detailed account for how all of the algorithmic mechanisms actually function at a neurochemical level. At present, there is only one framework that meets all of these criteria: error-driven predictive learning via temporal derivatives, driven by corticothalamic circuits, based on competitive kinase synaptic plasticity induction mechanisms. This has been implemented in the Axon neural simulation framework using spiking neurons, and demonstrated to learn across a wide range of challenging cognitively motivated tasks. [arxiv.org/abs/2606.08720](http://arxiv.org/abs/2606.08720) Something like this will lead to something better than back propagation and improve training times substantially.
Original Article

Similar Articles

Hebbian architecture AI model [R]

Reddit r/MachineLearning

A side project presents a Hebbian architecture AI model that avoids backpropagation and gradients, achieving 50 epochs on CIFAR-10 with emergent behaviors like accuracy dips followed by jumps and recovery after targeted damage.

Learning in Deep Networks under Dale's Constraint

arXiv cs.AI

This paper introduces a biologically motivated neural architecture that respects Dale's constraint—neurons and synapses have fixed sign—while still supporting backpropagation-like learning using non-negative error signals and local Hebbian updates, showing gains on Tiny ImageNet.

@yoheinakajima: https://x.com/yoheinakajima/status/2081741659260477666

X AI KOLs Following

This thread explores how the brain's dual memory systems (hippocampus and neocortex) offer lessons for building long-running AI agents, arguing that agents need a fast episodic capture and slow consolidation mechanism to avoid catastrophic interference, rather than relying solely on frozen models with temporary scaffolding.