How artificial neural networks build their own learning machinery [R]

Reddit r/MachineLearning Papers

Summary

MIT报道PNAS新研究:随机连接的神经元单元通过共享可塑性规则可自我组装出学习结构,在模式识别和图像分类上达到与反向传播训练网络相近的性能,作者强调这是生物合理性探索而非反向传播的替代方案。

MIT coverage (13 October 2026): https://news.mit.edu/2026/how-artificial-neural-networks-build-their-own-learning-machinery-1013 Paper: “How Biological Synapses Self-Assemble Gradient Learning” (PNAS, 9 October): https://www.pnas.org/doi/10.1073/pnas.2606245123 According to the MIT report, randomly interconnected neuron-like units governed by shared plasticity rules can assemble learning motifs and learn pattern recognition and image classification. The reported comparison finds performance similar to the backpropagation-trained networks tested. The distinction is between designing a learning circuit directly and specifying local rules from which its learning machinery can organise itself. The stability of the motifs under different initial connectivity and extension beyond the demonstrated tasks are useful questions for evaluating the result alongside classification accuracy. The authors explicitly caution that self-organisation does not establish that the brain uses this mechanism. The motivation is biological plausibility, rather than evidence of a replacement for backpropagation in large-scale models.
Original Article

Similar Articles

How artificial neural networks build their own learning machinery

MIT News — Artificial Intelligence

MIT researchers published a PNAS paper showing that artificial neural networks can build their own learning machinery through simple local rules, reshaping randomly connected units into effective information-processing networks without a developer's guiding hand, offering new insights into how the brain learns.

Neural networks are more modular than single neurons suggest

arXiv cs.AI

该论文提出一个形式化的嵌套模块化层级(单元级、正交、线性),发现尽管单个神经元常常承担多种功能,神经网络在子空间层面仍表现出清晰的功能模块化,并在视觉、语言模型和多任务RNN中通过选择性消融得到验证,且这些子空间与脑数据有差异化对应。

Neural networks are clean

Hacker News Top

Goodfire 研究者发文论证,此前被广泛接受的神经元多义性与叠加假说是对 InceptionV1 证据的误读;经架构改进后的模型 99-100% 末层神经元已可解释,主张网络本身就是可读的构建块,无需先用稀疏自编码器解缠。

AI Memory Is Learning to Rewire Itself

Reddit r/openclaw

The article discusses a new approach in AI where memory systems can autonomously rewire themselves, potentially leading to more adaptive and efficient learning.