How artificial neural networks build their own learning machinery [R]
Summary
MIT报道PNAS新研究:随机连接的神经元单元通过共享可塑性规则可自我组装出学习结构,在模式识别和图像分类上达到与反向传播训练网络相近的性能,作者强调这是生物合理性探索而非反向传播的替代方案。
Similar Articles
How artificial neural networks build their own learning machinery
MIT researchers published a PNAS paper showing that artificial neural networks can build their own learning machinery through simple local rules, reshaping randomly connected units into effective information-processing networks without a developer's guiding hand, offering new insights into how the brain learns.
Neural networks are more modular than single neurons suggest
该论文提出一个形式化的嵌套模块化层级(单元级、正交、线性),发现尽管单个神经元常常承担多种功能,神经网络在子空间层面仍表现出清晰的功能模块化,并在视觉、语言模型和多任务RNN中通过选择性消融得到验证,且这些子空间与脑数据有差异化对应。
Neural networks are clean
Goodfire 研究者发文论证,此前被广泛接受的神经元多义性与叠加假说是对 InceptionV1 证据的误读;经架构改进后的模型 99-100% 末层神经元已可解释,主张网络本身就是可读的构建块,无需先用稀疏自编码器解缠。
[R] I built a cognitive architecture that learns like a brain — no backprop, no GPU, no forgetting
Introduces a novel cognitive architecture that learns without backpropagation, GPUs, or forgetting, mimicking biological learning.
AI Memory Is Learning to Rewire Itself
The article discusses a new approach in AI where memory systems can autonomously rewire themselves, potentially leading to more adaptive and efficient learning.