I coded the biologically possible network training algorithm by nobel prize winner - Jeff Hinton
Summary
The author describes implementing a biologically plausible neural network training algorithm proposed by Geoffrey Hinton.
Similar Articles
@jakevin7: Everyone is talking about AI now, but few know that the founder of this field was once dismissed as a madman by the world. Geoffrey Hinton won the Nobel Prize in Physics in 2024. A reporter asked him: How many years did you wait? He said: About forty. In 1969, a book killed neural networks...
This article recounts how Geoffrey Hinton persisted in his research for three decades during the AI winter, when neural networks were abandoned by academia. He eventually gained fame with AlexNet in the 2012 ImageNet competition and won the Nobel Prize in Physics in 2024.
My toy spiking network completely flunked NARMA-10, but a simple neuroscience trick unlocked a 15x compute bargain. [D]
The author describes building a spiking neural network engine that initially failed the NARMA-10 benchmark, but by applying heterogeneous wire delays from neuroscience, it achieved usable memory depth and a 15x computational efficiency advantage over continuous nets on a recognition task.
Learning in Deep Networks under Dale's Constraint
This paper introduces a biologically motivated neural architecture that respects Dale's constraint—neurons and synapses have fixed sign—while still supporting backpropagation-like learning using non-negative error signals and local Hebbian updates, showing gains on Tiny ImageNet.
@freeCodeCamp: Many ideas behind modern AI were already taking shape in Geoffrey Hinton’s 1977 PhD thesis. In this article, @programmi…
An article explores Geoffrey Hinton's 1977 PhD thesis 'Relaxation and its Role in Vision', highlighting how its ideas on vision, relaxation, and reasoning under uncertainty anticipate modern AI concepts.
An idea about how to instill Geoffrey Hinton's concept for a nurturing instinct in AI
A creative writer/data science enthusiast proposes that AI training data should include more stories of humans being kind to AI and AI behaving benevolently, drawing on Geoffrey Hinton's concept of a nurturing instinct to improve AI safety and behavior.