Skip to main content

Unsupervised learning by competing hidden units.

Author(s): Krotov, Dmitry; Hopfield, John J

Download
To refer to this page use: http://arks.princeton.edu/ark:/88435/pr1rr3w
Full metadata record
DC FieldValueLanguage
dc.contributor.authorKrotov, Dmitry-
dc.contributor.authorHopfield, John J-
dc.date.accessioned2020-02-25T20:10:56Z-
dc.date.available2020-02-25T20:10:56Z-
dc.date.issued2019-04en_US
dc.identifier.citationKrotov, Dmitry, Hopfield, John J. (2019). Unsupervised learning by competing hidden units.. Proceedings of the National Academy of Sciences of the United States of America, 116 (16), 7723 - 7731. doi:10.1073/pnas.1820458116en_US
dc.identifier.issn0027-8424-
dc.identifier.urihttp://arks.princeton.edu/ark:/88435/pr1rr3w-
dc.description.abstractIt is widely believed that end-to-end training with the backpropagation algorithm is essential for learning good feature detectors in early layers of artificial neural networks, so that these detectors are useful for the task performed by the higher layers of that neural network. At the same time, the traditional form of backpropagation is biologically implausible. In the present paper we propose an unusual learning rule, which has a degree of biological plausibility and which is motivated by Hebb's idea that change of the synapse strength should be local-i.e., should depend only on the activities of the pre- and postsynaptic neurons. We design a learning algorithm that utilizes global inhibition in the hidden layer and is capable of learning early feature detectors in a completely unsupervised way. These learned lower-layer feature detectors can be used to train higher-layer weights in a usual supervised way so that the performance of the full network is comparable to the performance of standard feedforward networks trained end-to-end with a backpropagation algorithm on simple tasks.en_US
dc.format.extent1 - 9en_US
dc.languageengen_US
dc.language.isoenen_US
dc.relation.ispartofProceedings of the National Academy of Sciences of the United States of Americaen_US
dc.rightsFinal published version. This is an open access article.en_US
dc.titleUnsupervised learning by competing hidden units.en_US
dc.typeJournal Articleen_US
dc.identifier.doidoi:10.1073/pnas.1820458116-
dc.date.eissued2019-03-29en_US
dc.identifier.eissn1091-6490-
pu.type.symplectichttp://www.symplectic.co.uk/publications/atom-terms/1.0/journal-articleen_US

Files in This Item:
File Description SizeFormat 
Unsupervised learning by competing hidden units.pdf1.37 MBAdobe PDFView/Download


Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.