The Wake-Sleep Algorithm for Unsupervised Neural Networks Export

@misc{wakesleep, abstract = {An unsupervised learning algorithm for a multilayer network of stochastic neurons is described. Bottom-up \&\#034;recognition\&\#034; connections convert the input into representations in successive hidden layers and top-down \&\#034;generative\&\#034; connections reconstruct the representation in one layer from the representation in the layer above. In the \&\#034;wake\&\#034; phase, neurons are driven by recognition connections, and generative connections are adapted to increase the probability that they would reconstruct the correct activity vector in the layer below. In the \&\#034;sleep\&\#034; phase, neurons are driven by generative connections and recognition connections are adapted to increase the probability that they would produce the correct activity vector in the layer above. Supervised learning algorithms for multilayer neural networks face two problems: They require a teacher to specify the desired output of the network and they require some method of communicating error information to all of the connections. The wake-sleep al...}, author = {Hinton, Geoffrey E. and Dayan, Peter and Frey, Brendan J. and Neal, Radford M.}, citeulike-article-id = {4711181}, citeulike-linkout-0 = {http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.51.215}, posted-at = {2009-06-01 21:09:14}, priority = {2}, title = {The Wake-Sleep Algorithm for Unsupervised Neural Networks}, url = {http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.51.215}, year = {1995} }

TY - ELEC ID - wakesleep L3 - citeulike-article-id:4711181 N2 - An unsupervised learning algorithm for a multilayer network of stochastic neurons is described. Bottom-up "recognition" connections convert the input into representations in successive hidden layers and top-down "generative" connections reconstruct the representation in one layer from the representation in the layer above. In the "wake" phase, neurons are driven by recognition connections, and generative connections are adapted to increase the probability that they would reconstruct the correct activity vector in the layer below. In the "sleep" phase, neurons are driven by generative connections and recognition connections are adapted to increase the probability that they would produce the correct activity vector in the layer above. Supervised learning algorithms for multilayer neural networks face two problems: They require a teacher to specify the desired output of the network and they require some method of communicating error information to all of the connections. The wake-sleep al... TI - The Wake-Sleep Algorithm for Unsupervised Neural Networks AU - Hinton, Geoffrey AU - Dayan, Peter AU - Frey, Brendan AU - Neal, Radford PY - 1995/// UR - http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.51.215 ER -