Alternative learning mechanisms

tags

Machine learning

Many people, including Geoffrey Hinton, have raised concerns about the back-propagation algorithm and the fact that it’s likely not a promising way to achieve Artificial Intelligence (see this Axios blog post).

Alternative mechanisms for learning have been and are currently studied to try and approach the learning problem in a more effective way.

Direct feedback alignment

(Nøkland 2016)

Hebbian learning

The theory is sometimes summarized as “Cells that fire together wire together.”.

Predictive coding

(Whittington, Bogacz 2017; Millidge et al. 2020)

Bibliography

1. Arild Nøkland. December 21, 2016. http://arxiv.org/abs/1609.01596.
2. James C. R. Whittington, Rafal Bogacz. May 2017. Neural Computation 29 (5):1229–62. DOI.
3. Beren Millidge, Alexander Tschantz, Christopher L. Buckley. October 5, 2020. http://arxiv.org/abs/2006.04182.