How to represent part-whole hierarchies in a neural net

APA

Hinton, G. (2021). How to represent part-whole hierarchies in a neural net. Perimeter Institute for Theoretical Physics. https://pirsa.org/21050001

MLA

Hinton, Geoffrey. How to represent part-whole hierarchies in a neural net. Perimeter Institute for Theoretical Physics, May. 05, 2021, https://pirsa.org/21050001

BibTex

          @misc{ scivideos_PIRSA:21050001,
            doi = {10.48660/21050001},
            url = {https://pirsa.org/21050001},
            author = {Hinton, Geoffrey},
            keywords = {Other Physics},
            language = {en},
            title = {How to represent part-whole hierarchies in a neural net},
            publisher = {Perimeter Institute for Theoretical Physics},
            year = {2021},
            month = {may},
            note = {PIRSA:21050001 see, \url{https://scivideos.org/index.php/pirsa/21050001}}
          }
          

Geoffrey Hinton University of Toronto

Source Repository PIRSA
Collection
Talk Type Scientific Series
Subject

Abstract

I will present a single idea about representation which allows several recent advances in neural networks  to be combined into an imaginary system called GLOM.  GLOM answers the question: How can a neural network with a fixed architecture parse an image into a part-whole hierarchy which has a different structure for each image? The idea is simply to use islands of identical vectors to represent the nodes in the parse tree. The talk will discuss the many ramifications of this idea.  If GLOM can be made to work, it should significantly improve the interpretability of the representations produced by neural nets when applied to vision or language.