Video URL

https://pirsa.org/22020057

Learning Symbolic Equations with Deep Learning

Ho, S. (2022). Learning Symbolic Equations with Deep Learning. Perimeter Institute for Theoretical Physics. https://pirsa.org/22020057

Ho, Shirley. Learning Symbolic Equations with Deep Learning. Perimeter Institute for Theoretical Physics, Feb. 09, 2022, https://pirsa.org/22020057 

          @misc{ scivideos_PIRSA:22020057,
            doi = {10.48660/22020057},
            url = {https://pirsa.org/22020057},
            author = {Ho, Shirley},
            keywords = {Other Physics},
            language = {en},
            title = {Learning Symbolic Equations with Deep Learning},
            publisher = {Perimeter Institute for Theoretical Physics},
            year = {2022},
            month = {feb},
            note = {PIRSA:22020057 see, \url{https://scivideos.org/pirsa/22020057}}
          }

Shirley Ho Flatiron Institute

DOI 10.48660/22020057
Source Repository PIRSA
Collection
Talk Type Scientific Series
Subject

Abstract

We develop a general approach to "interpret" what a network has learned by introducing strong inductive biases. In particular, we focus on Graph Neural Networks. 

The technique works as follows: we first encourage sparse latent representations when we train a GNN in a supervised setting, then we apply symbolic regression to components of the learned model to extract explicit physical relations. The symbolic expressions extracted from the GNN using our technique also generalized to out-of-distribution data better than the GNN itself. Our approach offers alternative directions for interpreting neural networks and discovering novel physical principles from the representations they learn.

In particular, we will show examples of recovery of newton's law and masses of solar system bodies with real ephemeris data and recovery of navier-stokes equations with turbulence dataset.  We will speculate what one can do with this new tool.