VVTNS.png
https://www.wwtns.online - on twitter: wwtns@TheoreticalWide

You are cordially invited to  the lecture 

Lior Fox

Gatsby Computational Neuroscience Unit


 on the topic of 

 Unsupervised representation learning by amortised neural message-passing

The lecture will be held on zoom on March 4 ,2026, at 11:00 am ET     
 
Abstract: Useful internal representations should explain the patterns of regularities and dependencies among observations. Probabilistic graphical models promise a principled way to uncover latent factors as such, but they are hard to scale to  handle high-dimensional sensory observations and complicated  dependency structures. Neural-networks, on the other hand, excel at  approximating complicated high-dimensional functions, but their internal  representations do not easily lend themselves to a probabilistic interpretation.  Despite some successes, a general unified approach is still missing for integrating the two approaches. I will describe a novel approach towards merging adaptive neural-network components into a probabilistic framework, based on three core ideas. The first is to train a set of networks to collectively perform inference, leveraging the ability of pattern-recognition methods to amortise complicated transformations. The second is to constrain the way in which the outputs of these networks are interpreted, transformed, and combined together. These constraints, together with the learning objective itself, are derived directly from probabilistic considerations encoded in a graphical model. Finally, the third core idea is that of recognition-parameterization, allowing the inference ("recognition") procedure to directly define the model itself, without requiring an explicit "generative" decoder.


About VVTNS : Launched as the World Wide  Theoretical Neuroscience Seminar (WWTNS) in November 2020 and renamed in homage to Carl van Vreeswijk in Memoriam (April 20, 2022), Speakers have the occasion to talk about theoretical aspects of their work which cannot be discussed in a setting where the majority of the audience consists of experimentalists. The seminars, held on Wednesdays at 11 am ET,  are 45-50 min long followed by a discussion. The talks are recorded with authorization of the speaker and are available to everybody on our YouTube channel.