Comparing Probability Distributions with Conditional Transport


Mingyuan Zhou

University of Texas at Austin
Fri, Apr 9 2021 - 10:00 am (GMT + 7)
About Speaker

Mingyuan Zhou is an Associate Professor of Statistics in the McCombs School of Business at the University of Texas at Austin. He received his Ph.D. in Electrical and Computer Engineering from Duke University in 2013. His research lies at the intersection of machine learning and Bayesian statistics, covering a diverse set of research topics in statistical theory and methods, probabilistic modeling, statistical inference for big data, and deep learning. He is currently focused on advancing both statistical inference with deep learning and deep learning with probabilistic methods. He has served as the 2018-2019 treasurer of the Bayesian Nonparametrics Section of the International Society for Bayesian Analysis, and as (senior) area chairs for leading machine learning conferences, including NeurIPS, ICML, ICLR, and AAAI.


To measure the difference between two probability distributions, we propose conditional transport (CT) as a new divergence and further introduce amortized CT (ACT) to make it amenable to implicit distributions and stochastic gradient descent based optimization. Equipped with two navigators that amortize the computation of conditional transport plans, ACT comes with unbiased sample gradients that are straightforward to compute. When applied to train a generative model, ACT is shown to strike a good balance between mode covering and seeking behaviors and strongly resist mode collapse. On a wide variety of benchmark datasets for generative modeling, substituting the default statistical distance of an existing generative adversarial network with the transport cost under ACT is shown to consistently improve the performance.

Related seminars

Trieu Trinh

Google Deepmind

AlphaGeometry: Solving IMO Geometry without Human Demonstrations
Fri, Jul 5 2024 - 10:00 am (GMT + 7)

Tat-Jun (TJ) Chin

Adelaide University

Quantum Computing in Computer Vision: A Case Study in Robust Geometric Optimisation
Fri, Jun 7 2024 - 11:00 am (GMT + 7)

Fernando De la Torre

Carnegie Mellon University

Human Sensing for AR/VR
Wed, Apr 24 2024 - 07:00 am (GMT + 7)

Anh Nguyen

Microsoft GenAI

The Revolution of Small Language Models
Fri, Mar 8 2024 - 02:30 pm (GMT + 7)