Recently there is a rising interest in the research of mean-field optimization, in particular because of its role in analyzing the training of neural networks. In this talk, by adding the Fisher Information (in other word, the Schrodinger kinetic energy) as the regularizer, we relate the mean-field optimization problem with a so-called mean field Schrodinger (MFS) dynamics. We develop a free energy method to show that the marginal distributions of the MFS dynamics converge exponentially quickly towards the unique minimizer of the regularized optimization problem. We shall see that the MFS is a gradient flow on the probability measure space with respect to the relative entropy. Finally, we propose a Monte Carlo method to sample the marginal distributions of the MFS dynamics. This is an ongoing joint work with Julien Claisse, Giovanni Conforti and Songbo Wang.

3月16日
4:30pm - 5:30pm
地點
https://hkust.zoom.us/j/93244715329 (Passcode: 3485)
講者/表演者
Prof. Zhenjie Ren
Université Paris-Dauphine
主辦單位
Department of Mathematics
聯絡方法
付款詳情
對象
Alumni, Faculty and staff, PG students, UG students
語言
英語
其他活動
11月6日
研討會, 演講, 講座
IAS/ School of Science Joint Lecture - Drag on a Penetrable Disk in a Superfluid
Abstract The motion of a body through a superfluid can generate phenomena distinct from a normal viscous fluid. This includes the absence of drag below a critical body speed with the shedding o...
6月16日
研討會, 演講, 講座
IAS / School of Science Joint Lecture - Shaping Tumor Cell Plasticity and Therapy Resistance in Glioblastoma
Abstract Tumor heterogeneity fueled by plasticity and genetic diversification of cancer cells is key to therapy failure of malignant glioma. The speaker's team implemented spatial and genetic p...