Non-convex optimization is widely involved in many machine learning problems, and it usually implicates a two-stage algorithm: a refined initialization followed by a local gradient search. Even though recent studies in global geometric analysis have revealed that empirical loss function of many low-rank related problems have favourable landscape in parameterized Euclidean space, it is generally difficult to analyze. In this talk, I will discuss a new unified framework for the analysis of low-rank matrix recovery problems. Instead of classical parameterization in Euclidean space, we considers emperical least square loss function on the manifold of low-rank matrices directly. We show that (1) if the measurement operator satisfies RIP condition with constantly small enough, there would be no spurious critical points, and manifold gradient descent would generate linear convergent sequence to global minimum (e.g. matrix sensing); (2) under weaker assumptions, but with RIP-like distance-preserving condition, global linear convergence rate to local minimum is still guaranteed (e.g. phase retrieval).
12 Jul 2019
10:00am - 11:00am
Where
Room 5506, Academic Building, (near Lifts 25-26)
Speakers/Performers
Ms. Zhenzhen LI
HKUST
HKUST
Organizer(S)
Department of Mathematics
Contact/Enquiries
mathseminar@ust.hk
Payment Details
Audience
Alumni, Faculty and Staff, PG Students, UG Students
Language(s)
English
Other Events
22 Nov 2024
Seminar, Lecture, Talk
IAS / School of Science Joint Lecture - Leveraging Protein Dynamics Memory with Machine Learning to Advance Drug Design: From Antibiotics to Targeted Protein Degradation
Abstract
Protein dynamics are fundamental to protein function and encode complex biomolecular mechanisms. Although Markov state models have made it possible to capture long-timescale protein co...
8 Nov 2024
Seminar, Lecture, Talk
IAS / School of Science Joint Lecture - Some Theorems in the Representation Theory of Classical Lie Groups
Abstract
After introducing some basic notions in the representation theory of classical Lie groups, the speaker will explain three results in this theory: the multiplicity one theorem for classical...