We present an objective function for learning with unlabeled data that utilizes auxiliary expectation constraints. We optimize this objective function using a procedure that alternates between information and moment projections. Our method provides an alternate interpretation of the posterior regularization framework (Graca et al., 2008), maintains uncertainty during optimization unlike constraint-driven learning (Chang et al., 2007), and is more efficient than generalized expectation criteria (Mann & McCallum, 2008). Applications of this framework include minimally supervised learning, semisupervised learning, and learning with constraints that are more expressive than the underlying model. In experiments, we demonstrate comparable accuracy to generalized expectation criteria for minimally supervised learning, and use expressive structural constraints to guide semi-supervised learning, providing a 3%-6% improvement over stateof-the-art constraint-driven learning.
Deeply unrolled alternating projections for phase retrieval
University of Washington(华盛顿大学);NSF-Simons National Institute for Theory and Mathematics in Biology(NSF-Simons生物理论与数学国家研究所);Department of Computer Science, University of Chicago(芝加哥大学计算机科学系);Committee on Computational and Applied Mathematics, University of Chicago(芝加哥大学计算与应用数学委员会);Data Science Institute, University of Chicago(芝加哥大学数据科学研究所);NSF-Simons AI-Institute for the Sky (SkAI)(NSF-Simons天空人工智能研究所)
Derivative-free Alternating Projection Algorithms for General Nonconvex-Concave Minimax Problems
Shanghai University(上海大学);Newtouch Center for Mathematics of Shanghai University(上海大学新触数学中心);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院)
Accelerated Alternating Projections for Robust Principal Component Analysis
Department of Mathematics, University of California, Los Angeles(加州大学洛杉矶分校数学系);Department of Mathematics, Hong Kong University of Science and Technology(香港理工大学数学系);School of Data Science, Fudan University(复旦大学数据科学学院)
Accelerated Structured Alternating Projections for Robust Spectrally Sparse Signal Recovery
University of California, Los Angeles(加州大学洛杉矶分校);Hong Kong University of Science and Technology(香港科技大学);Southwestern University of Finance and Economics(西南财经大学);Shenzhen University(深圳大学)
Zeroth-Order primal-dual Alternating Projection Gradient Algorithms for Nonconvex Minimax Problems with Coupled linear Constraints
Department of Mathematics, College of Sciences, Shanghai University(上海大学数学系);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);Newtouch Center for Mathematics of Shanghai University(上海大学数学中心);State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院数学科学国家重点实验室);School of Mathematical Sciences, University of Chinese Academy of Sciences(中国科学院大学数学科学学院)