We study optimization methods for solving the maximum likelihood formulation of independent component analysis (ICA). We consider both the the problem constrained to white signals and the unconstrained problem. The Hessian of the objective function is costly to compute, which renders Newton's method impractical for large data sets. Many algorithms proposed in the literature can be rewritten as quasi-Newton methods, for which the Hessian approximation is cheap to compute. These algorithms are very fast on simulated data where the linear mixture assumption really holds. However, on real signals, we observe that their rate of convergence can be severely impaired. In this paper, we investigate the origins of this behavior, and show that the recently proposed Preconditioned ICA for Real Data (Picard) algorithm overcomes this issue on both constrained and unconstrained problems.
Modeling Shared Responses in Neuroimaging Studies through MultiView ICA
Inria(法国国家信息与自动化研究所);Université Paris-Saclay(巴黎萨克雷大学);MPI for Intelligent Systems(马克斯·普朗克智能系统研究所);MPI for Biological Cybernetics(马克斯·普朗克生物控制论研究所);University of Helsinki(赫尔辛基大学);Ecole Normale Supérieure(巴黎高等师范学院)
Disentangling Identifiable Features from Noisy Data with Structured Nonlinear ICA
University of Helsinki(赫尔辛基大学);Télécom SudParis(南巴黎电信学院);Institut Polytechnique de Paris(巴黎理工学院);Université Côte d’Azur(蔚蓝海岸大学);CNRS(法国国家科学研究中心);University of Cambridge(剑桥大学);Université Paris-Saclay(巴黎萨克雷大学)
Nonparametric Independent Component Analysis for the Sources with Mixed Spectra
The Research Foundation in Mental Hygen Inc.(精神卫生研究基金会公司);Columbia University(哥伦比亚大学);University of Hong Kong(香港大学);University of North Carolina at Chapel hill(北卡罗来纳大学教堂山分校)
Likelihood-Free Inference with Deep Gaussian Processes
Helsinki Institute for Information Technology(赫尔辛基信息技术研究所);Aalto University(阿尔托大学);University of Oslo(奥斯陆大学);University of Helsinki(赫尔辛基大学);University of Manchester(曼彻斯特大学)
Accelerating Posterior Inference from Pulsar Light Curves via Learned Latent Representations and Local Simulator-Guided Optimization
Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室);Florida State University(佛罗里达州立大学);New Mexico State University(新墨西哥州立大学);NASA Goddard Space Flight Center(美国宇航局戈达德太空飞行中心)
Estimation of Structural Causal Model via Sparsely Mixing Independent Component Analysis
The Graduate University for Advanced Studies (SOKENDAI)(综合研究大学院大学);The Institute of Statistical Mathematics(统计数理研究所);RIKEN Center for Advanced Intelligence Project (AIP)(日本理化学研究所先进智能研究中心)