The use of machine-learning in neuroimaging offers new perspectives in early diagnosis and prognosis of brain diseases. Although such multivariate methods can capture complex relationships in the data, traditional approaches provide irregular (l2 penalty) or scattered (l1 penalty) predictive pattern with a very limited relevance. A penalty like Total Variation (TV) that exploits the natural 3D structure of the images can increase the spatial coherence of the weight map. However, TV penalization leads to non-smooth optimization problems that are hard to minimize. We propose an optimization framework that minimizes any combination of l1, l2, and TV penalties while preserving the exact l1 penalty. This algorithm uses Nesterov's smoothing technique to approximate the TV penalty with a smooth function such that the loss and the penalties are minimized with an exact accelerated proximal gradient algorithm. We propose an original continuation algorithm that uses successively smaller values of the smoothing parameter to reach a prescribed precision while achieving the best possible convergence rate. This algorithm can be used with other losses or penalties. The algorithm is applied on a classification problem on the ADNI dataset. We observe that the TV penalty does not necessarily improve the prediction but provides a major breakthrough in terms of support recovery of the predictive brain regions.
School of Statistics and Data Science, Qufu Normal University(统计与数据科学学院,曲阜师范大学);Dongfang College, ShanDong University of Finance and Economics(东方学院,山东财经大学)
Network-regularized Sparse Logistic Regression Models for Clinical Risk Prediction and Biomarker Discovery
State Key Laboratory of Software Engineering, School of Computer, Wuhan University(武汉大学计算机学院软件工程国家重点实验室);National Center for Mathematics and Interdisciplinary Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院国家数学与交叉科学中心)
Inequality Constrained Stochastic Nonlinear Optimization via Active-Set Sequential Quadratic Programming
Argonne National Laboratory(阿贡国家实验室);The University of Chicago(芝加哥大学);University of California, Berkeley(加州大学伯克利分校);International Computer Science Institute(国际计算机科学研究所)