arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1407.5602stat.ML
收藏

用TV-弹性网惩罚和逻辑斯谛回归预测支持恢复:结构MRI的应用

Predictive support recovery with TV-Elastic Net penalty and logistic regression: an application to structural MRI

Mathieu Dubois, Fouad Hadj-Selem, Tommy Lofstedt, Matthieu Perrot, Clara Fischer, Vincent Frouin, Edouard Duchesnay

摘要:

机器学习在神经影像学中的应用为脑部疾病的早期诊断和预后提供了新的视角。虽然这样的多变量方法可以捕获数据中的复杂关系,但是传统方法提供了具有非常有限的相关性的不规则(l2罚分)或分散(l1罚分)的预测模式。像全变差(TV)这样的惩罚利用了图像的自然3D结构,可以增加权重图的空间一致性。然而,TV惩罚导致难以最小化的非平滑优化问题。我们提出了一个优化框架,最大限度地减少任何组合的l1,l2和TV的处罚,同时保留确切的l1处罚。该算法使用Nesterov的平滑技术来近似TV惩罚与平滑函数,使得损失和惩罚最小化与精确加速邻近梯度算法。我们提出了一个原始的连续算法,使用连续较小的值的平滑参数,以达到规定的精度,同时实现最佳的收敛速度。该算法可以用于其他损失或处罚。该算法被应用在ADNI数据集上的分类问题。我们观察到,TV惩罚并不一定改善预测,但在预测性脑区的支持恢复方面提供了重大突破。

英文摘要:

The use of machine-learning in neuroimaging offers new perspectives in early diagnosis and prognosis of brain diseases. Although such multivariate methods can capture complex relationships in the data, traditional approaches provide irregular (l2 penalty) or scattered (l1 penalty) predictive pattern with a very limited relevance. A penalty like Total Variation (TV) that exploits the natural 3D structure of the images can increase the spatial coherence of the weight map. However, TV penalization leads to non-smooth optimization problems that are hard to minimize. We propose an optimization framework that minimizes any combination of l1, l2, and TV penalties while preserving the exact l1 penalty. This algorithm uses Nesterov's smoothing technique to approximate the TV penalty with a smooth function such that the loss and the penalties are minimized with an exact accelerated proximal gradient algorithm. We propose an original continuation algorithm that uses successively smaller values of the smoothing parameter to reach a prescribed precision while achieving the best possible convergence rate. This algorithm can be used with other losses or penalties. The algorithm is applied on a classification problem on the ADNI dataset. We observe that the TV penalty does not necessarily improve the prediction but provides a major breakthrough in terms of support recovery of the predictive brain regions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑