arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.04946stat.MLcs.LG
收藏

稀疏模型中惩罚最小截尾平方性能的非渐近分析

Non-asymptotic analysis of the performance of the penalized least trimmed squares in sparse models

Michigan State University(密歇根州立大学)

Yijun Zuo

AI总结:

针对高维稀疏模型中样本量有限导致渐近分析不适用的问题,本文首次为基于LTS的估计与预测建立高概率有限样本误差界。

摘要:

最小截尾平方(LTS)估计量是经典最小二乘估计量的著名稳健替代方法,并广泛应用于位置、回归、机器学习和人工智能文献中。关于LTS已有许多研究,包括其稳健性、计算算法、向非线性情形的扩展、渐近性质等。LTS已被应用于高维真实数据稀疏模型设置下的惩罚回归,其中维度p(以千计)远大于样本量n(以几十或几百计)。在这种实际设置中,样本量n通常是在具有有限固定规模N的总体中,拥有某种特殊属性的子总体数量(例如阿尔茨海默病、帕金森病、白血病或ALS等疾病的患者数量)。在此类情形下,假设n趋于无穷大的渐近分析在实际中并不具有说服力和合理性。非渐近或有限样本分析将更为理想且可行。本文首次以高概率建立了基于LTS进行估计和预测的若干有限样本(非渐近)误差界。

英文摘要:

The least trimmed squares (LTS) estimator is a renowned robust alternative to the classic least squares estimator and is popular in location, regression, machine learning, and AI literature. Many studies exist on LTS, including its robustness, computation algorithms, extension to non-linear cases, asymptotics, etc. The LTS has been applied in the penalized regression in a high-dimensional real-data sparse-model setting where dimension $p$ (in thousands) is much larger than sample size $n$ (in tens, or hundreds). In such a practical setting, the sample size $n$ often is the count of sub-population that has a special attribute (e.g. the count of patients of Alzheimer's, Parkinson's, Leukemia, or ALS, etc.) among a population with a finite fixed size N. Asymptotic analysis assuming that $n$ tends to infinity is not practically convincing and legitimate in such a scenario. A non-asymptotic or finite sample analysis will be more desirable and feasible. This article establishes some finite sample (non-asymptotic) error bounds for estimating and predicting based on LTS with high probability for the first time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑