arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.02685stat.MEmath.STstat.TH
收藏

回归问题中无效应的检验:一种置换方法

Testing for no effect in regression problems: a permutation approach

Michał Ciszewski, Jakob Söhl, Ton Leenen, Bart van Trigt, Geurt Jongbloed

AI总结:

本文提出一种严格的置换检验方法,通过生成新配对避免样本分割,以评估回归模型预测是否优于拟合纯噪声,并引入新零假设进行理论证明。

摘要:

经常出现的问题是,能否使用特定模型基于 $X$ 预测 $Y$。特别是对于神经网络等高度灵活的模型,人们可能会问,看似良好的预测是否真的优于拟合纯噪声,或者是否必须归因于模型的灵活性。本文提出了一种严格的置换检验,以评估预测是否优于对纯噪声的预测。该检验避免了任何样本分割,而是基于生成 $(X_i,Y_j)$ 的新配对。它引入了零假设的新表述,并为检验提供了严格的证明,这使其有别于以往文献。理论发现被应用于模拟数据以及实验情境下网球发球的传感器数据。模拟研究强调了可用信息如何影响检验。结果表明,预测变量的信息量越少,拒绝拟合纯噪声零假设的概率就越低,并强调检测变量间较弱的依赖关系需要足够的样本量。

英文摘要:

Often the question arises whether $Y$ can be predicted based on $X$ using a certain model. Especially for highly flexible models such as neural networks one may ask whether a seemingly good prediction is actually better than fitting pure noise or whether it has to be attributed to the flexibility of the model. This paper proposes a rigorous permutation test to assess whether the prediction is better than the prediction of pure noise. The test avoids any sample splitting and is based instead on generating new pairings of $(X_i,Y_j)$. It introduces a new formulation of the null hypothesis and rigorous justification for the test, which distinguishes it from previous literature. The theoretical findings are applied both to simulated data and to sensor data of tennis serves in an experimental context. The simulation study underscores how the available information affects the test. It shows that the less informative the predictors, the lower the probability of rejecting the null hypothesis of fitting pure noise and emphasizes that detecting weaker dependence between variables requires a sufficient sample size.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑