关于机器学习中推广界的高概率与期望内保证的注记
A Note on High-Probability versus In-Expectation Guarantees of Generalization Bounds in Machine Learning
摘要:
统计机器学习理论经常试图给出机器学习模型的泛化保证。这些模型基于数据样本,自然存在一些波动。如果我们运气不好,收集的样本不能代表潜在的分布,就不能指望构建一个可靠的机器学习模型。在此之后,关于机器学习模型性能的陈述必须考虑采样过程。两种常见的方法是生成在随机抽样过程中以高概率或预期成立的语句。在这个简短的说明中,我们展示了如何将一个语句转换为另一个语句。作为一种技术创新,我们解决的情况下,无界损失函数,我们使用一个相当新的假设,称为证人条件。
英文摘要:
Statistical machine learning theory often tries to give generalization guarantees of machine learning models. Those models naturally underlie some fluctuation, as they are based on a data sample. If we were unlucky, and gathered a sample that is not representative of the underlying distribution, one cannot expect to construct a reliable machine learning model. Following that, statements made about the performance of machine learning models have to take the sampling process into account. The two common approaches for that are to generate statements that hold either in high-probability, or in-expectation, over the random sampling process. In this short note we show how one may transform one statement to another. As a technical novelty we address the case of unbounded loss function, where we use a fairly new assumption, called the witness condition.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。