划分与预测:一种用于输入空间划分和精度提升的架构
Divide and Predict: An Architecture for Input Space Partitioning and Enhanced Accuracy
AI总结:
本文提出了一种通过输入空间划分和方差分析提升模型精度的架构,通过量化数据异质性来优化训练过程。
摘要:
在本文中,作者开发了一种内在度量方法,用于量化监督学习中训练数据的异质性。该度量是随机变量的方差,通过成对训练点的影响因素来计算。方差被证明能够捕捉数据异质性,因此可以用来判断样本是否为多个分布的混合。作者证明了数据本身包含支持将其划分为块的关键信息。提供了几个概念验证研究,量化了方差与异质性在EMNIST图像数据和合成数据之间的联系。作者证明方差在分布等量混合时最大,并详细说明了基于方差的数据净化后,通过块进行传统训练可以显著提高测试精度。
英文摘要:
In this article the authors develop an intrinsic measure for quantifying heterogeneity in training data for supervised learning. This measure is the variance of a random variable which factors through the influences of pairs of training points. The variance is shown to capture data heterogeneity and can thus be used to assess if a sample is a mixture of distributions. The authors prove that the data itself contains key information that supports a partitioning into blocks. Several proof of concept studies are provided that quantify the connection between variance and heterogeneity for EMNIST image data and synthetic data. The authors establish that variance is maximal for equal mixes of distributions, and detail how variance-based data purification followed by conventional training over blocks can lead to significant increases in test accuracy.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。