PROMISSING:修剪神经网络中的缺失值
PROMISSING: Pruning Missing Values in Neural Networks
摘要:
虽然数据是机器学习模型的主要燃料,但它们经常会出现缺失值,特别是在现实世界中收集数据时。然而,许多现成的机器学习模型,包括人工神经网络模型,无法直接处理这些缺失值。因此,在学习和预测过程之前,额外的数据预处理和管理步骤(例如数据填补)是不可避免的。在这项研究中,我们提出了一个简单,直观而有效的方法修剪缺失值(PROMISSING)在学习和推理步骤中的神经网络。在这种方法中,不需要删除或估算缺失值;相反,缺失值被视为新的信息源(代表我们不知道的内容)。我们对模拟数据、几个分类和回归基准以及多模式临床数据集的实验表明,与各种插补技术相比,PROMISSING的预测性能相似。此外,我们的实验表明,使用PROMISSING技术训练的模型在面对具有许多未知数的不完整样本时,在预测中变得不那么果断。这一发现有望将机器学习模型从纯粹的预测机器推进到更现实的思考者,当面对不完整的信息来源时,他们也可以说“我不知道”。
英文摘要:
While data are the primary fuel for machine learning models, they often suffer from missing values, especially when collected in real-world scenarios. However, many off-the-shelf machine learning models, including artificial neural network models, are unable to handle these missing values directly. Therefore, extra data preprocessing and curation steps, such as data imputation, are inevitable before learning and prediction processes. In this study, we propose a simple and intuitive yet effective method for pruning missing values (PROMISSING) during learning and inference steps in neural networks. In this method, there is no need to remove or impute the missing values; instead, the missing values are treated as a new source of information (representing what we do not know). Our experiments on simulated data, several classification and regression benchmarks, and a multi-modal clinical dataset show that PROMISSING results in similar prediction performance compared to various imputation techniques. In addition, our experiments show models trained using PROMISSING techniques are becoming less decisive in their predictions when facing incomplete samples with many unknowns. This finding hopefully advances machine learning models from being pure predicting machines to more realistic thinkers that can also say "I do not know" when facing incomplete sources of information.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。