机器学习软件中的失真与故障
Distortion and Faults in Machine Learning Software
摘要:
机器学习软件,特别是深度神经网络(DNN)软件,可以从一个大的数据集中识别有价值的信息。这种DNN程序的结果取决于学习程序和数据集的质量。不幸的是,数据集的质量很难定义,因为它们只是样本。DNN软件的质量保证是困难的,因为得到的训练机器学习模型在其开发之前是未知的,并且根据预测性能间接进行验证。本文介绍了一个假设,在学习程序中的故障表现为训练机器学习模型的失真。用适当的观测器函数测量的相对畸变度可以指示存在一些隐藏的故障。该建议被证明与MNIST数据集的例子。
英文摘要:
Machine learning software, deep neural networks (DNN) software in particular, discerns valuable information from a large dataset, a set of data. Outcomes of such DNN programs are dependent on the quality of both learning programs and datasets. Unfortunately, the quality of datasets is difficult to be defined, because they are just samples. The quality assurance of DNN software is difficult, because resultant trained machine learning models are unknown prior to its development, and the validation is conducted indirectly in terms of prediction performance. This paper introduces a hypothesis that faults in the learning programs manifest themselves as distortions in trained machine learning models. Relative distortion degrees measured with appropriate observer functions may indicate that there are some hidden faults. The proposal is demonstrated with example cases of the MNIST dataset.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。