arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.04718cs.LG
收藏

利用变形关系作为知识载体训练深度神经网络

Use of Metamorphic Relations as Knowledge Carriers to Train Deep Neural Networks

Swinburne University of Technology(斯威本科技大学);Central Queensland University(中央昆士兰大学);Hefei University of Technology(合肥工业大学);Beihang University(北京航空航天大学)

Tsong Yueh Chen, Pak-Lok Poon, Kun Qiu, Zheng Zheng, Jinyi Zhou

摘要:

训练多层深度神经网络(DNN)是困难的。使用大量样本进行训练的标准做法通常不会将DNN的性能提高到令人满意的水平。因此,需要有系统的培训方法。为了满足这一需求,我们引入了一种创新的方法,使用变形关系(MR)作为“知识载体”训练DNN。基于变形测试和MR(在软件测试中扮演测试预言机的角色)的概念,我们利用输入的变形组的概念作为MR(知识的抽象)的具体实例,以系统和有效的方式训练DNN。为了验证我们的训练方法的可行性,我们进行了一个初步的实验,以比较两个DNN的性能:一个训练与MR和其他训练没有MR。我们发现,与MR训练的DNN提供了更好的性能,从而证实,我们的方法使用MR作为知识载体训练DNN是有前途的。然而,还需要更多的工作和研究来巩固和利用这种方法,对有效的DNN培训产生广泛的影响。

英文摘要:

Training multiple-layered deep neural networks (DNNs) is difficult. The standard practice of using a large number of samples for training often does not improve the performance of a DNN to a satisfactory level. Thus, a systematic training approach is needed. To address this need, we introduce an innovative approach of using metamorphic relations (MRs) as "knowledge carriers" to train DNNs. Based on the concept of metamorphic testing and MRs (which play the role of a test oracle in software testing), we make use of the notion of metamorphic group of inputs as concrete instances of MRs (which are abstractions of knowledge) to train a DNN in a systematic and effective manner. To verify the viability of our training approach, we have conducted a preliminary experiment to compare the performance of two DNNs: one trained with MRs and the other trained without MRs. We found that the DNN trained with MRs has delivered a better performance, thereby confirming that our approach of using MRs as knowledge carriers to train DNNs is promising. More work and studies, however, are needed to solidify and leverage this approach to generate widespread impact on effective DNN training.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑