KADEL:面向提交信息生成的知识感知去噪学习
KADEL: Knowledge-Aware Denoising Learning for Commit Message Generation
AI总结:
本文提出知识感知去噪学习方法 KADEL,利用少量良好实践提交学习提交知识,并通过动态去噪训练为其余样本补充信息,在 MCMD 数据集上取得了最先进的提交信息生成性能。
摘要:
提交信息是对代码变更的自然语言描述,对于代码理解和维护等软件演化活动具有重要意义。然而,以往的方法在整个数据集上进行训练,未考虑到一部分提交信息遵循良好实践(即良好实践提交),而其余部分并非如此。基于我们的实证研究,我们发现仅在良好实践提交上进行训练能显著提升提交信息生成的效果。受此发现启发,我们提出了一种新颖的知识感知去噪学习方法,称为 KADEL。考虑到良好实践提交仅占数据集的一小部分,我们将剩余的训练样本与这些良好实践提交进行对齐。为实现这一目标,我们提出一个模型,通过在良好实践提交上训练来学习提交知识。该知识模型能够为不符合良好实践的训练样本补充更多信息。然而,由于补充信息可能包含噪声或预测错误,我们提出了一种动态去噪训练方法。该方法构建了一个分布感知置信度函数和一个动态分布列表,从而增强了训练过程的有效性。在完整的 MCMD 数据集上的实验结果表明,与以往方法相比,我们的方法整体上达到了最先进的性能。我们的源代码和数据可在 https://github.com/DeepSoftwareAnalytics/KADEL 获取。
英文摘要:
Commit messages are natural language descriptions of code changes, which are important for software evolution such as code understanding and maintenance. However, previous methods are trained on the entire dataset without considering the fact that a portion of commit messages adhere to good practice (i.e., good-practice commits), while the rest do not. On the basis of our empirical study, we discover that training on good-practice commits significantly contributes to the commit message generation. Motivated by this finding, we propose a novel knowledge-aware denoising learning method called KADEL. Considering that good-practice commits constitute only a small proportion of the dataset, we align the remaining training samples with these good-practice commits. To achieve this, we propose a model that learns the commit knowledge by training on good-practice commits. This knowledge model enables supplementing more information for training samples that do not conform to good practice. However, since the supplementary information may contain noise or prediction errors, we propose a dynamic denoising training method. This method composes a distribution-aware confidence function and a dynamic distribution list, which enhances the effectiveness of the training process. Experimental results on the whole MCMD dataset demonstrate that our method overall achieves state-of-the-art performance compared with previous methods. Our source code and data are available at https://github.com/DeepSoftwareAnalytics/KADEL
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。