使用 HED-IT 进行微调:人工译后编辑对对话语言模型的影响
Fine-tuning with HED-IT: The impact of human post-editing for dialogical language models
AI总结:
本文构建机器生成对话与人工译后编辑版本配对的 HED-IT 数据集,并微调三种规模语言模型,证明数据质量会影响输出感知,且小模型对质量更敏感。
摘要:
自动生成和收集语言数据的方法已被证明可有效用于微调资源少于英语的语言中的语言模型(LM)。然而,尽管人们一直强调数据数量,但对其质量的关注较少。在本研究中,我们调查了在微调对话模型时人工干预机器生成数据的影响。具体而言,我们研究:(1)与自动生成的原始对话相比,经过译后编辑的对话是否表现出更高的感知质量;(2)使用译后编辑对话进行微调是否会在生成输出中产生明显差异;以及(3)在考虑 LM 的参数规模时,译后编辑对话是否会影响结果。为此,我们创建了 HED-IT,这是一个大规模数据集,其中机器生成的对话与人工译后编辑版本配对。利用 HED-IT 中已编辑和未编辑的部分,我们微调了三种不同规模的 LM。人工评估和自动评估的结果均表明,训练数据的不同质量能够被清晰感知,并且也会影响基于这些数据训练的模型。此外,我们的研究结果表明,较大的模型对数据质量较不敏感,而数据质量对较小的模型具有关键影响。这些结果增进了我们对高质量 LM 开发过程中训练数据上人工干预影响的理解。
英文摘要:
Automatic methods for generating and gathering linguistic data have proven effective for fine-tuning Language Models (LMs) in languages less resourced than English. Still, while there has been emphasis on data quantity, less attention has been given to its quality. In this work, we investigate the impact of human intervention on machine-generated data when fine-tuning dialogical models. In particular, we study (1) whether post-edited dialogues exhibit higher perceived quality compared to the originals that were automatically generated; (2) whether fine-tuning with post-edited dialogues results in noticeable differences in the generated outputs; and (3) whether post-edited dialogues influence the outcomes when considering the parameter size of the LMs. To this end we created HED-IT, a large-scale dataset where machine-generated dialogues are paired with the version post-edited by humans. Using both the edited and unedited portions of HED-IT, we fine-tuned three different sizes of an LM. Results from both human and automatic evaluation show that the different quality of training data is clearly perceived and it has an impact also on the models trained on such data. Additionally, our findings indicate that larger models are less sensitive to data quality, whereas this has a crucial impact on smaller models. These results enhance our comprehension of the impact of human intervention on training data in the development of high-quality LMs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。