arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.02144cs.CL
收藏

多领域道德学习的数据融合框架

A Data Fusion Framework for Multi-Domain Morality Learning

Information Sciences Institute, University of Southern California(南加州大学信息科学研究所)

Siyi Guo, Negar Mokhberian, Kristina Lerman

AI总结:

提出一种数据融合框架,通过领域对抗训练和加权损失函数处理异构道德数据集,提升道德情感识别模型的性能与泛化能力。

摘要:

语言模型可以经过训练来识别文本的道德情感,这为研究道德在人类生活中的作用创造了新机会。随着对语言和道德的兴趣日益浓厚,已经发布了几个带有道德标注的基准数据集。然而,这些数据集在数据收集方法、领域、主题、标注者指令等方面各不相同。在训练期间简单地聚合这种异构数据集可能会导致模型无法很好地泛化。我们描述了一个用于在多个异构数据集上进行训练的数据融合框架,该框架提高了性能和泛化能力。该模型使用领域对抗训练来对齐特征空间中的数据集,并使用加权损失函数来处理标签偏移。我们表明,与道德推理领域的先前工作相比,所提出的框架在不同的数据集上实现了最先进的性能。

英文摘要:

Language models can be trained to recognize the moral sentiment of text, creating new opportunities to study the role of morality in human life. As interest in language and morality has grown, several ground truth datasets with moral annotations have been released. However, these datasets vary in the method of data collection, domain, topics, instructions for annotators, etc. Simply aggregating such heterogeneous datasets during training can yield models that fail to generalize well. We describe a data fusion framework for training on multiple heterogeneous datasets that improve performance and generalizability. The model uses domain adversarial training to align the datasets in feature space and a weighted loss function to deal with label shift. We show that the proposed framework achieves state-of-the-art performance in different datasets compared to prior works in morality inference.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑