arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.14919cs.CLcs.AI
收藏

你可以做得更好!如果你在做预测时详细说明原因

You Can Do Better! If You Elaborate the Reason When Making Prediction

Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Peng Cheng Laboratory(鹏城实验室)

Dongfang Li, Jingcong Tao, Qingcai Chen, Baotian Hu

摘要:

神经预测模型在各种自然语言处理任务中取得了显着的性能改进。然而,大多数神经预测模型的预测缺乏可解释性,限制了它们的实际效用。本文提出了一种神经预测方法,可以同时进行预测并产生相应的解释。它利用解释中包含的知识作为更有效学习的额外蒸馏信号。我们对中医多项选择问答、英语自然语言推理和常识性问答任务进行了初步研究。实验结果表明,该方法可以产生合理的解释,其预测,即使在小规模的训练语料。该方法还提高了三个数据集上的预测精度,这表明在决策过程中生成解释可以使预测受益。

英文摘要:

Neural predictive models have achieved remarkable performance improvements in various natural language processing tasks. However, most neural predictive models suffer from the lack of explainability of predictions, limiting their practical utility. This paper proposes a neural predictive approach to make a prediction and generate its corresponding explanation simultaneously. It leverages the knowledge entailed in explanations as an additional distillation signal for more efficient learning. We conduct a preliminary study on Chinese medical multiple-choice question answering, English natural language inference, and commonsense question answering tasks. The experimental results show that the proposed approach can generate reasonable explanations for its predictions even with a small-scale training corpus. The proposed method also achieves improved prediction accuracy on three datasets, which indicates that making predictions can benefit from generating the explanation in the decision process.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑