CUE:一个用于基于预训练语言模型构建的文本分类器的不确定性解释框架
CUE: An Uncertainty Interpretation Framework for Text Classifiers Built on Pre-Trained Language Models
AI总结:
本文提出 CUE 框架,利用变分自编码器映射并扰动 PLM 表示的潜在空间,依据不确定性波动定位相关维度并追溯输入特征,在四个基准上验证了可行性。
摘要:
基于预训练语言模型(PLM)构建的文本分类器已在情感分析、自然语言推理和问答等多种任务中取得显著进展。然而,这些分类器会产生不确定预测,这在实际应用部署时对其可靠性构成挑战。已有大量工作致力于设计各种探针,以理解 PLM 捕获了什么;但鲜有研究深入探究影响基于 PLM 的分类器预测不确定性的因素。本文提出一个名为 CUE 的新颖框架,旨在解释基于 PLM 的模型预测中固有的不确定性。具体而言,我们首先通过变分自编码器将 PLM 编码的表示映射到一个潜在空间;随后通过扰动该潜在空间生成文本表示,这种扰动会引起预测不确定性的波动。通过比较扰动后与原始文本表示之间预测不确定性的差异,我们能够识别导致不确定性的潜在维度,并进一步追溯到造成该不确定性的输入特征。我们在涵盖语言可接受性分类、情感分类和自然语言推理的四个基准数据集上进行了大量实验,结果表明了所提框架的可行性。源代码可在 https://github.com/lijiazheng99/CUE 获取。
英文摘要:
Text classifiers built on Pre-trained Language Models (PLMs) have achieved remarkable progress in various tasks including sentiment analysis, natural language inference, and question-answering. However, the occurrence of uncertain predictions by these classifiers poses a challenge to their reliability when deployed in practical applications. Much effort has been devoted to designing various probes in order to understand what PLMs capture. But few studies have delved into factors influencing PLM-based classifiers' predictive uncertainty. In this paper, we propose a novel framework, called CUE, which aims to interpret uncertainties inherent in the predictions of PLM-based models. In particular, we first map PLM-encoded representations to a latent space via a variational auto-encoder. We then generate text representations by perturbing the latent space which causes fluctuation in predictive uncertainty. By comparing the difference in predictive uncertainty between the perturbed and the original text representations, we are able to identify the latent dimensions responsible for uncertainty and subsequently trace back to the input features that contribute to such uncertainty. Our extensive experiments on four benchmark datasets encompassing linguistic acceptability classification, emotion classification, and natural language inference show the feasibility of our proposed framework. Our source code is available at: https://github.com/lijiazheng99/CUE.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。