SenteCon:利用词典学习人类可解释的语言表示
SenteCon: Leveraging Lexicons to Learn Human-Interpretable Language Representations
AI总结:
本文提出 SenteCon,利用词典将文本编码为对应类别相关性的可解释表示层,在保持下游预测性能的同时,提升与人类文本刻画的一致性。
摘要:
尽管深度语言表示近年来已成为语言特征化的主导形式,但在许多场景中,理解模型的决策过程仍然很重要。这不仅需要可解释的模型,还需要可解释的特征。特别是,语言必须以一种既可解释、又仍能很好刻画原始文本的方式进行特征化。我们提出 SenteCon,这是一种在深度语言表示中引入人类可解释性的方法。给定一段文本,SenteCon 将文本编码为一层可解释类别,其中每个维度对应一个特定类别的相关性。我们的实证评估表明,使用 SenteCon 编码语言能够提供高层级可解释性,而对下游任务的预测性能几乎没有甚至完全没有代价。此外,我们发现,无论在下游性能方面,还是在与人类对文本的刻画相一致方面,SenteCon 都优于现有的可解释语言表示。
英文摘要:
Although deep language representations have become the dominant form of language featurization in recent years, in many settings it is important to understand a model's decision-making process. This necessitates not only an interpretable model but also interpretable features. In particular, language must be featurized in a way that is interpretable while still characterizing the original text well. We present SenteCon, a method for introducing human interpretability in deep language representations. Given a passage of text, SenteCon encodes the text as a layer of interpretable categories in which each dimension corresponds to the relevance of a specific category. Our empirical evaluations indicate that encoding language with SenteCon provides high-level interpretability at little to no cost to predictive performance on downstream tasks. Moreover, we find that SenteCon outperforms existing interpretable language representations with respect to both its downstream performance and its agreement with human characterizations of the text.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。