arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.07586cs.CL
收藏

校准黑盒模型是否有用?

Can Explanations Be Useful for Calibrating Black Box Models?

The University of Texas at Austin(德克萨斯大学奥斯汀分校)

Xi Ye, Greg Durrett

摘要:

NLP从业者通常希望采用现有的训练模型,并将其应用于新领域的数据。虽然可以使用微调或少样本学习来适应基本模型,但没有单一的方法使这些技术工作;此外,如果将其部署为黑盒,则可能无法访问原始模型权重。我们研究了如何通过利用模型行为的解释来提高黑盒模型在新领域的性能。我们的方法首先提取一组特征,将人类对任务的直觉与黑盒解释技术生成的模型属性相结合,然后使用一个简单的校准器,以分类器的形式,来预测基础模型是否正确。我们实验我们的方法上的两个任务,提取问答和自然语言推理,覆盖适应从几对域有限的目标域数据。所有领域对的实验结果表明,解释对于校准这些模型是有用的,当预测不必在每个示例中返回时,可以提高准确性。我们进一步表明,校准模型在一定程度上转移任务之间。

英文摘要:

NLP practitioners often want to take existing trained models and apply them to data from new domains. While fine-tuning or few-shot learning can be used to adapt a base model, there is no single recipe for making these techniques work; moreover, one may not have access to the original model weights if it is deployed as a black box. We study how to improve a black box model's performance on a new domain by leveraging explanations of the model's behavior. Our approach first extracts a set of features combining human intuition about the task with model attributions generated by black box interpretation techniques, then uses a simple calibrator, in the form of a classifier, to predict whether the base model was correct or not. We experiment with our method on two tasks, extractive question answering and natural language inference, covering adaptation from several pairs of domains with limited target-domain data. The experimental results across all the domain pairs show that explanations are useful for calibrating these models, boosting accuracy when predictions do not have to be returned on every example. We further show that the calibration model transfers to some extent between tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑