arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.09658cs.CLcs.AIcs.LG
收藏

APRIL:结合主动偏好学习和强化学习的交互式总结学习

APRIL: Interactively Learning to Summarise by Combining Active Preference Learning and Reinforcement Learning

Ubiquitous Knowledge Processing Lab (UKP-TUDA)(泛在知识处理实验室(UKP-TUDA));Technische Universität Darmstadt(达姆施塔特工业大学)

Yang Gao, Christian M. Meyer, Iryna Gurevych

摘要:

我们提出了一种方法来执行自动文档摘要,而不使用参考摘要。相反,我们的方法交互式地从用户的偏好中学习。基于偏好的交互式摘要的优点在于,偏好比参考摘要更容易为用户提供。现有的基于偏好的交互式学习方法存在样本复杂度高的问题,即它们需要与预言机进行多轮交互才能收敛。在这项工作中,我们提出了一个新的目标函数,它使我们能够利用主动学习,偏好学习和强化学习技术,以减少样本的复杂性。模拟和真实用户实验表明,我们的方法显着推进的最先进的。我们的源代码是免费提供的https://github.com/UKPLab/emnlp2018-april。

英文摘要:

We propose a method to perform automatic document summarisation without using reference summaries. Instead, our method interactively learns from users' preferences. The merit of preference-based interactive summarisation is that preferences are easier for users to provide than reference summaries. Existing preference-based interactive learning methods suffer from high sample complexity, i.e. they need to interact with the oracle for many rounds in order to converge. In this work, we propose a new objective function, which enables us to leverage active learning, preference learning and reinforcement learning techniques in order to reduce the sample complexity. Both simulation and real-user experiments suggest that our method significantly advances the state of the art. Our source code is freely available at https://github.com/UKPLab/emnlp2018-april.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑