arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1909.03582cs.CLcs.HC
收藏

点击诱饵?基于自动调整强化学习的耸人听闻的标题生成

Clickbait? Sensational Headline Generation with Auto-tuned Reinforcement Learning

Center for Artificial Intelligence Research (CAiRE)(人工智能研究中心(CAiRE));The Hong Kong University of Science and Technology(香港科技大学)

Peng Xu, Chien-Sheng Wu, Andrea Madotto, Pascale Fung

摘要:

耸人听闻的标题是标题,抓住人们的注意力,并产生读者的兴趣。传统的抽象标题生成方法,不像人类作家,不优化最大的读者注意力。在本文中,我们提出了一个模型,产生耸人听闻的标题没有标记的数据。我们首先训练一个耸人听闻的评分员,通过对从摘要模型生成的标题基线进行分类,对具有许多评论(“点击诱饵”)的在线标题进行分类。来自耸人听闻评分器的分数被用作对强化学习器的奖励。然而,最大化嘈杂的耸人听闻的奖励将产生不自然的短语,而不是耸人听闻的标题。为了有效地利用这种嘈杂的奖励,我们提出了一种新的损失函数,自动调整强化学习(ARL),动态平衡强化学习(RL)与最大似然估计(MLE)。人类评估表明,我们的模型生成的样本中有60.8%是耸人听闻的,这明显优于Pointer-Gen基线和其他RL模型。

英文摘要:

Sensational headlines are headlines that capture people's attention and generate reader interest. Conventional abstractive headline generation methods, unlike human writers, do not optimize for maximal reader attention. In this paper, we propose a model that generates sensational headlines without labeled data. We first train a sensationalism scorer by classifying online headlines with many comments ("clickbait") against a baseline of headlines generated from a summarization model. The score from the sensationalism scorer is used as the reward for a reinforcement learner. However, maximizing the noisy sensationalism reward will generate unnatural phrases instead of sensational headlines. To effectively leverage this noisy reward, we propose a novel loss function, Auto-tuned Reinforcement Learning (ARL), to dynamically balance reinforcement learning (RL) with maximum likelihood estimation (MLE). Human evaluation shows that 60.8% of samples generated by our model are sensational, which is significantly better than the Pointer-Gen baseline and other RL models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑