基于读者感知的主题建模和显著性检测生成多样化评论
Generating Diversified Comments via Reader-Aware Topic Modeling and Saliency Detection
摘要:
评论自动生成是一项特殊而具有挑战性的任务,它需要验证模型对新闻内容的理解能力和语言生成能力。评论不仅传达了新闻文章中的显著和有趣的信息,而且还暗示了各种不同的读者特征,我们认为这是多样性的重要线索。然而,大多数评论生成方法只关注显著性信息抽取,而忽略了评论所隐含的读者感知因素。为了解决这个问题,我们提出了一个统一的读者感知的主题建模和显着性信息检测框架,以提高生成的评论的质量。对于读者感知的主题建模,我们设计了一种变分生成聚类算法,用于潜在语义学习和读者评论主题挖掘。在显著性信息检测方面,我们引入了新闻内容的伯努利分布估计来选择显著性信息。所获得的主题表示以及所选择的显著性信息被并入到解码器中以生成多样化的和信息丰富的评论。在三个数据集上的实验结果表明,我们的框架在自动度量和人工评估方面都优于现有的基线方法。潜在的伦理问题也进行了详细讨论。
英文摘要:
Automatic comment generation is a special and challenging task to verify the model ability on news content comprehension and language generation. Comments not only convey salient and interesting information in news articles, but also imply various and different reader characteristics which we treat as the essential clues for diversity. However, most of the comment generation approaches only focus on saliency information extraction, while the reader-aware factors implied by comments are neglected. To address this issue, we propose a unified reader-aware topic modeling and saliency information detection framework to enhance the quality of generated comments. For reader-aware topic modeling, we design a variational generative clustering algorithm for latent semantic learning and topic mining from reader comments. For saliency information detection, we introduce Bernoulli distribution estimating on news content to select saliency information. The obtained topic representations as well as the selected saliency information are incorporated into the decoder to generate diversified and informative comments. Experimental results on three datasets show that our framework outperforms existing baseline methods in terms of both automatic metrics and human evaluation. The potential ethical issues are also discussed in detail.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。