arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.08543cs.SE
收藏

用户评论中的无监督主题发现

Unsupervised Topic Discovery in User Comments

Christoph Stanik, Tim Pietz, Walid Maalej

摘要:

在Twitter等社交媒体平台上,用户经常与软件供应商和服务提供商分享他们的意见和评论。流行的软件产品每天可能会收到数千条用户评论。研究表明,这些评论包含对利益相关者有价值的信息,例如功能想法、问题报告或支持查询。然而,很难手动管理和掌握大量的用户评论,这些评论可能是冗余的,并且质量不同。因此,研究人员提出了自动化方法来提取有价值的评论,例如,通过问题报告分类器。然而,这些方法并没有将语义相似的评论聚合到特定的方面,以提供诸如用户报告某个问题的频率之类的见解。本文提出了一种基于深度双向自然语言处理算法自动发现语义相似的用户评论主题的方法。利益相关者可以使用我们的方法,而不需要配置关键参数,如集群的数量。我们提出了我们的方法,并报告了一个严格的多步骤的实证评估,以评估如何凝聚力和有意义的集群。每个评估步骤都是对等编码的,编码器间的一致性高达98%,这让我们对这种方法有很高的信心。我们还报告了一个主题分析的主题,发现在电信领域的推文。

英文摘要:

On social media platforms like Twitter, users regularly share their opinions and comments with software vendors and service providers. Popular software products might get thousands of user comments per day. Research has shown that such comments contain valuable information for stakeholders, such as feature ideas, problem reports, or support inquiries. However, it is hard to manually manage and grasp a large amount of user comments, which can be redundant and of a different quality. Consequently, researchers suggested automated approaches to extract valuable comments, e.g., through problem report classifiers. However, these approaches do not aggregate semantically similar comments into specific aspects to provide insights like how often users reported a certain problem. We introduce an approach for automatically discovering topics composed of semantically similar user comments based on deep bidirectional natural language processing algorithms. Stakeholders can use our approach without the need to configure critical parameters like the number of clusters. We present our approach and report on a rigorous multiple-step empirical evaluation to assess how cohesive and meaningful the resulting clusters are. Each evaluation step was peer-coded and resulted in inter-coder agreements of up to 98%, giving us high confidence in the approach. We also report a thematic analysis on the topics discovered from tweets in the telecommunication domain.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑