arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.01774cs.CLcs.HCcs.LG
收藏

一个以用户为中心的、交互式的人在回路主题建模系统

A User-Centered, Interactive, Human-in-the-Loop Topic Modelling System

University of Warwick(华威大学);Bayes Business School, City, University of London(伦敦大学城市学院贝叶斯商学院);King’s College London(伦敦国王学院);The Alan Turing Institute(艾伦·图灵研究所)

Zheng Fang, Lama Alqazlan, Du Liu, Yulan He, Rob Procter

AI总结:

本文提出一个交互式的人在回路主题建模系统,支持跟踪比较模型步骤与主题词建议,并兼容传统与目标主题建模,通过用户研究验证了其价值。

摘要:

人在回路主题建模将用户的知识融入建模过程,使他们能够迭代地改进模型。最近的研究已经证明了用户反馈的价值,但仍然存在一些问题需要考虑,例如难以跟踪变化、比较不同模型以及缺乏基于真实世界使用示例的评估。我们开发了一个新颖的、交互式的人在回路主题建模系统,它具有一个用户友好的界面,使用户能够比较和记录他们采取的每一步,并且具有一个新颖的主题词建议功能,以帮助用户提供忠实于真实情况的反馈。我们的系统不仅支持传统主题模型所能做的事情,即从整个语料库中学习主题,还支持目标主题建模,即为语料库的特定方面学习主题。在本文中,我们概述了该系统,并展示了一系列用户研究的结果,这些研究旨在评估该系统在逐渐更真实的主题建模应用中的价值。

英文摘要:

Human-in-the-loop topic modelling incorporates users' knowledge into the modelling process, enabling them to refine the model iteratively. Recent research has demonstrated the value of user feedback, but there are still issues to consider, such as the difficulty in tracking changes, comparing different models and the lack of evaluation based on real-world examples of use. We developed a novel, interactive human-in-the-loop topic modeling system with a user-friendly interface that enables users compare and record every step they take, and a novel topic words suggestion feature to help users provide feedback that is faithful to the ground truth. Our system also supports not only what traditional topic models can do, i.e., learning the topics from the whole corpus, but also targeted topic modelling, i.e., learning topics for specific aspects of the corpus. In this article, we provide an overview of the system and present the results of a series of user studies designed to assess the value of the system in progressively more realistic applications of topic modelling.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑