arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2309.05035cs.IRcs.SEcs.SI
收藏

软件社区中的重复问题检索与确认时间预测

Duplicate Question Retrieval and Confirmation Time Prediction in Software Communities

Rima Hazra, Debanjan Saha, Amruit Sahoo, Somnath Banerjee, Animesh Mukherjee

AI总结:

本文面向 askubuntu 社区问答,提出融合文本与网络特征的 Siamese 神经网络检索重复问题,并结合机器学习与图特征预测重复确认时间,性能优于基线。

摘要:

由于多种平台的可用性以及用户之间大量可共享的信息,不同领域的社区问答(Community Question Answering,CQA)正在大规模增长。随着此类在线平台的快速发展,海量归档数据使版主很难为新问题检索可能的重复项,也很难在恰当的时间识别并确认现有问题对为重复问题。在对应于 askubuntu 等大型软件系统的 CQA 中,这一问题甚至更为关键,因为版主需要成为专家才能理解某些内容是重复的。需要注意的是,此类 CQA 平台的主要挑战在于,版主本身就是专家,因此通常极其繁忙,他们的时间也异常宝贵。为了便利版主的工作,本文针对 askubuntu CQA 平台处理了两个重要问题:(1)在给定新问题的情况下检索重复问题;(2)重复问题确认时间预测。在第一项任务中,我们专注于针对某个特定的新发布问题,从问题池中检索重复问题。在第二项任务中,我们解决一个回归问题,以对那些可能需要很长时间才能被确认为重复的问题对进行排序。对于重复问题检索,我们提出了一种基于孪生神经网络(Siamese neural network)的方法,同时利用文本特征和基于网络的特征,该方法优于若干最先进的基线技术。我们的方法分别比 DupPredictor 和 DUPE 高出 5% 和 7%。对于重复确认时间预测,我们同时使用了标准机器学习模型和神经网络,以及文本特征和基于图的特征。对于文本特征和基于图的特征,我们分别获得了 0.20 和 0.213 的 Spearman 等级相关系数(具有统计显著性)。

英文摘要:

Community Question Answering (CQA) in different domains is growing at a large scale because of the availability of several platforms and huge shareable information among users. With the rapid growth of such online platforms, a massive amount of archived data makes it difficult for moderators to retrieve possible duplicates for a new question and identify and confirm existing question pairs as duplicates at the right time. This problem is even more critical in CQAs corresponding to large software systems like askubuntu where moderators need to be experts to comprehend something as a duplicate. Note that the prime challenge in such CQA platforms is that the moderators are themselves experts and are therefore usually extremely busy with their time being extraordinarily expensive. To facilitate the task of the moderators, in this work, we have tackled two significant issues for the askubuntu CQA platform: (1) retrieval of duplicate questions given a new question and (2) duplicate question confirmation time prediction. In the first task, we focus on retrieving duplicate questions from a question pool for a particular newly posted question. In the second task, we solve a regression problem to rank a pair of questions that could potentially take a long time to get confirmed as duplicates. For duplicate question retrieval, we propose a Siamese neural network based approach by exploiting both text and network-based features, which outperforms several state-of-the-art baseline techniques. Our method outperforms DupPredictor and DUPE by 5% and 7% respectively. For duplicate confirmation time prediction, we have used both the standard machine learning models and neural network along with the text and graph-based features. We obtain Spearman's rank correlation of 0.20 and 0.213 (statistically significant) for text and graph based features respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑