这个会议是顶级的吗?ConfAssist:一个用于会议分类的辅助冲突解决框架
Is this conference a top-tier? ConfAssist: An assistive conflict resolution framework for conference categorization
摘要:
将出版场所分为顶级或非顶级是相当主观的,有时可能会有争议。在本文中,我们提出了ConfAssist,一种新的辅助框架会议分类,旨在解决现有的系统和门户网站的场地分类的局限性。我们首先假设顶级会议比其他会议更稳定,这些团体的内在动态在很大程度上不同。我们确定了与会议稳定性相关的各种功能,这些功能可能有助于我们将顶级会议与其他会议区分开来。虽然在许多明显的情况下,专家几乎可以立即就会议是否是顶级会议达成一致意见,但同样也有许多情况下,甚至在专家之间也可能导致冲突。ConfAssist试图在这种情况下通过增加专家对他们的决定的信心来提供帮助。对来自计算机科学22个子领域的110个会议的分析显然支持我们的假设,因为顶级会议被发现比非顶级会议表现出更少的稳定性相关特征的波动。我们使用基于会议分类的系统来评估我们的假设。为了评估,我们与28位领域专家进行了人类判断调查。结果令人印象深刻,分类准确率为85.18%。我们还比较了新启动的会议与旧会议的动态,以确定受欢迎的初始信号。该系统适用于任何具有至少5年出版历史的会议。
英文摘要:
Classifying publication venues into top-tier or non top-tier is quite subjective and can be debatable at times. In this paper, we propose ConfAssist, a novel assisting framework for conference categorization that aims to address the limitations in the existing systems and portals for venue classification. We start with the hypothesis that top-tier conferences are much more stable than other conferences and the inherent dynamics of these groups differs to a very large extent. We identify various features related to the stability of conferences that might help us separate a top-tier conference from the rest of the lot. While there are many clear cases where expert agreement can be almost immediately achieved as to whether a conference is a top-tier or not, there are equally many cases that can result in a conflict even among the experts. ConfAssist tries to serve as an aid in such cases by increasing the confidence of the experts in their decision. An analysis of 110 conferences from 22 sub-fields of computer science clearly favors our hypothesis as the top-tier conferences are found to exhibit much less fluctuations in the stability related features than the non top-tier ones. We evaluate our hypothesis using systems based on conference categorization. For the evaluation, we conducted human judgment survey with 28 domain experts. The results are impressive with 85.18% classification accuracy. We also compare the dynamics of the newly started conferences with the older conferences to identify the initial signals of popularity. The system is applicable to any conference with atleast 5 years of publication history.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。