arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.16623cs.DLcs.CY
收藏

ICLR 点数:每个领域中一篇论文相当于多少篇 ICLR 出版物?

ICLR Points: How Many ICLR Publications Is One Paper in Each Area?

Zhongtang Luo

AI总结:

提出 ICLR points 指标,用顶级机器学习会议论文的平均发表工作量校准不同 CS 子领域,并基于 DBLP 与 CSRankings 支持更公平的跨领域学术评价。

摘要:

科学出版物会显著影响计算机科学领域中与学术相关的决策,而顶级会议在其中尤其具有影响力。然而,不同子领域产出一篇出版物所需的工作量存在巨大差异。尽管现有基于引用的研究已经比较了各领域内部的会议,但由于出版物数量和引用实践不同,跨领域比较仍然具有挑战性。为弥补这一空白,我们提出 ICLR points 概念,其定义是在 ICLR、ICML 和 NeurIPS 等顶级机器学习会议上产出一篇出版物所需的平均工作量。利用来自 DBLP(2019—2023)的全面出版物数据以及来自 CSRankings 的教师信息,我们定量测量并比较了 27 个计算机科学子领域的平均发表工作量。分析揭示,平均发表工作量存在显著差异,并验证了坊间看法:总体而言,系统领域会议每篇出版物所需的工作量高于 AI 会议。我们还通过评估大学、现任教师和近期教师候选人的发表记录,展示了 ICLR points 指标的效用。研究结果强调,使用该指标如何使学术评价过程中的跨领域比较更有意义。最后,我们讨论了该指标的局限性,并告诫不要误用它,同时强调必须采用超越单纯出版物指标的整体性评价标准。

英文摘要:

Scientific publications significantly impact academic-related decisions in computer science, where top-tier conferences are particularly influential. However, efforts required to produce a publication differ drastically across various subfields. While existing citation-based studies compare venues within areas, cross-area comparisons remain challenging due to differing publication volumes and citation practices. To address this gap, we introduce the concept of ICLR points, defined as the average effort required to produce one publication at top-tier machine learning conferences such as ICLR, ICML, and NeurIPS. Leveraging comprehensive publication data from DBLP (2019--2023) and faculty information from CSRankings, we quantitatively measure and compare the average publication effort across 27 computer science sub-areas. Our analysis reveals significant differences in average publication effort, validating anecdotal perceptions: systems conferences generally require more effort per publication than AI conferences. We further demonstrate the utility of the ICLR points metric by evaluating publication records of universities, current faculties and recent faculty candidates. Our findings highlight how using this metric enables more meaningful cross-area comparisons in academic evaluation processes. Lastly, we discuss the metric's limitations and caution against its misuse, emphasizing the necessity of holistic assessment criteria beyond publication metrics alone.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑