机器学习研究已超越其沟通规范,NeurIPS应采取行动
Machine Learning Research Has Outpaced Its Communication Norms and NeurIPS Should Act
AI总结:
研究发现NeurIPS摘要可读性下降,缩写密度增加,且更易读的论文更受引用。文章提出七项标准以提升可读性与影响力。
摘要:
机器学习研究以指数级增长,但其沟通规范却没有相应提升。我们主张NeurIPS应采用明确、可衡量的写作标准。我们分析了280万篇arXiv论文(1991-2025)、24772篇NeurIPS论文(1987-2024)和2450万篇PubMed论文(1990-2025),应用经典可读性评分、Hohmann写作风格套件(包括煽动性语言)、缩写密度和重复率,以及LLM作为可读性评判协议,以及OpenAlex和Semantic Scholar的引用数据。四个模式显现。首先,NeurIPS摘要在每项经典可读性评分上都更难读:Flesch阅读易度从1987年的约24降至2024年的13,且NeurIPS摘要中的煽动性语言在2015至2024年间增加了约50%。其次,NeurIPS标题中的缩写密度从1987年的0.33个/100词增加到2024年的3.21,且约89%的NeurIPS缩写使用次数少于十次,比科学界的基准高出十点。第三,更易读的NeurIPS论文更受引用,表明可读性与影响力相关,且更难读的论文可能保持碎片化。LLM作为评判者评分显示NeurIPS摘要在1987至2022年间评分基本稳定,之后出现改善迹象,这一模式与所有经典可读性评分矛盾,提出了一个设计问题:目标读者是人类还是LLM?最后,NeurIPS的卷数从1987年到2024年增长了约50倍。假设目标是优化人类读者的体验,我们提出七项标准,NeurIPS可在2027年会议上试点:带有会议批准术语列表的缩写预算、人类可读性阈值、更严格的引用标准、独立的视觉元素、通俗语言摘要、预注册的缩写词典和开源审计工具。
英文摘要:
Machine learning research has grown exponentially while its communication norms have not. We argue NeurIPS should adopt explicit, measurable writing standards. We analyze 2.8 million arXiv papers (1991-2025), 24,772 NeurIPS papers (1987-2024), and 24.5 million PubMed papers (1990-2025), applying classical readability scores, the Hohmann writing style suite (including sensational language), acronym density and reuse, an LLM as judge readability protocol, and citations from OpenAlex and Semantic Scholar. Four patterns emerge. First, NeurIPS abstracts score harder to read on every classical readability metric: Flesch Reading Ease falls from about 24 in 1987 to 13 in 2024, and sensational language rises by about 50 percent in NeurIPS abstracts between 2015 and 2024. Second, acronym density in NeurIPS titles has grown from 0.33 per 100 words in 1987 to 3.21 in 2024, and about 89 percent of NeurIPS acronyms are used fewer than ten times, ten points above the science-wide baseline. Third, more readable NeurIPS papers tend to receive more citations, suggesting readability and impact are correlated and that less readable papers risk remaining fragmented. LLM as judge scores rate NeurIPS abstracts as roughly stable from 1987 to 2022, with early signs of improvement thereafter, a pattern that disagrees with every classical readability metric and raises a design question for enforcement: is the target reader a human or an LLM? Lastly, NeurIPS volume has grown roughly 50-fold between 1987 and 2024. Assuming the goal is to optimise for human readers, we propose seven standards NeurIPS could pilot at NeurIPS 2027: an acronym budget with a venue-approved term list, a human readability threshold, stricter citation standards, standalone visual elements, a plain language summary, a pre-registered acronym glossary, and open source audit tooling.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。