评价和传播计算研究的发展方法
Evolving Methods for Evaluating and Disseminating Computing Research
摘要:
社会和技术趋势显著改变了评估和传播计算研究的方法。传统的审查和出版场所,如会议和期刊,在过去是有效的。最近的趋势创造了新的机会,但也给审查和传播进程带来了新的压力。例如,在许多会议上,提交的文件数量大幅增加。同样,通过arXiv.org和社交媒体网络等出版场所传播研究思想也变得引人注目。虽然这些趋势早在COVID-19之前就出现了,但这一流行病可能会加速长期变化。基于对计算研究领域领先学者的采访,我们的发现包括:(1)影响计算研究的趋势在很大程度上是积极的,增加了研究过程的参与度、范围、可访问性和速度。(2)在确保这一进程的完整性方面仍然存在挑战,包括如何扩大审查进程,避免试图误导或混淆结果的传播,以及确保这一进程本身的公平性和广泛参与。基于这些发现,我们建议:(1)定期调查计算研究社区的成员,包括计划和大会主席,期刊编辑,作者,审稿人等,确定他们面临的具体挑战,以更好地了解这些问题。(2)一个有影响力的机构,如计算研究协会定期发布“计算研究企业状态”报告,以更新社区对影响计算研究企业的积极和消极趋势。(3)进行了更深入的调查,特别是为了更好地了解社交媒体和预印本档案对计算研究的影响。
英文摘要:
Social and technical trends have significantly changed methods for evaluating and disseminating computing research. Traditional venues for reviewing and publishing, such as conferences and journals, worked effectively in the past. Recently, trends have created new opportunities but also put new pressures on the process of review and dissemination. For example, many conferences have seen large increases in the number of submissions. Likewise, dissemination of research ideas has become dramatically through publication venues such as arXiv.org and social media networks. While these trends predate COVID-19, the pandemic could accelerate longer term changes. Based on interviews with leading academics in computing research, our findings include: (1) Trends impacting computing research are largely positive and have increased the participation, scope, accessibility, and speed of the research process. (2) Challenges remain in securing the integrity of the process, including addressing ways to scale the review process, avoiding attempts to misinform or confuse the dissemination of results, and ensuring fairness and broad participation in the process itself. Based on these findings, we recommend: (1) Regularly polling members of the computing research community, including program and general conference chairs, journal editors, authors, reviewers, etc., to identify specific challenges they face to better understand these issues. (2) An influential body, such as the Computing Research Association regularly issues a "State of the Computing Research Enterprise" report to update the community on trends, both positive and negative, impacting the computing research enterprise. (3) A deeper investigation, specifically to better understand the influence that social media and preprint archives have on computing research, is conducted.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。