arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.02182cs.CL
收藏

研究社区之外的生殖研究:来自NLP初学者的经验

Reproducibility Beyond the Research Community: Experience from NLP Beginners

Shane Storks, Keunwoo Peter Yu, Joyce Chai

摘要:

随着NLP研究吸引了公众的注意力和兴奋,它变得越来越重要,它是为广大观众访问。随着研究界努力使NLP民主化,目前尚不清楚该领域的初学者是否可以轻松应用最新的发展。为了了解他们的需求,我们在NLP入门课程中对93名学生进行了一项研究,学生们复制了最近NLP论文的结果。令人惊讶的是,我们的结果表明,他们的技术技能(即,编程经验)对他们完成练习的努力影响有限。相反,我们发现研究作者的可访问性努力是成功体验的关键,包括完整的文档和轻松访问所需的模型和数据集。

英文摘要:

As NLP research attracts public attention and excitement, it becomes increasingly important for it to be accessible to a broad audience. As the research community works to democratize NLP, it remains unclear whether beginners to the field can easily apply the latest developments. To understand their needs, we conducted a study with 93 students in an introductory NLP course, where students reproduced results of recent NLP papers. Surprisingly, our results suggest that their technical skill (i.e., programming experience) has limited impact on their effort spent completing the exercise. Instead, we find accessibility efforts by research authors to be key to a successful experience, including thorough documentation and easy access to required models and datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑