揭示2022年ACL和EMNLP会议数据集中的趋势
Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferences
AI总结:
本研究分析2022年ACL和EMNLP会议引入的92个新数据集,揭示其趋势与见解,并为未来数据集策划提供建议。
摘要:
自然语言处理(NLP)自Transformer架构出现以来已显著发展。Transformer催生了预训练大语言模型(PLMs)。NLP系统在多项任务上的性能得到了巨大提升。在某些特定任务上,NLP系统的表现与人类相当,甚至在某些情况下优于人类。然而,一个常态仍然是:\n\n*在预训练时拥有更高质量的数据集,无论任务如何,都能使PLMs获得更好的性能。* 对高质量数据集的需求促使NLP研究人员不断创建新数据集以满足特定需求。例如,两个顶级NLP会议ACL和EMNLP在2022年共接收了九十二篇论文,这些论文引入了新数据集。本研究旨在揭示这些数据集中蕴含的趋势和见解。此外,我们为未来有兴趣策划数据集的研究人员提供了宝贵的建议。
英文摘要:
Natural language processing (NLP) has grown significantly since the advent of the Transformer architecture. Transformers have given birth to pre-trained large language models (PLMs). There has been tremendous improvement in the performance of NLP systems across several tasks. NLP systems are on par or, in some cases, better than humans at accomplishing specific tasks. However, it remains the norm that \emph{better quality datasets at the time of pretraining enable PLMs to achieve better performance, regardless of the task.} The need to have quality datasets has prompted NLP researchers to continue creating new datasets to satisfy particular needs. For example, the two top NLP conferences, ACL and EMNLP, accepted ninety-two papers in 2022, introducing new datasets. This work aims to uncover the trends and insights mined within these datasets. Moreover, we provide valuable suggestions to researchers interested in curating datasets in the future.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。