arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2308.04889cs.CYcs.AIcs.CLcs.DLcs.LG
收藏

NLLG 季度 arXiv 报告 06/23:当前最具影响力的 AI 论文有哪些?

NLLG Quarterly arXiv Report 06/23: What are the most influential current AI Papers?

Natural Language Learning Group (NLLG)(自然语言学习组(NLLG))

Steffen Eger, Christoph Leiter, Jonas Belouadi, Ran Zhang, Aida Kostikova, Daniil Larionov, Yanran Chen, Vivian Fresen

AI总结:

该报告通过分析 2023 年上半年 arXiv 引用数据,识别出 40 篇最具影响力的 AI 论文,揭示了大语言模型与 ChatGPT 的主导地位、NLP 论文的高影响力以及 LLM 效率、评估、伦理等核心议题。

摘要:

生成式人工智能(AI)领域,尤其是自然语言处理(NLP)和机器学习(ML)子领域中的信息快速增长,给研究者和从业者跟上最新发展带来了重大挑战。为应对信息过载问题,比勒费尔德大学自然语言学习组(Natural Language Learning Group)撰写的本报告聚焦于识别 arXiv 上最受欢迎的论文,并特别强调 NLP 和 ML。其目标是提供一份关于最相关且被广泛讨论研究的快速指南,帮助新入行者和资深研究者及时了解当前趋势。具体而言,我们基于 2023 年上半年的标准化引用次数,编制了一份 40 篇最受欢迎论文的列表。我们观察到,在 2023 年上半年,与大语言模型(LLMs)特别是 ChatGPT 相关的论文占据主导地位,但后者在近期显示出受欢迎程度下降的迹象。此外,尽管我们的数据中 ML 相关论文数量是 NLP 相关论文的两倍,但 NLP 相关论文仍然最具影响力(约占顶级论文的 60%)。在被引用最多的论文中,研究的核心问题包括:LLM 效率、评估技术、伦理考量、具身智能体以及利用 LLM 进行问题求解。另外,我们还考察了顶级论文与 40 强名单之外其他论文相比的特征(注意到顶级论文更关注 LLM 相关问题且合著者数量更多),并分析了我们数据集中的引用分布等情况。

英文摘要:

The rapid growth of information in the field of Generative Artificial Intelligence (AI), particularly in the subfields of Natural Language Processing (NLP) and Machine Learning (ML), presents a significant challenge for researchers and practitioners to keep pace with the latest developments. To address the problem of information overload, this report by the Natural Language Learning Group at Bielefeld University focuses on identifying the most popular papers on arXiv, with a specific emphasis on NLP and ML. The objective is to offer a quick guide to the most relevant and widely discussed research, aiding both newcomers and established researchers in staying abreast of current trends. In particular, we compile a list of the 40 most popular papers based on normalized citation counts from the first half of 2023. We observe the dominance of papers related to Large Language Models (LLMs) and specifically ChatGPT during the first half of 2023, with the latter showing signs of declining popularity more recently, however. Further, NLP related papers are the most influential (around 60\% of top papers) even though there are twice as many ML related papers in our data. Core issues investigated in the most heavily cited papers are: LLM efficiency, evaluation techniques, ethical considerations, embodied agents, and problem-solving with LLMs. Additionally, we examine the characteristics of top papers in comparison to others outside the top-40 list (noticing the top paper's focus on LLM related issues and higher number of co-authors) and analyze the citation distributions in our dataset, among others.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑