Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Science
Ubiquitous Knowledge Processing Lab (UKP Lab)(普适知识处理实验室(UKP实验室));Hessian Center for AI (hessian.AI)(黑森人工智能中心);IBM Research Europe(IBM欧洲研究院);National Research Council Canada(加拿大国家研究委员会)
Aniket Pramanick, Yufang Hou, Saif M. Mohammad, Iryna Gurevych
Large Language Models (LLMs) have ushered in a transformative era in Natural Language Processing (NLP), reshaping research and extending NLP's influence to other fields of study. However, there is little to no work examining the degree to which LLMs influence other research fields. This work empirically and systematically examines the influence and use of LLMs in fields beyond NLP. We curate $106$ LLMs and analyze $\sim$$148k$ papers citing LLMs to quantify their influence and reveal trends in their usage patterns. Our analysis reveals not only the increasing prevalence of LLMs in non-CS fields but also the disparities in their usage, with some fields utilizing them more frequently than others since 2018, notably Linguistics and Engineering together accounting for $\sim$$45\%$ of LLM citations. Our findings further indicate that most of these fields predominantly employ task-agnostic LLMs, proficient in zero or few-shot learning without requiring further fine-tuning, to address their domain-specific problems. This study sheds light on the cross-disciplinary impact of NLP through LLMs, providing a better understanding of the opportunities and challenges.
Large Language Models Penetration in Scholarly Writing and Peer Review
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));University of Electronic Science and Technology of China(电子科技大学);Wuhan University of Technology(武汉理工大学);University of Copenhagen(哥本哈根大学);Shenzhen Research Institute of Big Data(深圳大数据研究院)
ChatGPT and a New Academic Reality: Artificial Intelligence-Written Research Papers and the Ethics of the Large Language Models in Scholarly Publishing
University of North Texas(北德克萨斯大学);Emporia State University(恩波利亚州立大学);Zhejiang Tongji Vocational College of Science and Technology(浙江同济科技职业学院);Babasaheb Bhimrao Ambedkar University(巴巴萨海布·比姆拉奥·安贝德卡尔大学);Baker University(贝克大学)
Falcon 7b for Software Mention Detection in Scholarly Documents
Fraunhofer Institute for Applied Information Technology(弗劳恩霍夫应用信息技术研究所);University of Koblenz(科布伦茨大学);School of Future Science and Engineering, Soochow University(苏州大学未来科学与工程学院);University Hospital of Cologne(科隆大学医院)
EduResearchBench: A Hierarchical Atomic Task Decomposition Benchmark for Full-Lifecycle Educational Research
Shanghai Institute of AI for Education, East China Normal University(上海人工智能教育研究院,东华大学);Shanghai Innovation Institute(上海创新研究院);School of Computer Science and Technology, East China Normal University(东华大学计算机科学与技术学院)
Large language models for automated scholarly paper review: A survey
School of Computer Science and Engineering, Guangzhou Institute of Science and Technology(计算机科学与工程学院,科学与技术研究院);School of Economics and Management, Guizhou Normal University(经济学与管理学院,贵州师范大学);School of Artificial Intelligence, Guangzhou Institute of Science and Technology(人工智能学院,科学与技术研究院)
Large Scale Subject Category Classification of Scholarly Papers with Deep Attentive Neural Networks
Pennsylvania State University(宾夕法尼亚州立大学);Old Dominion University(奥多明尼昂大学)
学术论文的主题类别通常是指论文所属的知识领域,例如计算机科学或物理学。利用学科分类信息可以构建数字图书馆搜索引擎的分面搜索。这可以极大地帮助用户缩小相关文档的搜索空间。不幸的是,许多学术论文的元数据中并没有这样的信息。解决这一问题的现有方法通常集中在无监督学习上,而无监督学习往往依赖于引文网络。然而,引用当前论文的完整列表可能不容易获得。特别是,引用很少或没有引用的新论文不能使用这种方法进行分类。在这里,我们提出了一个深度关注的神经网络(DANN),分类学术论文只使用他们的摘要。该网络使用来自Web of Science(WoS)的900万篇摘要进行训练。我们还使用了WoS模式,涵盖了104个主题类别。该网络由两个双向递归神经网络和一个注意层组成。我们通过改变架构和文本表示来将我们的模型与基线进行比较。我们最好的模型实现了0.76的微观F1测量值,单个主题类别的F1范围为0.50-0.95。结果表明,重新训练词嵌入模型的重要性,以最大限度地提高词汇重叠和注意力机制的有效性。词向量与TFIDF的组合优于字符和句子级别的嵌入模型。我们讨论了不平衡的样本和重叠的类别,并提出了可能的缓解策略。我们还通过对100万篇学术论文的随机样本进行分类来确定CiteSeerX中的主题类别分布。
Trans4E: Link Prediction on Scholarly Knowledge Graphs
University of Bonn(波恩大学);Institute for Applied Informatics (InfAI)(应用信息学研究所(InfAI));Fraunhofer IAIS(弗劳恩霍夫智能分析与信息系统研究所);The Open University(开放大学);University of Cagliari(卡利亚里大学)
Automated scholarly paper review: Concepts, technologies, and challenges
Xiamen University(厦门大学);Key Laboratory of Digital Protection and Intelligent Processing of Intangible Cultural Heritage of Fujian and Taiwan, Ministry of Culture and Tourism(文化和旅游部闽台非物质文化遗产数字化保护与智能处理重点实验室)