arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.01852cs.CL
收藏

ChatGPT相关研究综述与大型语言模型未来展望

Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models

School of Physics and Information Technology, Shaanxi Normal University(陕西师范大学物理与信息技术学院);School of Life and Technology Biomedical-Engineering, Xi’an Jiaotong University(西安交通大学生命与技术学院生物医学工程系);School of Computing, The University of Georgia(佐治亚大学计算机学院);Department of Computer Science and Engineering, The University of Texas at Arlington(德克萨斯大学阿灵顿分校计算机科学与工程系);Department of Radiology, Massachusetts General Hospital and Harvard Medical School(麻省总医院放射科与哈佛医学院);School of Biomedical Engineering, ShanghaiTech University(上海科技大学生物医学工程学院);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能有限公司);Shanghai Clinical Research and Trial Center(上海临床研究与试验中心)
Yiheng Liu, Tianle Han, Siyuan Ma, Jiayue Zhang, Yuanyuan Yang, Jiaming Tian, Hao He, Antong Li, Mengshen He, Zhengliang Liu, Zihao Wu, Lin Zhao, Dajiang Zhu, X… 展开作者

Yiheng Liu, Tianle Han, Siyuan Ma, Jiayue Zhang, Yuanyuan Yang, Jiaming Tian, Hao He, Antong Li, Mengshen He, Zhengliang Liu, Zihao Wu, Lin Zhao, Dajiang Zhu, Xiang Li, Ning Qiang, Dingang Shen, Tianming Liu, Bao Ge

AI总结:

本文通过分析194篇arXiv相关论文,全面综述ChatGPT相关研究的进展、应用分布与发展趋势,探讨其能力、影响与伦理问题,为大型语言模型未来研究提供方向。

摘要:

本文对ChatGPT相关(GPT-3.5与GPT-4)研究、GPT系列的前沿大型语言模型(LLM)及其在多领域的潜在应用展开全面综述。实际上,大规模预训练(可捕获整个万维网的知识)、指令微调以及人类反馈强化学习(RLHF)等关键创新,在提升LLM的适应性与性能方面发挥了重要作用。我们对arXiv上的194篇相关论文进行了深入分析,涵盖趋势分析、词云展示以及各应用领域的分布分析。研究结果显示,学界对ChatGPT相关研究的兴趣显著且持续增长,研究主要集中在直接自然语言处理应用,同时在教育、历史、数学、医学、物理等领域也展现出相当大的潜力。本研究旨在揭示ChatGPT的能力、潜在影响与伦理问题,并为该领域的未来发展方向提供指引。

英文摘要:

This paper presents a comprehensive survey of ChatGPT-related (GPT-3.5 and GPT-4) research, state-of-the-art large language models (LLM) from the GPT series, and their prospective applications across diverse domains. Indeed, key innovations such as large-scale pre-training that captures knowledge across the entire world wide web, instruction fine-tuning and Reinforcement Learning from Human Feedback (RLHF) have played significant roles in enhancing LLMs' adaptability and performance. We performed an in-depth analysis of 194 relevant papers on arXiv, encompassing trend analysis, word cloud representation, and distribution analysis across various application domains. The findings reveal a significant and increasing interest in ChatGPT-related research, predominantly centered on direct natural language processing applications, while also demonstrating considerable potential in areas ranging from education and history to mathematics, medicine, and physics. This study endeavors to furnish insights into ChatGPT's capabilities, potential implications, ethical concerns, and offer direction for future advancements in this field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑