Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
School of Physics and Information Technology, Shaanxi Normal University(陕西师范大学物理与信息技术学院);School of Life and Technology Biomedical-Engineering, Xi’an Jiaotong University(西安交通大学生命与技术学院生物医学工程系);School of Computing, The University of Georgia(佐治亚大学计算机学院);Department of Computer Science and Engineering, The University of Texas at Arlington(德克萨斯大学阿灵顿分校计算机科学与工程系);Department of Radiology, Massachusetts General Hospital and Harvard Medical School(麻省总医院放射科与哈佛医学院);School of Biomedical Engineering, ShanghaiTech University(上海科技大学生物医学工程学院);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能有限公司);Shanghai Clinical Research and Trial Center(上海临床研究与试验中心)
This paper presents a comprehensive survey of ChatGPT-related (GPT-3.5 and GPT-4) research, state-of-the-art large language models (LLM) from the GPT series, and their prospective applications across diverse domains. Indeed, key innovations such as large-scale pre-training that captures knowledge across the entire world wide web, instruction fine-tuning and Reinforcement Learning from Human Feedback (RLHF) have played significant roles in enhancing LLMs' adaptability and performance. We performed an in-depth analysis of 194 relevant papers on arXiv, encompassing trend analysis, word cloud representation, and distribution analysis across various application domains. The findings reveal a significant and increasing interest in ChatGPT-related research, predominantly centered on direct natural language processing applications, while also demonstrating considerable potential in areas ranging from education and history to mathematics, medicine, and physics. This study endeavors to furnish insights into ChatGPT's capabilities, potential implications, ethical concerns, and offer direction for future advancements in this field.
On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspective
Microsoft Research(微软研究院);City University of Hong Kong(香港城市大学);Microsoft STCA(微软中国区软件工程技术中心);Carnegie Mellon University(卡内基梅隆大学);Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));Peking University(北京大学);Westlake University(西湖大学)
LIDS: LLM Summary Inference Under the Layered Lens
Department of Mathematics, University of Southern California(数学系,南加州大学);Data Sciences and Operations Department, Marshall School of Business, University of Southern California(数据科学与运营系,马歇尔商学院,南加州大学)
The Impact of ChatGPT and LLMs on Medical Imaging Stakeholders: Perspectives and Use Cases
Swiss Federal Institute of Technology Lausanne (EPFL)(洛桑联邦理工学院);Technical University of Munich(慕尼黑工业大学);University of Zurich(苏黎世大学);Boston College(波士顿学院)
The potential of large language models for improving probability learning: A study on ChatGPT3.5 and first-year computer engineering students
Rey Juan Carlos University(胡安·卡洛斯国王大学);European Commission, Joint Research Centre(欧盟委员会联合研究中心);CETINIA: Research Centre for Intelligent Information Technologies(CETINIA智能信息技术研究中心)
Exploring the Use of Large Language Models for Reference-Free Text Quality Evaluation: An Empirical Study
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Peng Cheng Laboratory(鹏城实验室);Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies(广东省新型安全智能技术重点实验室)
Information-Theoretic Distillation for Reference-less Summarization
Paul G. Allen School of Computer Science & Engineering, University of Washington(华盛顿大学保罗 G. 艾伦计算机科学与工程学院);Allen Institute for Artificial Intelligence(艾伦人工智能研究所)
An Empirical Exploration of ChatGPT's Ability to Support Problem Formulation Tasks for Mission Engineering and a Documentation of its Performance Variability
University of Southern California(南加州大学);Stevens Institute of Technology(史蒂文斯理工学院);Virginia Tech(弗吉尼亚理工大学)
本文通过 NASA 太空任务设计挑战实证评估 ChatGPT-3.5 在任务工程问题表述中识别利益相关者的能力,发现其对人本利益相关者识别较好但对环境因素识别差、抽象层次保持不足且并行输出变异性大,表明其可靠性有限。
Multi-Stage Pre-training Enhanced by ChatGPT for Multi-Scenario Multi-Domain Dialogue Summarization
Beihang University(北京航空航天大学);Institute of Automation, CAS(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Zhongke Fanyu Technology Co., Ltd(中科凡语科技有限公司)
Testing the Depth of ChatGPT's Comprehension via Cross-Modal Tasks Based on ASCII-Art: GPT3.5's Abilities in Regard to Recognizing and Generating ASCII-Art Are Not Totally Lacking
Beijing University of Posts and Telecommunications(北京邮电大学);Beijing Institute of Technology(北京理工大学);Xi’an Jiaotong University(西安交通大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
Multilingual Natural Language Processing Model for Radiology Reports -- The Summary is all you need!
ALGORITMI Research Centre/LASI, University of Minho(米尼奥大学 ALGORITMI 研究中心/LASI);Institute for Artificial Intelligence in Medicine, University Medicine Essen (AöR)(埃森大学医学院人工智能医学研究所);Department of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen (AöR)(埃森大学医学院诊断与介入放射学及神经放射学系);Institute for Computer Graphics and Vision, Graz University of Technology(格拉茨技术大学计算机图形与视觉研究所)