Large Language Models (LLMs), exemplified by ChatGPT, have significantly reshaped text generation, particularly in the realm of writing assistance. While ethical considerations underscore the importance of transparently acknowledging LLM use, especially in scientific communication, genuine acknowledgment remains infrequent. A potential avenue to encourage accurate acknowledging of LLM-assisted writing involves employing automated detectors. Our evaluation of four cutting-edge LLM-generated text detectors reveals their suboptimal performance compared to a simple ad-hoc detector designed to identify abrupt writing style changes around the time of LLM proliferation. We contend that the development of specialized detectors exclusively dedicated to LLM-assisted writing detection is necessary. Such detectors could play a crucial role in fostering more authentic recognition of LLM involvement in scientific communication, addressing the current challenges in acknowledgment practices.
Smaller, Younger, and More Impactful: How AI-Assisted Writing Transforms Research Teams
School of Information, University of Texas at Austin(德克萨斯大学奥斯汀分校信息学院);National Science Library, Chinese Academy of Sciences(中国科学院国家科学图书馆);Department of Information Resources Management, School of Economics and Management, University of Chinese Academy of Sciences(中国科学院大学经济管理学院信息资源管理系);Department of Information Management, Peking University(北京大学信息管理系);Institute of Big Data, Fudan University(复旦大学大数据研究院);Institute for Global Public Policy, Fudan University(复旦大学全球公共政策研究院);Faculty of Finance, City University of Macau(澳门城市大学金融学院)
Controllable Narrative Rendering for Enhanced Assisted Writing
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);HiThink Research(海天瑞声)
CoAuthorAI: A Human in the Loop System For Scientific Book Writing
Kexin Technology, Beijing(凯欣科技,北京);Institute for Sustainable Industries and Liveable Cities, Victoria University(可持续产业与宜居城市研究所,维多利亚大学);School of Information Technology, Deakin University(信息科技学院,德坎大学)
Delving into LLM-assisted writing in biomedical publications through excess vocabulary
Hertie Institute for AI in Brain Health, University of Tübingen, Germany(人工智能与脑健康赫尔蒂研究所、图宾根大学,德国);Northwestern University, Evanston, Illinois, USA(西北大学,埃文斯顿,伊利诺伊州,美国)
LitCurate: A Configuration-Driven AI-Assisted Framework for Scientific Database Construction with an Application to Lower-Mantle Equation-of-State Data
Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams
Nanjing University of Science and Technology(南京理工大学);Baidu Inc(百度公司);AIML, Adelaide University(阿德莱德大学AIML);SUTD(新加坡科技设计大学);Southeast University(东南大学);East China Normal University(华东师范大学);University of Oxford(牛津大学)
Inclusivity in Large Language Models: Personality Traits and Gender Bias in Scientific Abstracts
Information Sciences Institute, University of Southern California(南加州大学信息科学学院);Iovine and Young Academy, University of Southern California(南加州大学约万与杨学院);In Vivo Group
Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation
University of Technology Nuremberg (UTN)(图恩大学(UTN));University of Tübingen, Tübingen AI Center(图宾根大学,图宾根人工智能中心);TIB Leibniz Information Centre for Science and Technology(莱比锡信息科学与技术研究中心);Austrian Research Institute for Artificial Intelligence(奥地利人工智能研究所);IT:U Interdisciplinary Transformation University Austria(奥地利 interdisciplinary transformation 大学);University of Hamburg(汉堡大学);University of Manchester(曼彻斯特大学);University of Sheffield(谢菲尔德大学);University of Aberdeen(阿伯丁大学);University of Manitoba(曼尼托巴大学)
ChatGPT as the Transportation Equity Information Source for Scientific Writing
Texas A&M Transportation Institute(德克萨斯A&M交通研究所);Texas State University(德克萨斯州立大学)
交通公平是一个跨学科的议程,需要交通和社会投入。传统上,交通公平信息来自公共图书馆、会议、电视、社交媒体等。包括ChatGPT等高级语言模型在内的人工智能(AI)工具正在成为最受欢迎的信息源。然而,其可信度尚未得到很好的探讨。本研究探讨了ChatGPT生成的与交通公平性相关的信息的内容和有用性。它利用了通过Web of Science(WoS)存储库检索的152篇论文。提示是为ChatGPT精心制作的,以提供给定论文标题的摘要。然后使用统计工具和无监督文本挖掘将基于ChatGPT的摘要与人类撰写的摘要进行比较。结果表明,ChatGPT和人类书面摘要之间的相似性较弱。平均而言,人类撰写的摘要和ChatGPT生成的摘要约有58%相似,最大和最小分别为97%和1.4%。相似度得分高于平均值的论文摘要中的关键词相似性更高,而低于平均值的论文摘要中的关键词相似性更低。具有高相似性分数的主题包括访问,公共交通和政策等。此外,观察到高和低相似性分数摘要的关键聚类模式存在明显差异。首先,从搭配的关键字的结果是不确定的。研究结果表明,ChatGPT有潜力成为交通公平信息的来源。然而,目前,在用户可以使用ChatGPT的材料之前,需要大量的注意力
MODOC: A Modular Interface for Flexible Interlinking of Text Retrieval and Text Generation Functions
Institute of Neuroinformatics, University of Zurich and ETH Zurich(苏黎世大学与苏黎世联邦理工学院神经信息学研究所);ETH Zurich(苏黎世联邦理工学院);Linguistic Research Infrastructure, University of Zurich(苏黎世大学语言研究基础设施)