本文通过分析微软、谷歌等将搜索引擎与类 ChatGPT 对话式 AI 结合的公开演示,指出其中存在大量事实错误,呼吁提升模型透明度与事实正确性。
摘要:
尽管 OpenAI 的 ChatGPT 等大型对话式 AI 模型已展现出巨大潜力,但我们质疑此类模型能否保证事实准确性。近期,微软和谷歌等科技公司宣布了新服务,旨在将搜索引擎与对话式 AI 相结合。然而,我们在公开演示中发现了大量错误,这表明我们不应轻易相信 AI 模型作出的事实性断言。我们并非要批评特定模型或公司,而是希望呼吁研究人员和开发者提升 AI 模型的透明度与事实正确性。
英文摘要:
Although large conversational AI models such as OpenAI's ChatGPT have demonstrated great potential, we question whether such models can guarantee factual accuracy. Recently, technology companies such as Microsoft and Google have announced new services which aim to combine search engines with conversational AI. However, we have found numerous mistakes in the public demonstrations that suggest we should not easily trust the factual claims of the AI models. Rather than criticizing specific models or companies, we hope to call on researchers and developers to improve AI models' transparency and factual correctness.
FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios
Shanghai Jiao Tong University(上海交通大学);Carnegie Mellon University(卡内基梅隆大学);City University of Hong Kong(香港城市大学);New York University(纽约大学);Meta AI;The Hong Kong University of Science and Technology(香港科技大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
Paul G. Allen School of Computer Science and Engineering, University of Washington(华盛顿大学保罗·G·艾伦计算机科学与工程学院);New York University(纽约大学);Allen Institute for Artificial Intelligence(艾伦人工智能研究所)
ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports
University Hospital, LMU Munich(慕尼黑大学附属医院);LMU Munich(慕尼黑大学);Comprehensive Pneumology Center (CPC-M)(综合肺病中心(CPC-M));German Center for Lung Research (DZL)(德国肺研究中心(DZL));Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心(MCML))
From Knowledge Generation to Knowledge Verification: Examining the BioMedical Generative Capabilities of ChatGPT
MGEN -- College of Engineering, Northeastern University Miami(东北大学迈阿密分校MGEN工程学院);University of Vermont(佛蒙特大学);AGH, University of Krakow(克拉科夫AGH大学);Howard University(霍华德大学)