arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2308.03301cs.AIcs.ITmath.IT
收藏

ChatGPT 读过什么?一个生成式人工智能应用所使用的考古学引文的来源

What has ChatGPT read? The origins of archaeological citations used by a generative artificial intelligence application

Dirk HR Spennemann

AI总结:

本文通过完形填空分析检验 ChatGPT 所提供考古学引文的真实性,发现大量引文为虚构,且真实引文均可在维基百科中找到,揭示其训练数据可能主要来源于维基百科而非原始文献全文。

摘要:

ChatGPT 的公开发布引起了广泛关注,并引发了关于生成式 AI 语言模型的有用性和能力的广泛讨论。它从文本来源中提取和总结数据,并将其呈现为类似人类的上下文响应的能力,使其成为回答用户可能提出的问题的非常适合的工具。本文测试了 ChatGPT 的训练阶段似乎包含了哪些考古学文献。虽然 ChatGPT 提供了看似相关的参考文献,但很大比例被证明是虚构的。本文使用完形填空分析来推断生成式 AI 模型“记忆”的来源,但无法证明 ChatGPT 能够访问真实参考文献的全文。可以表明,ChatGPT 提供的所有被证明是真实的参考文献也都在维基百科页面上被引用过。这强烈表明,至少部分数据的来源基础存在于这些页面中。本文讨论了这一点与数据质量相关的影响。

英文摘要:

The public release of ChatGPT has resulted in considerable publicity and has led to wide-spread discussion of the usefulness and capabilities of generative AI language models. Its ability to extract and summarise data from textual sources and present them as human-like contextual responses makes it an eminently suitable tool to answer questions users might ask. This paper tested what archaeological literature appears to have been included in ChatGPT's training phase. While ChatGPT offered seemingly pertinent references, a large percentage proved to be fictitious. Using cloze analysis to make inferences on the sources 'memorised' by a generative AI model, this paper was unable to prove that ChatGPT had access to the full texts of the genuine references. It can be shown that all references provided by ChatGPT that were found to be genuine have also been cited on Wikipedia pages. This strongly indicates that the source base for at least some of the data is found in those pages. The implications of this in relation to data quality are discussed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑