ChatGPT 能否进行解释性推理?溯因推理的基准测试
Can ChatGPT Make Explanatory Inferences? Benchmarks for Abductive Reasoning
AI总结:
本文提出溯因推理基准测试,评估ChatGPT的解释性推理能力,发现其在言语和视觉模态下能进行创造性和评价性推理,驳斥了其缺乏解释、理解等能力的观点。
摘要:
解释性推理是生成和评估提供解释的假设的过程,有时被称为溯因推理或溯因推断。生成式人工智能是一类基于新颖算法生成文本、图像和声音的新型人工智能模型。本文提出了一套基准测试,用于评估人工智能程序执行解释性推理的能力,并利用这些基准来确定领先的生成式人工智能模型 ChatGPT 在多大程度上能够进行解释性推理。对这些基准的测试表明,ChatGPT 在许多领域都能进行创造性和评价性推理,尽管它仅限于言语和视觉模态。本文驳斥了声称 ChatGPT 及类似模型不具备解释、理解、因果推理、意义和创造力的观点。
英文摘要:
Explanatory inference is the creation and evaluation of hypotheses that provide explanations, and is sometimes known as abduction or abductive inference. Generative AI is a new set of artificial intelligence models based on novel algorithms for generating text, images, and sounds. This paper proposes a set of benchmarks for assessing the ability of AI programs to perform explanatory inference, and uses them to determine the extent to which ChatGPT, a leading generative AI model, is capable of making explanatory inferences. Tests on the benchmarks reveal that ChatGPT performs creative and evaluative inferences in many domains, although it is limited to verbal and visual modalities. Claims that ChatGPT and similar models are incapable of explanation, understanding, causal reasoning, meaning, and creativity are rebutted.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。