定义知识:桥接认识论与大语言模型
Defining Knowledge: Bridging Epistemology and Large Language Models
AI总结:
本文通过回顾认识论中的知识定义并将其形式化以适用于大语言模型,结合对100位哲学家和计算机科学家的调查,揭示当前NLP研究在知识概念化上的不一致,并提出相应的知识测试评估协议。
摘要:
关于大语言模型(LLMs)的文献中充斥着大量知识主张;但我们能否说 GPT-4 真正“知道”地球是圆的?为了解决这一问题,我们回顾了认识论中关于知识的标准定义,并将适用于大语言模型的解释加以形式化。在此过程中,我们识别出当前自然语言处理研究在参照认识论框架来概念化知识时所存在的不一致与空白。此外,我们对100位专业哲学家和计算机科学家进行了一项调查,以比较他们在知识定义上的偏好,以及他们对大语言模型是否真的可以说“知道”这一问题的看法。最后,我们提出了依据最相关定义来测试知识的评估协议。
英文摘要:
Knowledge claims are abundant in the literature on large language models (LLMs); but can we say that GPT-4 truly "knows" the Earth is round? To address this question, we review standard definitions of knowledge in epistemology and we formalize interpretations applicable to LLMs. In doing so, we identify inconsistencies and gaps in how current NLP research conceptualizes knowledge with respect to epistemological frameworks. Additionally, we conduct a survey of 100 professional philosophers and computer scientists to compare their preferences in knowledge definitions and their views on whether LLMs can really be said to know. Finally, we suggest evaluation protocols for testing knowledge in accordance to the most relevant definitions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。