正面还是反面:因果抽象模拟的一个简单示例
Heads or Tails: A Simple Example of Causal Abstractive Simulation
AI总结:
该研究以抛硬币模拟为例,阐释因果抽象模拟的形式化方法,说明其可验证语言模型的系统模拟能力,为语言模型模拟研究提供因果理论基础,还为AI哲学及因果抽象领域带来新视角。
摘要:
本说明阐释了多种因果抽象(arXiv:1707.00819、arXiv:1812.03789,本文中定义为因果抽象模拟)如何可用于形式化语言模型模拟的一个简单示例。本文考虑了用语言模型模拟公平抛硬币的场景,给出了语言模型无法完成模拟的多种情况示例,同时呈现了一个成功案例,说明在给定系统的因果描述时,该形式化方法可用于证明语言模型能模拟其他某个系统。本说明可能对三类群体有价值:对于日益发展的语言模型模拟领域的从业者而言,因果抽象模拟是将临时的统计基准测试实践与坚实的因果理论形式基础关联起来的途径;AI哲学家与心灵哲学家可能会感兴趣,因为因果抽象模拟为“语言模型在进行角色扮演(arXiv:2402.12422)”这一观点提供了精确的可操作定义;研究因果抽象的数学家及其他人员可能会关注这一核心思想的新应用,它催生了因果抽象的一种新变体。
英文摘要:
This note illustrates how a variety of causal abstraction arXiv:1707.00819 arXiv:1812.03789, defined here as causal abstractive simulation, can be used to formalize a simple example of language model simulation. This note considers the case of simulating a fair coin toss with a language model. Examples are presented illustrating the ways language models can fail to simulate, and a success case is presented, illustrating how this formalism may be used to prove that a language model simulates some other system, given a causal description of the system. This note may be of interest to three groups. For practitioners in the growing field of language model simulation, causal abstractive simulation is a means to connect ad-hoc statistical benchmarking practices to the solid formal foundation of causality. Philosophers of AI and philosophers of mind may be interested as causal abstractive simulation gives a precise operationalization to the idea that language models are role-playing arXiv:2402.12422. Mathematicians and others working on causal abstraction may be interested to see a new application of the core ideas that yields a new variation of causal abstraction.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。