Sora 和 V-JEPA 尚未学习完整的现实世界模型——基于生产性想象力理论对视频 AI 的哲学分析
Sora and V-JEPA Have Not Learned The Complete Real World Model -- A Philosophical Analysis of Video AIs Through the Theory of Productive Imagination
AI总结:
本文基于康德哲学的生产性想象力理论,分析 Sora 与 V-JEPA 的局限,指出二者均未实现完整世界理解,并提出以联合嵌入为核心的训练框架以推进 AI 推理与规划。
摘要:
OpenAI 的 Sora 展现了卓越的性能,然而其技术实力是否等同于对现实的真实理解仍面临质疑。批评者认为它缺乏对世界的基础把握,而 Meta 的 V-JEPA 旨在通过其联合嵌入方法来弥补这一缺陷。这一争论对于引导通用人工智能(AGI)的未来方向至关重要。我们通过发展一种基于康德哲学的生产性想象力理论来丰富这一争论,该理论能够生成连贯的世界模型。我们识别出能够真正理解世界的连贯世界模型的三个不可或缺的组成部分:孤立对象的表征、跨越空间和时间的先验变化法则,以及康德范畴。我们的分析揭示,Sora 因忽视先验变化法则和康德范畴而受到限制,这些缺陷无法通过扩大训练规模来纠正。V-JEPA 学习了先验变化法则中依赖上下文的部分,然而它未能完全理解康德范畴并融入经验,这使我们得出结论:目前这两个系统均未实现全面的世界理解。尽管如此,每个系统都开发了推进集成式 AI 生产性想象力-理解引擎所必需的组件。最后,我们提出了一种创新的 AI 生产性想象力-理解引擎训练框架,该框架以联合嵌入系统为核心,旨在将无序的感知输入转化为结构化的、连贯的世界模型。我们的哲学分析指出了当代视频 AI 技术中的关键挑战,以及实现能够真正理解世界并可用于未来推理和规划的 AI 系统的路径。
英文摘要:
Sora from Open AI has shown exceptional performance, yet it faces scrutiny over whether its technological prowess equates to an authentic comprehension of reality. Critics contend that it lacks a foundational grasp of the world, a deficiency V-JEPA from Meta aims to amend with its joint embedding approach. This debate is vital for steering the future direction of Artificial General Intelligence(AGI). We enrich this debate by developing a theory of productive imagination that generates a coherent world model based on Kantian philosophy. We identify three indispensable components of the coherent world model capable of genuine world understanding: representations of isolated objects, an a priori law of change across space and time, and Kantian categories. Our analysis reveals that Sora is limited because of its oversight of the a priori law of change and Kantian categories, flaws that are not rectifiable through scaling up the training. V-JEPA learns the context-dependent aspect of the a priori law of change. Yet it fails to fully comprehend Kantian categories and incorporate experience, leading us to conclude that neither system currently achieves a comprehensive world understanding. Nevertheless, each system has developed components essential to advancing an integrated AI productive imagination-understanding engine. Finally, we propose an innovative training framework for an AI productive imagination-understanding engine, centered around a joint embedding system designed to transform disordered perceptual input into a structured, coherent world model. Our philosophical analysis pinpoints critical challenges within contemporary video AI technologies and a pathway toward achieving an AI system capable of genuine world understanding, such that it can be applied for reasoning and planning in the future.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。