arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.03151cs.AIcs.CVcs.LG
收藏

面向通用人工智能(AGI)的大语言模型:基础原则与方法综述

Large language models for artificial general intelligence (AGI): A survey of foundational principles and approaches

Cape Coast Technical University(海岸角理工大学);University of Mines and Technology(矿业与技术大学)

Alhassan Mumuni, Fuseini Mumuni

AI总结:

本文综述具身性、符号接地、因果性与记忆四项基础原则及其在大语言模型中的实现方法,探讨其如何有机支撑 AGI。

摘要:

基于大规模预训练基础模型(PFMs)的生成式人工智能(AI)系统,例如视觉-语言模型、大语言模型(LLMs)、扩散模型和视觉-语言-动作(VLA)模型,已经展示出在众多领域和情境中解决复杂且真正非平凡 AI 问题的能力。尤其是多模态大语言模型(MLLMs),能够从海量且多样的数据来源中学习,从而形成对世界丰富而细致的表征,并因此提供广泛能力,包括推理、开展有意义对话;与人类及其他智能体协作以共同解决复杂问题;以及理解人类的社会和情感层面。尽管取得了这一令人瞩目的成就,在大规模数据集上训练的最先进 LLMs 的认知能力仍然肤浅且脆弱。因此,通用 LLMs 在通用能力方面受到严重限制。为了使 LLMs 达到人类水平的通用智能,必须解决若干基础性问题:具身性、符号接地、因果性和记忆。这些概念更契合人类认知,并赋予 LLMs 内在的类人认知属性,从而支持实现物理上合理、语义上有意义、灵活且更具泛化性的知识与智能。在本工作中,我们讨论上述基础性问题,并综述在 LLMs 中实现这些概念的最先进方法。具体而言,我们讨论如何以有机方式利用具身性、符号接地、因果性和记忆原则来实现通用人工智能(AGI)。

英文摘要:

Generative artificial intelligence (AI) systems based on large-scale pretrained foundation models (PFMs) such as vision-language models, large language models (LLMs), diffusion models and vision-language-action (VLA) models have demonstrated the ability to solve complex and truly non-trivial AI problems in a wide variety of domains and contexts. Multimodal large language models (MLLMs), in particular, learn from vast and diverse data sources, allowing rich and nuanced representations of the world and, thereby, providing extensive capabilities, including the ability to reason, engage in meaningful dialog; collaborate with humans and other agents to jointly solve complex problems; and understand social and emotional aspects of humans. Despite this impressive feat, the cognitive abilities of state-of-the-art LLMs trained on large-scale datasets are still superficial and brittle. Consequently, generic LLMs are severely limited in their generalist capabilities. A number of foundational problems -- embodiment, symbol grounding, causality and memory -- are required to be addressed for LLMs to attain human-level general intelligence. These concepts are more aligned with human cognition and provide LLMs with inherent human-like cognitive properties that support the realization of physically-plausible, semantically meaningful, flexible and more generalizable knowledge and intelligence. In this work, we discuss the aforementioned foundational issues and survey state-of-the art approaches for implementing these concepts in LLMs. Specifically, we discuss how the principles of embodiment, symbol grounding, causality and memory can be leveraged toward the attainment of artificial general intelligence (AGI) in an organic manner.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑