Recent studies of the applications of conversational AI tools, such as chatbots powered by large language models, to complex real-world knowledge work have shown limitations related to reasoning and multi-step problem solving. Specifically, while existing chatbots simulate shallow reasoning and understanding they are prone to errors as problem complexity increases. The failure of these systems to address complex knowledge work is due to the fact that they do not perform any actual cognition. In this position paper, we present Cognitive AI, a higher-level framework for implementing programmatically defined neuro-symbolic cognition above and outside of large language models. Specifically, we propose a dual-layer functional architecture for Cognitive AI that serves as a roadmap for AI systems that can perform complex multi-step knowledge work. We propose that Cognitive AI is a necessary precursor for the evolution of higher forms of AI, such as AGI, and specifically claim that AGI cannot be achieved by probabilistic approaches on their own. We conclude with a discussion of the implications for large language models, adoption cycles in AI, and commercial Cognitive AI development.
What is the Visual Cognition Gap between Humans and Multimodal LLMs?
Department of Computer Science, University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校计算机科学系);College of Computing, Georgia Institute of Technology(佐治亚理工学院计算机学院);Department of Computer Science, University of Virginia(弗吉尼亚大学计算机科学系);Digital Twin Lab, Purdue University(普渡大学数字孪生实验室);HKUST (Guangzhou)(香港科技大学(广州));Department of Rehabilitation Medicine, Shenzhen Children’s Hospital(深圳儿童医院康复医学系)
From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Models
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学北京校区人工智能学院);Xiamen University(厦门大学);The Hong Kong University of Science and Technology(香港理工大学);Nanyang Technological University(南洋理工大学)
Identifying Quantum Structure in AI Language: Evidence for Evolutionary Convergence of Human and Artificial Cognition
Center Leo Apostel for Interdisciplinary Studies, Vrije Universiteit Brussel (VUB)(利奥·阿波斯泰尔跨学科研究中心,布鲁塞尔自由大学);Department of Economics, University of Bergamo(博洛尼亚大学经济系);Department of Humanities and Cultural Heritage (DIUM) and Centre CQSCS, University of Udine(乌迪内大学人文与文化遗产系及CQSCS中心)
A "Wenlu" Brain System for Multimodal Cognition and Embodied Decision-Making: A Secure New Architecture for Deep Integration of Foundation Models and Domain Knowledge
College of Mechanical and Electrical Engineering, Shijiazhuang University(石家庄大学机械与电气工程学院);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);The Key Laboratory of Agricultural Robotics Intelligent Perception in Shijiazhuang(石家庄农业机器人智能感知重点实验室)
Remote Sensing Image Intelligent Interpretation with the Language-Centered Perspective: Principles, Methods and Challenges
School of Geosciences and Info-Physics, Central South University(中南大学地球科学与信息物理学院);Faculty of Geosciences and Environmental Engineering, Southwest Jiaotong University(西南交通大学地质科学与环境工程学院);School of Earth and Space Sciences, Peking University(北京大学地球与空间科学学院);Institute of Remote Sensing Information Processing (IRSIP), Wuhan University(武汉大学遥感信息处理研究所)
Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心);Institute of Trustworthy Embodied AI, Fudan University(复旦大学可信具身人工智能研究院)