Language models (LMs) are sentence-completion engines trained on massive corpora. LMs have emerged as a significant breakthrough in natural-language processing, providing capabilities that go far beyond sentence completion including question answering, summarization, and natural-language inference. While many of these capabilities have potential application to cognitive systems, exploiting language models as a source of task knowledge, especially for task learning, offers significant, near-term benefits. We introduce language models and the various tasks to which they have been applied and then review methods of knowledge extraction from language models. The resulting analysis outlines both the challenges and opportunities for using language models as a new knowledge source for cognitive systems. It also identifies possible ways to improve knowledge extraction from language models using the capabilities provided by cognitive systems. Central to success will be the ability of a cognitive agent to itself learn an abstract model of the knowledge implicit in the LM as well as methods to extract high-quality knowledge effectively and efficiently. To illustrate, we introduce a hypothetical robot agent and describe how language models could extend its task knowledge and improve its performance and the kinds of knowledge and methods the agent can use to exploit the knowledge within a language model.
Cognitive Models and AI Algorithms Provide Templates for Designing Language Agents
Department of Computer Science, Princeton University(普林斯顿大学计算机科学系);Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology(麻省理工学院脑科学与认知科学系);Zuckerman Mind Brain Behavior Institute(祖克曼心智大脑行为研究所);Department of Psychiatry, Columbia University(哥伦比亚大学精神医学系);Neuroscience Institute(神经科学研究所);Department of Machine Learning, Carnegie Mellon University(卡内基梅隆大学机器学习系);Department of Psychology, Princeton University(普林斯顿大学心理学系)
Evaluating Cognitive Age Alignment in Interactive AI Agents
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Shenzhen Children's Hospital(深圳儿童医院);Peking University(北京大学);Hong Kong Polytechnic University(香港理工大学)
NuHF Claw: A Risk Constrained Cognitive Agent Framework for Human Centered Procedure Support in Digital Nuclear Control Rooms
Institute of Nuclear and New Energy Technology, Tsinghua University(清华大学核能与新能源技术研究院);National Key Laboratory of Human Factors Engineering(人因工程国家重点实验室);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所)
SuperLocalMemory V3.3: The Living Brain -- Biologically-Inspired Forgetting, Cognitive Quantization, and Multi-Channel Retrieval for Zero-LLM Agent Memory Systems
Incorporating Cognitive Load and Knowledge Transfer for Multi-Domain Knowledge Tracing
University of Science and Technology of China(中国科学技术大学);iFLYTEK AI Research(讯飞AI研究院);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)
Web-CogReasoner: Towards Multimodal Knowledge-Induced Cognitive Reasoning for Web Agents
Southwestern University of Finance and Economics(西南财经大学);Shanghai Jiao Tong University(上海交通大学);Central South University(中南大学);Hithink Research(Hithink研究);Westlake University(西湖大学);Harbin Institute of Technology(哈尔滨工业大学);University of Manchester(曼彻斯特大学);University of California, Los Angeles(加州大学洛杉矶分校);University of Adelaide(阿德莱德大学);Fudan University(复旦大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Chengdu Everimaging Science and Technology Co., Ltd(成都亿联科技有限公司)
Impact of different belief facets on agents' decision -- a refined cognitive architecture to model the interaction between organisations' institutional characteristics and agents' behaviour
University of Otago(奥塔哥大学);Norwegian University of Science and Technology(挪威科技大学)
An Agent Model Abstraction for Human-AI Teaming Cognitive Coupling
University of Groningen(格罗宁根大学);Luxembourg Institute of Science and Technology(卢森堡科学技术研究院);Université de Lorraine(洛林大学);CNRS(法国国家科学研究中心);CRAN(南锡自动化与计算机科学研究中心)
CogEvolution: A Human-like Generative Educational Agent to Simulate Student's Cognitive Evolution
Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan, Hubei, China(教育人工智能学院,中国中央师范大学,武汉,湖北,中国);National Engineering Research Center for Educational Big Data, Central China Normal University, Wuhan, Hubei, China(教育大数据国家工程研究中心,中国中央师范大学,武汉,湖北,中国);Central China Normal University Wollongong Joint Institute, Central China Normal University, Wuhan, Hubei, China(中国中央师范大学沃林顿联合学院,中国中央师范大学,武汉,湖北,中国)