While Large Language Models (LLMs) have achieved remarkable success across various applications, they also raise concerns regarding self-cognition. In this paper, we perform a pioneering study to explore self-cognition in LLMs. Specifically, we first construct a pool of self-cognition instruction prompts to evaluate where an LLM exhibits self-cognition and four well-designed principles to quantify LLMs' self-cognition. Our study reveals that 4 of the 48 models on Chatbot Arena--specifically Command R, Claude3-Opus, Llama-3-70b-Instruct, and Reka-core--demonstrate some level of detectable self-cognition. We observe a positive correlation between model size, training data quality, and self-cognition level. Additionally, we also explore the utility and trustworthiness of LLM in the self-cognition state, revealing that the self-cognition state enhances some specific tasks such as creative writing and exaggeration. We believe that our work can serve as an inspiration for further research to study the self-cognition in LLMs.
Curiosity as Linguistic Intervention: Using LLM Tutoring Dialogues to Influence Exploratory Learning Behavior
School of Computing and Information Systems, Singapore Management University(新加坡管理大学计算与信息系统学院);Human-Computer Interaction Institute, Carnegie Mellon University(卡内基梅隆大学人机交互研究所)
Large Language Models Have Intrinsic Meta-Cognition, but Need a Good Lens
School of Computer Science and Engineering, Key Laboratory of Computer Network and Information Integration, Ministry of Education, Southeast University, China(计算机科学与工程学院、计算机网络与信息集成重点实验室、教育部、东南大学,中国);Department of Neurosurgery, Shanghai Tenth People’s Hospital, School of Clinical Medicine of Nanjing Medical University, China(神经外科科、上海第十人民医院、南京医科大学临床医学学院,中国)
Can Large Language Models Self-Correct in Medical Question Answering? An Exploratory Study
Department of Electrical and Computer Engineering, University of Minnesota(明尼苏达大学电气与计算机工程系);Division of Computational Health Sciences, Department of Surgery, University of Minnesota(明尼苏达大学外科学系计算健康科学部);Department of Software Engineering, University of St. Thomas(圣托马斯大学软件工程系)
Metareasoning constraints couple narratives, affect and cognition
Applied Computational Psychiatry Lab(应用计算精神病学实验室);Max Planck UCL Centre for Computational Psychiatry and Ageing Research(马克斯·普朗克UCL计算精神病学与衰老研究中心);Queen Square Institute of Neurology and Mental Health(圣夸克广场神经病学与心理健康研究所);Neuroscience Department(神经科学系);Division of Psychiatry(精神病学系)
Identifying Quantum Structure in AI Language: Evidence for Evolutionary Convergence of Human and Artificial Cognition
Center Leo Apostel for Interdisciplinary Studies, Vrije Universiteit Brussel (VUB)(利奥·阿波斯泰尔跨学科研究中心,布鲁塞尔自由大学);Department of Economics, University of Bergamo(博洛尼亚大学经济系);Department of Humanities and Cultural Heritage (DIUM) and Centre CQSCS, University of Udine(乌迪内大学人文与文化遗产系及CQSCS中心)
CitySeeker: How Do VLMS Explore Embodied Urban Navigation With Implicit Human Needs?
Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算机系);Tongji University(同济大学);Nanjing Institute of Geography and Limnology, Chinese Academy of Sciences(中国科学院南京地理与湖泊研究所);Research Centre for Data Science & Artificial Intelligence(数据科学与人工智能研究中心)
Cognition Chain for Explainable Psychological Stress Detection on Social Media
University of Oxford(牛津大学);Tsinghua University(清华大学);Beijing Normal University(北京师范大学);Wuhan University(武汉大学);Oxford Suzhou Centre for Advanced Research(牛津苏州高等研究院)
ThinkNote: Enhancing Knowledge Integration and Utilization of Large Language Models via Constructivist Cognition Modeling
School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Language Technologies Institute, Carnegie Mellon University(卡内基梅隆大学语言技术研究所)
PRefLexOR: Preference-based Recursive Language Modeling for Exploratory Optimization of Reasoning and Agentic Thinking
Center for Computational Science and Engineering(计算科学与工程中心);Schmarzman College of Computing(施马茨曼计算学院);Laboratory for Atomistic and Molecular Mechanics (LAMM)(原子与分子力学实验室);Massachusetts Institute of Technology(麻省理工学院)
CityGPT: Empowering Urban Spatial Cognition of Large Language Models
Department of Electronic Engineering, BNRist, Tsinghua University(电子工程系、BNRist、清华大学);School of Electronic and Information Engineering, Beijing Jiaotong University(电子信息工程学院、北京交通大学);Department of Electronic Engineering, Tsinghua University(电子工程系、清华大学);Department of Urban Planning, Tsinghua University(城市规划系、清华大学)
Cognitive Linguistic Identity Fusion Score (CLIFS): A Scalable Cognition-Informed Approach to Quantifying Identity Fusion from Text
Center for Complex Networks and Systems Research, Luddy School of Informatics, Computing, and Engineering, Indiana University Bloomington(复杂网络与系统研究中心,信息学、计算与工程学院,印第安纳大学布卢明顿分校);Cognitive Science Program, Indiana University Bloomington(认知科学项目,印第安纳大学布卢明顿分校);School of Data Science, University of Virginia(数据科学学院,弗吉尼亚大学);CulturePulse, Inc.(CulturePulse公司)
Emulating Clinician Cognition via Self-Evolving Deep Clinical Research
Gaoling School of Artificial Intelligence(首都经济贸易大学人工智能学院);Renmin University of China(中国人民大学);Peking University Third Hospital(北京大学第三医院);Baidu Inc.(百度公司);Chinese PLA General Hospital(中国人民解放军总医院);Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly(联合NTU-UBC老年积极生活方式卓越研究中心);Nanyang Technological University(南洋理工大学)
Population-Level Profiling of DSM-5 Depressive Symptom Language Among Twitter Users With Self-Reported ADHD or ASD: Exploratory Study Using Natural Language Processing and Statistical Analysis
Faculty of Computer and Information Science, University of Ljubljana(卢布尔雅那大学计算机与信息科学学院)
Purdue University(普渡大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California Los Angeles(加州大学洛杉矶分校);University of Connecticut(康涅狄格大学);University of California Berkeley(加州大学伯克利分校)