Large language models (LLMs) have a wealth of knowledge that allows them to excel in various Natural Language Processing (NLP) tasks. Current research focuses on enhancing their performance within their existing knowledge. Despite their vast knowledge, LLMs are still limited by the amount of information they can accommodate and comprehend. Therefore, the ability to understand their own limitations on the unknows, referred to as self-knowledge, is of paramount importance. This study aims to evaluate LLMs' self-knowledge by assessing their ability to identify unanswerable or unknowable questions. We introduce an automated methodology to detect uncertainty in the responses of these models, providing a novel measure of their self-knowledge. We further introduce a unique dataset, SelfAware, consisting of unanswerable questions from five diverse categories and their answerable counterparts. Our extensive analysis, involving 20 LLMs including GPT-3, InstructGPT, and LLaMA, discovering an intrinsic capacity for self-knowledge within these models. Moreover, we demonstrate that in-context learning and instruction tuning can further enhance this self-knowledge. Despite this promising insight, our findings also highlight a considerable gap between the capabilities of these models and human proficiency in recognizing the limits of their knowledge.
EpiCaR: Knowing What You Don't Know Matters for Better Reasoning in LLMs
Graduate School of Data Science, Seoul National University(数据科学研究生院,首尔国立大学);Department of Rural Systems Engineering, Seoul National University(农村系统工程系,首尔国立大学);Department of Aerospace Engineering, Seoul National University(航空航天工程系,首尔国立大学)
What Don't You Understand? Using Large Language Models to Identify and Characterize Student Misconceptions About Challenging Topics
Harvard Medical School and Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center(哈佛医学院和肺科、重症医学及睡眠医学部门,贝斯以色列德aconess医疗中心)
Only Ask What You Don't Know: Grounded Delta Planning for Efficient Multi-step RAG
Dept. of Computer Science and Information Engineering, National Taiwan University(国立台湾大学资讯工程学系);Graduate Institute of Communication Engineering, National Taiwan University(国立台湾大学电信工程学研究所);Department of Economics, National Taiwan University(国立台湾大学经济学系);Department of Information Management, National Taiwan University(国立台湾大学资讯管理学系);NTU Artificial Intelligence Center of Research Excellence (NTU AI-CoRE)(国立台湾大学人工智能卓越研究中心)