With the recent appearance of LLMs in practical settings, having methods that can effectively detect factual inconsistencies is crucial to reduce the propagation of misinformation and improve trust in model outputs. When testing on existing factual consistency benchmarks, we find that a few large language models (LLMs) perform competitively on classification benchmarks for factual inconsistency detection compared to traditional non-LLM methods. However, a closer analysis reveals that most LLMs fail on more complex formulations of the task and exposes issues with existing evaluation benchmarks, affecting evaluation precision. To address this, we propose a new protocol for inconsistency detection benchmark creation and implement it in a 10-domain benchmark called SummEdits. This new benchmark is 20 times more cost-effective per sample than previous benchmarks and highly reproducible, as we estimate inter-annotator agreement at about 0.9. Most LLMs struggle on SummEdits, with performance close to random chance. The best-performing model, GPT-4, is still 8\% below estimated human performance, highlighting the gaps in LLMs' ability to reason about facts and detect inconsistencies when they occur.
Physics Reasoner: Knowledge-Augmented Reasoning for Solving Physics Problems with Large Language Models
Institute for Artificial Intelligence, Tsinghua University (THUAI)(清华大学人工智能研究院);Beijing National Research Center for Information Science and Technology (BNRist)(北京信息科学与技术国家研究中心);Department of Automation, Tsinghua University(清华大学自动化系);TMLR Group, Hong Kong Baptist University(香港浸会大学TMLR组)
When Less Language is More: Language-Reasoning Disentanglement Makes LLMs Better Multilingual Reasoners
Harbin Institute of Technology(哈尔滨工业大学);Singapore Management University(新加坡管理学院);Monash University(墨尔本大学);Singapore University of Technology and Design(新加坡科技设计大学);National University of Singapore(国立新加坡大学)
Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity
Westlake University(西湖大学);Zhejiang University(浙江大学);Purdue University(普渡大学);Fudan University(复旦大学);Amazon AWS AI(亚马逊AWS人工智能);Yale University(耶鲁大学);Shanghai Jiao Tong University(上海交通大学);The Hong Kong University of Science and Technology(香港科技大学);Tsinghua University(清华大学);Microsoft Research(微软研究院)
Are Language Models Consequentialist or Deontological Moral Reasoners?
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Washington(华盛顿大学);University of Zürich(苏黎世大学);University of Michigan(密歇根大学);University of Toronto(多伦多大学);Vector Institute(向量研究所)
Kwai-STaR: Transform LLMs into State-Transition Reasoners
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Kuaishou Technology(快手科技);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Pengcheng Laboratory(鹏城实验室)
FELM: Benchmarking Factuality Evaluation of Large Language Models
National University of Singapore(新加坡国立大学);The Hong Kong University of Science and Technology(香港科技大学);Carnegie Mellon University(卡内基梅隆大学);City University of Hong Kong(香港城市大学);Shanghai Jiao Tong University(上海交通大学)
UAlign: Leveraging Uncertainty Estimations for Factuality Alignment on Large Language Models
The Chinese University of Hong Kong(香港中文大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);The University of Hong Kong(香港大学);The Hong Kong Polytechnic University(香港理工大学);Hong Kong University of Science and Technology, Guangzhou(香港科技大学(广州));MoE Key Laboratory of High Confidence Software Technologies(教育部高可信软件技术重点实验室)
LLM Factoscope: Uncovering LLMs' Factual Discernment through Inner States Analysis
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
Mitigating Large Language Model Hallucinations via Autonomous Knowledge Graph-based Retrofitting
Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);State Key Laboratory of Computer Science(计算机科学国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学)
Is Factuality Enhancement a Free Lunch For LLMs? Better Factuality Can Lead to Worse Context-Faithfulness
Institute of Computing Technology, CAS(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);University of California, Merced(加州大学默塞德分校);University of Science and Technology of China(中国科学技术大学)