The ability to summarize and organize knowledge into abstract concepts is key to learning and reasoning. Many industrial applications rely on the consistent and systematic use of concepts, especially when dealing with decision-critical knowledge. However, we demonstrate that, when methodically questioned, large language models (LLMs) often display and demonstrate significant inconsistencies in their knowledge. Computationally, the basic aspects of the conceptualization of a given domain can be represented as Is-A hierarchies in a knowledge graph (KG) or ontology, together with a few properties or axioms that enable straightforward reasoning. We show that even simple ontologies can be used to reveal conceptual inconsistencies across several LLMs. We also propose strategies that domain experts can use to evaluate and improve the coverage of key domain concepts in LLMs of various sizes. In particular, we have been able to significantly enhance the performance of LLMs of various sizes with openly available weights using simple knowledge-graph (KG) based prompting strategies.
Cross-Lingual Consistency: A Novel Inference Framework for Advancing Reasoning in Large Language Models
Shandong Inspur Artificial Intelligence Research Institute Co., Ltd.(山东浪潮人工智能研究院有限公司);Shandong Yunhai Guochuang Cloud Computing Equipment Industry Innovation Center Co., Ltd.(山东云海国创云计算装备产业创新中心有限公司)
Reasoning or Not? A Comprehensive Evaluation of Reasoning LLMs for Dialogue Summarization
Faculty of Applied Sciences, Macao Polytechnic University(澳门理工大学应用科学学院);Computer Science and Communication Research Center, School of Technology and Management, Polytechnic of Leiria(莱里亚理工学院技术与管理学院计算机科学与通信研究中心);Institute of International Language Services Studies, Macau Millennium College(澳门 millennium 学院国际语言服务研究学院);CISUC, Department of Informatics Engineering, University of Coimbra(科英布拉大学信息工程系 CISUC)
Revealing the Truth with ConLLM for Detecting Multi-Modal Deepfakes
Macquarie University(麦考瑞大学);Bharati Vidyapeeth’s College Of Engineering(巴里蒂大学工程学院);Vivekananda Institute of Professional Studies (VIPS)(维维kananda专业研究学院);DSEU-Okhla;Center for SDGC(SDGC研究中心);Stanford University(斯坦福大学);Cornell University(康奈尔大学)
Retrieval is Not Enough: Enhancing RAG Reasoning through Test-Time Critique and Optimization
Zhejiang University(浙江大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);South China University of Technology(华南理工大学);University of British Columbia(不列颠哥伦比亚大学);Fudan University(复旦大学);University of Hong Kong(香港大学)
Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoning
Shanghai AI Lab(上海人工智能实验室);Xi’an Jiaotong University(西安交通大学);The University of Hong Kong(香港大学);Peking University(北京大学);Hong Kong University of Science and Technology(香港科技大学)
CLIPO: Contrastive Learning in Policy Optimization Generalizes RLVR
Qwen Large Model Application Team, Alibaba Institute of Automation, Chinese Academy of Sciences(文勤大模型应用团队,阿里巴巴自动化研究所,中国科学院);Qwen Large Model Application Team, Alibaba(文勤大模型应用团队,阿里巴巴)
From Prompts to Pavement Through Time: Temporal Grounding in Agentic Scene-to-Plan Reasoning
Computer Science & Engineering Department, German University in Cairo (GUC), Egypt(德国亚历山大大学(GUC)计算机科学与工程系,埃及);C-DRiVeS Lab: Cognitive Driving Research in Vehicular Systems, Cairo, Egypt(认知驾驶系统实验室,埃及开罗,C-DRiVeS);M.Eng. Robotics Candidate at Deggendorf Institute of Technology, Germany(德国德格多夫技术学院机器人硕士候选人);IAV GmbH, Berlin, Germany(德国柏林IAV GmbH公司)
Knowledge-Augmented Long-CoT Generation for Complex Biomolecular Reasoning
The Polytechnic Institute, Zhejiang University(浙江大学Polytechnic学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University(浙江大学Hangzhou全球科技创新中心);University of Oxford(牛津大学);Ant Group(蚂蚁集团);University of Aberdeen(阿伯丁大学);ZJU-UIUC Institute, Zhejiang University(浙江大学UIUC研究院)