Large Language Models (LLMs) have made significant strides in various intelligent tasks but still struggle with complex action reasoning tasks that require systematic search. To address this limitation, we propose a method that bridges the natural language understanding capabilities of LLMs with the symbolic reasoning strengths of action languages. Our approach, termed "LLM+AL," leverages the LLM's strengths in semantic parsing and commonsense knowledge generation alongside the action language's proficiency in automated reasoning based on encoded knowledge. We compare LLM+AL against state-of-the-art LLMs, including ChatGPT-4, Claude 3 Opus, Gemini Ultra 1.0, and o1-preview, using benchmarks for complex reasoning about actions. Our findings indicate that, although all methods exhibit errors, LLM+AL, with relatively minimal human corrections, consistently leads to correct answers, whereas standalone LLMs fail to improve even with human feedback. LLM+AL also contributes to automated generation of action languages.
The Pragmatic Persona: Discovering LLM Persona through Bridging Inference
Department of Artificial Intelligence, Chung-Ang University, Seoul, 06974, Republic of Korea(Chung-Ang大学人工智能系);Department of Computer Science, University of British Columbia, Vancouver, BC V6T 1Z4, Canada(不列颠哥伦比亚大学计算机科学系);Van Lang University, Ho Chi Minh City, Vietnam(文-lang大学)
Bridging the Reasoning Gap in Vietnamese with Small Language Models via Test-Time Scaling
Computer Science and Engineering(计算机科学与工程);Information Science Faculty(信息科学系);Faculty of Information(信息学院);Faculty of Advanced Technologies and Engineering(先进技术和工程学院);VNU Vietnam(越南VNU);Japan University(日本大学);JAIST;VNU University of Engineering and Technology(VNU工程大学);VNU Vietnam Japan University(越南日本大学);Hanoi, Vietnam(越南河内);Ishikawa, Japan(日本石川)
Can Reasoning Path still be Effective as Input? Bridging Post-Reasoning to Chain-of-Thought Compression
Faculty of Electronic and Information Engineering, Xi’an Jiaotong University(西安交通大学电子与信息工程学院);Queen Mary University of London(伦敦大学玛丽女王学院);City University of Hong Kong(香港城市大学)
Bridging Auxiliary Constraints to Resolve Instruction Following in Large Reasoning Models
The Chinese University of Hong Kong(香港中文大学);University of International Relations(国际关系大学);Tencent Jarvis Lab(腾讯Jarvis实验室);Westlake University(西湖大学);King’s College London(伦敦国王学院)
ActMem: Bridging the Gap Between Memory Retrieval and Reasoning in LLM Agents
State Key Laboratory for Novel Software Technology, Nanjing University, China(南京大学新型软件技术国家重点实验室);Alibaba Group, Hangzhou, China(阿里巴巴集团,杭州,中国);National Institute of Healthcare Data Science, Nanjing University, China(南京大学健康数据科学国家研究院)
MorphBPE: A Morpho-Aware Tokenizer Bridging Linguistic Complexity for Efficient LLM Training Across Morphologies
Qatar Computing Research Institute (QCRI)(卡塔尔计算研究所);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);Technical University of Berlin(柏林工业大学)
Bridging Internal Probability and Self-Consistency for Effective and Efficient LLM Reasoning
National Key Laboratory for Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室);School of Artificial Intelligence, Nanjing University(南京大学人工智能学院);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院)
Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning
Massachusetts Institute of Technology(麻省理工学院);Havard Univeristy(哈佛大学);LG CNS;Université de Montréal(蒙特利尔大学);Mila(米拉研究所);Google(谷歌);Stanford University(斯坦福大学)
HyPER: Bridging Exploration and Exploitation for Scalable LLM Reasoning with Hypothesis Path Expansion and Reduction
Institute for Artificial Intelligence, Peking University, Beijing(北京大学人工智能研究院);Huawei(华为);School of Integrated Circuits, Peking University, Beijing(北京大学集成电路学院)
VCSearch: Bridging the Gap Between Well-Defined and Ill-Defined Problems in Mathematical Reasoning
National Key Laboratory for Novel Software Technology, Nanjing University(南京大学新型软件技术国家重点实验室);School of Artificial Intelligence, Nanjing University(南京大学人工智能学院);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院)
Bridging the Gap in Ophthalmic AI: MM-Retinal-Reason Dataset and OphthaReason Model toward Dynamic Multimodal Reasoning
School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Department of Ophthalmology, The First Affiliated Hospital of Nanjing Medical University(南京医科大学第一附属医院眼科学系);School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);School of Computer Science, Northwestern Polytechnical University(西北工业大学计算机学院)
PANDA: An LLM-Enhanced Performance-Driven Analog Design Framework Bridging Design Intent and Layout Generation
School of Integrated Circuits, Peking University(集成电路学院,北京大学);Beijing Advanced Innovation Center for Integrated Circuits(北京集成电路先进创新中心);Institute of Electronic Design Automation, Peking University(电子设计自动化研究所,北京大学)
Bridging External and Parametric Knowledge: Mitigating Hallucination of LLMs with Shared-Private Semantic Synergy in Dual-Stream Knowledge
Beijing Institute of Technology, China(北京理工大学);Beijing University of Posts and Telecommunications, China(北京邮电大学);Meituan, China(美团);The Open University, UK(开放大学)
Bridging the Gap between Different Vocabularies for LLM Ensemble
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Wuhan AI Research(武汉人工智能研究院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)