Graph walking based on reinforcement learning (RL) has shown great success in navigating an agent to automatically complete various reasoning tasks over an incomplete knowledge graph (KG) by exploring multi-hop relational paths. However, existing multi-hop reasoning approaches only work well on short reasoning paths and tend to miss the target entity with the increasing path length. This is undesirable for many reason-ing tasks in real-world scenarios, where short paths connecting the source and target entities are not available in incomplete KGs, and thus the reasoning performances drop drastically unless the agent is able to seek out more clues from longer paths. To address the above challenge, in this paper, we propose a dual-agent reinforcement learning framework, which trains two agents (GIANT and DWARF) to walk over a KG jointly and search for the answer collaboratively. Our approach tackles the reasoning challenge in long paths by assigning one of the agents (GIANT) searching on cluster-level paths quickly and providing stage-wise hints for another agent (DWARF). Finally, experimental results on several KG reasoning benchmarks show that our approach can search answers more accurately and efficiently, and outperforms existing RL-based methods for long path queries by a large margin.
DTKG: Dual-Track Knowledge Graph-Verified Reasoning Framework for Multi-Hop QA
School of Computer Science;Engineering, Beihang University, Beijing, China;School of Reliability;Systems Engineering, Beihang University, Beijing, China;State Key Laboratory of Complex \& Critical Software Environment;National Key Laboratory of Reliability;State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences
DuetGraph: Coarse-to-Fine Knowledge Graph Reasoning with Dual-Pathway Global-Local Fusion
School of Biomedical Engineering, University of Science and Technology of China(生物医学工程学院,中国科学技术大学);School of Artificial Intelligence and Data Science, USTC(人工智能与数据科学学院,中国科学技术大学);Data Darkness Lab, Suzhou Institute for Advanced Research, USTC(数据黑暗实验室,苏州先进研究院)
Hey GPT-OSS, Looks Like You Got It -- Now Walk Me Through It! An Assessment of the Reasoning Language Models Chain of Thought Mechanism for Digital Forensics
Chair for Cybersecurity, University of Augsburg, Augsburg, Germany(网络安全系,乌尔姆大学,乌尔姆,德国)
Learning to Solve Geometry Problems via Simulating Human Dual-Reasoning Process
University of Science and Technology of China(中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院);iFLYTEK AI Research(讯飞人工智能研究院);State Key Laboratory of Cognitive Intelligence(认知智能国家重点实验室)
DIRCR: Dual-Inference Rule-Contrastive Reasoning for Solving RAVENs
School of Computer Science, University of Nottingham Ningbo China, China(诺丁汉大学宁波校区计算机科学学院);Nottingham Ningbo China Beacons of Excellence Research and Innovation Institute, China(诺丁汉宁波中国卓越研究与创新研究所);School of Artificial Intelligence, Shenzhen University, China(深圳大学人工智能学院)
Optimus-3: Dual-Router Aligned Mixture-of-Experts Agent with Dual-Granularity Reasoning-Aware Policy Optimization
School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen Campus)(计算机科学与技术学院,哈尔滨工业大学(深圳校区));Pengcheng Laboratory(鹏城实验室);School of Information Science and Technology, Harbin Institute of Technology (Shenzhen Campus)(信息科学与技术学院,哈尔滨工业大学(深圳校区));Shenzhen Loop Area Institute(深圳河套学院)
Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learning
University of Massachusetts, Amherst(马萨诸塞大学阿默斯特分校);Carnegie Mellon University(卡内基梅隆大学);University of Texas at Austin(德克萨斯大学奥斯汀分校);Amazon Web Services(亚马逊网络服务)
DualVGR: A Dual-Visual Graph Reasoning Unit for Video Question Answering
Nanjing University of Posts and Telecommunications(南京邮电大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学)
Beyond Imitation: Learning Key Reasoning Steps from Dual Chain-of-Thoughts in Reasoning Distillation
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
VITAL: Visual-Semantic Dual Supervision for Enhanced and Interpretable Latent Reasoning in Medical MLLMs
Zhejiang University(浙江大学);Shanghai AI Laboratory(上海人工智能实验室);Tencent(腾讯);Ningbo Global Innovation Center, Zhejiang University(宁波全球创新中心,浙江大学);Zhejiang Key Laboratory of Digital-Intelligence Service Technology(浙江省数字智能服务技术重点实验室)
Incentivizing Dual Process Thinking for Efficient Large Language Model Reasoning
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);Department of Computer Science, National University of Singapore(新加坡国立大学计算机科学系);Ant Group(蚂蚁集团)
Relational Temporal Graph Reasoning for Dual-task Dialogue Language Understanding
Australian Artificial Intelligence Institute (AAII)(澳大利亚人工智能研究所);University of Technology Sydney(悉尼科技大学);Centre for Frontier AI Research, A*STAR(新加坡科技研究局前沿人工智能研究中心)
AudioRouter: Data Efficient Audio Understanding via RL based Dual Reasoning
University of California, Los Angeles(加利福尼亚大学洛杉矶分校);The University of Queensland(昆士兰大学);vivo Mobile Communication Co., Ltd.(维沃移动通信有限公司);University of California, Merced(加利福尼亚大学美熹德分校)