The paper studies sequential reasoning over graph-structured data, which stands as a fundamental task in various trending fields like automated math problem solving and neural graph algorithm learning, attracting a lot of research interest. Simultaneously managing both sequential and graph-structured information in such tasks presents a notable challenge. Over recent years, many neural architectures in the literature have emerged to tackle the issue. In this work, we generalize the existing architectures and propose a context-enhanced framework. The crucial innovation is that the reasoning of each step does not only rely on the outcome of the preceding step but also leverages the aggregation of information from more historical outcomes. The idea stems from our observation that in sequential graph reasoning, each step's outcome has a much stronger inner connection with each other compared to traditional seq-to-seq tasks. We show that the framework can effectively integrate with the existing methods, enhancing their reasoning abilities. Empirical evaluations are conducted on the challenging CLRS Reasoning Benchmark, and the results demonstrate that the proposed framework significantly improves the performance of existing architectures, yielding state-of-the-art results across the majority of the datasets within the benchmark.
Toward AI-Friendly Cartography: Understanding How Color Design Influences Foundation Model Spatial Reasoning on Sequential Choropleth Maps
School of Geographic Sciences, Hunan Normal University(湖南师范大学地理科学学院);Hunan Key Laboratory of Geospatial Big Data Mining and Application(湖南省地理空间大数据挖掘与应用重点实验室);School of Information and Communication Engineering, Beijing University of Posts and Telecommunications(北京邮电大学信息与通信工程学院);School of Geography and Information Engineering, China University of Geosciences(中国地质大学(武汉)地理与信息工程学院);Advanced Interdisciplinary Institute of Satellite Applications, State Key Laboratory of Earth Surface Processes and Resource Ecology, Faculty of Geographical Science, Beijing Normal University(北京师范大学地理科学学部卫星应用先进交叉研究院、地表过程与资源生态国家重点实验室)
Thinking with Gaze: Sequential Eye-Tracking as Visual Reasoning Supervision for Medical VLMs
School of Computing, University of Georgia(佐治亚大学计算机学院);Department of Computer Science and Engineering, University of Texas, Arlington(德克萨斯大学阿灵顿分校计算机科学与工程系);Massachusetts General Hospital, Harvard Medical School(麻省总医院哈佛医学院);Department of Biomedical Engineering, New Jersey Institute of Technology(新泽西理工学院生物医学工程系)
TrajGEOS: Trajectory Graph Enhanced Orientation-based Sequential Network for Mobility Prediction
Shanghai Jiao Tong University(上海交通大学);Shanghai Transportation Information Center(上海市交通信息中心);Shanghai Urban-Rural Construction and Transportation Development Research Institute(上海城乡建设和交通发展研究院)
Dynamic Hypergraph-Enhanced Prediction of Sequential Medical Visits
University of Southern California(南加州大学);University of California, Berkeley(加利福尼亚大学伯克利分校);Texas Tech University(德克萨斯理工大学);Southern Methodist University(南卫理公会大学)
DisenReason: Behavior Disentanglement and Latent Reasoning for Shared-Account Sequential Recommendation
School of Big Data and Software Engineering(大数据与软件工程学院);College of Computer Science and Engineering(计算机科学与工程学院);School of Computing and Mathematical Sciences(计算与数学科学学院);Department of Plastic Surgery(整形外科部门);College of Environmental Science and Engineering(环境科学与工程学院)
ViSA-Enhanced Aerial VLN: A Visual-Spatial Reasoning Enhanced Framework for Aerial Vision-Language Navigation
Tianmushan Laboratory, Beihang University(北航之梦实验室,北京航空航天大学);Hangzhou International Innovation Institute, Beihang University(杭州国际创新研究院,北京航空航天大学);Foshan Graduate School of Innovation, Northeastern University(佛山创新研究生学院,东北大学);School of Aeronautic Science and Engineering, Beihang University(航空科学与工程学院,北京航空航天大学);Faculty of Robot Science and Engineering, Northeastern University(机器人科学与工程学院,东北大学)
The Perceptual Bandwidth Bottleneck in Vision-Language Models: Active Visual Reasoning via Sequential Experimental Design
The Hong Kong University of Science(香港科学与技术大学);University College London, London, United Kingdom(伦敦大学学院, 英国伦敦);ShanghaiTech University, Shanghai, China(上海科技大学, 中国上海);AI Lab, The Yangtze River Delta, China(人工智能实验室, 长江三角洲, 中国)
Do Latent-CoT Models Think Step-by-Step? A Mechanistic Study on Sequential Reasoning Tasks
Institute for Computational and Mathematical Engineering, Stanford University, Stanford, USA(计算与数学工程研究所,斯坦福大学);MOE Key Lab of Computational Linguistics, Peking University, Beijing, China(教育部计算语言学重点实验室,北京大学);Beijing Academy of Artificial Intelligence, Beijing, China(北京人工智能研究院)
GOT4Rec: Graph of Thoughts for Sequential Recommendation
NLPR, MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)