大模型推理能力

PhysPatch: A Physically Realizable and Transferable Adversarial Patch Attack for Multimodal Large Language Models-based Autonomous Driving Systems

Qi Guo, Xiaojun Jia, Shanmin Pang, Simeng Qin, Lin Wang, Ju Jia, Yang Liu, Qing Guo

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

OS Agents: A Survey on MLLM-based Agents for General Computing Devices Use

Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu

机构 * Zhejiang University（浙江大学） ； Fudan University（复旦大学） ； OPPO AI Center（OPPO AI中心） ； University of Chinese Academy of Sciences（中国科学院大学） ； Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所） ； The Chinese University of Hong Kong（香港中文大学） ； Tsinghua University（清华大学） ； Shanghai Jiao Tong University（上海交通大学） ； The Hong Kong Polytechnic University（香港理工大学） 纠错

专题命中 规划推理 ：planning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL 2025 (Oral)

Robot builds a robot's brain: AI generated drone command and control station hosted in the sky

Peter Burke

机构 * Department of Electrical Engineering and Computer Science, University of California, Irvine（电气工程与计算机科学系，加州大学伊文斯顿分校） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Eyes Will Shut: A Vision-Based Next GPS Location Prediction Model by Reinforcement Learning from Visual Map Feed Back

Ruixing Zhang, Yang Zhang, Tongyu Zhu, Leilei Sun, Weifeng Lv

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Natural Language Interaction with a Household Electricity Knowledge-based Digital Twin

Carolina Fortuna, Vid Hanžel, Blaž Bertalanič

机构 * 1 Department of Communication Systems, Jo z ef Stefan Institute, Slovenia ； Jozef Stefan Institute, Ljubljana, Slovenia 纠错

专题命中 规划推理 ：planning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at IEEE SmartGridComm'24

The Multi-Agent Fault Localization System Based on Monte Carlo Tree Search Approach

Rui Ren

专题命中 规划推理 ：reasoning(abstract)；chain-of-thought(abstract)

The pitfalls of next-token prediction

Gregor Bachmann, Vaishnavh Nagarajan

机构 * ETH Zürich, Switzerland（苏黎世联邦理工学院） ； Google Research, US（谷歌研究院） 纠错

专题命中 规划推理 ：planning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICML 2024

Integration of Large Language Models within Cognitive Architectures for Autonomous Robots

Miguel Á. González-Santamarta, Irene González-Fernández, Francisco J. Rodríguez-Lera, Ángel Manuel Guerrero-Higueras, Vicente Matellán-Olivera

机构 * University of León（莱昂大学） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Comments 9 pages, 6 figures, 2 tables, Submitted to ROBOT 2025 (8th Iberian Robotics Conference)

Agentic Reinforced Policy Optimization

Guanting Dong, Hangyu Mao, Kai Ma, Licheng Bao, Yifei Chen, Zhongyuan Wang, Zhongxia Chen, Jiazhen Du, Huiyang Wang, Fuzheng Zhang, Guorui Zhou, Yutao Zhu, Ji-Rong Wen, Zhicheng Dou

机构 * Renmin University of China（中国人民大学） ； Kuaishou Technology（快手科技） 纠错

专题命中 规划推理 ：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Working on progress

ADAgent: LLM Agent for Alzheimer's Disease Analysis with Collaborative Coordinator

Wenlong Hou, Guangqian Yang, Ye Du, Yeung Lau, Lihao Liu, Junjun He, Ling Long, Shujun Wang

机构 * 1 Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China 2 Amazon, USA 3 Shanghai Artificial Intelligence Laboratory, China 4 Department of Geriatrics, Third Affiliated Hospital of Sun Yat-sen University, China 5 Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong SAR, China 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

VLM-UDMC: VLM-Enhanced Unified Decision-Making and Motion Control for Urban Autonomous Driving

Haichao Liu, Haoren Guo, Pei Liu, Benshan Ma, Yuxiang Zhang, Jun Ma, Tong Heng Lee

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州）） ； National University of Singapore（新加坡国立大学） ； The Hong Kong University of Science and Technology（香港科学与技术大学） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Comments 14 pages, 12 figures

LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead

Junda He, Christoph Treude, David Lo

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Comments TOSEM 2030 Special Issue

A Comprehensive Survey of Electronic Health Record Modeling: From Deep Learning Approaches to Large Language Models

Weijieying Ren, Jingxi Zhu, Zehao Liu, Tianxiang Zhao, Vasant Honavar

机构 * Information Sciences and Technology, The Pennsylvania State University（信息科学与技术系，宾夕法尼亚州立大学） 纠错

专题命中 规划推理 ：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Foresight in Motion: Reinforcing Trajectory Prediction with Reward Heuristics

Muleilan Pei, Shaoshuai Shi, Xuesong Chen, Xu Liu, Shaojie Shen

机构 * HKUST（香港科技大学） ； Voyager Research, Didi Chuxing（维嘉尔研究，滴滴出行） ； Zhuoyu Technology（筑宇科技） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Comments Accepted by ICCV 2025

STEP Planner: Constructing cross-hierarchical subgoal tree as an embodied long-horizon task planner

Tianxing Zhou, Zhirui Wang, Haojia Ao, Guangyan Chen, Boyang Xing, Jingwen Cheng, Yi Yang, Yufeng Yue

机构 * School of Automation, Beijing Institute of Technology, Beijing, 100081, China（自动化学院，北京理工大学，北京） ； Beijing Zhongguancun Academy, Beijing, 100094, China（中关村学院，北京，北京） ； Humanoid Robot (Shanghai) Co., Ltd., Shanghai, 200093, China（人形机器人（上海）有限公司，上海） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

LVLM-MPC Collaboration for Autonomous Driving: A Safety-Aware and Task-Scalable Control Architecture

Kazuki Atsuta, Kohei Honda, Hiroyuki Okuda, Tatsuya Suzuki

机构 * Department of Mechanical Systems Engineering（机械系统工程系） ； Nagoya University（名古屋大学） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Comments 8 pages, 8 figures

Foundation Model Driven Robotics: A Comprehensive Review

Muhammad Tayyab Khan, Ammar Waheed

机构 * School of Mechanical and Aerospace Engineering, Nanyang Technological University（南洋理工大学机械与航空航天工程学院） ； J. Mike Walker ’66 Department of Mechanical Engineering, Texas A&M University（德克萨斯农工大学J. Mike Walker ’66机械工程系） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Structured Task Solving via Modular Embodied Intelligence: A Case Study on Rubik's Cube

Chongshan Fan, Shenghai Yuan

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

"Hi AirStar, Guide Me to the Badminton Court."

Ziqin Wang, Jinyu Chen, Xiangyi Zheng, Qinan Liao, Linjiang Huang, Si Liu

机构 * Beihang University（北京航空航天大学） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

PAVLM: Advancing Point Cloud based Affordance Understanding Via Vision-Language Model

Shang-Ching Liu, Van Nhiem Tran, Wenkai Chen, Wei-Lun Cheng, Yen-Lin Huang, I-Bin Liao, Yung-Hui Li, Jianwei Zhang

机构 * Technical Aspects of Multimodal Systems (TAMS), Department of Informatics, University of Hamburg（汉堡大学信息学院多模态系统技术部门） ； Hon Hai Research Institute (HHRI)（鸿海研究机构） ； Department of Electrical Engineering, National Taiwan University（台湾大学电子工程系） ； Department of Computer Science and Technology, National Tsinghua University（清华大学计算机科学与技术系） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

FaSTA$^*$: Fast-Slow Toolpath Agent with Subroutine Mining for Efficient Multi-turn Image Editing

Advait Gupta, Rishie Raj, Dang Nguyen, Tianyi Zhou

机构 * University of Maryland, College Park（马里兰大学 College Park分校） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent

Yunlong Lin, Zixu Lin, Kunjie Lin, Jinbin Bai, Panwang Pan, Chenxin Li, Haoyu Chen, Zhongdao Wang, Xinghao Ding, Wenbo Li, Shuicheng Yan

机构 * Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University（中国教育部多媒体可信感知与高效计算重点实验室，厦门大学） ； The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） ； The Chinese University of Hong Kong（香港中文大学） ； Bytedance（字节跳动） ； National University of Singapore（新加坡国立大学） ； Tsinghua University（清华大学） 纠错

专题命中 规划推理 ：reasoning(abstract)；chain-of-thought(abstract)

Comments 40 pages, 26 figures

YOLO-MARL: You Only LLM Once for Multi-Agent Reinforcement Learning

Yuan Zhuang, Yi Shen, Zhili Zhang, Yuxiao Chen, Fei Miao

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Comments accepted to International Conference on Intelligent Robots and Systems (IROS2025)

Towards the Autonomous Optimization of Urban Logistics: Training Generative AI with Scientific Tools via Agentic Digital Twins and Model Context Protocol

Haowen Xu, Yulin Sun, Jose Tupayachi, Olufemi Omitaomu, Sisi Zlatanova, Xueping Li

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Prompting with the Future: Open-World Model Predictive Control with Interactive Digital Twins

Chuanruo Ning, Kuan Fang, Wei-Chiu Ma

机构 * Cornell University（康奈尔大学） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Multimodal Large Language Models-Enabled UAV Swarm: Towards Efficient and Intelligent Autonomous Aerial Systems

Yuqi Ping, Tianhao Liang, Huahao Ding, Guangyu Lei, Junwei Wu, Xuan Zou, Kuan Shi, Rui Shao, Chiya Zhang, Weizheng Zhang, Weijie Yuan, Tingting Zhang

机构 * College of Informatics, Harbin Institute of Technology（信息学院，哈尔滨工业大学） ； Key Laboratory of Forest and Grassland Fire Risk Prevention, Ministry of Emergency Management, China Fire and Rescue Institute（森林和草原火灾风险预防重点实验室，应急管理部，中国消防救援学院） ； Southern University of Science and Technology（南方科技大学） 纠错

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Comments 8 pages, 5 figures,submitted to IEEE wcm

PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts

Ming Zhang, Yuhui Wang, Yujiong Shen, Tingyi Yang, Changhao Jiang, Yilong Wu, Shihan Dou, Qinhao Chen, Zhiheng Xi, Zhihao Zhang, Yi Dong, Zhen Wang, Zhihui Fei, Mingyang Wan, Tao Liang, Guojun Ma, Qi Zhang, Tao Gui, Xuanjing Huang

机构 * College of Computer Science and Artificial Intelligence, Fudan University（复旦大学计算机科学与人工智能学院） ； Douyin Co., Ltd.（抖音公司） ； Institute of Modern Languages and Linguistics, Fudan University（复旦大学现代语言与语言学研究所） ； Institute of Trustworthy Embodied Artificial Intelligence, Fudan University（复旦大学可信具身人工智能研究所） ； Graduate School of Arts and Sciences, Columbia University（哥伦比亚大学艺术与科学院） 纠错

专题命中 规划推理 ：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

CheMatAgent: Enhancing LLMs for Chemistry and Materials Science through Tree-Search Based Tool Learning

Mengsong Wu, YaFei Wang, Yidong Ming, Yuqi An, Yuwei Wan, Wenliang Chen, Binbin Lin, Yuqiang Li, Tong Xie, Dongzhan Zhou

机构 * Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； Soochow University（苏州大学） ； Zhejiang University（浙江大学） ； City University of Hong Kong（香港城市大学） 纠错

专题命中 规划推理 ：planning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 15 pages, 6 figures

Accelerating Causal Network Discovery of Alzheimer Disease Biomarkers via Scientific Literature-based Retrieval Augmented Generation

Xiaofan Zhou, Liangjie Huang, Pinyang Cheng, Wenpen Yin, Rui Zhang, Wenrui Hao, Lu Cheng

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)

Comments 9 pages, under review

Towards Action Hijacking of Large Language Model-based Agent

Yuyang Zhang, Kangjie Chen, Jiaxin Gao, Ronghao Cui, Run Wang, Lina Wang, Tianwei Zhang

专题命中 规划推理 ：reasoning(abstract)；planning(abstract)