大模型推理能力 - arXivDaily 专题

2412.11621 2024-12-17 cs.CV cs.MM 82%

VG-TVP: Multimodal Procedural Planning via Visually Grounded Text-Video Prompting

Muhammet Furkan Ilaslan, Ali Koksal, Kevin Qinhong Lin, Burak Satar, Mike Zheng Shou, Qianli Xu

专题命中规划推理：planning(title,abstract)；reasoning(abstract)

Comments Accepted for The 39th Annual AAAI Conference on Artificial Intelligence 2025 in Main Track, 19 pages, 24 figures

2401.05577 2024-11-26 cs.CV 82%

VLP: Vision Language Planning for Autonomous Driving

Chenbin Pan, Burhaneddin Yaman, Tommaso Nesti, Abhirup Mallik, Alessandro G Allievi, Senem Velipasalar, Liu Ren

专题命中规划推理：planning(title,abstract)；reasoning(abstract)

Comments CVPR2024

Journal ref CVPR2024

2411.09971 2024-11-18 cs.CV cs.RO 82%

Explanation for Trajectory Planning using Multi-modal Large Language Model for Autonomous Driving

Shota Yamazaki, Chenyu Zhang, Takuya Nanri, Akio Shigekane, Siyuan Wang, Jo Nishiyama, Tao Chu, Kohei Yokosawa

专题命中规划推理：planning(title,abstract)；reasoning(abstract)

Comments Accepted and presented at ECCV 2024 2nd Workshop on Vision-Centric Autonomous Driving (VCAD) on September 30, 2024. 13 pages, 5 figures

2411.05212 2024-11-11 cs.RO 82%

RT-Grasp: Reasoning Tuning Robotic Grasping via Multi-modal Large Language Model

Jinxuan Xu, Shiyu Jin, Yutian Lei, Yuqian Zhang, Liangjun Zhang

专题命中规划推理：reasoning(title,abstract)；planning(abstract)

Comments Accepted to IROS 2024

2408.12036 2024-11-04 cs.LG cs.AI cs.CL cs.IR 82%

Reasoning and Tools for Human-Level Forecasting

Elvis Hsieh, Preston Fu, Jonathan Chen

专题命中规划推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2410.19727 2024-10-28 cs.AI cs.CL cs.IR cs.LG 82%

FISHNET: Financial Intelligence from Sub-querying, Harmonizing, Neural-Conditioning, Expert Swarms, and Task Planning

Nicole Cho, Nishan Srishankar, Lucas Cecchi, William Watson

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at the 5th ACM International Conference on AI in Finance (ICAIF '24)

2410.00371 2024-10-02 cs.RO 82%

AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulation

Jiafei Duan, Wilbert Pumacay, Nishanth Kumar, Yi Ru Wang, Shulin Tian, Wentao Yuan, Ranjay Krishna, Dieter Fox, Ajay Mandlekar, Yijie Guo

专题命中规划推理：reasoning(title,abstract)；planning(abstract)

Comments Appendix and details can be found in project website: https://aha-vlm.github.io/

2410.00079 2024-10-02 cs.MA cs.AI cs.CL cs.HC cs.LG 82%

Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interface

Wenyue Hua, Mengting Wan, Shashank Vadrevu, Ryan Nadel, Yongfeng Zhang, Chi Wang

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 27 pages, 22 figures

2409.20557 2024-10-01 cs.CV 82%

Propose, Assess, Search: Harnessing LLMs for Goal-Oriented Planning in Instructional Videos

Md Mohaiminul Islam, Tushar Nagarajan, Huiyu Wang, Fu-Jen Chu, Kris Kitani, Gedas Bertasius, Xitong Yang

专题命中规划推理：planning(title,abstract)；reasoning(abstract)

Comments Accepted by ECCV 2024 (Oral)

2409.09513 2024-09-17 cs.LG cs.AI cs.CL 82%

Planning Transformer: Long-Horizon Offline Reinforcement Learning with Planning Tokens

Joseph Clinton, Robert Lieck

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 11 pages, 5 figures, Submitted to AAAI

2408.07531 2024-08-28 cs.AI cs.CL cs.LG 82%

Development of a Large Language Model-based Multi-Agent Clinical Decision Support System for Korean Triage and Acuity Scale (KTAS)-Based Triage and Treatment Planning in Emergency Departments

Seungjun Han, Wongyung Choi

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2306.09237 2024-08-22 cs.CL cs.AI cs.LG 82%

One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Support

Ronja Stern, Vishvaksenan Rasiah, Veton Matoshi, Srinanda Brügger Bose, Matthias Stürmer, Ilias Chalkidis, Daniel E. Ho, Joel Niklaus

专题命中规划推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2404.04929 2024-07-31 cs.RO 82%

RoboMP$^2$: A Robotic Multimodal Perception-Planning Framework with Multimodal Large Language Models

Qi Lv, Hao Li, Xiang Deng, Rui Shao, Michael Yu Wang, Liqiang Nie

专题命中规划推理：planning(title,abstract)；reasoning(abstract)

Comments Accepted by ICML 2024; Project page: https://aopolin-lv.github.io/RoboMP2.github.io/

Journal ref Proceedings of the 41st International Conference on Machine Learning, PMLR 235:33558-33574, 2024

2310.08582 2024-07-25 cs.CL cs.AI cs.LG cs.RO 82%

Tree-Planner: Efficient Close-loop Task Planning with Large Language Models

Mengkang Hu, Yao Mu, Xinmiao Yu, Mingyu Ding, Shiguang Wu, Wenqi Shao, Qiguang Chen, Bin Wang, Yu Qiao, Ping Luo

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published in ICLR 2024

2402.06559 2024-07-18 cs.LG cs.AI cs.CL cs.RO 82%

Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following

Brian Yang, Huangyuan Su, Nikolaos Gkanatsios, Tsung-Wei Ke, Ayush Jain, Jeff Schneider, Katerina Fragkiadaki

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2309.15091 2024-07-16 cs.CV cs.AI cs.CL cs.LG 82%

VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planning

Han Lin, Abhay Zala, Jaemin Cho, Mohit Bansal

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments COLM 2024; Project page: https://videodirectorgpt.github.io

2309.05660 2024-06-03 cs.LG cs.AI cs.CL 82%

Hypothesis Search: Inductive Reasoning with Language Models

Ruocheng Wang, Eric Zelikman, Gabriel Poesia, Yewen Pu, Nick Haber, Noah D. Goodman

专题命中规划推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICLR 2024. The first two authors contributed equally. Code: https://github.com/Relento/hypothesis_search

2401.05268 2024-05-28 cs.CL cs.AI cs.HC cs.LG cs.MA 82%

AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning

Shuofei Qiao, Ningyu Zhang, Runnan Fang, Yujie Luo, Wangchunshu Zhou, Yuchen Eleanor Jiang, Chengfei Lv, Huajun Chen

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL 2024

2404.18374 2024-04-30 cs.RO 82%

Trajectory Optimization for Adaptive Informative Path Planning with Multimodal Sensing

Joshua Ott, Edward Balaban, Mykel Kochenderfer

专题命中规划推理：planning(title,abstract)；reasoning(abstract)

Comments IEEE International Conference on Control, Decision and Information Technologies

2404.16163 2024-04-26 cs.RO cs.FL 82%

The Trembling-Hand Problem for LTLf Planning

Pian Yu, Shufang Zhu, Giuseppe De Giacomo, Marta Kwiatkowska, Moshe Vardi

专题命中规划推理：planning(title,abstract)；reasoning(abstract)

Comments The paper is accepted by IJCAI 2024

2309.12089 2024-04-09 cs.RO 82%

HiCRISP: An LLM-based Hierarchical Closed-Loop Robotic Intelligent Self-Correction Planner

Chenlin Ming, Jiacheng Lin, Pangkit Fong, Han Wang, Xiaoming Duan, Jianping He

专题命中规划推理：self-correction(title,abstract)；planning(abstract)

2303.01619 2024-04-02 cs.RO cs.MA 82%

Conflict-Based Model Predictive Control for Scalable Multi-Robot Motion Planning

Ardalan Tajbakhsh, Lorenz T. Biegler, Aaron M. Johnson

专题命中规划推理：planning(title,abstract)；reasoning(abstract)

2402.17930 2024-02-29 cs.AI cs.CL cs.LG 82%

Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning

Tan Zhi-Xuan, Lance Ying, Vikash Mansinghka, Joshua B. Tenenbaum

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to AAMAS 2024. 8 pages (excl. references), 5 figures/tables. (Appendix: 8 pages, 8 figures/tables). Code available at: https://github.com/probcomp/CLIPS.jl

2307.12856 2024-02-27 cs.LG cs.AI cs.CL 82%

A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis

Izzeddin Gur, Hiroki Furuta, Austin Huang, Mustafa Safdari, Yutaka Matsuo, Douglas Eck, Aleksandra Faust

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ICLR 2024 (Oral)

2402.02716 2024-02-08 cs.AI cs.CL cs.LG 82%

Understanding the planning of LLM agents: A survey

Xu Huang, Weiwen Liu, Xiaolong Chen, Xingmei Wang, Hao Wang, Defu Lian, Yasheng Wang, Ruiming Tang, Enhong Chen

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 pages, 2 tables, 2 figures

2402.03610 2024-02-07 cs.LG cs.AI cs.CL 82%

RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agents

Tomoyuki Kagaya, Thong Jing Yuan, Yuxuan Lou, Jayashree Karlekar, Sugiri Pranata, Akira Kinose, Koki Oguri, Felix Wick, Yang You

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2402.00251 2024-02-02 cs.LG cs.AI cs.CL 82%

Efficient Non-Parametric Uncertainty Quantification for Black-Box Large Language Models and Decision Planning

Yao-Hung Hubert Tsai, Walter Talbott, Jian Zhang

专题命中规划推理：planning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2310.20034 2023-11-01 cs.RO 82%

GG-LLM: Geometrically Grounding Large Language Models for Zero-shot Human Activity Forecasting in Human-Aware Task Planning

Moritz A. Graule, Volkan Isler

专题命中规划推理：planning(title,abstract)；reasoning(abstract)

2305.14078 2023-10-31 cs.RO 82%

Large Language Models as Commonsense Knowledge for Large-Scale Task Planning

Zirui Zhao, Wee Sun Lee, David Hsu

专题命中规划推理：planning(title,abstract)；reasoning(abstract)

Comments In Proceedings of NeurIPS 2023

2305.00633 2023-10-27 cs.CL cs.AI cs.LG 82%

Self-Evaluation Guided Beam Search for Reasoning

Yuxi Xie, Kenji Kawaguchi, Yiran Zhao, Xu Zhao, Min-Yen Kan, Junxian He, Qizhe Xie

专题命中规划推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NeurIPS 2023. 10 pages, 7 figures, 4 tables (33 pages, 14 figures, 15 tables including references and appendices)

1. 规划推理 11120 篇

VG-TVP: Multimodal Procedural Planning via Visually Grounded Text-Video Prompting

VLP: Vision Language Planning for Autonomous Driving

Explanation for Trajectory Planning using Multi-modal Large Language Model for Autonomous Driving

RT-Grasp: Reasoning Tuning Robotic Grasping via Multi-modal Large Language Model

Reasoning and Tools for Human-Level Forecasting

FISHNET: Financial Intelligence from Sub-querying, Harmonizing, Neural-Conditioning, Expert Swarms, and Task Planning

AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulation

Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interface

Propose, Assess, Search: Harnessing LLMs for Goal-Oriented Planning in Instructional Videos

Planning Transformer: Long-Horizon Offline Reinforcement Learning with Planning Tokens

Development of a Large Language Model-based Multi-Agent Clinical Decision Support System for Korean Triage and Acuity Scale (KTAS)-Based Triage and Treatment Planning in Emergency Departments

One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Support

RoboMP$^2$: A Robotic Multimodal Perception-Planning Framework with Multimodal Large Language Models

Tree-Planner: Efficient Close-loop Task Planning with Large Language Models

Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following

VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planning

Hypothesis Search: Inductive Reasoning with Language Models

AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning

Trajectory Optimization for Adaptive Informative Path Planning with Multimodal Sensing

The Trembling-Hand Problem for LTLf Planning

HiCRISP: An LLM-based Hierarchical Closed-Loop Robotic Intelligent Self-Correction Planner

Conflict-Based Model Predictive Control for Scalable Multi-Robot Motion Planning

Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning

A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis

Understanding the planning of LLM agents: A survey

RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agents

Efficient Non-Parametric Uncertainty Quantification for Black-Box Large Language Models and Decision Planning

GG-LLM: Geometrically Grounding Large Language Models for Zero-shot Human Activity Forecasting in Human-Aware Task Planning

Large Language Models as Commonsense Knowledge for Large-Scale Task Planning

Self-Evaluation Guided Beam Search for Reasoning