Recent large language models (LLMs) have demonstrated remarkable performance on a variety of natural language processing (NLP) tasks, leading to intense excitement about their applicability across various domains. Unfortunately, recent work has also shown that LLMs are unable to perform accurate reasoning nor solve planning problems, which may limit their usefulness for robotics-related tasks. In this work, our central question is whether LLMs are able to translate goals specified in natural language to a structured planning language. If so, LLM can act as a natural interface between the planner and human users; the translated goal can be handed to domain-independent AI planners that are very effective at planning. Our empirical results on GPT 3.5 variants show that LLMs are much better suited towards translation rather than planning. We find that LLMs are able to leverage commonsense knowledge and reasoning to furnish missing details from under-specified goals (as is often the case in natural language). However, our experiments also reveal that LLMs can fail to generate goals in tasks that involve numerical or physical (e.g., spatial) reasoning, and that LLMs are sensitive to the prompts used. As such, these models are promising for translation to structured planning languages, but care should be taken in their use.
Personalized Learning Path Planning with Goal-Driven Learner State Modeling
Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology(计算机科学与技术系,信息科学国家研究中心);Tsinghua University(清华大学);Institution of Education(教育研究所);Department of Statistics and Data Science(统计与数据科学系)
Context Matters! Relaxing Goals with LLMs for Feasible 3D Scene Planning
Department of Computer, Automation and Management Engineering, Sapienza University of Rome(Sapienza大学计算机、自动化与管理工程系);Department of Electronics and Automation, Mohamed Khider University of Biskra(Mohamed Khider大学电子与自动化系);International University of Rome UNINT, Rome(罗马国际大学UNINT)
Beyond Trajectory Similarity: Evaluating Surgical Planning by Protocol Adherence
Technical University of Munich, Germany(慕尼黑技术大学);University of Strasbourg, France(斯特拉斯堡大学);University of Glasgow, United Kingdom(格拉斯哥大学);Nanyang Technological University, Singapore(南洋理工大学);University of Massachusetts Boston, USA(马萨诸塞大学波士顿分校)