Planning is a fundamental task in artificial intelligence that involves finding a sequence of actions that achieve a specified goal in a given environment. Large language models (LLMs) are increasingly used for applications that require planning capabilities, such as web or embodied agents. In line with recent studies, we demonstrate through experimentation that LLMs lack necessary skills required for planning. Based on these observations, we advocate for the potential of a hybrid approach that combines LLMs with classical planning methodology. Then, we introduce SimPlan, a novel hybrid-method, and evaluate its performance in a new challenging setup. Our extensive experiments across various planning domains demonstrate that SimPlan significantly outperforms existing LLM-based planners.
LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Maryland, College Park(马里兰大学帕克分校);Nanyang Technological University(南洋理工大学);Purdue University(普渡大学);University of Illinois Chicago(芝加哥伊利诺伊大学)
Developing and evaluating a chatbot to support maternal health care
Carnegie Mellon University(卡内基梅隆大学);Population Council Institute(人口理事会研究所);Sitaram Bhartia Institute of Science and Research(西塔拉姆·巴提亚科学与研究研究所);Nivi, Inc.(Nivi公司)
Consolidating and Developing Benchmarking Datasets for the Nepali Natural Language Understanding Tasks
Information and Language Processing Research Lab (ILPRL)(信息与语言处理研究实验室);Kathmandu University(加德满都大学);Institute for Research and Innovation in Intelligent Systems (IRIIS)(智能系统研究与创新研究院)
Developing and Evaluating an AI-Assisted Prediction Model for Unplanned Intensive Care Admissions following Elective Neurosurgery using Natural Language Processing within an Electronic Healthcare Record System
University College London(伦敦大学学院);National Hospital for Neurology and Neurosurgery(国立神经学与神经外科医院)
Evaluating Generative Ad Hoc Information Retrieval
Leipzig University(莱比锡大学);The University of Queensland(昆士兰大学);Bauhaus-Universität Weimar(魏玛包豪斯大学);Friedrich-Schiller-Universität Jena(弗里德里希·席勒大学耶拿分校);University of Kassel(卡塞尔大学)