OptiTree: Hierarchical Thoughts Generation with Tree Search for LLM Optimization Modeling
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China(脑启发式感知与认知联合实验室,中国科学技术大学);Noah’s Ark Lab, Huawei Technologies(华为诺亚实验室);Tianjin University(天津大学)
Optimization modeling is one of the most crucial but technical parts of operations research (OR). To automate the modeling process, existing works have leveraged large language models (LLMs), prompting them to break down tasks into steps for generating variables, constraints, and objectives. However, due to the highly complex mathematical structures inherent in OR problems, standard fixed-step decomposition often fails to achieve high performance. To address this challenge, we introduce OptiTree, a novel tree search approach designed to enhance modeling capabilities for complex problems through adaptive problem decomposition into simpler subproblems. Specifically, we develop a modeling tree that organizes a wide range of OR problems based on their hierarchical problem taxonomy and complexity, with each node representing a problem category and containing relevant high-level modeling thoughts. Given a problem to model, we recurrently search the tree to identify a series of simpler subproblems and synthesize the global modeling thoughts by adaptively integrating the hierarchical thoughts. Experiments show that OptiTree significantly improves the modeling accuracy compared to the state-of-the-art, achieving over 10\% improvements on the challenging benchmarks. The code is released at https://github.com/MIRALab-USTC/OptiTree/tree/main.
HGOT: Hierarchical Graph of Thoughts for Retrieval-Augmented In-Context Learning in Factuality Evaluation
Smith School of Business, Queen’s University(女王大学史密斯商学院);Ingenuity Labs Research Institute, Queen’s University(女王大学 Ingenuity 实验室研究所);Department of Electrical and Computer Engineering, Queen’s University(女王大学电气与计算机工程系)
ReasonAlloc: Hierarchical Decoding-Time KV Cache Budget Allocation for Reasoning Models
Tsinghua University(清华大学);City University of Hong Kong(香港城市大学);Peking University(北京大学);Shenzhen University of Advanced Technology(深圳理工大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
EEG-VLM: A Hierarchical Vision-Language Model with Multi-Level Feature Alignment and Visually Enhanced Language-Guided Reasoning for EEG Image-Based Sleep Stage Prediction
School of Electronic and Electrical Engineering, Shanghai University of Engineering Science(上海工程技术大学电子与电气工程学院);Department of Control Science and Engineering, College of Electronics and Information Engineering, Tongji University(同济大学电子信息工程学院控制科学与工程系);Tencent Youtu Lab(腾讯云视觉实验室);Case Western Reserve University(凯斯西储大学)
HiPO: Hierarchical Preference Optimization for Adaptive Reasoning in LLMs
Vellore Institute of Technology(维洛雷理工学院);University of Massachusetts Amherst(马萨诸塞大学阿姆赫斯特分校);Northwestern University(西北大学);Yale University(耶鲁大学);Algoverse AI Research(Algoverse AI研究)
Tree-of-Mixed-Thought: Combining Fast and Slow Thinking for Multi-hop Visual Reasoning
University of Science and Technology of China(中国科学技术大学);cmss.chinamobile.com(中移(苏州)软件技术有限公司);Lin Gang Laboratory(林冈实验室);ShanghaiTech University(上海科技大学)
HTPO: Towards Exploration-Exploitation Balanced Policy Optimization via Hierarchical Token-level Objective Control
School of Information Science and Electronic Engineering, Shanghai Jiao Tong University(上海交通大学信息科学与电子工程学院);Xiaohongshu Inc.(小红书公司);MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University(上海交通大学人工智能研究院)
Hierarchical knowledge guided fault intensity diagnosis of complex industrial systems
School of Artificial Intelligence, Xidian University, Xian, China(西安电子科技大学人工智能学院);School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, China(香港科技大学(深圳)科学与工程学院);Frankfurt Institute for Advanced Studies, Frankfurt am Main, Germany(法兰克福高级研究院);Xidian-FIAS international Joint Research Center, Frankfurt am Main, Germany(西电-法兰克福国际联合研究中心);Institut für Theoretische Physik, Goethe Universität Frankfurt, Frankfurt am Main, Germany(法兰克福歌德大学理论物理研究所);GSI Helmholtzzentrum für Schwerionenforschung GmbH, Darmstadt, Germany(重离子研究中心(GSI));SAMSON AG, Frankfurt am Main, Germany(SAMSON公司)
Large Language Models are Few-shot Generators: Proposing Hybrid Prompt Algorithm To Generate Webshell Escape Samples
School of Cyber Science and Engineering(网络空间科学与工程学院);Huazhong University of Science and Technology(华中科技大学);School of Artificial Intelligence and Automation(人工智能与自动化学院)
SHERPA: A Model-Driven Framework for Large Language Model Execution
Electrical and Computer Engineering, McGill University, Canada(麦吉尔大学电气与计算机工程系);Department of Computer Science and Systems, University of Murcia, Spain(穆尔西亚大学计算机科学与系统系);Aggregate Intellect Inc., Canada(聚合智力公司)
An Agentic AI Framework with Large Language Models and Chain-of-Thought for UAV-Assisted Logistics Scheduling with Mobile Edge Computing
Nanyang Technological University(南洋理工大学);Singapore Institute of Technology(新加坡理工学院);Seatrium New Energy Laboratory(Seatrium 新能源实验室);Ministry of Education (MOE) Tier 1(教育部 Tier 1);Research Innovation and Enterprise (RIE) 2025 Industry Alignment Fund-Industry Collaboration Projects (IAF-ICP)(研究创新与企业 (RIE) 2025 行业对齐基金-行业合作项目 (IAF-ICP))