Solver-Independent Automated Problem Formulation via LLMs for High-Cost Simulation-Driven Design
School of Artificial Intelligence, Xidian University(西安电子科技大学人工智能学院);School of Engineering and Computer Science, Victoria University of Wellington(惠灵顿维多利亚大学工程与计算机科学学院);School of Engineering, Westlake University(西湖大学工学院)
Yuchen Li, Handing Wang, Bing Xue, Mengjie Zhang, Yaochu Jin
In the high-cost simulation-driven design domain, translating ambiguous design requirements into a mathematical optimization formulation is a bottleneck for optimizing product performance. This process is time-consuming and heavily reliant on expert knowledge. While large language models (LLMs) offer potential for automating this task, existing approaches either suffer from poor formalization that fails to accurately align with the design intent or rely on solver feedback for data filtering, which is unavailable due to the high simulation costs. To address this challenge, we propose APF, a framework for solver-independent, automated problem formulation via LLMs designed to automatically convert engineers' natural language requirements into executable optimization models. The core of this framework is an innovative pipeline for automatically generating high-quality data, which overcomes the difficulty of constructing suitable fine-tuning datasets in the absence of high-cost solver feedback with the help of data generation and test instance annotation. The generated high-quality dataset is used to perform supervised fine-tuning on LLMs, significantly enhancing their ability to generate accurate and executable optimization problem formulations. Experimental results on antenna design demonstrate that APF significantly outperforms the existing methods in both the accuracy of requirement formalization and the quality of resulting radiation efficiency curves in meeting the design goals.
LLMs as Adaptive Meta-Solvers: Strategy-Diverse RL for Industrial-Scale Optimization
Tokentide AI;Alibaba Group(阿里巴巴集团);East China Normal University(华东师范大学);Fudan University(复旦大学);The University of Hong Kong(香港大学);Shanghai Jiao Tong University(上海交通大学);Stanford University(斯坦福大学)
ExpNote: Black-box Large Language Models are Better Task Solvers with Experience Notebook
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
Know Your Limits : On the Faithfulness of LLMs as Solvers and Autoformalizers in Legal Reasoning
UC Santa Cruz(加州大学圣克鲁兹分校);Univ. Helsinki(赫尔辛基大学);CodeX, Stanford(斯坦福大学CodeX中心);Stanford University(斯坦福大学);Canyon Crest Academy(峡谷峰学院);Monta Vista High School(蒙塔维斯塔高中);Los Altos High School(洛斯阿尔托斯高中)
Say It Another Way: Auditing LLMs with a User-Grounded Automated Paraphrasing Framework
Mila - Quebec AI Institute(魁北克人工智能研究所);McGill University(麦吉尔大学);University of Waterloo(滑铁卢大学);Vector Institute(向量研究所);Université de Sherbrooke(舍布鲁克大学);Université de Montréal(蒙特利尔大学)
Offscript: Automated Auditing of Instruction Adherence in LLMs
University of Washington Information School Seattle Washington USA;University of Washington\ G. Allen School of Computer Science \& Engineering Seattle Washington USA;University of Washington Information School;University of Washington\ G. Allen School of Computer Science \& Engineering
Learning to Model Optimization Problems from Solver Outcomes
School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Rewarding Novel Deductions: Solver-guided Process Supervision for Logical Reasoning
Information Technology University(信息技术大学);Huazhong Agricultural University(华中农业大学);Qatar Computing Research Institute, Hamad Bin Khalifa University(卡塔尔计算研究所,哈马德·本·哈利法大学)
Using LLMs for Automated Privacy Policy Analysis: Prompt Engineering, Fine-Tuning and Explainability
School of Cyber Science and Engineering, Shanghai Jiao Tong University(上海交通大学网络安全科学与工程学院);Institute of Cyber Security for Society (iCSS), University of Kent(肯特大学社会网络安全研究所)
Towards Automated Fact-Checking of Real-World Claims: Exploring Task Formulation and Assessment with LLMs
Technische Universität Berlin(柏林工业大学);Deutsches Forschungszentrum für Künstliche Intelligenz(德国人工智能研究中心);National Institute of Informatics(信息学研究所);Harz University of Applied Sciences(哈尔茨应用技术大学)
FormuEvo: LLM-Guided Evolution for Discovering Solver-Efficient Mixed-Integer Programming Formulations
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);School of Computing and Information Systems, Singapore Management University(新加坡管理大学计算与信息系统学院);Tsinghua University(清华大学)