Designing solutions for complex engineering challenges is crucial in human production activities. However, previous research in the retrieval-augmented generation (RAG) field has not sufficiently addressed tasks related to the design of complex engineering solutions. To fill this gap, we introduce a new benchmark, SolutionBench, to evaluate a system's ability to generate complete and feasible solutions for engineering problems with multiple complex constraints. To further advance the design of complex engineering solutions, we propose a novel system, SolutionRAG, that leverages the tree-based exploration and bi-point thinking mechanism to generate reliable solutions. Extensive experimental results demonstrate that SolutionRAG achieves state-of-the-art (SOTA) performance on the SolutionBench, highlighting its potential to enhance the automation and reliability of complex engineering solution design in real-world applications.
Exploring the System 1 Thinking Capability of Large Reasoning Models
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);Tongyi Lab, Alibaba Group(阿里巴巴集团通义实验室)
Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学);Zhongguancun Academy(中关村学院);Shenzhen Loop Area Institute(深圳河套学院)
Step Back to Leap Forward: Self-Backtracking for Boosting Reasoning of Language Models
Nanjing University(南京大学);National Key Laboratory for Novel Software Technology(现代软件工程国家重点实验室);School of Artificial Intelligence, Nanjing University(南京大学人工智能学院);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院)
Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Models
Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所);Microsoft(微软);Pennsylvania State University(宾夕法尼亚州立大学);Saarland Informatics Campus, Saarland University(萨尔大学萨尔信息学园区)
Comparing Exploration-Exploitation Strategies of LLMs and Humans: Insights from Standard Multi-armed Bandit Experiments
Department of Mechanical & Industrial Engineering, University of Toronto(机械与工业工程系,多伦多大学);The Rotman School of Management, University of Toronto(罗特曼管理学院,多伦多大学);Department of Psychiatry, University of Toronto(精神病学系,多伦多大学)
Boosting Efficiency in Task-Agnostic Exploration through Causal Knowledge
Department of Computer Science and Engineering, Shanghai Jiao Tong University(上海交通大学计算机科学与工程系);Halicioğlu Data Science Institute (HDSI), University of California San Diego(加州大学圣迭戈分校哈利乔格鲁数据科学研究所);Guangdong Institute of Intelligence Science and Technology(广东省智能科学与技术研究院)
Thinking Before Running! Efficient Code Generation with Thorough Exploration and Optimal Refinement
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);Moonshot AI;Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Electronic Science and Technology of China(电子科技大学);School of Artifcial Intelligence, Wuhan University(武汉大学人工智能学院);Engineering Research Center of Next-Generation Intelligent Search and Recommendation, MoE(下一代智能搜索与推荐工程技术研究中心)
Boosting Universal LLM Reward Design through Heuristic Reward Observation Space Evolution
Center on Frontiers of Computing Studies, School of Computer Science, Peking University(北京大学计算机学院计算前沿研究中心);PKU-Agibot Lab, School of Computer Science, Peking University(北京大学计算机学院PKU-Agibot实验室);National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University(北京大学计算机学院多媒体信息处理国家重点实验室);School of Automation, Southeast University(东南大学自动化学院)
Renmin University of China(中国人民大学);Department of Statistics and Data Science, Tsinghua University(清华大学统计与数据科学系);School of Computer Science and Engineering, UESTC(UESTC计算机科学与工程学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);School of Mathematical Sciences, Nankai University(南开大学数学科学学院);Whiting School, Johns Hopkins University(约翰斯·霍普金斯大学惠特林学院);School of Artificial Intelligence, Shanghai Jiaotong University(上海交通大学人工智能学院)