Dalian University of Technology（大连理工大学）；University of Victoria（维多利亚大学）；Southern University of Science and Technology（南方科技大学）；National Center for Applied Mathematics Shenzhen（深圳国家应用数学中心）；Peng Cheng Laboratory（鹏城实验室）；The Hong Kong Polytechnic University（香港理工大学）
Risheng Liu, Xuan Liu, Shangzhi Zeng, Jin Zhang, Yixuan Zhang
In recent years, by utilizing optimization techniques to formulate the propagation of deep model, a variety of so-called Optimization-Derived Learning (ODL) approaches have been proposed to address diverse learning and vision tasks. Although having achieved relatively satisfying practical performance, there still exist fundamental issues in existing ODL methods. In particular, current ODL methods tend to consider model construction and learning as two separate phases, and thus fail to formulate their underlying coupling and depending relationship. In this work, we first establish a new framework, named Hierarchical ODL (HODL), to simultaneously investigate the intrinsic behaviors of optimization-derived model construction and its corresponding learning process. Then we rigorously prove the joint convergence of these two sub-tasks, from the perspectives of both approximation quality and stationary analysis. To our best knowledge, this is the first theoretical guarantee for these two coupled ODL components: optimization and learning. We further demonstrate the flexibility of our framework by applying HODL to challenging learning tasks, which have not been properly addressed by existing ODL methods. Finally, we conduct extensive experiments on both synthetic data and real applications in vision and other learning tasks to verify the theoretical properties and practical performance of HODL in various application scenarios.
Direct Preference Optimization for Primitive-Enabled Hierarchical RL: A Bilevel Approach
IIT Kanpur（印度理工学院坎浦尔分校）；University of Maryland, College Park（马里兰大学学院公园分校）；U.S. Army Research Laboratory（美国陆军研究实验室）；University of Texas, Austin（德克萨斯大学奥斯汀分校）；Oracle（Oracle公司）；University of Central Florida（中央佛罗里达大学）；University of Bath（巴斯大学）
Hierarchical Bayesian optimization of an aircraft-based multi-agent system-of-systems
IRIT, UMR 5505 CNRS, Université Toulouse Capitole, Université de Toulouse（图卢兹计算机科学研究所，法国国家科学研究中心联合研究单位5505，图卢兹第一大学，图卢兹大学）；ONERA, DTIS, Université de Toulouse（法国国家航空航天研究院，信息处理与系统部，图卢兹大学）；Fédération ENAC ISAE-SUPAERO ONERA, Université de Toulouse（法国国立民航大学-法国国立高等航空航天学院-法国国家航空航天研究院联合会，图卢兹大学）；German Aerospace Center (DLR), Institute of System Architectures in Aeronautics（德国航空航天中心，航空系统架构研究所）
Hierarchical Wireless Foundation Model for Multi-Task Optimization
Department of Electrical and Electronic Engineering, Faculty of Engineering, Imperial College London（电气与电子工程系，工程学院，伦敦帝国理工学院）；School of Mathematics and Statistics, Beijing Jiaotong University（数学与统计学学院，北京交通大学）
A Comparative Analysis of Portfolio Optimization Using Mean-Variance, Hierarchical Risk Parity, and Reinforcement Learning Approaches on the Indian Stock Market
M-HOF-Opt: Multi-Objective Hierarchical Output Feedback Optimization via Multiplier Induced Loss Landscape Scheduling
Institute of AI for Health, Computational Health Center, Helmholtz Munich（亥姆霍兹慕尼黑人工智能健康研究所（计算健康中心））；Machine Learning Research Lab, Volkswagen Group（大众集团机器学习研究实验室）；KTH Royal Institute of Technology（瑞典皇家理工学院）；Technical University Munich（慕尼黑工业大学）；U.S. FDA/CDRH（美国食品药品监督管理局医疗器械和辐射健康中心）；Applied Geology, GeoZentrum Nordbayern, Friedrich-Alexander-Universität（弗里德里希-亚历山大-埃尔朗根-纽伦堡大学北巴伐利亚地理中心应用地质学系）
A Hierarchical Two-tier Approach to Hyper-parameter Optimization in Reinforcement Learning
Facultad Regional Villa María, UTN（UTN玛丽亚城地区学院）；CIT Villa María - CONICET-UNVM（玛丽亚城跨学科研究中心 - CONICET-UNVM）；Instituto de Desarrollo y Diseño CONICET-UTN（CONICET-UTN发展与设计研究所）
VistaDPO: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Models
The University of Hong Kong（香港大学）；The Hong Kong University of Science and Technology（香港科技大学）；National University of Singapore（新加坡国立大学）；University of Texas at Dallas（德克萨斯大学达拉斯分校）；Nanyang Technological University（南洋理工大学）
Hierarchical Testing with Rabbit Optimization for Industrial Cyber-Physical Systems
Department of Computer Science, University of Liverpool（利物浦大学计算机科学系）；Department of Electrical and Electronic Engineering, University of Sheffield（谢菲尔德大学电子与电气工程系）
HPG-Diff: Hierarchical physics-guided diffusion with differentiable connectivity constraints for topology optimization
School of Mechanical Engineering, Beijing Institute of Technology（北京理工大学机械工程学院）；Computer Science and Engineering, University of New South Wales（新南威尔士大学计算机科学与工程学院）；College of Intelligence and Computing, Tianjin University（天津大学智能与计算学部）；Research Institute of Electrical Communication, Tohoku University（东北大学电气通信研究所）
Not All Objectives Are Born Equal: Priority-Constrained Descent for Hierarchical Multi-Objective Optimization
Department of Computer Science & Engineering, American University of Sharjah（美国沙迦大学计算机科学与工程系）；Senseable City Laboratory, Massachusetts Institute of Technology（麻省理工学院可感知城市实验室）
Optimization for Master-UAV-powered Auxiliary-Aerial-IRS-assisted IoT Networks: An Option-based Multi-agent Hierarchical Deep Reinforcement Learning Approach
University of Electronic Science and Technology of China（电子科技大学）；Institute for Infocomm Research, Agency for Science, Technology and Research（新加坡科技研究局信息通信研究院）
