We present an approach for designing swarm-based optimizers for the global optimization of expensive black-box functions. In the proposed approach, the problem of finding efficient optimizers is framed as a reinforcement learning problem, where the goal is to find optimization policies that require a few function evaluations to converge to the global optimum. The state of each agent within the swarm is defined as its current position and function value within a design space and the agents learn to take favorable actions that maximize reward, which is based on the final value of the objective function. The proposed approach is tested on various benchmark optimization functions and compared to the performance of other global optimization strategies. Furthermore, the effect of changing the number of agents, as well as the generalization capabilities of the trained agents are investigated. The results show superior performance compared to the other optimizers, desired scaling when the number of agents is varied, and acceptable performance even when applied to unseen functions. On a broader scale, the results show promise for the rapid development of domain-specific optimizers.
Human Implicit Preference-Based Policy Fine-tuning for Multi-Agent Reinforcement Learning in USV Swarm
Korea Military Academy (KMA)(韩国军事学院);KAIST(韩国科学技术院);Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院);University of California, Riverside(加州大学河滨分校)
UC-PSRO: Utility-Conditioned Policy-Space Response Oracles with a Communication-Dropout Curriculum for Game-Theoretic Course-of-Action Generation in Adversarial Swarms
SUB-PLAY: Adversarial Policies against Partially Observed Multi-Agent Reinforcement Learning Systems
Zhejiang University(浙江大学);Laboratory for Big Data and Decision(大数据与决策实验室);Chinese Aeronautical Establishment(中国航空研究院);Institute of Computer Application, China Academy of Engineering Physics(中国工程物理研究院计算机应用研究所)
Communication-Free Collective Navigation for a Swarm of UAVs via LiDAR-Based Deep Reinforcement Learning
Department of Mechanical Engineering, Ulsan National Institute of Science and Technology(机械工程系,釜山国立科学技术研究院);Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology(机械工程系,韩国科学技术院)
Discrete Differential Evolution Particle Swarm Optimization Algorithm for Energy Saving Flexible Job Shop Scheduling Problem Considering Machine Multi States
Business School, Shandong Normal University(山东师范大学商学院);School of Mathematics, Yunnan Normal University(云南师范大学数学学院);School of Physics and Electronics, Shandong Normal University(山东师范大学物理与电子科学学院)
RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms
Hangzhou Institute for Advanced Study, UCAS(杭州高等研究机构,中国科学院大学);Zhejiang University(浙江大学);Zhejiang Lab(浙江实验室);Macau University of Science and Technology(澳门科学理工学院)
Automated Generation of MDPs Using Logic Programming and LLMs for Robotic Applications
Department of Information Engineering and Computer Science, University of Trento(信息工程与计算机科学系,特伦托大学);Department of Industrial Engineering, University of Trento(工业工程系,特伦托大学)
From Static to Adaptive Defense: Federated Multi-Agent Deep Reinforcement Learning-Driven Moving Target Defense Against DoS Attacks in UAV Swarm Networks
School of Cyber Science and Engineering, Southeast University, Purple Mountain Laboratories, and Jiangsu Province Engineering Research Center of Security for Ubiquitous Network(网络信息安全学院,东南大学,紫金山实验室,江苏省 ubiquitous 网络安全工程研究中心)
Unveiling Complex Collective Behaviors from Simple Rewards
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);WINDY Lab, School of Engineering, Westlake University(西湖大学工程学院风语实验室);Shanghai AI Laboratory(上海人工智能实验室);Max Planck Institute of Animal Behavior(马克斯·普朗克动物行为研究所);Department of Computer and Information Science, University of Konstanz(康斯坦茨大学计算机与信息科学系);Centre for the Advanced Study of Collective Behaviour, University of Konstanz(康斯坦茨大学集体行为高级研究中心);Department of Biology, University of Konstanz(康斯坦茨大学生物系)