Metamaterial mechanisms are micro-architectured compliant structures that operate through the elastic deformation of specially designed flexible members. This study develops an efficient design methodology for compliant mechanisms using deep reinforcement learning (RL). For this purpose, design domains are digitized into finite cells with various hinge connections, and finite element analyses (FEAs) are conducted to evaluate the deformation behaviors of the compliance mechanism with different cell combinations. The FEA data are learned through the RL method to obtain optimal compliant mechanisms for desired functional requirements. The RL algorithm is applied to the design of a compliant door-latch mechanism, exploring the effect of human guidance and tiling direction. The optimal result is achieved with minimal human guidance and inward tiling, resulting in a threefold increase in the predefined reward compared to human-designed mechanisms. The proposed approach is extended to the design of a soft gripper mechanism, where the effect of hinge connections is additionally considered. The optimal design under hinge penalization reveals remarkably enhanced compliance, and its performance is validated by experimental tests using an additively manufactured gripper. These findings demonstrate that RL-optimized designs outperform those developed with human insight, providing an efficient design methodology for cell-based compliant mechanisms in practical applications.
Provable Traffic Rule Compliance in Safe Reinforcement Learning on the Open Sea
Technical University of Munich(慕尼黑工业大学);TUM School of Computation, Information and Technology(慕尼黑工业大学计算、信息与技术学院);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心)
SLA-MORL: SLA-Aware Multi-Objective Reinforcement Learning for HPC Resource Optimization
Department of Information Systems, University of Maryland, Baltimore County(信息系统系,马里兰州大学巴尔的摩县);Department of Computer Science, McMurry University(计算机科学系,麦卡里大学)
Inverse designing metamaterials with programmable nonlinear functional responses in graph space
University of California Berkeley(加州大学伯克利分校);University of California Los Angeles(加州大学洛杉矶分校);Penn State University(宾州州立大学);CNRS(法国国家科学研究中心);Institut Jean Lamour(让·拉穆尔研究所)
HIPO: Instruction Hierarchy via Constrained Reinforcement Learning
School of ECEE Arizona State University(亚利桑那州立大学电子与计算机工程学院);Department of ECE The Ohio State University(俄亥俄州立大学电子工程系);Computer Science Department University of Houston(休斯顿大学计算机科学系);College of Engineering & Applied Science CU Boulder(科罗拉多大学博尔德分校工程与应用科学学院);Dept. of Electrical Engineering & Computer Science United States Military Academy(美国军事学院电子工程与计算机科学系)
Reinforcement learning for inverse silhouette design and rapid laser cutting of compact parallelogram quad kirigami prototypes
Department of Electrical and Computer Engineering, The University of British Columbia(电气与计算机工程系,不列颠哥伦比亚大学);School of Biomedical Engineering, Biomedical Research Centre, The University of British Columbia(生物医学工程学院,生物医学研究中心,不列颠哥伦比亚大学);Department of Orthopaedics, Gordon and Leslie Diamond Health Care Centre, The University of British Columbia(骨科系,戈登和丽丝·戴维健康中心,不列颠哥伦比亚大学);International Collaboration on Repair Discoveries (ICORD), Blusson Spinal Cord Centre(修复发现国际协作(ICORD),布卢森脊髓中心)
Realizable Continuous-Space Shields for Safe Reinforcement Learning
University of California, Irvine(加利福尼亚大学欧文分校);IMDEA Software Institute(IMDEA软件研究所);Universidad Politécnica de Madrid(马德里理工大学);Universitat Politècnica de Catalunya(加泰罗尼亚理工大学)
Norms at a Price: Why RL-Based Alignment Can Promise Conditional Compliance at Best
German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));Hamburg University of Technology (TUHH)(汉堡工业大学);University of Oxford(牛津大学);Oxford Internet Institute(牛津互联网研究所)
Autonomous AI Agents for Real-Time Affordable Housing Site Selection: Multi-Objective Reinforcement Learning Under Regulatory Constraints
Department of Applied Mathematics and Computer Science (DTU Compute), Technical University of Denmark(应用数学与计算机科学系(DTU Compute),丹麦技术大学);Department of Mathematics, Trakya University(数学系,特拉基亚大学);Department of Engineering, Eskisehir Technical University(工程系,埃斯基谢普尔技术大学);Department of Computer Engineering, Afyon Kocatepe University(计算机工程系,阿菲昂卡奥卡佩大学);Department of Computer Systems, Riga Technical University(计算机系统系,里加技术大学)
Leveraging the Capabilities of Connected and Autonomous Vehicles and Multi-Agent Reinforcement Learning to Mitigate Highway Bottleneck Congestion
Purdue University(普渡大学);Lyles School of Civil Engineering(莱尔土木工程学院);Center for Connected and Automated Transportation (CCAT)(连通与自动化交通中心(CCAT));Carnegie Mellon University(卡内基梅隆大学);Robotics Institute(机器人研究所)
Deep Reinforcement Learning for Contact-Rich Skills Using Compliant Movement Primitives
Faculty of Mechanical Engineering(机械工程学院)
近年来,工业机器人已被安装在各个行业,以处理先进制造和高精度任务。然而,与人类操作员相比,工业机器人的进一步集成受到其有限的灵活性,适应性和决策技能的阻碍。装配任务对机器人来说尤其具有挑战性,因为它们具有丰富的接触性,对即使很小的不确定性也很敏感。虽然强化学习(RL)提供了一个很有前途的框架,从头开始学习接触丰富的控制策略,其适用性高维连续状态动作空间仍然相当有限,由于高脆性和样本的复杂性。为了解决这些问题,我们提出了不同的修剪方法,促进收敛和推广。特别是,我们将任务分为自由和接触丰富的子任务,在笛卡尔空间而不是关节空间中执行控制,并参数化控制策略。这些修剪方法自然地在动态运动基元(dynamic movement primitives,简称HMM)的框架内实现。为了处理接触丰富的任务,我们通过引入一个耦合项来扩展RISK框架,该耦合项的作用类似于人类手腕,并在与环境接触时提供主动顺应性。我们证明了所提出的方法可以学习对空间,大小,形状和密切相关的场景不变的插入技能,同时处理大的不确定性。最后,我们证明了学习的政策可以很容易地从模拟转移到现实世界中,并实现类似的性能UR5e机器人。
Towards Real-World Deployment of Reinforcement Learning for Traffic Signal Control
Fraunhofer IOSB-INA(弗劳恩霍夫IOSB-INA);Stührenberg GmbH(施蒂伦贝格有限公司);OWL University of Applied Sciences and Arts(OWL应用科学与艺术大学);University of Groningen(格罗宁根大学)
Safety-Driven Deep Reinforcement Learning Framework for Cobots: A Sim2Real Approach
Data Science Software Competence Center Hagenberg(哈根伯格数据科学软件能力中心);Industrial Automation Pilz(皮尔茨工业自动化公司);Computer Science Trinity College Dublin(都柏林圣三一学院计算机科学系);Food Science and Environmental Health Technological University Dublin(都柏林理工大学食品科学与环境健康学院);Robotics and Automation Irish Manufacturing Research(爱尔兰制造研究机构机器人与自动化部门)
提出一种将 ISO 10218 安全约束嵌入 DRL 训练并经 Sim2Real 迁移到协作机械臂的框架,在仿真和实测中提升成功率且无安全违规。