Scalable Co-Optimization of Morphology and Control in Embodied Machines
Cornell University(康奈尔大学);University of Wyoming(怀俄明大学);University of Vermont(佛蒙特大学);NASA Ames/SGT Inc(美国国家航空航天局艾姆斯研究中心/SGT公司);Columbia University(哥伦比亚大学)
Nick Cheney, Josh Bongard, Vytas SunSpiral, Hod Lipson
Evolution sculpts both the body plans and nervous systems of agents together over time. In contrast, in AI and robotics, a robot's body plan is usually designed by hand, and control policies are then optimized for that fixed design. The task of simultaneously co-optimizing the morphology and controller of an embodied robot has remained a challenge. In psychology, the theory of embodied cognition posits that behavior arises from a close coupling between body plan and sensorimotor control, which suggests why co-optimizing these two subsystems is so difficult: most evolutionary changes to morphology tend to adversely impact sensorimotor control, leading to an overall decrease in behavioral performance. Here, we further examine this hypothesis and demonstrate a technique for "morphological innovation protection", which temporarily reduces selection pressure on recently morphologically-changed individuals, thus enabling evolution some time to "readapt" to the new morphology with subsequent control policy mutations. We show the potential for this method to avoid local optima and converge to similar highly fit morphologies across widely varying initial conditions, while sustaining fitness improvements further into optimization. While this technique is admittedly only the first of many steps that must be taken to achieve scalable optimization of embodied machines, we hope that theoretical insight into the cause of evolutionary stagnation in current methods will help to enable the automation of robot design and behavioral training -- while simultaneously providing a testbed to investigate the theory of embodied cognition.
Training Cross-Morphology Embodied AI Agents: From Practical Challenges to Theoretical Foundations
Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳人工智能与机器人研究院);Quantum Science Center of Guangdong-Hong Kong-Macau Greater Bay Area(粤港澳大湾区量子科学中心)
SciHorizon-eLab: An Agentic Protocol-to-Task Compiler for Scalable Benchmarking of Scientific Embodied Agents
Data Intelligence for Scientific Innovation Lab, Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心科学智能创新数据实验室);Beihang University(北京航空航天大学)
EmbodiedAgent: A Scalable Hierarchical Approach to Overcome Practical Challenge in Multi-Robot Control
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, China(香港中文大学(深圳)科学与工程学院);Shenzhen Institute of Artificial Intelligence and Robotics for Society, China(社会人工智能与机器人研究所);The School of Computer Science, The University of Sydney, Australia(悉尼大学计算机科学学院);Faculty of Computer and Mathematical Sciences, The Hong Kong Polytechnic University, China(香港理工大学计算机与数学科学学院)
Learning Primitive Embodied World Models: Towards Scalable Robotic Learning
Shanghai AI Lab(上海人工智能实验室);Fudan(复旦大学);SJTU(上海交通大学);NJUST(南京理工大学);THU(清华大学);Harvard(哈佛大学);ZJU(浙江大学);NJU(南京大学);USTC(中国科学技术大学);Tongji(同济大学);HKUST (GZ)(香港科技大学(广州))
Towards provable probabilistic safety for scalable embodied AI systems
Department of Automation, Tsinghua University(清华大学自动化系);Beijing Academy of Artificial Intelligence(北京人工智能研究院);School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院);School of Computer, Liaocheng University(聊城大学计算机学院);Department of Automation, Southeast University(东南大学自动化学院);Department of Mechanical and Aerospace Engineering, George Washington University(乔治华盛顿大学机械与航空航天工程系);University of Michigan Transportation Research Institute(密歇根大学交通研究所);Department of Civil and Environmental Engineering, University of Michigan(密歇根大学土木与环境工程系)
V-CAGE: Context-Aware Generation and Verification for Scalable Long-Horizon Embodied Tasks
Department of Computer Science and Technology, University of Cambridge, Cambridge, England.(计算机科学与技术系,剑桥大学,剑桥,英格兰);Shanghai Jiao Tong University, Shanghai, China(上海交通大学,上海,中国);Wuhan University, Wuhan, Hubei, China(武汉大学,武汉,湖北,中国)
RoboLDA: A Probabilistic Generative Model for Uncovering Embodied Hierarchical Structures in Voxel-based Soft Robots
School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院);Intelligent Game and Decision Laboratory(智能博弈与决策实验室);School of Statistics, Renmin University of China(中国人民大学统计学院);School of Artificial Intelligence, Shanghai Jiao Tong University(上海交通大学人工智能学院);Shanghai Innovation Institute(上海创新研究院);Center for Applied Statistics, Renmin University of China(中国人民大学应用统计中心)
Information Theoretically Aided Reinforcement Learning for Embodied Agents
Max Planck Institute for Mathematics in the Sciences(马克斯·普朗克数学科学研究所);Faculty of Mathematics and Computer Science, Leipzig University(莱比锡大学数学与计算机科学学院);Santa Fe Institute(圣塔菲研究所)
AtomEgo: Exploring Ego-Robot Integration for Embodied Foundation Model Pretraining
INFIFORCE;Lionrock Artificial Intelligence Laboratory(狮岩人工智能实验室);HKU(香港大学);Tongji University(同济大学);Huazhong University of Science and Technology(华中科技大学)
Communicating Plans, Not Percepts: Scalable Multi-Agent Coordination with Embodied World Models
Department of Computer Science University of Wisconsin-Madison(计算机科学系 明尼苏达大学);Department of Computer Science National University of Singapore(计算机科学系 新加坡国立大学)
Emergent Hand Morphology and Control from Optimizing Robust Grasps of Diverse Objects
NVIDIA(英伟达);University of California, Berkeley(加州大学伯克利分校);University of Toronto(多伦多大学);Vector Institute(向量研究所);Caltech(加州理工学院);The University of Texas at Austin(德克萨斯大学奥斯汀分校)
FluxVLA Engine: A One-Stop VLA Engineering Platform for Embodied Intelligence
LimX Dynamics;Nankai University(南开大学);The University of Hong Kong(香港大学);University of Electronic Science and Technology of China(电子科技大学);Beijing Institute of Technology(北京理工大学);Xidian University(西安电子科技大学);Zhejiang University(浙江大学);Xi’an Jiaotong University(西安交通大学)
Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges
Shenzhen International Graduate School (SIGS), Tsinghua University(深圳国际研究生院(SIGS),清华大学);New Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences(模式识别新实验室(NLPR),自动化研究所,中国科学院)
LAPT-Scale: Scaling Embodied Policies with Latent Action Pre-Training on Human Videos
Joy Future Academy, JD(京东探索研究院);School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术学院);Tsinghua SIGS, Tsinghua University(清华大学深圳国际研究生院);Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)人工智能学院)