While large-scale sequence modeling from offline data has led to impressive performance gains in natural language and image generation, directly translating such ideas to robotics has been challenging. One critical reason for this is that uncurated robot demonstration data, i.e. play data, collected from non-expert human demonstrators are often noisy, diverse, and distributionally multi-modal. This makes extracting useful, task-centric behaviors from such data a difficult generative modeling problem. In this work, we present Conditional Behavior Transformers (C-BeT), a method that combines the multi-modal generation ability of Behavior Transformer with future-conditioned goal specification. On a suite of simulated benchmark tasks, we find that C-BeT improves upon prior state-of-the-art work in learning from play data by an average of 45.7%. Further, we demonstrate for the first time that useful task-centric behaviors can be learned on a real-world robot purely from play data without any task labels or reward information. Robot videos are best viewed on our project website: https://play-to-policy.github.io
Re-designing cities with conditional adversarial networks
University College London (UCL)(伦敦大学学院)
本文介绍了一种条件生成对抗网络,通过生成1)城市干预政策,2)需要干预的地方的注意力地图,3)实施干预后的高分辨率街道级图像(1024 X 1024或1536 X 1536)来重新设计城市场景的街道级图像。我们还介绍了一个新的数据集,其中包括对齐的街道级图像之前和之后的城市干预措施,从现实生活中的场景,使这项研究成为可能。所介绍的方法已在应用于逼真图像的不同范围的城市干预上进行了训练。经过训练的模型在重新建模城市方面表现出强大的性能,优于在单个GPU中计算的其他领域中应用图像到图像转换的现有方法。这项研究为机器智能在基于对抗学习的重新思考和重新设计城市的不同属性方面发挥作用打开了大门,超越了面部地标操作或语义分割图像合成的主流。
Diffusion Policy through Conditional Proximal Policy Optimization
Southern University of Science and Technology, Shenzhen, China(南方科技大学);Hong Kong University of Science and Technology, Hongkong, China(香港科技大学);Zhejiang University-University of Illinois Urbana-Champaign Institute, Haining, China(浙江大学-伊利诺伊大学厄巴纳-香槟分校联合研究所)
DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Driving
School of Mechanical and Aerospace Engineering, Nanyang Technological University(南洋理工大学机械与航天工程学院);NVIDIA Research, NVIDIA Corporation(英伟达公司英伟达研究院);Department of Aeronautics and Astronautics, Stanford University(斯坦福大学航空航天系)
Crowd-FM: Learned Optimal Selection of Conditional Flow Matching-generated Trajectories for Crowd Navigation
Robotics Research Center, IIIT Hyderabad, India(IIIT海得拉巴机器人研究中心,印度);Nanyang Technological University, Singapore(新加坡南洋理工大学);University of Tartu, Estonia(爱沙尼亚塔尔图大学);Inria, Université de Lorraine, France(法国里尔大学Inria研究院)
AquaMend: Minimal Re-probing and Conditional Rollback for Latent-Belief Failures in Embodied Agents
University College London(伦敦大学学院);Peking University(北京大学);Nanyang Technological University(南洋理工大学);University of the Chinese Academy of Sciences(中国科学院大学);Beijing University of Posts and Telecommunications(北京邮电大学);University of Leeds(利兹大学);Fullive-AI