This work developed collaborative bimanual manipulation for reliable and safe human-robot collaboration, which allows remote and local human operators to work interactively for bimanual tasks. We proposed an optimal motion adaptation to retarget arbitrary commands from multiple human operators into feasible control references. The collaborative manipulation framework has three main modules: (1) contact force modulation for compliant physical interactions with objects via admittance control; (2) task-space sequential equilibrium and inverse kinematics optimization, which adapts interactive commands from multiple operators to feasible motions by satisfying the task constraints and physical limits of the robots; and (3) an interaction controller adopted from the fractal impedance control, which is robust to time delay and stable to superimpose multiple control efforts for generating desired joint torques and controlling the dual-arm robots. Extensive experiments demonstrated the capability of the collaborative bimanual framework, including (1) dual-arm teleoperation that adapts arbitrary infeasible commands that violate joint torque limits into continuous operations within safe boundaries, compared to failures without the proposed optimization; (2) robust maneuver of a stack of objects via physical interactions in presence of model inaccuracy; (3) collaborative multi-operator part assembly, and teleoperated industrial connector insertion, which validate the guaranteed stability of reliable human-robot co-manipulation.
ManiDP: Manipulability-Aware Diffusion Policy for Posture-Dependent Bimanual Manipulation
Department of Mechanical and Automation Engineering, T-Stone Robotics Institute, The Chinese University of Hong Kong(机械与自动化工程系、T-Stone机器人研究所、香港中文大学);Hong Kong Center for Logistics Robotics(香港物流机器人中心);Department of Technological Sciences, Wuhan University(技术科学系、武汉大学);Idiap Research Institute(Idiap研究所);Department of Advanced Robotics, Istituto Italiano di Tecnologia(先进机器人系、意大利Istituto Italiano di Tecnologia)
MV-Actor: Aligning Multi-View Semantics and Spatial Awareness for Bimanual Manipulation
School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院);Institute for AI Industry Research (AIR), Tsinghua University(清华大学智能产业研究院);AIR Wuxi Innovation Center, Tsinghua University(清华大学智能产业研究院无锡创新中心)
Morphologically Equivariant Flow Matching for Bimanual Mobile Manipulation
PEARL Lab, Dept. of Computer Science, TU Darmstadt, Germany(德累斯顿技术大学计算机科学系PEARL实验室);Istituto Italiano di Tecnologia(意大利技术研究院);Robotics Institute Germany(德国机器人研究所)
UniBiDex: A Unified Teleoperation Framework for Robotic Bimanual Dexterous Manipulation
Department of Computer Science, The University of Hong Kong(香港大学计算机科学系);Dongguan Key Laboratory of Intelligent Equipment and Smart Industry, School of Advanced Engineering, The Great Bay University(东莞智能装备与智能制造重点实验室,高级工程学院,大湾区大学);Department of Mechanical Engineering, The Hong Kong Polytechnic University(香港理工大学机械工程系);Guangdong Academy of Sciences(广东省科学院)
PA-BiCoop: A Primary-Auxiliary Cooperative Framework for General Bimanual Manipulation
SGIT AI Lab, State Grid Corporation of China(国家电网公司SGIT人工智能实验室);The Hong Kong University of Science and Technology, Guangzhou(香港科技大学(广州));Baidu Research, Beijing, China(百度研究院);Zhejiang University of Technology, Hangzhou(浙江工业大学)
Ag2x2: Robust Agent-Agnostic Visual Representations for Zero-Shot Bimanual Manipulation
National Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI)(国家关键人工智能实验室,北京通用人工智能研究院(BIGAI));School of Psychological and Cognitive Sciences, Peking University(北京大学心理与认知科学学院);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院);Beijing Key Laboratory of Behavior and Mental Health, Peking University(北京行为与心理健康重点实验室,北京大学);Yuanpei College, Peking University(北京大学元培学院);Department of Computer Science and Technology, University of Cambridge(剑桥大学计算机科学与技术系);Embodied Intelligence Lab, PKU-Wuhan Institute for Artificial Intelligence(具身智能实验室,北京大学-武汉人工智能研究院)
BiRoAD: Learning Shared and Role-Adaptive Representations for Bimanual Manipulation
Peking University(北京大学);PrimeBot Research Institute(PrimeBot研究院);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));UC Berkeley(加州大学伯克利分校)
AnyBimanual: Transferring Unimanual Policy for General Bimanual Manipulation
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电气与电子工程学院)
RoTri-Diff: A Spatial Robot-Object Triadic Interaction-Guided Diffusion Model for Bimanual Manipulation
School of Computer Science, Nanjing University(南京大学计算机科学学院);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院);School of Computing, National University of Singapore(新加坡国立大学计算机学院);Department of Computer Science and Engineering, The Hong Kong University of Science and Technology(香港科技大学计算机科学与工程系)
Task-Aware Bimanual Affordance Prediction via VLM-Guided Semantic-Geometric Reasoning
Department of Computer Science, Technical University of Darmstadt(达姆施塔特工业大学计算机科学系);German Research Center for AI (DFKI)(德国人工智能研究中心);Centre for Cognitive Science, Technical University of Darmstadt(达姆施塔特工业大学认知科学中心);Hessian Center for Artificial Intelligence (Hessian.AI), Darmstadt(黑森州人工智能中心);Robotics Institute Germany (RIG)(德国机器人研究所)
ALPHA-$α$ and Bi-ACT Are All You Need: Importance of Position and Force Information/Control for Imitation Learning of Unimanual and Bimanual Robotic Manipulation with Low-Cost System
Osaka University(大阪大学);Graduate School of Information Science and Technology of Osaka University(大阪大学信息科学与技术研究生院);School of Engineering Science, Osaka University(大阪大学工程科学学院)
DexRoam: Learning Mobile Bimanual Dexterous Manipulation from Egocentric Whole-Body Human Demonstrations
The Hong Kong University of Science and Technology(香港科技大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(北京大学计算机学院多媒体信息处理国家重点实验室);Beihang University(北京航空航天大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Diffusion-Based Imaginative Coordination for Bimanual Manipulation
Fudan University(复旦大学);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);ETH Zurich(苏黎世联邦理工学院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));KAUST(阿卜杜拉国王科技大学)