Guangdong Key Laboratory of Intelligent Morphing Mechanisms and Adaptive Robotics and School of Intelligence Science and Engineering, the Harbin Institute of Technology Shenzhen, China(广东省智能变形机制与自适应机器人重点实验室和智能科学与工程学院,哈尔滨工业大学深圳学院)
Yueyang Weng, Xiaopeng Zhang, Yongjin Mu, Yingcong Zhu, Yanjie Li
Action chunking is a widely adopted approach in Learning from Demonstration (LfD). By modeling multi-step action chunks rather than single-step actions, action chunking significantly enhances modeling capabilities for human expert policies. However, because action chunking makes a single decision only after a complete action block has been executed, the resulting reduction in decision frequency restricts the utilization of real-time observations, impairing reactivity in dynamic or noisy environments. Existing efforts to address this issue have primarily resorted to trading off reactivity against decision consistency, without achieving both. To address this limitation, we propose a novel algorithm, Temporal Action Selection (TAS), which caches predicted action chunks from multiple timesteps and dynamically selects the optimal action through a lightweight selector network. TAS achieves balanced optimization across both reactivity and decision consistency. Experiments across multiple tasks with diverse base policy architectures show that TAS significantly improves success rates. Furthermore, integrating TAS as a base policy with residual reinforcement learning (RL) improves both training efficiency and the performance ceiling. Experiments in both simulation and physical robots confirm the method's efficacy.
Memorized action chunking with Transformers: Imitation learning for vision-based tissue surface scanning
Imperial College London(帝国理工学院);Hamlyn Centre for Robotic Surgery(哈姆林机器人外科中心);Institute of Global Health Innovation(全球健康创新研究所);Department of Surgery and Cancer(外科与癌症系)
HarvestPoint-ACT: Explicit Target Selection and Harvest-Point Conditioning for Robotic Fruit Harvesting under Occlusion
College of Computer and Information Sciences, Fujian Agriculture and Forestry University(福建农林大学计算机与信息学院);School of Mechatronic Engineering and Automation, Shanghai University(上海大学机电工程与自动化学院);Graduate School of Engineering Science, The University of Osaka(大阪大学工程科学研究生院)
Implicit Action Chunking for Smooth Continuous Control
Department of Data and Systems Engineering, The University of Hong Kong, Hong Kong SAR, China(香港大学数据与系统工程系);Beijing Institute of Technology, Zhuhai, China(北京理工大学珠海学院);College of Computer Science, Sichuan University, Chengdu, China(四川大学计算机学院)
Denoising Tells When to Replan: Denoising-Variance Adaptive Chunking for Flow-Based Robot Policies
Beijing Institute of Technology(北京理工大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen Loop Area Institute(深圳河套学院);Hunan University(湖南大学);Xi’an Jiaotong University(西安交通大学);Renmin University of China(中国人民大学);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳))
Learning High-Frequency Continuous Action Chunks in Latent Space
School of Computer Science, Shanghai Jiao Tong University, Shanghai, China(上海交通大学计算机科学学院);National University of Singapore, Singapore(新加坡国立大学);Institute of Automation, Chinese Academy of Sciences, Beijing, China(中国科学院自动化研究所);Fudan University, Shanghai, China(复旦大学)
Goal-oriented Semantic Communication for Robot Arm Reconstruction in Digital Twin: Feature and Temporal Selections
Department of Engineering, King’s College London(伦敦国王学院工程系);ZhejiangLab(浙江实验室);Bristol Research and Innovation Laboratory, Toshiba Europe Ltd.(巴斯德研究与创新实验室,东芝欧洲有限公司)