We present ConFusion, an open-source package for online sensor fusion for robotic applications. ConFusion is a modular framework for fusing measurements from many heterogeneous sensors within a moving horizon estimator. ConFusion offers greater flexibility in sensor fusion problem design than filtering-based systems and the ability to scale the online estimate quality with the available computing power. We demonstrate its performance in comparison to an iterated extended Kalman filter in visual-inertial tracking, and show its versatility through whole-body sensor fusion on a mobile manipulator.
Efficient Robotic Task Generalization Using Deep Model Fusion Reinforcement Learning
A*STAR Artificial Intelligence Initiative (A*AI)(新加坡科技研究局人工智能倡议(A*AI));Institute of Information Research(信息研究院);Institute of High Performance Computing(高性能计算研究院)
Play to the Score: Stage-Guided Dynamic Multi-Sensory Fusion for Robotic Manipulation
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Shenzhen Taobotics Co., Ltd.(深圳桃机器人有限公司);Institute of Artificial Intelligence (TeleAI), China Telecom(中国电信人工智能研究院(TeleAI))
LAC-Net: Linear-Fusion Attention-Guided Convolutional Network for Accurate Robotic Grasping Under the Occlusion
school of Data Science, Fudan University(复旦大学数据科学学院);Fudan University(复旦大学);School of statistics and information, Shanghai University of International Business and Economics(上海对外经贸大学统计与信息学院)
Mastering Autonomous Assembly in Fusion Application with Learning-by-doing: a Peg-in-hole Study
Lappeenranta University of Technology(拉彭兰塔工业大学);Institute of Plasma Physics Chinese Academy of Sciences(中国科学院等离子体物理研究所);University of Science and Technology of China(中国科学技术大学);Hefei Comprehensive National Science Center(合肥综合性国家科学中心)
LiDAR-BIND-T: Improved and Temporally Consistent Sensor Modality Translation and Fusion for Robotic Applications
IDLab - Faculty of Applied Engineering, University of Antwerp - imec(IDLab - 应用工程学院,安特卫普大学 - imec);Cosys-Lab - Faculty of Applied Engineering, University of Antwerp(Cosys-Lab - 应用工程学院,安特卫普大学);Flanders Make Strategic Research Centre(弗拉芒制造战略研究中心)
本文提出 LiDAR-BIND-T,通过时间嵌入相似度、运动对齐损失和窗口化时间融合增强异构传感器到 LiDAR 的转换,并以新指标验证其提升 SLAM 稳定性与精度。
In-Hand Object Pose Estimation via Visual-Tactile Fusion
Department of Computer Science, Goethe Universität Frankfurt, Germany(弗赖堡大学计算机科学系);Intelligent Autonomous Systems Lab, Department of Computer Science, TU Darmstadt, Germany(图恩-达姆斯塔德大学计算机科学系智能自主系统实验室);German Research Center for AI (DFKI)(德国人工智能研究中心);Centre for Cognitive Science, TU Darmstadt(图恩-达姆斯塔德大学认知科学中心);Hessian Center for Artificial Intelligence (Hessian.AI), Darmstadt(黑森人工智能中心(Hessian.AI),达姆斯塔特)
GAMMA: Graspability-Aware Mobile MAnipulation Policy Learning based on Online Grasping Pose Fusion
CFCS, School of Computer Science, Peking University(北京大学计算机学院CFCS);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Galbot Tongji University(同济大学Galbot)
RASEC: Rescaling Acquisition Strategy with Energy Constraints under SE-OU Fusion Kernel for Active Trachea Palpation and Incision Recommendation in Laryngeal Region
The Chinese University of Hong Kong(香港中文大学);Shun Hing Institute of Advanced Engineering, The Chinese University of Hong Kong(香港中文大学信兴高等工程研究所);National University of Singapore(新加坡国立大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Southern University of Science and Technology(南方科技大学);Shenzhen Research Institute of the Chinese University of Hong Kong(香港中文大学深圳研究院);Singapore General Hospital(新加坡中央医院)
M3ET: Efficient Vision-Language Learning for Robotics based on Multimodal Mamba-Enhanced Transformer
School of Software Northwestern Polytechnical University Xi'an, China(软件学院 西安理工大学 西安);Laboratoire L2Tl University Sorbonne Paris Nord Paris, France(L2Tl实验室 索邦巴黎北大学 巴黎)
Edge Computing based Human-Robot Cognitive Fusion: A Medical Case Study in the Autism Spectrum Disorder Therapy
Intelligent Social Systems and Swarm Robotics Lab (IS$^3$R)(智能社会系统与群体机器人实验室);Computer Science and Information Systems Department(计算机科学与信息系统系);Bradley University(布拉德利大学)
Federated Imitation Learning: A Novel Framework for Cloud Robotic Systems with Heterogeneous Sensor Data
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Hong Kong University of Science and Technology(香港科技大学);University of Macau(澳门大学)
Learning When to See and When to Feel: Adaptive Vision-Torque Fusion for Contact-Aware Manipulation
Edwardson School of Industrial Engineering, Purdue University(普渡大学爱德华森工业工程学院);Zachry Department of Civil and Environmental Engineering, Texas A&M University(德州农工大学扎克里土木与环境工程系)
Information-Theoretic Graph Fusion with Vision-Language-Action Model for Policy Reasoning and Dual Robotic Control
Electrical and Computer Engineering Department, University of New Mexico, Albuquerque, United States, 87106(电气与计算机工程系,新墨西哥大学,阿尔伯克基,美国,87106);Dynamic Robot Systems Group, Oxford Robotics Institute, University of Oxford, United Kingdom, OX26NN(动态机器人系统组,牛津机器人研究所,牛津大学,英国,OX26NN);Mechanical and Aerospace Engineering Department, The George Washington University, DC, United States, 22202(机械与航空航天工程系,乔治华盛顿大学,华盛顿特区,美国,22202);Department of Computer Science, University of Alabama at Birmingham, Alabama, United States, 35294(计算机科学系,阿拉巴马大学伯明翰分校,阿拉巴马,美国,35294);The School of Computation, Information and Technology, Technical University of Munich, Germany, 85748(计算、信息与技术学院,慕尼黑技术大学,德国,85748);Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy, 20156(机械工程系,米兰理工学院,米兰,意大利,20156)