A key technical challenge in performing 6D object pose estimation from RGB-D image is to fully leverage the two complementary data sources. Prior works either extract information from the RGB image and depth separately or use costly post-processing steps, limiting their performances in highly cluttered scenes and real-time applications. In this work, we present DenseFusion, a generic framework for estimating 6D pose of a set of known objects from RGB-D images. DenseFusion is a heterogeneous architecture that processes the two data sources individually and uses a novel dense fusion network to extract pixel-wise dense feature embedding, from which the pose is estimated. Furthermore, we integrate an end-to-end iterative pose refinement procedure that further improves the pose estimation while achieving near real-time inference. Our experiments show that our method outperforms state-of-the-art approaches in two datasets, YCB-Video and LineMOD. We also deploy our proposed method to a real robot to grasp and manipulate objects based on the estimated pose.
IT-TextFusion: Iterative Text-Image Interaction with Text-Guided Residual Refinement for Degradation-Aware Image Fusion
School of Automation, Southeast University(东南大学自动化学院);Chair of Robotics, Artificial Intelligence and Real-time Systems, Technical University of Munich(慕尼黑工业大学机器人、人工智能与实时系统研究所)
School of Electrical and Information Engineering, Jiangsu University, Zhenjiang, 212013, China(江苏大学电气与信息工程学院);School of Computer Science and Engineering, Jiangsu University of Science and Technology, Zhenjiang, 212003, China(江苏科技大学计算机科学与工程学院);School of Automation, Southeast University, Nanjing, 210096, China(东南大学自动化学院);Department of Computer Science and Engineering, University of North Texas, Denton, TX 76207, USA(北卡罗来纳州立大学计算机科学与工程系);School of Computing, Nanjing Normal University, Nanjing, 210046, Jiangsu(南京师范大学计算机学院)
LIDIA: Precise Liver Tumor Diagnosis on Multi-Phase Contrast-Enhanced CT via Iterative Fusion and Asymmetric Contrastive Learning
College of Computer Science, Sichuan University(四川大学计算机学院);DAMO Academy, Alibaba Group(阿里巴巴集团达摩院);Hupan Lab(湖畔实验室);Shengjing Hospital of China Medical University(中国医科大学附属盛京医院);First Affiliated Hospital of Zhejiang University(浙江大学附属第一医院)
Monocular Depth Estimation and Segmentation for Transparent Object with Iterative Semantic and Geometric Fusion
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation of Chinese Academy of Sciences(中国科学院自动化研究所);School of Information Science and Technology, Shijiazhuang Tiedao University(石家庄铁道大学信息科学与技术学院);D-Robotics(杭州宇树科技有限公司)
MV6D: Multi-View 6D Pose Estimation on RGB-D Frames Using a Deep Point-wise Voting Network
Bosch Center for Artificial Intelligence(博世人工智能中心);University of Tübingen(图宾根大学);Robert Bosch GmbH(罗伯特·博世有限公司);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院)
Relative-Absolute Fusion: Rethinking Feature Extraction in Image-Based Iterative Method Selection for Solving Sparse Linear Systems
School of Software Technology, Dalian University of Technology(大连理工大学软件学院);Greater Bay Area National Center of Technology Innovation(粤港澳大湾区国家技术创新中心);CATARC Automotive Test Center (Tianjin) Co., Ltd(CATARC汽车测试中心(天津)有限公司)
FGS-SLAM: Fourier-based Gaussian Splatting for Real-time SLAM with Sparse and Dense Map Fusion
State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences(中国科学院沈阳自动化研究所机器人重点实验室);University of Chinese Academy of Sciences(中国科学院大学);Department of Mechanical and Energy Engineering, Southern University of Science and Technology(南方科技大学机械与能源工程系)
Self-Supervised Diffusion MRI Denoising via Iterative and Stable Refinement
School of Biomedical Engineering, Division of Life Sciences and Medicine, USTC(中国科学技术大学生命科学与医学部生物医学工程学院);MIRACLE Center, Suzhou Institute for Advance Research, USTC(中国科学技术大学苏州研究院MIRACLE中心);State Key Laboratory of Precision and Intelligent Chemistry, USTC(中国科学技术大学精准与智能化学国家重点实验室);Key Laboratory of Intelligent Information Processing of CAS, Institute of Computing Technology, CAS(中国科学院计算技术研究所中国科学院智能信息处理重点实验室)
Task-driven Image Fusion with Learnable Fusion Loss
Xi’an Jiaotong University(西安交通大学);ETH Zürich(苏黎世联邦理工学院);City University of Hong Kong(香港城市大学);Tsinghua University(清华大学);Northwestern Polytechnical University(西北工业大学)
Panchromatic and Multispectral Image Fusion via Alternating Reverse Filtering Network
Hefei Institute of Physical Science, Chinese Academy of Sciences(中国科学院合肥物质科学研究院);University of Science and Technology of China(中国科学技术大学);Nanyang Technological University(南洋理工大学);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院)
Mask-adaptive Gated Convolution and Bi-directional Progressive Fusion Network for Depth Completion
College of Information Science and Engineering, Northeastern University(东北大学信息科学与工程学院);Foshan Graduate School of Innovation, Northeastern University(东北大学佛山创新研究生院);National Frontiers Science Center for Industrial Intelligence and Systems Optimization, Northeastern University(东北大学工业智能与系统优化国家前沿科学中心)
FlowLUT: Efficient Image Enhancement via Differentiable LUTs and Iterative Flow Matching
School of Engineering, Zhejiang Normal University(工程学院,浙江师范大学);School of Computer Science and Engineering, University of Science and Technology of China(计算机科学与工程学院,中国科学技术大学);School of Computer Science and Engineering, Nanjing University of Science and Technology(计算机科学与工程学院,南京理工大学);School of Information Science and Engineering, Shandong Normal University(信息科学与工程学院,山东师范大学)
提出 FlowLUT 端到端图像增强模型,结合多先验可微 3D LUT、动态融合与迭代流匹配,在保持 O(1) 高效色彩校正的同时恢复细节并消除伪影。
EPOFusion: Exposure aware Progressive Optimization Method for Infrared and Visible Image Fusion
College of Information Engineering, Zhejiang University of Technology(浙江工业大学信息工程学院);College of Information Science and Technology, Zhejiang Shuren University(浙江树人大学信息科技学院);Department of Electrical and Electronic Engineering, The University of Hong Kong(香港大学电机电子工程系)
Supervise-assisted Multi-modality Fusion Diffusion Model for PET Restoration
Beijing Institute of Technology(北京理工大学);Research and Development Center of Agricultural Bank of China(中国农业银行研发中心);Peking University(北京大学);Beijing Normal University(北京师范大学)
Unaligned RGB Guided Hyperspectral Image Super-Resolution with Spatial-Spectral Concordance
Beijing Institute of Technology(北京理工大学);Hangzhou Dianzi University(杭州电子科技大学);Chinese Academy of Sciences(中国科学院);University of Chinese Academy of Sciences(中国科学院大学)
AD-SRF: Attack-Defense Semantic Reinforcement for Multi-Modal Image Fusion
Electronic Information School, Wuhan University(武汉大学电子信息学院);School of Robotics, Wuhan University(武汉大学机器人学院);Suzhou Institute, Wuhan University(武汉大学苏州研究院)