This paper proposes a new method for accurate and robust 6D pose estimation of novel objects, named GS2Pose. By introducing 3D Gaussian splatting, GS2Pose can utilize the reconstruction results without requiring a high-quality CAD model, which means it only requires segmented RGBD images as input. Specifically, GS2Pose employs a two-stage structure consisting of coarse estimation followed by refined estimation. In the coarse stage, a lightweight U-Net network with a polarization attention mechanism, called Pose-Net, is designed. By using the 3DGS model for supervised training, Pose-Net can generate NOCS images to compute a coarse pose. In the refinement stage, GS2Pose formulates a pose regression algorithm following the idea of reprojection or Bundle Adjustment (BA), referred to as GS-Refiner. By leveraging Lie algebra to extend 3DGS, GS-Refiner obtains a pose-differentiable rendering pipeline that refines the coarse pose by comparing the input images with the rendered images. GS-Refiner also selectively updates parameters in the 3DGS model to achieve environmental adaptation, thereby enhancing the algorithm's robustness and flexibility to illuminative variation, occlusion, and other challenging disruptive factors. GS2Pose was evaluated through experiments conducted on the LineMod dataset, where it was compared with similar algorithms, yielding highly competitive results. The code for GS2Pose will soon be released on GitHub.
TextSplat: Text-Guided Semantic Fusion for Generalizable Gaussian Splatting
Institute of Artificial Intelligence, Xiamen University(厦门大学人工智能研究所);Guangdong Laboratory of Artificial Intelligence(广东省人工智能与数字经济实验室);Peking University(北京大学);School of Future Technology, South China University of Technology(华南理工大学未来技术学院);Hangzhou Dianzi University(杭州电子科技大学);Central Laboratory of Lishui Hospital of Wenzhou Medical University, The First Affiliated Hospital of Lishui University, Lishui People's Hospital(丽水市人民医院中央实验室、丽水大学第一附属医院、丽水人民医院)
University of Liverpool(利物浦大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Universidad Antonio de Nebrija(安东尼奥·德·内布里哈大学);ARIES Research Centre(ARIES研究中心)
Reprojection-Guided 3D Gaussian Splatting Diffusion for Weakly Supervised Single-Image Normal Estimation
School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China(江南大学人工智能与计算机科学学院,中国无锡);School of Data Science, Lingnan University, Hong Kong, China(岭南大学数据科学学院,中国香港)
Wangxuan Institute of Computer Technology, Peking University(北京大学计算机技术研究院);Chongqing Changan Automobile Co., Ltd(重庆长安汽车有限公司);University of California, Merced(加州大学默塞德分校)
ERGO: Excess-Risk-Guided Optimization for High-Fidelity Monocular 3D Gaussian Splatting
Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);Peking University(北京大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Guilin University of Electronic Technology(桂林电子科技大学);UiT The Arctic University of Norway(UiT北欧大学)
USP-Gaussian: Unifying Spike-based Image Reconstruction, Pose Correction and Gaussian Splatting
School of Computer Science, Peking University(北京大学计算机科学学院);State Key Laboratory for Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)
Rendering Anywhere You See: Renderability Field-guided Gaussian Splatting
Laboratory of Artificial Intelligence Robotics(人工智能机器人实验室);Politecnico di Milano(米兰理工学院);Ningbo Institute of Materials Technology and Engineering(宁波材料技术与工程研究所)
ExtraGS: Enhancing Endoscopic View Extrapolation via Diffusion-Guided 3D Gaussian Splatting
The School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, and the Shanghai Key Laboratory of Navigation and Location-Based Services(上海交通大学自动化与智能感知学院以及上海市导航与位置服务重点实验室);Global College, Shanghai Jiao Tong University(上海交通大学密西根学院);Shanghai Ninth People’s Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属第九人民医院)
CSS: Overcoming Pose and Scene Challenges in Crowd-Sourced 3D Gaussian Splatting
Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);China Unicom Smart City Research Institute(中国联通智慧城市研究院)
AD-GS: Anatomical Density-guided 3D Gaussian Splatting for Sparse-View Dental CBCT Reconstruction
Beijing University of Posts and Telecommunications(北京邮电大学);Peking University Third Hospital(北京大学第三医院);National Institute of Informatics(信息学研究所);Peking University(北京大学)
PEGASUS: Physically Enhanced Gaussian Splatting Simulation System for 6DoF Object Pose Dataset Generation
Friedrich-Alexander-Universität Erlangen-Nürnberg(弗里德里希-亚历山大-埃尔兰根-纽伦堡大学);National Institute of Advanced Industrial Science and Technology(日本先进工业科学技术研究院);Industrial CPS Research Center(工业网络物理系统研究中心)
GALA: Guided Attention with Language Alignment for Open Vocabulary Gaussian Splatting
Technical University of Munich(慕尼黑技术大学);Universitat Politècnica de Catalunya(巴塞罗那技术大学);Google(谷歌);Munich Center for Machine Learning(慕尼黑机器学习中心);University of Tubingen(图宾根大学);ETH Zurich(苏黎世联邦理工学院);Visualais
3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting
The Chinese University of Hong Kong(香港中文大学);Stanford University(斯坦福大学);Snap Inc.(Snap公司);University of California Los Angeles(加利福尼亚大学洛杉矶分校);ByteDance(字节跳动)