Visual place recognition has gained significant attention in recent years as a crucial technology in autonomous driving and robotics. Currently, the two main approaches are the perspective view retrieval (P2P) paradigm and the equirectangular image retrieval (E2E) paradigm. However, it is practical and natural to assume that users only have consumer-grade pinhole cameras to obtain query perspective images and retrieve them in panoramic database images from map providers. To address this, we propose \textit{PanoVPR}, a perspective-to-equirectangular (P2E) visual place recognition framework that employs sliding windows to eliminate feature truncation caused by hard cropping. Specifically, PanoVPR slides windows over the entire equirectangular image and computes feature descriptors for each window, which are then compared to determine place similarity. Notably, our unified framework enables direct transfer of the backbone from P2P methods without any modification, supporting not only CNNs but also Transformers. To facilitate training and evaluation, we derive the Pitts250k-P2E dataset from the Pitts250k and establish YQ360, latter is the first P2E visual place recognition dataset collected by a mobile robot platform aiming to simulate real-world task scenarios better. Extensive experiments demonstrate that PanoVPR achieves state-of-the-art performance and obtains 3.8% and 8.0% performance gain on Pitts250k-P2E and YQ360 compared to the previous best method, respectively. Code and datasets will be publicly available at https://github.com/zafirshi/PanoVPR.
You Need a Transition Plane: Bridging Continuous Panoramic 3D Reconstruction with Perspective Gaussian Splatting
Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学研究所);Visual Intelligence +X International Cooperation Joint Laboratory of MOE(教育部视觉智能+X国际合作联合实验室);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
Visual Gyroscope: Combination of Deep Learning Features and Direct Alignment for Panoramic Stabilization
Instituto de Investigacion en Ingenieria de Aragon(阿拉贡工程研究所);University of Zaragoza(萨拉戈萨大学);CNRS-AIST JRL (Joint Robotics Laboratory)(法国国家科学研究中心-日本产业技术综合研究所联合机器人实验室);Universite de Picardie Jules Verne(皮卡迪儒勒·凡尔纳大学)
What's in my Room? Object Recognition on Indoor Panoramic Images
Université Bourgogne Franche-Comté(勃艮第-弗朗什-孔泰大学);Instituto de Investigación en Ingeniería de Aragón (I3A)(阿拉贡工程研究院(I3A));Universidad de Zaragoza(萨拉戈萨大学)
Conditional Panoramic Image Generation via Masked Autoregressive Modeling
School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院);Insta360 Research(Insta360研究院);National University of Singapore(新加坡国立大学);The University of Tokyo(东京大学)
OmniAct3D: Leveraging Foundation Geometry and Evidence-Grounded Reasoning for Panoramic 3D Detection
Hunan University(湖南大学);National Engineering Research Center of Robot Visual Perception and Control Technology(国家机器人视觉感知与控制技术工程研究中心);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院)
Geometry-to-Image Synthesis-Driven Generative Point Cloud Registration
ANGEL CorpLab and College of Computing and Data Science, Nanyang Technological University, Singapore(ANGEL CorpLab和计算与数据科学学院,南洋理工大学,新加坡);Alibaba Cloud, Alibaba Group, China(阿里巴巴云,阿里巴巴集团,中国);PCA Lab, VCIP, College of Computer Science, Nankai University, China(PCA实验室,VCIP,计算机科学学院,南开大学,中国);State Key Laboratory for Novel Software Technology & Schoolof Intelligence Science and Technology, Nanjing University, China(新型软件技术国家重点实验室与智能科学与技术学校,南京大学,中国)