arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.06680cs.CVcs.GRcs.LG
收藏

DIGITOUR:房地产自动数字导览

DIGITOUR: Automatic Digital Tours for Real-Estate Properties

Prateek Chhikara, Harshul Kuhar, Anil Goyal, Chirag Sharma

摘要:

虚拟或数字旅游是虚拟现实技术的一种形式,其允许用户远程体验特定位置。目前,这些虚拟旅游是通过以下两步战略创建的。首先,摄影师点击一个360度等距矩形图像;然后,一组注释人员手动链接这些图像,以获得“漫游”用户体验。大规模采用虚拟旅游的主要挑战是人工注释/链接图像所涉及的时间和成本。因此,本文提出了一个端到端的管道自动生成的三维虚拟旅游使用equirectangular图像的房地产属性。我们提出了一种新的HSV为基础的着色方案,需要放置在不同的位置之前,使用360度摄像头点击等距矩形图像的纸标签。这些标签有两个特点:i)它们被编号,以帮助摄影师按顺序放置标签; ii)双色,允许更好地学习图像中的标签检测(使用YOLOv 5架构)和数字识别(使用自定义MobileNet架构)任务。最后,我们根据检测到的标签链接/连接所有的等矩形图像。我们展示了从Housing.com数据库中收集的真实世界equirectangular图像数据集上的拟议管道的效率。

英文摘要:

A virtual or digital tour is a form of virtual reality technology which allows a user to experience a specific location remotely. Currently, these virtual tours are created by following a 2-step strategy. First, a photographer clicks a 360 degree equirectangular image; then, a team of annotators manually links these images for the "walkthrough" user experience. The major challenge in the mass adoption of virtual tours is the time and cost involved in manual annotation/linking of images. Therefore, this paper presents an end-to-end pipeline to automate the generation of 3D virtual tours using equirectangular images for real-estate properties. We propose a novel HSV-based coloring scheme for paper tags that need to be placed at different locations before clicking the equirectangular images using 360 degree cameras. These tags have two characteristics: i) they are numbered to help the photographer for placement of tags in sequence and; ii) bi-colored, which allows better learning of tag detection (using YOLOv5 architecture) in an image and digit recognition (using custom MobileNet architecture) tasks. Finally, we link/connect all the equirectangular images based on detected tags. We show the efficiency of the proposed pipeline on a real-world equirectangular image dataset collected from the Housing.com database.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑