利用运动运动恢复结构定位不可访问的公交车站
Leveraging Structure from Motion to Localize Inaccessible Bus Stops
摘要:
检测公共交通站点附近的危险状况对于确保公共交通的安全和无障碍是必要的。智慧城市基础设施旨在通过使用计算机视觉来促进这一任务。然而,大多数最先进的计算机视觉模型需要数千张图像才能执行准确的检测,并且几乎不存在危险条件的图像,因为它们通常是罕见的。在本文中,我们研究检测积雪覆盖的人行道沿公交线路。以前的工作主要集中在检测大雪中的其他车辆或简单地检测雪的存在。然而,我们的应用程序有一个额外的复杂性,即确定雪是否覆盖了重要的区域,并可能导致跌倒或其他事故(例如,雪覆盖了人行道),或者只是覆盖了一些背景区域(例如,邻近场地上的雪)。这个问题涉及到当重要区域不一定可见时,将它们的位置定位。我们介绍了一种方法,利用运动恢复结构(SfM),而不是额外的注释数据来解决这个问题。具体来说,我们的方法通过将分割模型和SfM应用于天气晴朗时公交车摄像头的图像来学习给定场景中人行道的位置。然后,我们使用学习的位置来检测人行道是否以及在哪里被雪遮挡。在对各种阈值参数进行评估后,我们确定了一个最佳范围,在该范围内,我们的方法始终正确地对不同类别的人行道图像进行分类。虽然我们展示了沿公交线路的积雪覆盖的应用,这种方法可以扩展到其他危险的条件。这个项目的代码可以在https://github.com/ind1010/SfM_for_BusEdge上找到。
英文摘要:
The detection of hazardous conditions near public transit stations is necessary for ensuring the safety and accessibility of public transit. Smart city infrastructures aim to facilitate this task among many others through the use of computer vision. However, most state-of-the-art computer vision models require thousands of images in order to perform accurate detection, and there exist few images of hazardous conditions as they are generally rare. In this paper, we examine the detection of snow-covered sidewalks along bus routes. Previous work has focused on detecting other vehicles in heavy snowfall or simply detecting the presence of snow. However, our application has an added complication of determining if the snow covers areas of importance and can cause falls or other accidents (e.g. snow covering a sidewalk) or simply covers some background area (e.g. snow on a neighboring field). This problem involves localizing the positions of the areas of importance when they are not necessarily visible. We introduce a method that utilizes Structure from Motion (SfM) rather than additional annotated data to address this issue. Specifically, our method learns the locations of sidewalks in a given scene by applying a segmentation model and SfM to images from bus cameras during clear weather. Then, we use the learned locations to detect if and where the sidewalks become obscured with snow. After evaluating across various threshold parameters, we identify an optimal range at which our method consistently classifies different categories of sidewalk images correctly. Although we demonstrate an application for snow coverage along bus routes, this method can extend to other hazardous conditions as well. Code for this project is available at https://github.com/ind1010/SfM_for_BusEdge.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。