基础模型能否可靠识别空间危险?路缘分割案例研究
Can Foundation Models Reliably Identify Spatial Hazards? A Case Study on Curb Segmentation
AI总结:
本文构建最大路缘分割数据集评估主流基础模型,发现其假阳性率高、实时性不足,并提出过滤边界框选择等改进方案。
摘要:
路缘是划分安全行人区域与潜在车辆交通危险的重要边界。在动态导航中,路缘也代表一种主要空间危险,具有显著的绊倒风险。对于盲人和低视力人群(PBLV)而言,这些脆弱性尤其严重。准确的基于视觉的路缘辨别,对于帮助 PBLV 在城市环境中安全导航的辅助技术至关重要。本文研究基础模型在路缘分割方面的效能。我们引入了迄今为止最大的路缘分割数据集,以对主流基础模型进行基准测试。结果表明,最先进的基础模型在路缘分割中面临重大挑战。这是由于它们具有很高的假阳性率(最高达95%),并且在区分路缘与类似路缘的物体或非路缘区域(例如人行道)时性能较差。此外,表现最好的模型平均推理时间为3.70秒,凸显了其在提供实时辅助方面的问题。为此,我们提出包括过滤边界框选择在内的解决方案,以实现更准确的路缘分割。总体而言,尽管基础模型具备即时灵活性,但将其应用于实际辅助技术仍需改进。本研究强调,迫切需要专门数据集和定制化模型训练来应对 PBLV 的导航挑战,并凸显基础模型的隐性弱点。
英文摘要:
Curbs serve as vital borders that delineate safe pedestrian zones from potential vehicular traffic hazards. Curbs also represent a primary spatial hazard during dynamic navigation with significant stumbling potential. Such vulnerabilities are particularly exacerbated for persons with blindness and low vision (PBLV). Accurate visual-based discrimination of curbs is paramount for assistive technologies that aid PBLV with safe navigation in urban environments. Herein, we investigate the efficacy of curb segmentation for foundation models. We introduce the largest curb segmentation dataset to-date to benchmark leading foundation models. Our results show that state-of-the-art foundation models face significant challenges in curb segmentation. This is due to their high false-positive rates (up to 95%) with poor performance distinguishing curbs from curb-like objects or non-curb areas, such as sidewalks. In addition, the best-performing model averaged a 3.70-second inference time, underscoring problems in providing real-time assistance. In response, we propose solutions including filtered bounding box selections to achieve more accurate curb segmentation. Overall, despite the immediate flexibility of foundation models, their application for practical assistive technology applications still requires refinement. This research highlights the critical need for specialized datasets and tailored model training to address navigation challenges for PBLV and underscores implicit weaknesses in foundation models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。