arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.00818cs.CV
收藏

部分监督多任务网络在单视角膳食评价中的应用

Partially Supervised Multi-Task Network for Single-View Dietary Assessment

ARTORG Center for Biomedical Engineering Research, University of Bern(伯尔尼大学ARTORG生物医学工程研究中心)

Ya Lu, Thomai Stathopoulou, Stavroula Mougiakakou

摘要:

食物体积估计是膳食评估流程中必不可少的一步,需要精确估计食物表面和台面的深度估计。现有的基于计算机视觉的方法要么需要多幅图像输入,要么需要额外的深度图,降低了实现的便利性和实际意义。尽管最近在从单个图像进行无监督深度估计方面取得了进展,但在大的无纹理区域的情况下所实现的性能需要改进。在本文中,我们提出了一种网络架构,联合执行几何理解(即,深度预测和3D平面估计)以及对单个食物图像的语义预测,从而实现稳健且准确的食物体积估计,而不管目标平面的纹理特性如何。对于网络的训练,只需要具有语义地面实况的单眼视频,而不再需要深度图和3D平面地面实况。在两个独立的食物图像数据库上的实验结果表明,该方法在无纹理的情况下表现稳健,优于无监督网络和基于运动恢复结构运动恢复结构的方法,同时它实现了与全监督方法相当的性能。

英文摘要:

Food volume estimation is an essential step in the pipeline of dietary assessment and demands the precise depth estimation of the food surface and table plane. Existing methods based on computer vision require either multi-image input or additional depth maps, reducing convenience of implementation and practical significance. Despite the recent advances in unsupervised depth estimation from a single image, the achieved performance in the case of large texture-less areas needs to be improved. In this paper, we propose a network architecture that jointly performs geometric understanding (i.e., depth prediction and 3D plane estimation) and semantic prediction on a single food image, enabling a robust and accurate food volume estimation regardless of the texture characteristics of the target plane. For the training of the network, only monocular videos with semantic ground truth are required, while the depth map and 3D plane ground truth are no longer needed. Experimental results on two separate food image databases demonstrate that our method performs robustly on texture-less scenarios and is superior to unsupervised networks and structure from motion based approaches, while it achieves comparable performance to fully-supervised methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑