MetaFood CVPR 2024 物理信息驱动的3D食物重建挑战赛:方法与结果
MetaFood CVPR 2024 Challenge on Physically Informed 3D Food Reconstruction: Methods and Results
AI总结:
针对3D食物重建领域数据稀缺、产学研合作不足的问题,本文介绍了CVPR 2024 MetaFood研讨会举办的物理信息驱动3D食物重建挑战赛的设置、参赛情况及成果,为膳食监测相关技术发展提供支撑。
摘要:
随着营养与膳食监测领域的计算机视觉应用日益受到关注,针对食物的先进3D重建技术得以发展。然而,高质量数据的稀缺以及产学研合作有限,制约了该领域的进展。基于3D重建领域的最新进展,我们举办了MetaFood研讨会及其“物理信息驱动的3D食物重建”挑战赛。本次挑战赛的核心任务是利用可见的棋盘格作为尺寸参考,从2D图像重建出体积准确的食物3D模型。参赛者需完成20种选定食物的3D模型重建,这些食物按难度分为简单、中等、困难三个等级:简单等级提供200张图像,中等等级提供30张图像,困难等级仅提供1张图像用于重建。最终测试阶段共有16支队伍提交了结果。本次挑战赛中诞生的解决方案在3D食物重建方面取得了可观的成果,对于提升膳食评估与营养监测中的食物分量估算能力具有巨大潜力。关于本次研讨会挑战赛的更多细节以及数据集获取渠道,可访问https://sites.google.com/view/cvpr-metafood-2024。
英文摘要:
The increasing interest in computer vision applications for nutrition and dietary monitoring has led to the development of advanced 3D reconstruction techniques for food items. However, the scarcity of high-quality data and limited collaboration between industry and academia have constrained progress in this field. Building on recent advancements in 3D reconstruction, we host the MetaFood Workshop and its challenge for Physically Informed 3D Food Reconstruction. This challenge focuses on reconstructing volume-accurate 3D models of food items from 2D images, using a visible checkerboard as a size reference. Participants were tasked with reconstructing 3D models for 20 selected food items of varying difficulty levels: easy, medium, and hard. The easy level provides 200 images, the medium level provides 30 images, and the hard level provides only 1 image for reconstruction. In total, 16 teams submitted results in the final testing phase. The solutions developed in this challenge achieved promising results in 3D food reconstruction, with significant potential for improving portion estimation for dietary assessment and nutritional monitoring. More details about this workshop challenge and access to the dataset can be found at https://sites.google.com/view/cvpr-metafood-2024.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。