DAVIS-Ag:用于农业机器人领域启发式主动视觉原型构建的合成植物数据集
DAVIS-Ag: A Synthetic Plant Dataset for Prototyping Domain-Inspired Active Vision in Agricultural Robots
AI总结:
本文提出DAVIS-Ag合成植物数据集,利用AgML与Helios生成50余万张多作物多尺度图像及标签,用于农业机器人主动视点规划研究,并通过基线实验和真实环境迁移验证其有效性。
摘要:
在农业环境中,视点规划对于配备视觉传感器的机器人来说是一项关键功能,使其能够从具有随机遮挡的复杂植物结构中获取感兴趣对象(如果实)的有效观测。尽管近期关于主动视觉的研究已显示出在农业任务中的一定潜力,但每个模型都是在各自独特的环境中设计和验证的,这些环境难以复现,从而不利于对后续开发的新方法进行基准测试。本文中,我们引入了一个名为DAVIS-Ag的数据集,以促进农业领域启发式主动视觉(Domain-inspired Active VISion in Agriculture)的更广泛研究。具体而言,我们利用开源的“AgML”框架和“Helios”三维植物模拟器,在632个合成果园中的30K个密集采样空间位置生成了502K张RGB图像。此外,还考虑了草莓、番茄和葡萄的植物环境,并涵盖两种不同尺度(即单株和多株)。每张图像还提供了有用的标签,包括:(1)所有可识别果实的边界框和(2)实例分割掩码,以及(3)指向通过执行动作可到达的其他视点图像的指针,以便在每个时间步模拟主动视点选择。利用DAVIS-Ag,我们可视化了具有启发性的示例,其中果实可见性会因相机视角姿态的变化而发生剧烈变化,这主要是由于叶子等其他组成部分造成的遮挡。此外,我们提出了若干基线模型及实验结果,用于在目标可见性最大化任务中进行基准测试。我们还研究了向真实草莓环境的可迁移性,以证明使用该数据集进行现实世界解决方案原型构建的可行性。为便于未来研究,我们的数据集已在线公开:https://github.com/ctyeong/DAVIS-Ag。
英文摘要:
In agricultural environments, viewpoint planning can be a critical functionality for a robot with visual sensors to obtain informative observations of objects of interest (e.g., fruits) from complex structures of plant with random occlusions. Although recent studies on active vision have shown some potential for agricultural tasks, each model has been designed and validated on a unique environment that would not easily be replicated for benchmarking novel methods being developed later. In this paper, we introduce a dataset, so-called DAVIS-Ag, for promoting more extensive research on Domain-inspired Active VISion in Agriculture. To be specific, we leveraged our open-source "AgML" framework and 3D plant simulator of "Helios" to produce 502K RGB images from 30K densely sampled spatial locations in 632 synthetic orchards. Moreover, plant environments of strawberries, tomatoes, and grapes are considered at two different scales (i.e., Single-Plant and Multi-Plant). Useful labels are also provided for each image, including (1) bounding boxes and (2) instance segmentation masks for all identifiable fruits, and also (3) pointers to other images of the viewpoints that are reachable by an execution of action so as to simulate active viewpoint selections at each time step. Using DAVIS-Ag, we visualize motivating examples where fruit visibility can dramatically change depending on the pose of the camera view primarily due to occlusions by other components, such as leaves. Furthermore, we present several baseline models with experiment results for benchmarking in the task of target visibility maximization. Transferability to real strawberry environments is also investigated to demonstrate the feasibility of using the dataset for prototyping real-world solutions. For future research, our dataset is made publicly available online: https://github.com/ctyeong/DAVIS-Ag.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。