Autonomous crop monitoring at high spatial and temporal resolution is a critical problem in precision agriculture. While Structure from Motion and Multi-View Stereo algorithms can finely reconstruct the 3D structure of a field with low-cost image sensors, these algorithms fail to capture the dynamic nature of continuously growing crops. In this paper we propose a 4D reconstruction approach to crop monitoring, which employs a spatio-temporal model of dynamic scenes that is useful for precision agriculture applications. Additionally, we provide a robust data association algorithm to address the problem of large appearance changes due to scenes being viewed from different angles at different points in time, which is critical to achieving 4D reconstruction. Finally, we collected a high quality dataset with ground truth statistics to evaluate the performance of our method. We demonstrate that our 4D reconstruction approach provides models that are qualitatively correct with respect to visual appearance and quantitatively accurate when measured against the ground truth geometric properties of the monitored crops.
Precision farming robots, which target to reduce the amount of herbicides that need to be brought out in the fields, must have the ability to identify crops and weeds in real time to trigger weeding actions. In this paper, we address the problem of CNN-based semantic segmentation of crop fields separating sugar beet plants, weeds, and background solely based on RGB data. We propose a CNN that exploits existing vegetation indexes and provides a classification in real time. Furthermore, it can be effectively re-trained to so far unseen fields with a comparably small amount of training data. We i…
Real-time object detection and robotic manipulation for agriculture using a YOLO-based learning approach
Imperial College（帝国理工学院）；University of Sheffield（谢菲尔德大学）；University of Manchester（曼彻斯特大学）；University of Southampton（南安普顿大学）；Fudan University（复旦大学）；Iowa State University（爱荷华州立大学）
Tampere University（坦佩雷大学）；Sampoerna University（桑波尔纳大学）
The rapid development of technology has brought unmanned aerial vehicles (UAVs) to become widely known in the current era. The market of UAVs is also predicted to continue growing with related technologies in the future. UAVs have been used in various sectors, including livestock, forestry, and agriculture. In agricultural applications, UAVs are highly capable of increasing the productivity of the farm and reducing farmers' workload. This paper discusses the application of UAVs in agriculture, particularly in spraying and crop monitoring. This study examines the urgency of UAV implementation i…
We present two large datasets of labelled plant-images that are suited towards the training of machine learning and computer vision models. The first dataset encompasses as the day of writing over 1.2 million images of indoor-grown crops and weeds common to the Canadian Prairies and many US states. The second dataset consists of over 540,000 images of plants imaged in farmland. All indoor plant images are labelled by species and we provide rich etadata on the level of individual images. This comprehensive database allows to filter the datasets under user-defined specifications such as for exam…
Manipal Institute of Technology, Manipal Academy of Higher Education（马尼帕尔高等教育学院马尼帕尔理工学院）
Uncontrolled growth of weeds can severely affect the crop yield and quality. Unrestricted use of herbicide for weed removal alters biodiversity and cause environmental pollution. Instead, identifying weed-infested regions can aid selective chemical treatment of these regions. Advances in analyzing farm images have resulted in solutions to identify weed plants. However, a majority of these approaches are based on supervised learning methods which requires huge amount of manually annotated images. As a result, these supervised approaches are economically infeasible for the individual farmer beca…
Autonomous navigation is a pre-requisite for field robots to carry out precision agriculture tasks. Typically, a robot has to navigate through a whole crop field several times during a season for monitoring the plants, for applying agrochemicals, or for performing targeted intervention actions. In this paper, we propose a framework tailored for navigation in row-crop fields by exploiting the regular crop-row structure present in the fields. Our approach uses only the images from on-board cameras without the need for performing explicit localization or maintaining a map of the field and thus ca…
High efficiency in precision farming depends on accurate tools to perform weed detection and mapping of crops. This allows for precise removal of harmful weeds with a lower amount of pesticides, as well as increase of the harvest's yield by providing the farmer with valuable information. In this paper, we address the problem of fully automatic stem detection from image data for this purpose. Our approach runs on mobile agricultural robots taking RGB images. After processing the images to obtain a vegetation mask, our approach separates each plant into its individual leaves and later estimates …
Trường Đại học Công nghệ, Đại học Quốc gia Hà Nội（河内国家大学所属技术大学）；Trường Đại học Kinh tế - Kỹ thuật Công nghiệp（工业经济与技术大学）
Agricultural production using high technology is an inevitable trend in Vietnam. Especially for material crops which typically need large growing areas, wireless sensor networks has been clearly playing a significant role in increasing productivity, monitoring pests and diseases, mitigating the impact of climate change, and reducing the direct labor of cultivators. This paper constructs an experimental model of agricultural crop field monitoring using a combination of LoRa wireless sensor networks and unmanned aerial vehicles to collect data on conditions of weather and soil, plant health, whi…
Precision agriculture aims to use technological tools for the agro-food sector to increase productivity, cut labor costs, and reduce the use of resources. This work takes inspiration from bees vision to design a remote sensing system tailored to incorporate UV-reflectance into a flower detector. We demonstrate how this approach can provide feature-rich images for deep learning strawberry flower detection and we apply it to a scalable, yet cost effective aerial monitoring robotic system in the field. We also compare the performance of our UV-G-B image detector with a similar work that utilizes …
In agriculture, the majority of vision systems perform still image classification. Yet, recent work has highlighted the potential of spatial and temporal cues as a rich source of information to improve the classification performance. In this paper, we propose novel approaches to explicitly capture both spatial and temporal information to improve the classification of deep convolutional neural networks. We leverage available RGB-D images and robot odometry to perform inter-frame feature map spatial registration. This information is then fused within recurrent deep learnt models, to improve thei…
AgriCruiser: An Open Source Agriculture Robot for Over-the-row Navigation
Dept. of Mechanical & Aerospace Engineering University of California, Los Angeles（机械与航空航天工程系，加州大学洛杉矶分校）；Dept. of Mathematics University of California, Los Angeles（数学系，加州大学洛杉矶分校）；Dept. of Plant Sciences North Dakota State University（植物科学系，北达科塔州立大学）
Design and Evaluation of an AI-Enabled Cloud-Edge Architecture for Connected Precision Agriculture Farms
Autonomous Robotics Systems Limited（自主机器人系统有限公司）；University of Hyderabad（海得拉巴大学）；ThoughtGreen Technologies Private Limited（ThoughtGreen科技私人有限公司）；Ideabytes Software India Private Limited（Ideabytes软件印度私人有限公司）；Georgia Institute of Technology（佐治亚理工学院）；Tata Consultancy Services（塔塔咨询服务公司）；EPAM India（埃培智印度分公司）；Kaveri University（卡弗里大学）；University of Malaya（马来亚大学）
