Included few details about the dataset. This paper has been accepted in IEEE Access. Citation: S. Shorewala, A. Ashfaque, S. R and U. Verma, "Weed Density and Distribution Estimation for Precision Agriculture using Semi-Supervised Learning," in IEEE Access, doi: 10.1109/ACCESS.2021.3057912
Uncontrolled growth of weeds can severely affect the crop yield and quality. Unrestricted use of herbicide for weed removal alters biodiversity and cause environmental pollution. Instead, identifying weed-infested regions can aid selective chemical treatment of these regions. Advances in analyzing farm images have resulted in solutions to identify weed plants. However, a majority of these approaches are based on supervised learning methods which requires huge amount of manually annotated images. As a result, these supervised approaches are economically infeasible for the individual farmer because of the wide variety of plant species being cultivated. In this paper, we propose a deep learning-based semi-supervised approach for robust estimation of weed density and distribution across farmlands using only limited color images acquired from autonomous robots. This weed density and distribution can be useful in a site-specific weed management system for selective treatment of infected areas using autonomous robots. In this work, the foreground vegetation pixels containing crops and weeds are first identified using a Convolutional Neural Network (CNN) based unsupervised segmentation. Subsequently, the weed infected regions are identified using a fine-tuned CNN, eliminating the need for designing hand-crafted features. The approach is validated on two datasets of different crop/weed species (1) Crop Weed Field Image Dataset (CWFID), which consists of carrot plant images and the (2) Sugar Beets dataset. The proposed method is able to localize weed-infested regions a maximum recall of 0.99 and estimate weed density with a maximum accuracy of 82.13%. Hence, the proposed approach is shown to generalize to different plant species without the need for extensive labeled data.
Precision farming robots, which target to reduce the amount of herbicides that need to be brought out in the fields, must have the ability to identify crops and weeds in real time to trigger weeding actions. In this paper, we address the problem of CNN-based semantic segmentation of crop fields separating sugar beet plants, weeds, and background solely based on RGB data. We propose a CNN that exploits existing vegetation indexes and provides a classification in real time. Furthermore, it can be effectively re-trained to so far unseen fields with a comparably small amount of training data. We i…
Lincoln Institute of Agri-food Technology, University of Lincoln（林肯大学林肯农业食品技术研究所）；Lincoln Centre for Autonomous Systems, University of Lincoln（林肯大学林肯自主系统中心）
The evolution of smaller, faster processors and cheaper digital storage mechanisms across the last 4-5 decades has vastly increased the opportunity to integrate intelligent technologies in a wide range of practical environments to address a broad spectrum of tasks. One exciting application domain for such technologies is precision agriculture, where the ability to integrate on-board machine vision with data-driven actuation means that farmers can make decisions about crop care and harvesting at the level of the individual plant rather than the whole field. This makes sense both economically an…
WeedVision: Multi-Stage Growth and Classification of Weeds using DETR and RetinaNet for Precision Agriculture
School of Computing（计算机学院）；Southern Illinois University Carbondale（南伊利诺伊大学卡本代尔分校）；Department of Plant Soils and Agricultural Systems（植物土壤与农业系统系）；School of Agricultural Sciences（农业科学学院）；School of Biological Sciences（生物科学学院）
CWD30: A Comprehensive and Holistic Dataset for Crop Weed Recognition in Precision Agriculture
Jeonbuk National University（全北国立大学）；Core Research Institute of Intelligent Robots, Jeonbuk National University（全北国立大学智能机器人核心研究所）；Universitas Udayana（乌达亚纳大学）；Rural Development Administration, National Institute of Crop Science（农村振兴厅国家作物科学研究所）
Centre de Developpement de Technologies Avancees（先进技术开发中心）
Computer vision techniques have attracted a great interest in precision agriculture, recently. The common goal of all computer vision-based precision agriculture tasks is to detect the objects of interest (e.g., crop, weed) and discriminating them from the background. The Weeds are unwanted plants growing among crops competing for nutrients, water, and sunlight, causing losses to crop yields. Weed detection and mapping is critical for site-specific weed management to reduce the cost of labor and impact of herbicides. This paper investigates the use of color and texture features for discriminat…
High efficiency in precision farming depends on accurate tools to perform weed detection and mapping of crops. This allows for precise removal of harmful weeds with a lower amount of pesticides, as well as increase of the harvest's yield by providing the farmer with valuable information. In this paper, we address the problem of fully automatic stem detection from image data for this purpose. Our approach runs on mobile agricultural robots taking RGB images. After processing the images to obtain a vegetation mask, our approach separates each plant into its individual leaves and later estimates …
We present two large datasets of labelled plant-images that are suited towards the training of machine learning and computer vision models. The first dataset encompasses as the day of writing over 1.2 million images of indoor-grown crops and weeds common to the Canadian Prairies and many US states. The second dataset consists of over 540,000 images of plants imaged in farmland. All indoor plant images are labelled by species and we provide rich etadata on the level of individual images. This comprehensive database allows to filter the datasets under user-defined specifications such as for exam…
University of Orléans（奥尔良大学）；INSA Centre Val de Loire（卢瓦尔河谷国立应用科学学院）
In modern agriculture, usually weeds control consists in spraying herbicides all over the agricultural field. This practice involves significant waste and cost of herbicide for farmers and environmental pollution. One way to reduce the cost and environmental impact is to allocate the right doses of herbicide at the right place and at the right time (Precision Agriculture). Nowadays, Unmanned Aerial Vehicle (UAV) is becoming an interesting acquisition system for weeds localization and management due to its ability to obtain the images of the entire agricultural field with a very high spatial re…
EcoWeedNet: A Lightweight and Automated Weed Detection Method for Sustainable Next-Generation Agricultural Consumer Electronics
Computer Engineering Department, King Fahd University of Petroleum and Minerals（国王法赫德石油与矿物大学计算机工程系）；SDAIA-KFUPM Joint Research Center on Artificial Intelligence, IRC for Intelligent Secure Systems and Department of Computer Engineering（人工智能联合研究中心、智能安全系统研究所及计算机工程系）
Smart weeding systems to perform plant-specific operations can contribute to the sustainability of agriculture and the environment. Despite monumental advances in autonomous robotic technologies for precision weed management in recent years, work on under-canopy weeding in fields is yet to be realized. A prerequisite of such systems is reliable detection and classification of weeds to avoid mistakenly spraying and, thus, damaging the surrounding plants. Real-time multi-class weed identification enables species-specific treatment of weeds and significantly reduces the amount of herbicide use. H…
Over the past decade, unprecedented progress in the development of neural networks influenced dozens of different industries, including weed recognition in the agro-industrial sector. The use of neural networks in agro-industrial activity in the task of recognizing cultivated crops is a new direction. The absence of any standards significantly complicates the understanding of the real situation of the use of the neural network in the agricultural sector. The manuscript presents the complete analysis of researches over the past 10 years on the use of neural networks for the classification and t…
Improving Lightweight Weed Detection via Knowledge Distillation
University of Hohenheim（霍根海姆大学）；Dept. of Artificial Intelligence in Agricultural Engineering & Computational Science Hub Stuttgart, Germany（农业工程与计算科学人工智能部门，斯图加特研究中心，德国）
Selective weeding is one of the key challenges in the field of agriculture robotics. To accomplish this task, a farm robot should be able to accurately detect plants and to distinguish them between crop and weeds. Most of the promising state-of-the-art approaches make use of appearance-based models trained on large annotated datasets. Unfortunately, creating large agricultural datasets with pixel-level annotations is an extremely time consuming task, actually penalizing the usage of data-driven techniques. In this paper, we face this problem by proposing a novel and effective approach that aim…
INSA CVL（INSA中央卢瓦尔河谷校区）；University of Orleans（奥尔良大学）；PRISME EA 4229（PRISME EA 4229研究所）
Crop and weed monitoring is an important challenge for agriculture and food production nowadays. Thanks to recent advances in data acquisition and computation technologies, agriculture is evolving to a more smart and precision farming to meet with the high yield and high quality crop production. Classification and recognition in Unmanned Aerial Vehicles (UAV) images are important phases for crop monitoring. Advances in deep learning models relying on Convolutional Neural Network (CNN) have achieved high performances in image classification in the agricultural domain. Despite the success of thi…
Weed Detection in Challenging Field Conditions: A Semi-Supervised Framework for Overcoming Shadow Bias and Data Scarcity
College of Science and Engineering, James Cook University（詹姆斯库克大学科学与工程学院）；Agriculture Technology and Adoption Centre, James Cook University（詹姆斯库克大学农业技术与采纳中心）；ARC Training Centre in Plant Biosecurity（植物生物安全培训中心）
Semi-Supervised Weed Detection for Rapid Deployment and Enhanced Efficiency
College of Science and Engineering, James Cook University（詹姆斯库克大学科学与工程学院）；AutoWeed Pty Ltd（AutoWeed私人有限公司）；Agriculture Technology and Adoption Centre, James Cook University（詹姆斯库克大学农业技术与推广中心）
Reducing the use of agrochemicals is an important component towards sustainable agriculture. Robots that can perform targeted weed control offer the potential to contribute to this goal, for example, through specialized weeding actions such as selective spraying or mechanical weed removal. A prerequisite of such systems is a reliable and robust plant classification system that is able to distinguish crop and weed in the field. A major challenge in this context is the fact that different fields show a large variability. Thus, classification systems have to robustly cope with substantial environ…
Deep Learning Techniques for In-Crop Weed Identification: A Review
School of Computer Science, The University of Sydney（悉尼大学计算机学院）；School of Life and Environmental Sciences, The University of Sydney（悉尼大学生命与环境科学学院）；Australian Centre for Field Robotics, The University of Sydney（悉尼大学澳大利亚田间机器人中心）；College of Information Science and Technology, Dalian Maritime University（大连海事大学信息科学技术学院）；College of Mathematics and Computer Science, Wuhan Polytechnic University（武汉轻工大学数学与计算机学院）；Department of Computer Science and Engineering, Texas A&M University（德克萨斯农工大学计算机科学与工程系）；Citrus Research and Education Center, University of Florida（佛罗里达大学柑橘研究与教育中心）
In agriculture, the majority of vision systems perform still image classification. Yet, recent work has highlighted the potential of spatial and temporal cues as a rich source of information to improve the classification performance. In this paper, we propose novel approaches to explicitly capture both spatial and temporal information to improve the classification of deep convolutional neural networks. We leverage available RGB-D images and robot odometry to perform inter-frame feature map spatial registration. This information is then fused within recurrent deep learnt models, to improve thei…
College of Science and Engineering, James Cook University（詹姆斯·库克大学理工学院）
Robotic weed control has seen increased research of late with its potential for boosting productivity in agriculture. Majority of works focus on developing robotics for croplands, ignoring the weed management problems facing rangeland stock farmers. Perhaps the greatest obstacle to widespread uptake of robotic weed control is the robust classification of weed species in their natural environment. The unparalleled successes of deep learning make it an ideal candidate for recognising various weed species in the complex rangeland environment. This work contributes the first large, public, multicl…
Murdoch University（莫道克大学）；Centre for Crop and Food Innovation（作物与食品创新中心）；Food Futures Institute（食品未来研究所）；Department of Primary Industries and Regional Development, Western Australia（西澳大利亚州初级产业与区域发展部）；Centre for Sustainable Farming Systems（可持续农业系统中心）；Centre of Biosecurity and One Health, Harry Butler Institute（哈里·巴特勒研究所生物安全与同一健康中心）
The rapid advances in Deep Learning (DL) techniques have enabled rapid detection, localisation, and recognition of objects from images or videos. DL techniques are now being used in many applications related to agriculture and farming. Automatic detection and classification of weeds can play an important role in weed management and so contribute to higher yields. Weed detection in crops from imagery is inherently a challenging problem because both weeds and crops have similar colours ('green-on-green'), and their shapes and texture can be very similar at the growth phase. Also, a crop in one s…
Computer Engineering Department, King Fahd University of Petroleum and Minerals (KFUPM)（计算机工程系，国王法赫德石油与矿物大学）；SDAIA-KFUPM Joint Research Center on Artificial Intelligence, IRC for Intelligent Secure Systems and Department of Computer Engineering, KFUPM（SDAIA-KFUPM人工智能联合研究中心，智能安全系统研究院及计算机工程系，KFUPM）；Center for Intelligent Secure Systems and the Department of Computer Engineering, King Fahd University of Petroleum & Minerals（智能安全系统中心及计算机工程系，国王法赫德石油与矿物大学）；Research Chair of Pervasive and Mobile Computing, Department of Software Engineering, College of Computer and Information Sciences, King Saud University（普及与移动计算研究主席，软件工程系，计算机与信息科学学院，国王沙特大学）
本文提出TinyEcoWeedNet，通过结构化剪枝、量化感知训练和TensorRT加速，在Jetson Orin Nano上实现184 FPS实时杂草检测，模型缩小68.5%，并在CottonWeedDet12上以85.9% mAP50超越YOLO11n和YOLO12n。
USU-Corn-WeedDB: A UAV RGB Image Dataset for Multi-Species Weed Detection in Forage Corn
Department of Applied Sciences, Technology, and Education, Utah State University（应用科学、技术和教育系，犹他州立大学）；Department of Plants, Soils & Climate, Utah State University（植物、土壤与气候系，犹他州立大学）；Department of Civil and Environmental Engineering, Utah State University（土木与环境工程系，犹他州立大学）
Modular Transformer Architecture for Precision Agriculture Imaging
University Park The Pennsylvania State University PA, United States（帕克大学帕萨迪纳分校）；Engineering Division, Great Valley The Pennsylvania State University PA, United States（工程部，大山谷帕萨迪纳分校）
Improved Crop and Weed Detection with Diverse Data Ensemble Learning
University of Regina（里贾纳大学）；King Fahd University of Petroleum and Minerals（法赫德国王石油与矿业大学）；SDAIA-KFUPM Joint Research Center for Artificial Intelligence（SDAIA-KFUPM人工智能联合研究中心）
Advances in deep learning and transfer learning have paved the way for various automation classification tasks in agriculture, including plant diseases, pests, weeds, and plant species detection. However, agriculture automation still faces various challenges, such as the limited size of datasets and the absence of plant-domain-specific pretrained models. Domain specific pretrained models have shown state of art performance in various computer vision tasks including face recognition and medical imaging diagnosis. In this paper, we propose AgriNet dataset, a collection of 160k agricultural image…
Unmanned aerial vehicles (UAV) are used in precision agriculture (PA) to enable aerial monitoring of farmlands. Intelligent methods are required to pinpoint weed infestations and make optimal choice of pesticide. UAV can fly a multispectral camera and collect data. However, the classification of multispectral images using supervised machine learning algorithms such as convolutional neural networks (CNN) requires large amount of training data. This is a common drawback in deep learning we try to circumvent making use of a semi-supervised generative adversarial networks (GAN), providing a pixel-…
Mississippi State University（密西西比州立大学）；Michigan State University（密歇根州立大学）；United States Department of Agriculture, Agricultural Research Service（美国农业部农业研究局）
In agricultural image analysis, optimal model performance is keenly pursued for better fulfilling visual recognition tasks (e.g., image classification, segmentation, object detection and localization), in the presence of challenges with biological variability and unstructured environments. Large-scale, balanced and ground-truthed image datasets, however, are often difficult to obtain to fuel the development of advanced, high-performance models. As artificial intelligence through deep learning is impacting analysis and modeling of agricultural images, data augmentation plays a crucial role in b…
WeedNet: A Foundation Model-Based Global-to-Local AI Approach for Real-Time Weed Species Identification and Classification
Department of Agronomy, Iowa State University, Iowa, USA（农业学系，爱荷华州立大学）；Department of Computer Science, Iowa State University, Iowa, USA（计算机科学系，爱荷华州立大学）；Data Science Institute, University of Arizona, Arizona, USA（数据科学研究所，亚利桑那大学）；Department of Mechanical Engineering, Iowa State University, Iowa, USA（机械工程系，爱荷华州立大学）；Department of Plant Pathology, Entomology and Microbiology, Iowa State University, Iowa, USA（植物病理学、昆虫学和微生物学系，爱荷华州立大学）
Agriculture is vital for human survival and remains a major driver of several economies around the world; more so in underdeveloped and developing economies. With increasing demand for food and cash crops, due to a growing global population and the challenges posed by climate change, there is a pressing need to increase farm outputs while incurring minimal costs. Previous machine vision technologies developed for selective weeding have faced the challenge of reliable and accurate weed detection. We present approaches for plant seedlings classification with a dataset that contains 4,275 images …
A lack of sufficient training data, both in terms of variety and quantity, is often the bottleneck in the development of machine learning (ML) applications in any domain. For agricultural applications, ML-based models designed to perform tasks such as autonomous plant classification will typically be coupled to just one or perhaps a few plant species. As a consequence, each crop-specific task is very likely to require its own specialized training data, and the question of how to serve this need for data now often overshadows the more routine exercise of actually training such models. To tackle…
Robotic System with AI for Real Time Weed Detection, Canopy Aware Spraying, and Droplet Pattern Evaluation
Machine Vision and Optical Sensor (MVOS) Lab, Dept. of Agricultural and Biosystems Engineering, South Dakota State University, Brookings, SD, USA（机械视觉与光学传感器实验室，农业与生物系统工程系，南达科他州立大学，布鲁金斯，SD，USA）；Department of Agronomy, Horticulture and Plant Science, South Dakota State University, Brookings, SD, USA（园艺、园艺学与植物科学系，南达科他州立大学，布鲁金斯，SD，USA）
本研究开发了一种基于AI的机器人喷洒系统，利用YOLO11模型在Jetson Orin Nano上实时检测杂草和冠层，动态调整喷嘴，实现精准除草剂施用，减少成本与污染。
