Many applications for the automated diagnosis of plant disease have been developed based on the success of deep learning techniques. However, these applications often suffer from overfitting, and the diagnostic performance is drastically decreased when used on test datasets from new environments. In this paper, we propose LeafGAN, a novel image-to-image translation system with own attention mechanism. LeafGAN generates a wide variety of diseased images via transformation from healthy images, as a data augmentation tool for improving the performance of plant disease diagnosis. Thanks to its own attention mechanism, our model can transform only relevant areas from images with a variety of backgrounds, thus enriching the versatility of the training images. Experiments with five-class cucumber disease classification show that data augmentation with vanilla CycleGAN cannot help to improve the generalization, i.e., disease diagnostic performance increased by only 0.7% from the baseline. In contrast, LeafGAN boosted the diagnostic performance by 7.4%. We also visually confirmed the generated images by our LeafGAN were much better quality and more convincing than those generated by vanilla CycleGAN. The code is available publicly at: https://github.com/IyatomiLab/LeafGAN.
School of Electronics Engineering and Computer Science Peking University（北京大学电子工程与计算机科学学院）；Institute of Sports Medicine Peking University Third Hospital（北京大学第三医院运动医学研究所）
The process of determining which disease or condition explains a person's symptoms and signs can be very complicated and may be inaccurate in some cases. The general belief is that diagnosing diseases relies on doctors' keen intuition, rich experience and professional equipment. In this work, we employ ideas from recent advances in plantar pressure research and from the powerful capacity of the convolutional neural network for learning representations. Here, we propose a model using convolutional neural network based on plantar pressure for medical diagnosis. Our model learns a network that ma…
Hosei University（法政大学）；Saitama Agricultural Technology Research Center（埼玉县农业技术研究中心）
In image-based plant diagnosis, clues related to diagnosis are often unclear, and the other factors such as image backgrounds often have a significant impact on the final decision. As a result, overfitting due to latent similarities in the dataset often occurs, and the diagnostic performance on real unseen data (e,g. images from other farms) is usually dropped significantly. However, this problem has not been sufficiently explored, since many systems have shown excellent diagnostic performance due to the bias caused by the similarities in the dataset. In this study, we investigate this problem…
Tesla STEM High School（特斯拉STEM高中）；Lockheed Martin Corporation（洛克希德·马丁公司）；Seattle University（西雅图大学）
Automated plant diagnosis is a technology that promises large increases in cost-efficiency for agriculture. However, multiple problems reduce the effectiveness of drones, including the inverse relationship between resolution and speed and the lack of adequate labeled training data. This paper presents a two-step machine learning approach that analyzes low-fidelity and high-fidelity images in sequence, preserving efficiency as well as accuracy. Two data-generators are also used to minimize class imbalance in the high-fidelity dataset and to produce low-fidelity data that is representative of UA…
This paper proposes an unsupervised anomaly detection technique for image-based plant disease diagnosis. The construction of large and publicly available datasets containing labeled images of healthy and diseased crop plants led to growing interest in computer vision techniques for automatic plant disease diagnosis. Although supervised image classifiers based on deep learning can be a powerful tool for plant disease diagnosis, they require a huge amount of labeled data. The data mining technique of anomaly detection includes unsupervised approaches that do not require rare samples for training…
Bangladesh University of Business and Technology（孟加拉国商业技术大学）
A disease that limits a plant from its maximal capacity is defined as plant disease. From the perspective of agriculture, diagnosing plant disease is crucial, as diseases often limit plants' production capacity. However, manual approaches to recognize plant diseases are often temporal, challenging, and time-consuming. Therefore, computerized recognition of plant diseases is highly desired in the field of agricultural automation. Due to the recent improvement of computer vision, identifying diseases using leaf images of a particular plant has already been introduced. Nevertheless, the most intr…
Hosei University（法政大学）；Saitama Agricultural Technology Research Center（埼玉县农业技术研究中心）
Practical automated detection and diagnosis of plant disease from wide-angle images (i.e. in-field images containing multiple leaves using a fixed-position camera) is a very important application for large-scale farm management, in view of the need to ensure global food security. However, developing automated systems for disease diagnosis is often difficult, because labeling a reliable wide-angle disease dataset from actual field images is very laborious. In addition, the potential similarities between the training and test data lead to a serious problem of model overfitting. In this paper, we…
Hosei University（法政大学）；Saitama Agricultural Technology Research Center（埼玉县农业技术研究中心）
Automated plant diagnosis using images taken from a distance is often insufficient in resolution and degrades diagnostic accuracy since the important external characteristics of symptoms are lost. In this paper, we first propose an effective pre-processing method for improving the performance of automated plant disease diagnosis systems using super-resolution techniques. We investigate the efficiency of two different super-resolution methods by comparing the disease diagnostic performance on the practical original high-resolution, low-resolution, and super-resolved cucumber images. Our method …
Robust Plant Disease Diagnosis with Few Target-Domain Samples
Department of Applied Informatics, Graduate School of Science and Engineering, Hosei University（应用信息系，理工学研究院，恒生大学）；Department of Clinical Plant Science, Faculty of Bioscience and Applied Chemistry, Hosei University（临床植物科学系，生物科学与应用化学学部，恒生大学）
Hosei University（法政大学）；Saitama Agricultural Technology Research Center（埼玉农业技术研究中心）
The collection of high-resolution training data is crucial in building robust plant disease diagnosis systems, since such data have a significant impact on diagnostic performance. However, they are very difficult to obtain and are not always available in practice. Deep learning-based techniques, and particularly generative adversarial networks (GANs), can be applied to generate high-quality super-resolution images, but these methods often produce unexpected artifacts that can lower the diagnostic performance. In this paper, we propose a novel artifact-suppression super-resolution method that i…
PlantSeg: A Large-Scale In-the-wild Dataset for Plant Disease Segmentation
The University of Queensland（昆士兰大学）；School of Electrical Engineering and Computer Science, The University of Queensland（昆士兰大学电气工程与计算机科学学院）；School of Agriculture and Food Sustainability, The University of Queensland（昆士兰大学农业与食品可持续发展学院）；CSIRO（联邦科学与工业研究组织）
Rethinking Plant Disease Diagnosis: Bridging the Academic-Practical Gap with Vision Transformers and Zero-Shot Learning
Department of Computer Science, Mohamed El Bachir El Ibrahimi University（计算机科学系，莫亨德·埃巴希里·埃布拉希米大学）；Laboratory of Physical Chemistry and Biological Materials（物理化学与生物材料实验室）；Laboratory of Informatics and its Applications of M’sila, Mohamed Boudiaf University（信息学及其应用实验室，莫赫梅德·布迪亚夫大学）；Department of Computer Science, Mohamed Boudiaf University（计算机科学系，莫赫梅德·布迪亚夫大学）；Department of agricultural science, Mohamed El Bachir El Ibrahimi University（农业科学系，莫亨德·埃巴希里·埃布拉希米大学）；Laboratoire d’Amélioration et de Développement de la Production Végétale et Animale (LADPVA), University of Ferhat ABBAS (UFAS-Sétif1)（植物和动物生产改良与发展实验室（LADPVA），费哈特·阿巴斯大学（UFAS-Sétif1））
Harbin Institute of Technology（哈尔滨工业大学）；Peng Cheng Laboratory（鹏城实验室）；Peking University（北京大学）
Plant diseases serve as one of main threats to food security and crop production. It is thus valuable to exploit recent advances of artificial intelligence to assist plant disease diagnosis. One popular approach is to transform this problem as a leaf image classification task, which can be then addressed by the powerful convolutional neural networks (CNNs). However, the performance of CNN-based classification approach depends on a large amount of high-quality manually labeled training data, which are inevitably introduced noise on labels in practice, leading to model overfitting and performanc…
Fusing Perceptual Vision Experts with Multimodal LLMs for Explainable Plant Disease Diagnosis: From Benchmark Imagery to Real-World Robotic Field Validation
Cornell University（康奈尔大学）；University of the Peloponnese（伯罗奔尼撒大学）；Agricultural University of Athens（雅典农业大学）
Crop diseases are a major threat to food security, but their rapid identification remains difficult in many parts of the world due to the lack of the necessary infrastructure. The combination of increasing global smartphone penetration and recent advances in computer vision made possible by deep learning has paved the way for smartphone-assisted disease diagnosis. Using a public dataset of 54,306 images of diseased and healthy plant leaves collected under controlled conditions, we train a deep convolutional neural network to identify 14 crop species and 26 diseases (or absence thereof). The tr…
PDPM Indian Institute of Information Technology, Design and Manufacturing（PDPM印度信息技术设计与制造学院）
Plant diseases are the primary cause of crop losses globally, with an impact on the world economy. To deal with these issues, smart agriculture solutions are evolving that combine the Internet of Things and machine learning for early disease detection and control. Many such systems use vision-based machine learning methods for real-time disease detection and diagnosis. With the advancement in deep learning techniques, new methods have emerged that employ convolutional neural networks for plant disease detection and identification. Another trend in vision-based deep learning is the use of visio…
Plant Doctor: A hybrid machine learning and image segmentation software to quantify plant damage in video footage
Waseda University（早稻田大学）；Kyoto Prefecture Momoyama High School（京都府立桃山高等学校）；Kyushu University（九州大学）；The University of Tokyo Hospital（东京大学医学部附属医院）；Ryukoku University（龙谷大学）
Automated Plant Disease and Pest Detection System Using Hybrid Lightweight CNN-MobileViT Models for Diagnosis of Indigenous Crops
Department of Computer Science \& Engineering；Department of Information Technology Mekelle University - Mekelle Institute of Technology, Ethiopia Email
Many existing techniques provide automatic estimation of crop damage due to various diseases. However, early detection can prevent or reduce the extend of damage itself. The limited performance of existing techniques in early detection is lack of localized information. We instead propose a dataset with annotations for each diseased segment in each image. Unlike existing approaches, instead of classifying images into either healthy or diseased, we propose to provide localized classification for each segment of an images. Our method is based on Mask RCNN and provides location as well as extend o…
The Institute for Sustainable Industries and Liveable Cities (ISILC), Victoria University（维多利亚大学可持续产业与宜居城市研究所（ISILC））；Namal Institute（纳马尔学院）；Charles Sturt University（查尔斯特大学）；Victoria University（维多利亚大学）
In the Agriculture sector, control of plant leaf diseases is crucial as it influences the quality and production of plant species with an impact on the economy of any country. Therefore, automated identification and classification of plant leaf disease at an early stage is essential to reduce economic loss and to conserve the specific species. Previously, to detect and classify plant leaf disease, various Machine Learning models have been proposed; however, they lack usability due to hardware incompatibility, limited scalability and inefficiency in practical usage. Our proposed DeepLens Classi…
Makerere University（麦克雷雷大学）；National Crops Resources Research Institute（国家作物资源研究所）
Pests and diseases pose a key challenge to passion fruit farmers across Uganda and East Africa in general. They lead to loss of investment as yields reduce and losses increases. As the majority of the farmers, including passion fruit farmers, in the country are smallholder farmers from low-income households, they do not have the sufficient information and means to combat these challenges. While, passion fruits have the potential to improve the well-being of these farmers as they have a short maturity period and high market value , without the required knowledge about the health of their crops,…
Apple diseases, if not diagnosed early, can lead to massive resource loss and pose a serious threat to humans and animals who consume the infected apples. Hence, it is critical to diagnose these diseases early in order to manage plant health and minimize the risks associated with them. However, the conventional approach of monitoring plant diseases entails manual scouting and analyzing the features, texture, color, and shape of the plant leaves, resulting in delayed diagnosis and misjudgments. Our work proposes an ensembled system of Xception, InceptionResNet, and MobileNet architectures to de…
Advances in deep learning and transfer learning have paved the way for various automation classification tasks in agriculture, including plant diseases, pests, weeds, and plant species detection. However, agriculture automation still faces various challenges, such as the limited size of datasets and the absence of plant-domain-specific pretrained models. Domain specific pretrained models have shown state of art performance in various computer vision tasks including face recognition and medical imaging diagnosis. In this paper, we propose AgriNet dataset, a collection of 160k agricultural image…
Thinking Like a Botanist: Challenging Multimodal Language Models with Intent-Driven Chain-of-Inquiry
Department of Robotics and Mechatronics Engineering, University of Dhaka（达卡大学机器人与机电工程系）；Department of Computer Science and Engineering, University of Dhaka（达卡大学计算机科学与工程系）；Department of Agronomy, Gazipur Agricultural University（加兹ipur农业大学作物学系）；Department of Botany, University of Dhaka（达卡大学植物学系）
Crop diseases are a major threat to food security and their rapid identification is important to prevent yield loss. Swift identification of these diseases are difficult due to the lack of necessary infrastructure. Recent advances in computer vision and increasing penetration of smartphones have paved the way for smartphone-assisted disease identification. Most of the plant diseases leave particular artifacts on the foliar structure of the plant. This study was conducted in 2020 at Department of Computer Science and Engineering, University of Engineering and Technology, Lahore, Pakistan to che…
Dynamic Meta-Ensemble Framework for Efficient and Accurate Deep Learning in Plant Leaf Disease Detection on Resource-Constrained Edge Devices
South West University Science and Technology, School of Computer Science and Technology（西南科技大学计算机科学与技术学院）；South West University Science and Technology, School of Control and Information Engineering Technology（西南科技大学控制与信息工程学院）
LeafNet: A Large-Scale Dataset and Comprehensive Benchmark for Foundational Vision-Language Understanding of Plant Diseases
School of Electrical Engineering, Korea University（韩国大学电气工程学院）；Department of Integrative Biology, The University of Texas at Austin（德克萨斯大学奥斯汀分校整合生物学系）；Department of Software Engineering, FPT University（FPT大学软件工程系）
Apple orchards in the U.S. are under constant threat from a large number of pathogens and insects. Appropriate and timely deployment of disease management depends on early disease detection. Incorrect and delayed diagnosis can result in either excessive or inadequate use of chemicals, with increased production costs, environmental, and health impacts. We have manually captured 3,651 high-quality, real-life symptom images of multiple apple foliar diseases, with variable illumination, angles, surfaces, and noise. A subset, expert-annotated to create a pilot dataset for apple scab, cedar apple ru…
In this research, an attention-based depthwise separable neural network with Bayesian optimization (ADSNN-BO) is proposed to detect and classify rice disease from rice leaf images. Rice diseases frequently result in 20 to 40 \% corp production loss in yield and is highly related to the global economy. Rapid disease identification is critical to plan treatment promptly and reduce the corp losses. Rice disease diagnosis is still mainly performed manually. To achieve AI assisted rapid and accurate disease detection, we proposed the ADSNN-BO model based on MobileNet structure and augmented attenti…
Emory University（埃默里大学）；Stony Brook University（石溪大学）；Georgia State University（佐治亚州立大学）
Liver steatosis is known as the abnormal accumulation of lipids within cells. An accurate quantification of steatosis area within the liver histopathological microscopy images plays an important role in liver disease diagnosis and trans-plantation assessment. Such a quantification analysis often requires a precise steatosis segmentation that is challenging due to abundant presence of highly overlapped steatosis droplets. In this paper, a deep learning model Mask-RCNN is used to segment the steatosis droplets in clumps. Extended from Faster R-CNN, Mask-RCNN can predict object masks in addition …
Ferdowsi University of Mashhad（马什哈德菲尔多西大学）；University of Western Australia（西澳大学）
In the last decades, the area under cultivation of maize products has increased because of its essential role in the food cycle for humans, livestock, and poultry. Moreover, the diseases of plants impact food safety and can significantly reduce both the quality and quantity of agricultural products. There are many challenges to accurate and timely diagnosis of the disease. This research presents a novel scheme based on a deep neural network to overcome the mentioned challenges. Due to the limited number of data, the transfer learning technique is employed with the help of two well-known archit…
SugarcaneShuffleNet: A Very Fast, Lightweight Convolutional Neural Network for Diagnosis of 15 Sugarcane Leaf Diseases
Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka 1000, Bangladesh（机器人与机电工程系，达卡大学，达卡1000，孟加拉国）；GIS and Remote Sensing Lab, Gazipur Agricultural University, Gazipur 1706, Bangladesh（地理信息系统与遥感实验室，加兹ipur农业大学，加兹ipur 1706，孟加拉国）；Bangladesh Sugarcrop Research Institute, Ishwardi, Pabna, Bangladesh（孟加拉国甘蔗作物研究 institute，Ishwardi，Pabna，孟加拉国）；Department of Computer Science and Engineering, University of Dhaka, Dhaka 1000, Bangladesh（计算机科学与工程系，达卡大学，达卡1000，孟加拉国）
BAAI Cardiac Agent: An intelligent multimodal agent for automated reasoning and diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging
Beijing Academy of Artificial Intelligence（北京智源人工智能研究院）；Department of Radiology, Beijing Anzhen Hospital, Beijing Institute of Heart, Lung & Vascular Diseases, Capital Medical University（首都医科大学附属北京安贞医院放射科，北京市心肺血管疾病研究所）；Department of MR, the First Affiliated Hospital, Henan Medical University（河南医科大学第一附属医院磁共振科）；Department of Cardiology, Clinical Center for Coronary Heart Disease, Beijing Institute of Heart, Lung and Blood Vessel Disease, Beijing Anzhen Hospital, Capital Medical University（首都医科大学附属北京安贞医院心内科，冠心病临床中心，北京市心肺血管疾病研究所）；Department of Cardiac Surgery, Beijing Anzhen Hospital, Institute of Heart, Lung and Vascular Diseases, Capital Medical University（首都医科大学附属北京安贞医院心脏外科，心肺血管疾病研究所）
