Automatic Plant Image Identification of Vietnamese species using Deep Learning Models
The University of Danang - University of Science and Technology（岘港大学-科技大学）；The University of Danang - VN-UK Institute for Research and Executive Education（岘港大学-越南英国研究与教育学院）
Nguyen Van Hieu, Ngo Le Huy Hien
备注：
7 pages, 8 figures, 2 tables, Published with International Journal of Engineering Trends and Technology (IJETT)
发表信息：
International Journal of Engineering Trends and Technology 68.4(2020):25-31. Published by Seventh Sense Research Group
It is complicated to distinguish among thousands of plant species in the natural ecosystem, and many efforts have been investigated to address the issue. In Vietnam, the task of identifying one from 12,000 species requires specialized experts in flora management, with thorough training skills and in-depth knowledge. Therefore, with the advance of machine learning, automatic plant identification systems have been proposed to benefit various stakeholders, including botanists, pharmaceutical laboratories, taxonomists, forestry services, and organizations. The concept has fueled an interest in research and application from global researchers and engineers in both fields of machine learning and computer vision. In this paper, the Vietnamese plant image dataset was collected from an online encyclopedia of Vietnamese organisms, together with the Encyclopedia of Life, to generate a total of 28,046 environmental images of 109 plant species in Vietnam. A comparative evaluation of four deep convolutional feature extraction models, which are MobileNetV2, VGG16, ResnetV2, and Inception Resnet V2, is presented. Those models have been tested on the Support Vector Machine (SVM) classifier to experiment with the purpose of plant image identification. The proposed models achieve promising recognition rates, and MobilenetV2 attained the highest with 83.9%. This result demonstrates that machine learning models are potential for plant species identification in the natural environment, and future works need to examine proposing higher accuracy systems on a larger dataset to meet the current application demand.
Deep Learning for Automated Identification of Vietnamese Timber Species: A Tool for Ecological Monitoring and Conservation
Mathematical Modeling Laboratory, Graduate School of Bioresource and Bioenvironmental Sciences, Kyushu University（九州大学生物资源与生物环境科学研究生院数学建模实验室）；International Cooperation Center, Thai Nguyen University（Thai Nguyen大学国际合作中心）；Centrer of Crop Research for Adaptation to Climate Change, Thai Nguyen University of Agriculture and Forestry（Thai Nguyen农业与林业大学适应气候变化作物研究中心）
Supervised learning is often used to count objects in images, but for counting small, densely located objects, the required image annotations are burdensome to collect. Counting plant organs for image-based plant phenotyping falls within this category. Object counting in plant images is further challenged by having plant image datasets with significant domain shift due to different experimental conditions, e.g. applying an annotated dataset of indoor plant images for use on outdoor images, or on a different plant species. In this paper, we propose a domain-adversarial learning approach for dom…
Indian Institute of Technology Gandhinagar（甘地纳格尔印度理工学院）
India loses 35% of the annual crop yield due to plant diseases. Early detection of plant diseases remains difficult due to the lack of lab infrastructure and expertise. In this paper, we explore the possibility of computer vision approaches for scalable and early plant disease detection. The lack of availability of sufficiently large-scale non-lab data set remains a major challenge for enabling vision based plant disease detection. Against this background, we present PlantDoc: a dataset for visual plant disease detection. Our dataset contains 2,598 data points in total across 13 plant species …
Recently, the EAGL-I system was developed to rapidly create massive labeled datasets of plants intended to be commonly used by farmers and researchers to create AI-driven solutions in agriculture. As a result, a publicly available plant species recognition dataset composed of 40,000 images with different sizes consisting of 8 plant species was created with the system in order to demonstrate its capabilities. This paper proposes a novel method, called Variably Overlapping Time-Coherent Sliding Window (VOTCSW), that transforms a dataset composed of images with variable size to a 3D representatio…
We present two large datasets of labelled plant-images that are suited towards the training of machine learning and computer vision models. The first dataset encompasses as the day of writing over 1.2 million images of indoor-grown crops and weeds common to the Canadian Prairies and many US states. The second dataset consists of over 540,000 images of plants imaged in farmland. All indoor plant images are labelled by species and we provide rich etadata on the level of individual images. This comprehensive database allows to filter the datasets under user-defined specifications such as for exam…
University of Southern Denmark, The Maersk Mc-Kinney Moller Institute（南丹麦大学，马士基麦克-金尼穆勒研究所）；Aarhus University, Department of Engineering - Signal Processing（奥胡斯大学，工程学院 - 信号处理）；Aarhus University, Department of Agroecology - Crop Health（奥胡斯大学，农业生态学系 - 作物健康）
A database of images of approximately 960 unique plants belonging to 12 species at several growth stages is made publicly available. It comprises annotated RGB images with a physical resolution of roughly 10 pixels per mm. To standardise the evaluation of classification results obtained with the database, a benchmark based on $f_{1}$ scores is proposed. The dataset is available at https://vision.eng.au.dk/plant-seedlings-dataset
Agriculture is vital for human survival and remains a major driver of several economies around the world; more so in underdeveloped and developing economies. With increasing demand for food and cash crops, due to a growing global population and the challenges posed by climate change, there is a pressing need to increase farm outputs while incurring minimal costs. Previous machine vision technologies developed for selective weeding have faced the challenge of reliable and accurate weed detection. We present approaches for plant seedlings classification with a dataset that contains 4,275 images …
Vines-DB: An RGB image dataset for multi-species ornamental vine segmentation
Department of Plants, Soils and Climate, Utah State University（植物、土壤与气候系，犹他州立大学）；Department of Applied Sciences, Technology and Education, Utah State University（应用科学、科技与教育系，犹他州立大学）
Self-supervised transformer-based pre-training method with General Plant Infection dataset
Key Laboratory of Smart Agriculture Systems, Ministry of Education, China Agricultural University（智能农业系统重点实验室，教育部，中国农业大学）；College of Engineering, China Agricultural University（工程学院，中国农业大学）；College of Economics and Management, China Agricultural University（经济管理学院，中国农业大学）；College of Information and Electrical Engineering, China Agricultural University（信息与电气工程学院，中国农业大学）
The Commonwealth Scientific and Industrial Research Organisation (CSIRO), Data61（联邦科学与工业研究组织（CSIRO）Data61）
The traditional paradigm of applying deep learning -- collect, annotate and train on data -- is not applicable to image-based plant phenotyping as almost 400,000 different plant species exists. Data costs include growing physical samples, imaging and labelling them. Model performance is impacted by the species gap between the domain of each plant species, it is not generalisable and may not transfer to unseen plant species. In this paper, we investigate the use of synthetic data for leaf instance segmentation. We study multiple synthetic data training regimes using Mask-RCNN when few or no ann…
ETH Zürich（苏黎世联邦理工学院）；WSL（瑞士联邦森林、雪和景观研究所）；University of Zurich（苏黎世大学）
Automatic identification of plant specimens from amateur photographs could improve species range maps, thus supporting ecosystems research as well as conservation efforts. However, classifying plant specimens based on image data alone is challenging: some species exhibit large variations in visual appearance, while at the same time different species are often visually similar; additionally, species observations follow a highly imbalanced, long-tailed distribution due to differences in abundance as well as observer biases. On the other hand, most species observations are accompanied by side inf…
Plant species identification in the wild is a difficult problem in part due to the high variability of the input data, but also because of complications induced by the long-tail effects of the datasets distribution. Inspired by the most recent fine-grained visual classification approaches which are based on attention to mitigate the effects of data variability, we explore the idea of using object detection as a form of attention. We introduce a bottom-up approach based on detecting plant organs and fusing the predictions of a variable number of organ-based species classifiers. We also curate a…
PlantSegNeRF: A few-shot, cross-species method for plant 3D instance point cloud reconstruction via joint-channel NeRF with multi-view image instance matching
This paper investigates the issue of real-world identification to fulfill better species protection. We focus on plant species identification as it is a classic and hot issue. In tradition plant species identification the samples are scanned specimen and the background is simple. However, real-world species recognition is more challenging. We first systematically investigate what is realistic species recognition and the difference from tradition plant species recognition. To deal with the challenging task, an interdisciplinary collaboration is presented based on the latest advances in computer…
Pontifical Catholic University of Paraná（巴拉那州天主教大学）；State University of Ponta Grossa（蓬塔格罗萨州立大学）；Federal University of Paraná（巴拉那联邦大学）
Automatic plant classification is a challenging problem due to the wide biodiversity of the existing plant species in a fine-grained scenario. Powerful deep learning architectures have been used to improve the classification performance in such a fine-grained problem, but usually building models that are highly dependent on a large training dataset and which are not scalable. In this paper, we propose a novel method based on a two-view leaf image representation and a hierarchical classification strategy for fine-grained recognition of plant species. It uses the botanical taxonomy as a basis fo…
Indian Institute of Information Technology, Bhopal（博帕尔印度信息技术学院）；Maulana Azad National Institute of Technology, Bhopal（博帕尔毛拉纳·阿扎德国立理工学院）
Deep learning is currently the most important branch of machine learning, with applications in speech recognition, computer vision, image classification, and medical imaging analysis. Plant recognition is one of the areas where image classification can be used to identify plant species through their leaves. Botanists devote a significant amount of time to recognizing plant species by personally inspecting. This paper describes a method for dissecting color images of Swedish leaves and identifying plant species. To achieve higher accuracy, the task is completed using transfer learning with the …
TasselNetV4: A vision foundation model for cross-scene, cross-scale, and cross-species plant counting
National Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation（multispectral information intelligent processing technology, school of artificial intelligence and automation）；China-Poland Joint Laboratory on Measurement and Control Technology, School of Artificial Intelligence and Automation；School of Cyber Science and Engineering；School of Computer Science and Engineering；Wuhan Institute of Technology；Graduate School of Agricultural and Life Sciences；Engineering Research Center of Plant Phenotyping, Ministry of Education, Jiangsu Collaborative Innovation Center for Modern Crop Production, Academy for Advanced Interdisciplinary Studies
Plants are fundamentally important to life. Key research areas in plant science include plant species identification, weed classification using hyper spectral images, monitoring plant health and tracing leaf growth, and the semantic interpretation of leaf information. Botanists easily identify plant species by discriminating between the shape of the leaf, tip, base, leaf margin and leaf vein, as well as the texture of the leaf and the arrangement of leaflets of compound leaves. Because of the increasing demand for experts and calls for biodiversity, there is a need for intelligent systems that…
University of Malaya（马来亚大学）；Royal Botanic Gardens, Kew（英国皇家植物园邱园）；Kingston University（金斯顿大学）
This paper studies convolutional neural networks (CNN) to learn unsupervised feature representations for 44 different plant species, collected at the Royal Botanic Gardens, Kew, England. To gain intuition on the chosen features from the CNN model (opposed to a 'black box' solution), a visualisation technique based on the deconvolutional networks (DN) is utilized. It is found that venations of different order have been chosen to uniquely represent each of the plant species. Experimental results using these CNN features with different classifiers show consistency and superiority compared to the …
Friedrich Schiller University Jena（耶拿弗里德里希·席勒大学）；Max Planck Institute for Biogeochemistry（马克斯·普朗克生物地球化学研究所）
Monitoring the responses of plants to environmental changes is essential for plant biodiversity research. This, however, is currently still being done manually by botanists in the field. This work is very laborious, and the data obtained is, though following a standardized method to estimate plant coverage, usually subjective and has a coarse temporal resolution. To remedy these caveats, we investigate approaches using convolutional neural networks (CNNs) to automatically extract the relevant data from images, focusing on plant community composition and species coverages of 9 herbaceous plant …
Zero-Shot 3D Plant Organ Segmentation with SAM3 and Semantic NeRFs
Fraunhofer Institute for Integrated Circuits (IIS)（弗劳恩霍夫集成电路研究所）；Otto-Friedrich-Universität Bamberg（班贝格奥托·弗里德里希大学）；Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）
School of Engineering, Griffith University（格里菲斯大学工程学院）；School of Computer Science and Technology, Wuhan University of Technology（武汉理工大学计算机科学与技术学院）；Northeast Institute of Geography and Agroecology, Chinese Academy of Sciences（中国科学院东北地理与农业生态研究所）
Leaf image recognition techniques have been actively researched for plant species identification. However it remains unclear whether leaf patterns can provide sufficient information for cultivar recognition. This paper reports the first attempt on soybean cultivar recognition from plant leaves which is not only a challenging research problem but also important for soybean cultivar evaluation, selection and production in agriculture. In this paper, we propose a novel multiscale sliding chord matching (MSCM) approach to extract leaf patterns that are distinctive for soybean cultivar identificati…
Data-driven Prediction of Species-Specific Plant Responses to Spectral-Shifting Films from Leaf Phenotypic and Photosynthetic Traits
Smart Farm Research Center, Korea Institute of Science and Technology（韩国科学技术院智能农场研究中心）；Research Institute of Agriculture and Life Sciences, Seoul National University（首尔国立大学农业与生命科学研究院）；Department of Agriculture, Forestry and Bioresources, Seoul National University（首尔国立大学农业、林业与生物资源系）
Advances in deep learning and transfer learning have paved the way for various automation classification tasks in agriculture, including plant diseases, pests, weeds, and plant species detection. However, agriculture automation still faces various challenges, such as the limited size of datasets and the absence of plant-domain-specific pretrained models. Domain specific pretrained models have shown state of art performance in various computer vision tasks including face recognition and medical imaging diagnosis. In this paper, we propose AgriNet dataset, a collection of 160k agricultural image…
The Institute for Sustainable Industries and Liveable Cities (ISILC), Victoria University（维多利亚大学可持续产业与宜居城市研究所（ISILC））；Namal Institute（纳马尔学院）；Charles Sturt University（查尔斯特大学）；Victoria University（维多利亚大学）
In the Agriculture sector, control of plant leaf diseases is crucial as it influences the quality and production of plant species with an impact on the economy of any country. Therefore, automated identification and classification of plant leaf disease at an early stage is essential to reduce economic loss and to conserve the specific species. Previously, to detect and classify plant leaf disease, various Machine Learning models have been proposed; however, they lack usability due to hardware incompatibility, limited scalability and inefficiency in practical usage. Our proposed DeepLens Classi…
Prior work on plant species classification predominantly focuses on building models from isolated plant attributes. Hence, there is a need for tools that can assist in species identification in the natural world. We present a novel and robust two-fold approach capable of identifying trees in a real-world natural setting. Further, we leverage unlabelled data through deep semi-supervised learning and demonstrate superior performance to supervised learning. Our single-GPU implementation for feature recognition uses minimal annotated data and achieves accuracies of 93.96% and 93.11% for leaves and…
Kansas State University（堪萨斯州立大学）；The Land Institute（土地研究所）
A common requirement of plant breeding programs across the country is companion planting -- growing different species of plants in close proximity so they can mutually benefit each other. However, the determination of companion plants requires meticulous monitoring of plant growth. The technique of ocular monitoring is often laborious and error prone. The availability of image processing techniques can be used to address the challenge of plant growth monitoring and provide robust solutions that assist plant scientists to identify companion plants. This paper presents a new image processing alg…
Weed scouting is an important part of modern integrated weed management but can be time consuming and sparse when performed manually. Automated weed scouting and weed destruction has typically been performed using classification systems able to classify a set group of species known a priori. This greatly limits deployability as classification systems must be retrained for any field with a different set of weed species present within them. In order to overcome this limitation, this paper works towards developing a clustering approach to weed scouting which can be utilized in any field without t…
In the recent decade, high-throughput plant phenotyping techniques, which combine non-invasive image analysis and machine learning, have been successfully applied to identify and quantify plant health and diseases. However, these techniques usually do not consider the progressive nature of plant stress and often require images showing severe signs of stress to ensure high confidence detection, thereby reducing the feasibility for early detection and recovery of plants under stress. To overcome the problem mentioned above, we propose a deep learning pipeline for the temporal analysis of the vis…
PLANesT-3D: A new annotated dataset for segmentation of 3D plant point clouds
Faculty of Agriculture（农业学院）；Usak University（乌萨克大学）；Department of Electrical-Electronics Engineering（电气电子工程系）；Eskisehir Osmangazi University（埃斯基谢普大学）；SADC Department（SADC部门）；Huawei Türkiye R&D Center（华为土耳其研发中心）；Laboratoire Angevin de Recherche en Ingénierie des Systèmes (LARIS)（安热斯工程系统研究实验室）；Université d’Angers（安格斯大学）
