Preserving the number and diversity of insects is one of our society's most important goals in the area of environmental sustainability. A prerequisite for this is a systematic and up-scaled monitoring in order to detect correlations and identify countermeasures. Therefore, automatized monitoring using live traps is important, but so far there is no system that provides image data of sufficient detailed information for entomological classification.
In this work, we present an imaging method as part of a multisensor system developed as a low-cost, scalable, open-source system that is adaptable to classical trap types. The image quality meets the requirements needed for classification in the taxonomic tree. Therefore, illumination and resolution have been optimized and motion artefacts have been suppressed. The system is evaluated exemplarily on a dataset consisting of 16 insect species of the same as well as different genus, family and order. We demonstrate that standard CNN-architectures like ResNet50 (pretrained on iNaturalist data) or MobileNet perform very well for the prediction task after re-training. Smaller custom made CNNs also lead to promising results. Classification accuracy of $>96\%$ has been achieved. Moreover, it was proved that image cropping of insects is necessary for classification of species with high inter-class similarity.
InsectUp: Crowdsourcing Insect Observations to Assess Demographic Shifts and Improve Classification
Massachussets Institute of Technology(麻省理工学院);Montreal Institute for Learning Algorithms(蒙特利尔学习算法研究所);Ecole CentraleSupélec(中央理工-高等电力学院);Ecole Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);CNRS(法国国家科学研究中心);Université Paris-Saclay(巴黎萨克雷大学);Mines ParisTech(巴黎高等矿业学院)
Deep-Wide Learning Assistance for Insect Pest Classification
AISIA Research Lab(AISIA研究实验室);University of Science, Ho Chi Minh City, Vietnam(胡志明市科学大学);Université de Bourgogne(勃艮第大学);KDDI Research, Inc.(KDDI研究所);Vietnam National University, Ho Chi Minh City, Vietnam(越南国家大学胡志明市分校)
Insect Identification in the Wild: The AMI Dataset
Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Aarhus University(奥胡斯大学);Vermont Center for Ecostudies(佛蒙特生态研究中心);UK Centre for Ecology & Hydrology(英国生态与水文中心);Centre de données sur le patrimoine naturel du Québec(魁北克自然遗产数据中心);Smithsonian Tropical Research Institute(史密森尼热带研究所);Université de Sherbrooke(舍布鲁克大学);Montreal Insectarium(蒙特利尔昆虫馆)
A neuromorphic model of the insect visual system for natural image processing
School of Natural Sciences, Macquarie University(麦考瑞大学自然科学学院);QUT Centre for Robotics, Queensland University of Technology(昆士兰科技大学机器人中心);College of Medicine and Public Health, Flinders University(弗林德斯大学医学院与公共卫生学院)
A Step Towards Worldwide Biodiversity Assessment: The BIOSCAN-1M Insect Dataset
University of Guelph(圭尔夫大学);Vector Institute for AI(向量人工智能研究所);Centre for Biodiversity Genomics(生物多样性基因组学中心);Aalborg University(奥尔堡大学);Pioneer Centre for AI(先锋人工智能中心);Dalhousie University(达尔豪斯大学);Simon Fraser University(西蒙弗雷泽大学);University of Waterloo(滑铁卢大学);Alberta Machine Intelligence Institute (Amii)(阿尔伯塔机器智能研究所)
Deep Learning Pipeline for Automated Visual Moth Monitoring: Insect Localization and Species Classification
Friedrich Schiller University Jena(耶拿弗里德里希·席勒大学);German Aerospace Center (DLR)(德国航空航天中心(DLR));Michael Stifel Center Jena for Data-Driven and Simulation Science(耶拿迈克尔·施蒂费尔数据驱动与模拟科学中心)
BioAutoML-NAS: An End-to-End AutoML Framework for Multimodal Insect Classification via Neural Architecture Search on Large-Scale Biodiversity Data
Department of Computer Science and Engineering, United International University, Dhaka, Bangladesh(乌姆国际大学计算机科学与工程系,达卡,孟加拉国);Applied Artificial Intelligence and Intelligent Systems (AAIINS) Laboratory, 1217, Dhaka, Bangladesh(应用人工智能与智能系统实验室(AAIINS),1217号,达卡,孟加拉国);Department of Computer Science and Engineering, Penn State University, University Park, PA, USA(宾夕法尼亚州立大学计算机科学与工程系,University Park,PA,美国);Faculty of Science and Information Technology, Charles Darwin University, Sydney, NSW, Australia(查尔斯达尔文大学科学与信息技术学院,悉尼,新南威尔士州,澳大利亚);Faculty of Science and Technology, Charles Darwin University, Casuarina, 0909, NT, Australia(查尔斯达尔文大学科学与技术学院,Casuarina,0909,北领地,澳大利亚)
Miyagi University(宫城大学);The Miyagi Prefectural Izunuma-Uchinuma Environmental Foundation(宫城县伊豆沼・内沼环境基金会);Miyagi University School of Food Industrial Sciences(宫城大学食品产业科学学院)
BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity
Centre for Biodiversity Genomics(生物多样性基因组学中心);University of Guelph(圭尔夫大学);University of Waterloo(滑铁卢大学);Simon Fraser University(西蒙菲莎大学);Vector Institute(矢量研究所);Alberta Machine Intelligence Institute (Amii)(阿尔伯塔机器智能研究所);Aalborg University(奥尔堡大学);Pioneer Centre for AI(人工智能先锋中心)
An Insect-Inspired Randomly, Weighted Neural Network with Random Fourier Features For Neuro-Symbolic Relational Learning
Arizona State University(亚利桑那州立大学);Peoples' Friendship University of Russia (RUDN University)(俄罗斯人民友谊大学(RUDN大学));Joint Institute for Nuclear Research(联合核研究所);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);University of Skövde(舍夫德大学)
Open-Insect: Benchmarking Open-Set Recognition of Novel Species in Biodiversity Monitoring
McGill University(麦吉尔大学);Mila - Quebec Artificial Intelligence Institute(魁北克人工智能研究所);University of Copenhagen(哥本哈根大学);Agriculture and Agri-food Canada(加拿大农业与农业食品部);Smithsonian Tropical Research Institute(史密松尼热带研究所);Biology Center, Czech Academy of Sciences(捷克科学院生物学中心);Maestria de Entomologia, University of Panama(巴拿马大学昆虫学系);Massachusetts Institute of Technology(麻省理工学院);Montréal Insectarium(蒙特利尔昆虫馆)
A machine learning pipeline for automated insect monitoring
Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Federal University of Amazonas(亚马逊联邦大学);EPFL(洛桑联邦理工学院);Daresay(达雷赛公司);Montreal Insectarium(蒙特利尔昆虫馆);McGill University(麦吉尔大学)
A multi-modal dataset for insect biodiversity with imagery and DNA at the trap and individual level
Department of Ecology, Swedish University of Agricultural Sciences(生态系,瑞典农业科学大学);University of Guelph(圭尔夫大学);Vector Institute(向量研究所);University of Helsinki(赫尔辛基大学);Department of Entomology, National Museum of Natural History, Smithsonian Institution(昆虫学系,国家自然历史博物馆,史密松尼研究所);Department of Biological and Environmental Science, University of Jyväskylä(生物与环境科学系,于韦斯屈埃大学);Faculty of Biological and Environmental Sciences, University of Helsinki(生物与环境科学学院,赫尔辛基大学);Centre for Biodiversity Genomics, University of Guelph(生物多样性基因组中心,圭尔夫大学);NVIDIA(NVIDIA公司);University of Toronto(多伦多大学);Kilpisjärvi Biological Station, University of Helsinki(基利皮斯杰里生物学站,赫尔辛基大学);Unit for Field-based Forest Research, Swedish University of Agricultural Sciences(基于现场的森林研究单位,瑞典农业科学大学)
Spotting insects from satellites: modeling the presence of Culicoides imicola through Deep CNNs
University of Modena and Reggio Emilia(摩德纳-雷焦艾米利亚大学);Istituto Zooprofilattico Sperimentale dell’Abruzzo e del Molise ‘G.Caporale’(阿布鲁佐与莫利塞“G.卡波拉莱”实验动物卫生研究所)
TerraIncognita: A Dynamic Benchmark for Species Discovery Using Frontier Models
Iowa State University(爱荷华州立大学);University of Arizona(亚利桑那大学);University of Nevada(内华达大学);Yanayacu Biological Station and Center for Creative Studies(亚纳亚库生物站和创意研究中心);New York University(纽约大学)
CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale
Simon Fraser University(西蒙弗雷泽大学);Aalborg University(奥胡斯大学);Vector Institute(向量研究所);University of Guelph(圭尔夫大学);Alberta Machine Intelligence Institute (Amii)(阿尔伯塔人工智能研究所)