A neuromorphic model of the insect visual system for natural image processing
School of Natural Sciences, Macquarie University(麦考瑞大学自然科学学院);QUT Centre for Robotics, Queensland University of Technology(昆士兰科技大学机器人中心);College of Medicine and Public Health, Flinders University(弗林德斯大学医学院与公共卫生学院)
Insect vision supports complex behaviors including associative learning, navigation, and object detection, and has long motivated computational models for understanding biological visual processing. However, many contemporary models prioritize task performance while neglecting biologically grounded processing pathways. Here, we introduce a bio-inspired vision model that captures principles of the insect visual system to transform dense visual input into sparse, discriminative codes. The model is trained using a fully self-supervised contrastive objective, enabling representation learning without labeled data and supporting reuse across tasks without reliance on domain-specific classifiers. We evaluated the resulting representations on flower recognition tasks and natural image benchmarks. The model consistently produced reliable sparse codes that distinguish visually similar inputs. To support different modelling and deployment uses, we have implemented the model as both an artificial neural network and a spiking neural network. In a simulated localization setting, our approach outperformed a simple image downsampling comparison baseline, highlighting the functional benefit of incorporating neuromorphic visual processing pathways. Collectively, these results advance insect computational modelling by providing a generalizable bio-inspired vision model capable of sparse computation across diverse tasks.
Neuromorphic Object Detection: An In-Depth Study and Future Directions
Peking University(北京大学);Peng Cheng Laboratory(鹏城实验室);Harbin Institute of Technology(哈尔滨工业大学);Chinese Academy of Sciences(中国科学院);Italian Institute of Technology(意大利理工学院);Carnegie Mellon University(卡内基梅隆大学);University of Pittsburgh(匹兹堡大学);Sorbonne Université(索邦大学);INSERM(法国国家健康与医学研究院);CNRS(法国国家科学研究中心);Institut de la Vision(视觉研究所)
Deep Learning Pipeline for Automated Visual Moth Monitoring: Insect Localization and Species Classification
Friedrich Schiller University Jena(耶拿弗里德里希·席勒大学);German Aerospace Center (DLR)(德国航空航天中心(DLR));Michael Stifel Center Jena for Data-Driven and Simulation Science(耶拿迈克尔·施蒂费尔数据驱动与模拟科学中心)
Towards Computational Models and Applications of Insect Visual Systems for Motion Perception: A Review
School of Mechanical and Electrical Engineering, Guangzhou University(广州大学机电工程学院);Machine Life and Intelligence Research Centre, Guangzhou University(广州大学机器生命与智能研究中心);Computational Intelligence Lab, School of Computer Science, University of Lincoln(林肯大学计算机科学学院计算智能实验室);Lincoln Centre for Autonomous Systems, University of Lincoln(林肯大学林肯自治系统中心)
Neuromorphic visual attention for Sign-language recognition on SpiNNaker
Faculty of Information Technology, Czech Technical University in Prague(信息技术学院,布拉格捷克技术大学);Dept. of Cybernetics, Faculty of Electrical Engineering, Czech Technical University in Prague(电子工程系,捷克技术大学);Université de Lille, CNRS, Centrale Lille, UMR 9189 CRIStAL(里尔大学,法国国家科学研究中心,里尔中央大学,UMR 9189 CRIStAL)
Visual Odometry with Neuromorphic Resonator Networks
Institute of Neuroinformatics, University of Zurich and ETH Zurich(苏黎世大学与苏黎世联邦理工学院神经信息学研究所);Forschungszentrum Jülich(于利希研究中心);Accenture Labs(埃森哲实验室);Intel Neuromorphic Computing Lab, Intel Labs(英特尔实验室英特尔神经形态计算实验室);Redwood Center for Theoretical Neuroscience, UC Berkeley(加州大学伯克利分校红木理论神经科学中心);Intel Labs(英特尔实验室);ZHAW Zurich University of Applied Sciences(苏黎世应用科技大学)
Towards high-throughput 3D insect capture for species discovery and diagnostics
CSIRO, Data61(澳大利亚联邦科学与工业研究组织数据61);Queensland University of Technology(昆士兰科技大学);CSIRO, National Collections and Marine Infrastructure(澳大利亚联邦科学与工业研究组织国家收藏与海洋基础设施)
Neuromorphic Visual Scene Understanding with Resonator Networks
Institute of Neuroinformatics, University of Zurich and ETH Zurich(苏黎世大学与苏黎世联邦理工学院神经信息学研究所);Forschungszentrum Jülich(于利希研究中心);Accenture Labs(埃森哲实验室);Redwood Center for Theoretical Neuroscience, UC Berkeley(加州大学伯克利分校红木理论神经科学中心);Intel Labs(英特尔实验室);ZHAW Zurich University of Applied Sciences(苏黎世应用科技大学);Intel Neuromorphic Computing Lab, Intel Labs(英特尔实验室英特尔神经形态计算实验室)
Beihang University(北京航空航天大学);Beijing Institute of Technology(北京理工大学);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);City University of Hong Kong(香港城市大学);University of Cambridge(剑桥大学);Tsinghua University(清华大学);Beijing Tongren Hospital, Capital Medical University(首都医科大学附属北京同仁医院);Shandong University(山东大学);Northeastern University(东北大学)
BioAutoML-NAS: An End-to-End AutoML Framework for Multimodal Insect Classification via Neural Architecture Search on Large-Scale Biodiversity Data
Department of Computer Science and Engineering, United International University, Dhaka, Bangladesh(乌姆国际大学计算机科学与工程系,达卡,孟加拉国);Applied Artificial Intelligence and Intelligent Systems (AAIINS) Laboratory, 1217, Dhaka, Bangladesh(应用人工智能与智能系统实验室(AAIINS),1217号,达卡,孟加拉国);Department of Computer Science and Engineering, Penn State University, University Park, PA, USA(宾夕法尼亚州立大学计算机科学与工程系,University Park,PA,美国);Faculty of Science and Information Technology, Charles Darwin University, Sydney, NSW, Australia(查尔斯达尔文大学科学与信息技术学院,悉尼,新南威尔士州,澳大利亚);Faculty of Science and Technology, Charles Darwin University, Casuarina, 0909, NT, Australia(查尔斯达尔文大学科学与技术学院,Casuarina,0909,北领地,澳大利亚)
Khalifa University Center for Autonomous Robotic Systems (KUCARS), Khalifa University of Science and Technology(哈利法大学自主机器人系统中心(KUCARS),哈利法科技大学);Kingston University(金斯顿大学);Purdue University(普渡大学)
A Sparse Coding Multi-Scale Precise-Timing Machine Learning Algorithm for Neuromorphic Event-Based Sensors
Sorbonne Universite(索邦大学);INSERM(法国国家健康与医学研究院);CNRS(法国国家科学研究中心);Institut de la Vision(视觉研究所);University of Pittsburgh Medical Center(匹兹堡大学医学中心);Carnegie Mellon University(卡内基梅隆大学)
The University of Hong Kong(香港大学);Centre for Transformative Garment Production(变革性服装生产中心);Wuhan University(武汉大学);Beihang University(北京航空航天大学);City University of Hong Kong(香港城市大学);Texas A&M University(德克萨斯农工大学)
EventZoom: A Progressive Approach to Event-Based Data Augmentation for Enhanced Neuromorphic Vision
School of Future Technology, University of Chinese Academy of Sciences(中国科学院大学未来技术学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Wandering around: A bioinspired approach to visual attention through object motion sensitivity
Department of Cybernetics, Faculty of Electrical Engineering, Czech Technical University in Prague(捷克技术大学普拉茨分校电子工程系);IBM Research Europe, Zurich, Switzerland(IBM欧洲研究院,瑞士苏黎世);Italian Institute of Technology, Genoa, Italy(意大利理工学院,热那亚);National Research Council of Canada & Systems Design Engineering, University of Waterloo, Canada(加拿大国家研究理事会与系统设计工程,滑铁卢大学);European Space Agency, Noordwijk, The Netherlands(欧洲航天局,荷兰诺德维克);Adapsent, Leiden, The Netherlands(Adapsent,荷兰莱顿)
See Silhouettes in Motion with Neuromorphic Vision
School of Electrical Engineering, Guangxi University(广西大学电气工程学院);Department of Computer Science, The University of Hong Kong(香港大学计算机科学系);School of Mechatronic Engineering and Automation, Shanghai University(上海大学机电工程与自动化学院);SHU General Intelligent Robotics Research Institute(SHU通用智能机器人研究院);School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications(北京邮电大学计算机科学学院(国家试点软件学院));School of Information and Communication Engineering, University of Electronic Science and Technology of China(电子科技大学信息与通信工程学院)