A Saccade-inspired Approach to Image Classification using Vision Transformer Attention Maps
Institut de Neurosciences de la Timone, Aix-Marseille Université, CNRS(神经科学蒂姆研究所,艾克斯-马赛大学,CNRS);Laboratoire d’Électronique, Antennes et Télécommunications, Université Côte d’Azur, CNRS(电子、天线和电信实验室,蔚蓝海岸大学,CNRS)
Human vision achieves remarkable perceptual performance while operating under strict metabolic constraints. A key ingredient is the selective attention mechanism, driven by rapid saccadic eye movements that constantly reposition the high-resolution fovea onto task-relevant locations, unlike conventional AI systems that process entire images with equal emphasis. Our work aims to draw inspiration from the human visual system to create smarter, more efficient image processing models. Using DINO, a self-supervised Vision Transformer that produces attention maps strikingly similar to human gaze patterns, we explore a saccade inspired method to focus the processing of information on key regions in visual space. To do so, we use the ImageNet dataset in a standard classification task and measure how each successive saccade affects the model's class scores. This selective-processing strategy preserves most of the full-image classification performance and can even outperform it in certain cases. By benchmarking against established saliency models built for human gaze prediction, we demonstrate that DINO provides superior fixation guidance for selecting informative regions. These findings highlight Vision Transformer attention as a promising basis for biologically inspired active vision and open new directions for efficient, neuromorphic visual processing.
Exploring Frequency-Inspired Optimization in Transformer for Efficient Single Image Super-Resolution
School of Information and Communication Engineering, University of Electronic Science and Technology of China(电子科技大学信息与通信工程学院);College of Computer Science, Nankai University(南开大学计算机学院)
A TRPCA-Inspired Deep Unfolding Network for Hyperspectral Image Denoising via Thresholded t-SVD and Top-K Sparse Transformer
College of Computer Science and Engineering, Shandong University of Science and Technology(计算机科学与工程学院,山东科技大学);Gosci Information Technology Co.,Ltd.(Gosci信息技术有限公司)
Brain-Inspired Stepwise Patch Merging for Vision Transformers
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Brain-inspired Cognitive AI Lab, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所脑启发认知人工智能实验室);State Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology(脑认知与脑启发智能技术国家重点实验室);School of Future Technology, University of Chinese Academy of Sciences(中国科学院大学未来技术学院);Center for Long-term AI(长期人工智能中心)
Evaluating Graphical Perception Capabilities of Vision Transformers
Viscom Group, Institute of Media Informatics, Ulm University(Viscom集团,媒体信息学研究所,乌尔姆大学);ViRVIG Group, Universitat Politècnica de Catalunya - BarcelonaTech(ViRVIG集团,巴塞罗那技术大学-加泰罗尼亚理工大学);Ulm University(乌尔姆大学)
CirT: Global Subseasonal-to-Seasonal Forecasting with Geometry-inspired Transformer
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);DAMO Academy, Alibaba Group(阿里巴巴达摩院)
University of Surrey(萨里大学);Leibniz University of Hanover(莱布尼茨汉诺威大学);Nokia Technologies(诺基亚技术公司);University of Twente(特温特大学);University of Glasgow(格拉斯哥大学)
APRIL: Finding the Achilles' Heel on Privacy for Vision Transformers
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
A microstructure estimation Transformer inspired by sparse representation for diffusion MRI
Zhejiang University(浙江大学);Shandong Medical Imaging Research Institute(山东医学影像研究所);Shandong University(山东大学);Lanzhou University(兰州大学);Siemens Healthineers Ltd.(西门子医疗有限公司);Beijing Institute of Technology(北京理工大学)
DualGazeNet: A Biologically Inspired Dual-Gaze Query Network for Salient Object Detection
School of Computation, Information and Technology, Technical University of Munich(计算信息与技术学院,慕尼黑技术大学);Department of Informatics, Technical University of Munich(信息学院,慕尼黑技术大学);University Research and Innovation Center, Obuda University(奥布达大学研究与创新中心);State Key Laboratory for Novel Software Technology, Nanjing University Suzhou Campus(新型软件技术国家重点实验室,南京大学苏州校区);School of Science and Technology, Nanjing University Suzhou Campus(科学与技术学院,南京大学苏州校区);Department of Computer Science and Technology, Tsinghua University(计算机科学与技术系,清华大学)
Stripformer: Strip Transformer for Fast Image Deblurring
National Tsing Hua University(台湾清华大学);National Chengchi University(政治大学);National Yang Ming Chiao Tung University(阳明交通大学);Qualcomm Technologies, Inc.(高通技术公司)
Point-Focused Attention Meets Context-Scan State Space: Robust Biological Visual Perception for Point Cloud Representation
College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics(南京航空航天大学人工智能学院);School of Mathematical Sciences, Beijing University of Posts and Telecommunications(北京邮电大学数学科学学院)
Attention via Synaptic Plasticity is All You Need: A Biologically Inspired Spiking Neuromorphic Transformer
Department of Electronics and Communication Engineering, National Institute of Technology Allahabad, Prayagraj, 211004, India(国家理工学院阿姆利达分校电子与通信工程系);Centre for Nanotechnology, Indian Institute of Technology Roorkee, Roorkee, Uttarakhand, 247667, India(印度理工学院罗奥基分校纳米技术中心)
FovEx: Human-Inspired Explanations for Vision Transformers and Convolutional Neural Networks
Department AIBE, FAU Erlangen-Nürnberg(FAU埃朗根-纽伦堡大学AIBE部门);PAVIS, Istituto Italiano di Tecnologia (IIT), Genova, Italy(意大利技术研究院(IIT)帕维斯部门,热那亚,意大利);Ernst Strüngmann Institute for Neuroscience, Frankfurt, Germany(神经科学埃朗根-纽伦堡研究所,法兰克福,德国);Goethe-Universität Frankfurt am Main(法兰克福大学);Institute of AI for Health, Helmholtz Zentrum München, Munich, Germany(健康人工智能研究所,海德堡中心慕尼黑,德国)
Neuroscience-Inspired Analyses of Visual Interestingness in Multimodal Transformers
Cognitive Computational Neuroscience Group, Patter Recognition Lab, University Erlangen-Nürnberg(认知计算神经科学组、模式识别实验室、埃尔兰根-纽伦堡大学);IDS Institut für Data Science, ZHAW School of Engineering, Winterthur, Switzerland(IDS数据科学研究所、ZHAW工程学院、温特图尔,瑞士);Mannheim Center for Neuromodulation and Neuroprosthetics, University Hospital Mannheim, Heidelberg University(曼海姆神经调制与神经假体中心、曼海姆大学医院、海德堡大学);BGU Ludwigshafen, Germany(BGU路易斯港,德国);Physics and Cognition Group, MCNN, University Hospital Mannheim, Heidelberg University(物理与认知组、MCNN、曼海姆大学医院、海德堡大学);NeuroAI and BCI Group, MCNN, University Hospital Mannheim, Heidelberg University(神经AI与BCI组、MCNN、曼海姆大学医院、海德堡大学)
Artificial Microsaccade Compensation: Stable Vision for an Ornithopter
Department of Computer Science, University of Maryland, College Park(计算机科学系,马里兰大学,学院公园);Faculty of Aerospace Engineering, Delft University of Technology(航空航天工程系,代尔夫特理工大学);Institute for Advanced Computer Studies, University of Maryland, College Park(高级计算机研究 institute,马里兰大学,学院公园)