Attention and Prediction Guided Motion Detection for Low-Contrast Small Moving Targets
Guangzhou University(广州大学);University of Lincoln(林肯大学);Guangxi University(广西大学);Northwest Institute of Mechanical and Electrical Engineering(西北机电工程研究所)
Small target motion detection within complex natural environments is an extremely challenging task for autonomous robots. Surprisingly, the visual systems of insects have evolved to be highly efficient in detecting mates and tracking prey, even though targets occupy as small as a few degrees of their visual fields. The excellent sensitivity to small target motion relies on a class of specialized neurons called small target motion detectors (STMDs). However, existing STMD-based models are heavily dependent on visual contrast and perform poorly in complex natural environments where small targets generally exhibit extremely low contrast against neighbouring backgrounds. In this paper, we develop an attention and prediction guided visual system to overcome this limitation. The developed visual system comprises three main subsystems, namely, an attention module, an STMD-based neural network, and a prediction module. The attention module searches for potential small targets in the predicted areas of the input image and enhances their contrast against complex background. The STMD-based neural network receives the contrast-enhanced image and discriminates small moving targets from background false positives. The prediction module foresees future positions of the detected targets and generates a prediction map for the attention module. The three subsystems are connected in a recurrent architecture allowing information to be processed sequentially to activate specific areas for small target detection. Extensive experiments on synthetic and real-world datasets demonstrate the effectiveness and superiority of the proposed visual system for detecting small, low-contrast moving targets against complex natural environments.
Prior-guided Hierarchical Instance-pixel Contrastive Learning for Ultrasound Speckle Noise Suppression
School of Biological Science and Medical Engineering, Southeast University(生物科学与医学工程学院,东南大学);Department of Biomedical Engineering, The Ohio State University(生物医学工程系,奥斯特大学);Jiangsu Key Laboratory of Biomaterials and Devices, Southeast University(江苏省生物材料与器件重点实验室,东南大学);State Key Laboratory of Digital Medical Engineering, Southeast University(国家数字医学工程重点实验室,东南大学)
A Multihead Continual Learning Framework for Fine-Grained Fashion Image Retrieval with Contrastive Learning and Exponential Moving Average Distillation
Graduate School of Information Science and Technology, Hokkaido University(信息科学与技术研究生院,北海道大学);Graduate School of Information Science and Technology, The University of Tokyo(信息科学与技术研究生院,东京大学)
A Contrastive Learning-Guided Confident Meta-learning for Zero Shot Anomaly Detection
Dept. of Engineering for Innovation Medicine, University of Verona(创新医学工程系,威尼斯大学);Faculty of Computer and Information Science, University of Ljubljana(计算机与信息科学系,卢布尔雅那大学);Qualyco S.r.l.(Qualyco公司)
Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignments
School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);Institute of Translational Medicine, Shanghai Jiao Tong University(上海交通大学转化医学研究院);Zhongguancun Academy & Zhongguancun Institute of Artificial Intelligence, Beijing, China(北京中关村学院及中关村人工智能研究院);Department of Molecular Imaging, Royal Prince Alfred Hospital(皇家珀斯阿尔弗雷德医院分子成像部)
Generalizable Synthetic Image Detection via Language-guided Contrastive Learning
School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);State Key Laboratory of Internet of Things for Smart City(智慧城市物联网国家重点实验室);Department of Computer and Information Science, Faculty of Science and Technology, University of Macau(澳门大学计算机与信息科学系);Faculty of Applied Sciences, Macao Polytechnic University(澳门 polytechnic 大学应用科学系)
Pseudo-label Guided Cross-video Pixel Contrast for Robotic Surgical Scene Segmentation with Limited Annotations
The Chinese University of Hong Kong(香港中文大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University College London(伦敦大学学院);Zhejiang Lab(之江实验室)
Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction
University of Science and Technology of China(中国科学技术大学);Institute of Advanced Technology(先进技术研究院);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)
Clustering-Guided Multi-Layer Contrastive Representation Learning for Citrus Disease Classification
College of Informatics, Huazhong Agricultural University(华中农业大学信息学院);Huazhong Agricultural University(华中农业大学);Engineering Research Center of Intelligent Technology for Agriculture, Ministry of Education(农业智能技术工程研究中心);National Key Laboratory for Germplasm Innovation & Utilization of Horticultural Crops(园艺作物种质创新与利用国家重点实验室)
SMC-NCA: Semantic-guided Multi-level Contrast for Semi-supervised Temporal Action Segmentation
School of Computing and Mathematical Sciences, University of Leicester(莱斯特大学计算与数学科学学院);School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University(西北工业大学人工智能、光学与电子学院(iOPEN))
Diverse Normal Prototypes-Guided Contrastive Reconstruction for Medical Anomaly Detection
School of Mathematics, Shandong University(山东大学数学学院);Department of Interventional Medicine and Minimally Invasive Oncology, The Second Qilu Hospital of Shandong University(山东大学第二齐鲁医院介入医学与微创肿瘤科);Department of Neurosurgery, The Second Qilu Hospital of Shandong University(山东大学第二齐鲁医院神经外科)
Mitigating Video Hallucinations via Attention-Guided Representation Perturbation
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);Beijing Institute for General Artificial Intelligence, BIGAI(北京通用人工智能研究院);Sino-French Engineer School, Beihang University(北京航空航天大学中法工程师学院)
MR-CLIP: Efficient Metadata-Guided Learning of MRI Contrast Representations
School of Biomedical Engineering and Imaging Sciences, King’s College London, London, UK(生物医学工程与成像科学学院,伦敦国王学院,伦敦,英国);deepc GMBH, Munich, Germany(deepc 德国慕尼黑分公司)
Mutual Information guided Visual Contrastive Learning
Antiquus S. Hippocampus, Natalia Cerebro & Amelie P. Amygdale Department of Computer Science Cranberry-Lemon University Pittsburgh, PA 15213, USA(计算机科学系,Cranberry-Lemon大学);Ji Q. Ren & Yevgeny LeNet Department of Computational Neuroscience University of the Witwatersrand Joburg, South Africa(计算神经科学系,乌特雷赫大学)
Gaze on the Prize: Shaping Visual Attention with Return-Guided Contrastive Learning
Department of Computer Science University of California Davis(加州大学戴维斯分校计算机科学系);Department of Electrical Engineering and Computer Sciences University of California Berkeley(加州大学伯克利分校电气工程与计算机科学系);Department of Mechanical and Aerospace Engineering University of California Davis(加州大学戴维斯分校机械与航空航天工程系)
Gaze on the Prize通过回报引导的对比学习,提升视觉强化学习的样本效率,解决ManiSkill3基准中难以学习的任务。