The primary aim of this manuscript is to underscore a significant limitation in current deep learning models, particularly vision models. Unlike human vision, which efficiently selects only the essential visual areas for further processing, leading to high speed and low energy consumption, deep vision models process the entire image. In this work, we examine this issue from a broader perspective and propose two solutions that could pave the way for the next generation of more efficient vision models. In the first solution, convolution and pooling operations are selectively applied to altered regions, with a change map sent to subsequent layers. This map indicates which computations need to be repeated. In the second solution, only the modified regions are processed by a semantic segmentation model, and the resulting segments are inserted into the corresponding areas of the previous output map. The code is available at https://github.com/aliborji/spatial_attention.
DEEVA: A Deep Learning and IoT Based Computer Vision System to Address Safety and Security of Production Sites in Energy Industry
当涉及到解决不同生产/施工现场的安全/安保相关需求时,准确检测工人、车辆、设备的存在非常重要,并构成了基于计算机视觉的监控系统(CVSS)的组成部分。传统的CVSS系统集中于使用不同的计算机视觉和模式识别算法,过度依赖于手动提取特征和小数据集,由于准确性低、需要专家知识和高计算成本而限制了它们的使用。本文的主要目标是为现场决策者提供实用而全面的基于深度学习和物联网的解决方案,以解决各种计算机视觉相关问题,如场景分类,场景中的目标检测,语义分割,我们的首要目标是解决这个网站正在发生什么以及它在哪里发生的中心问题,以自动化的方式最小化需要专门用于监视的人力资源。我们开发了Deep ExxonMobil Eye for Video Analysis(DEEVA)软件包,以分层方式处理场景分类、目标检测、语义分割和场景字幕。结果表明,使用RetinaNet对象检测器的迁移学习能够以高准确度(90%以上)检测工人、不同类型的车辆/施工设备、安全相关对象的存在。借助深度学习自动提取特征和物联网技术自动捕获,传输和处理大量实时图像,该框架是智能监控系统开发的重要一步,旨在解决安全/安全监控,生产力评估和未来决策领域的无数开放式问题。
SGV3D:Towards Scenario Generalization for Vision-based Roadside 3D Object Detection
School of Vehicle and Mobility, Tsinghua University(清华大学车辆与 mobility学院);Beijing Institute of Technology(北京理工大学);National University of Singapore(新加坡国立大学);Beijing University of Chemical Technology(北京化工大学)
Dual-Anchoring: Addressing State Drift in Vision-Language Navigation
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence(人机混合增强智能国家重点实验室);National Engineering Research Center for Visual Information and Applications(视觉信息与应用国家工程研究中心);Institute of Artificial Intelligence and Robotics(人工智能与机器人研究院);Xi’an Jiaotong University(西安交通大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Johns Hopkins University(约翰霍普金斯大学);Joy Future Academy, JD(京东探索研究院)
Drone Stereo Vision for Radiata Pine Branch Detection and Distance Measurement: Utilizing Deep Learning and YOLO Integration
Centre for Data Science and Artificial Intelligence(数据科学与人工智能中心);Victoria University of Wellington(惠灵顿维多利亚大学);Department of Computer Science and Software Engineering(计算机科学与软件工程系);Canterbury University(坎特伯雷大学)
Surgical-LVLM: Learning to Adapt Large Vision-Language Model for Grounded Visual Question Answering in Robotic Surgery
The Chinese University of Hong Kong(香港中文大学);Universiti Malaya(马来亚大学);Centre for Artificial Intelligence and Robotics, HKISI-CAS(香港智能系统研究所人工智能与机器人中心);University College London(伦敦大学学院)
P$^2$-DPO: Grounding Hallucination in Perceptual Processing via Calibration Direct Preference Optimization
Guangdong Provincial Key Laboratory of Computational AI Models and Cognitive Intelligence, School of Computer Science & Engineering, South China University of Technology(广东省计算人工智能模型与认知智能重点实验室,计算机科学与工程学院,华南理工大学);Pazhou Lab, Guangzhou, China(琶洲实验室,广州,中国);Engineering Research Center of the Ministry of Education on Health Intelligent Perception and Paralleled Digital-Human, Guangzhou, China(教育部健康智能感知与并行数字人工程研究中心,广州,中国)
MIMO: A medical vision language model with visual referring multimodal input and pixel grounding multimodal output
School of Software & Microelectronics, Peking University(软件与微电子学院,北京大学);School of Computer Science, Peking University(计算机学院,北京大学);National Engineering Research Center for Software Engineering, Peking University(软件工程国家工程研究中心,北京大学);Peking University Sixth Hospital(北京大学第六医院);Augusta University(奥古斯塔大学);Peking University First Hospital(北京大学第一医院)
Using Computer Vision for Skin Disease Diagnosis in Bangladesh Enhancing Interpretability and Transparency in Deep Learning Models for Skin Cancer Classification