Active visual exploration addresses the issue of limited sensor capabilities in real-world scenarios, where successive observations are actively chosen based on the environment. To tackle this problem, we introduce a new technique called Attention-Map Entropy (AME). It leverages the internal uncertainty of the transformer-based model to determine the most informative observations. In contrast to existing solutions, it does not require additional loss components, which simplifies the training. Through experiments, which also mimic retina-like sensors, we show that such simplified training significantly improves the performance of reconstruction, segmentation and classification on publicly available datasets.
Frontier Detection and Reachability Analysis for Efficient 2D Graph-SLAM Based Active Exploration
School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);Department of Computer Science, University of Macau(澳门大学计算机科学系);Department of Mechanical Engineering, MIT(麻省理工学院机械工程系)
Active Zero: Self-Evolving Vision-Language Models through Active Environment Exploration
Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所基础模型研究中心);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);National University of Singapore(新加坡国立大学);Wuhan AI Research(武汉人工智能研究所);Tsinghua University(清华大学)
From Exploration to Exploitation: A Two-Stage Entropy RLVR Approach for Noise-Tolerant MLLM Training
Independent Researcher(独立研究者);The Chinese University of Hong Kong(香港中文大学);City University of Hong Kong(香港城市大学);Hong Kong University of Science and Technology(香港科技大学);University of Hong Kong(香港大学)
Active Spatial Inspection for Effective and Efficient Embodied Exploration
The Hong Kong Polytechnic University(香港理工大学);China Three Gorges University(三峡大学);Huazhong University of Science and Technology(华中科技大学);Shenzhen University(深圳大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学)
TORE: Token Recycling in Vision Transformers for Efficient Active Visual Exploration
University of Warsaw(华沙大学);Faculty of Mathematics and Computer Science, Jagiellonian University(雅盖隆大学数学与计算机科学学院);Ardigen SA(Ardigen SA公司);Center for Molecular Medicine Cologne (CMMC), University of Cologne(科隆大学科隆分子医学中心);IDEAS NCBR