Visually exploring the world around us is not a passive process. Instead, we actively explore the world and acquire visual information over time. Here, we present a new model for simulating human eye-movement behavior in dynamic real-world scenes. We model this active scene exploration as a sequential decision making process. We adapt the popular drift-diffusion model (DDM) for perceptual decision making and extend it towards multiple options, defined by objects present in the scene. For each possible choice, the model integrates evidence over time and a decision (saccadic eye movement) is triggered as soon as evidence crosses a decision threshold. Drawing this explicit connection between decision making and object-based scene perception is highly relevant in the context of active viewing, where decisions are made continuously while interacting with an external environment. We validate our model with a carefully designed ablation study and explore influences of our model parameters. A comparison on the VidCom dataset supports the plausibility of the proposed approach.
Modular Diffusion Models for Structured Visual Recognition
Department of Computer Science, University of British Columbia(不列颠哥伦比亚大学计算机科学系);Vector Institute for AI(向量人工智能研究所);CompVis, Ludwig Maximilian University of Munich(慕尼黑路德维希·马克西米利安大学计算机视觉实验室);Munich Center for Machine Learning(慕尼黑机器学习中心);CIFAR AI Chair(CIFAR人工智能教席)
ReMoGen: Real-time Human Interaction-to-Reaction Generation via Modular Learning from Diverse Data
ShanghaiTech University(上海科技大学);Guangzhou Institute of Energy Conversion, CAS(中国科学院广州能源研究所);University of Science and Technology of China(中国科学技术大学);The Chinese University of Hong Kong(香港中文大学);Nanyang Technological University(南洋理工大学)
SceneX: Procedural Controllable Large-scale Scene Generation
University of Chinese Academy of Sciences(中国科学院大学);Centre for Artificial Intelligence and Robotics(人工智能与机器人研究中心);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Shandong University(山东大学);University of Science and Technology Beijing(北京科技大学);China University of Geosciences Beijing(中国地质大学(北京))
FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation
State Key Laboratory of General Artificial Intelligence (BIGAI)(通用人工智能国家重点实验室(BIGAI));Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院);School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院)
HMR-Net: Hierarchical Modular Routing for Cross-Domain Object Detection in Aerial Images
Department of Computer Science, University of York(约克大学计算机科学系);SEIEE, Shanghai Jiao Tong University(上海交通大学SEIEE);Computer Vision Laboratory, Linkoping University(林哈姆大学计算机视觉实验室);School of Computing and Mathematical Sciences, University of Leicester(莱斯特大学计算与数学科学学院);SCEE, East China Normal University(华东师范大学SCEE)
LLM-Driven 3D Scene Generation of Agricultural Simulation Environments
Faculty of Applied Engineering – Dept. of Electronics and ICT, University of Antwerp(应用工程学院——电子与信息通信技术系,安特卫普大学);Flanders Make Strategic Research Centre(弗拉芒制造战略研究中心)
Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolution
School of Data Science, Fudan University(复旦大学数据科学学院);Shanghai Innovation Institute(上海创新研究院);University of Surrey(Surrey大学);Imperial College London(伦敦帝国理工学院)
Language-Driven Object-Oriented Two-Stage Method for Scene Graph Anticipation
Department of Computer Science and Engineering, The Hong Kong University of Science and Technology(计算机科学与工程系,香港科学与技术大学);Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University of Technology(计算能力网络与信息安全重点实验室,教育部,山东计算机科学中心,齐鲁大学);Academy of Interdisciplinary Studies, The Hong Kong University of Science and Technology(跨学科研究学院,香港科学与技术大学)
Optimizing Latent Graph Representations of Surgical Scenes for Zero-Shot Domain Transfer
University of Strasbourg(斯特拉斯堡大学);CNRS(法国国家科学研究中心);West China Hospital of Sichuan University(四川大学华西医院);IHU Strasbourg(斯特拉斯堡大学医院研究所);Fondazione Policlinico Universitario A. Gemelli IRCCS(Gemelli IRCCS大学综合医院基金会)
Tübingen AI Center(图宾根人工智能中心);University of Tübingen(图宾根大学);EPFL(洛桑联邦理工学院);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Cambridge(剑桥大学);Amazon(亚马逊)
3D-Aware Object Goal Navigation via Simultaneous Exploration and Identification
Peking University(北京大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Tongji University(同济大学);Huazhong University of Science and Technology(华中科技大学);Tencent AI Lab(腾讯人工智能实验室);National University of Defense Technology(国防科技大学)