The advent of always-on personal AI assistants, enabled by all-day wearable devices such as smart glasses, demands a new level of contextual understanding, one that goes beyond short, isolated events to encompass the continuous, longitudinal stream of egocentric video. Achieving this vision requires advances in long-horizon video understanding, where systems must interpret and recall visual and audio information spanning days or even weeks. Existing methods, including large language models and retrieval-augmented generation, are constrained by limited context windows and lack the ability to perform compositional, multi-hop reasoning over very long video streams. In this work, we address these challenges through EGAgent, an enhanced agentic framework centered on entity scene graphs, which represent people, places, objects, and their relationships over time. Our system equips a planning agent with tools for structured search and reasoning over these graphs, as well as hybrid visual and audio search capabilities, enabling detailed, cross-modal, and temporally coherent reasoning. Experiments on the EgoLifeQA and Video-MME (Long) datasets show that our method achieves state-of-the-art performance on EgoLifeQA (57.5%) and competitive performance on Video-MME (Long) (74.1%) for complex longitudinal video understanding tasks. Code is available at https://github.com/facebookresearch/egagent.
VideoGAIA: A Benchmark for General AI Assistants on Agentic Video Understanding
The Chinese University of Hong Kong(香港中文大学);Ant Group(蚂蚁集团);Tsinghua University(清华大学);Tongji University(同济大学);The Hong Kong University of Science and Technology(香港科技大学)
VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videos
Shandong University(山东大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beihang University(北航);Southern University of Science and Technology(南方科技大学)
Video-Browser: Towards Open-web Agentic Video Browsing
Singapore Management University(新加坡管理大学);University of Trento(特伦托大学);Beijing Academy of Artificial Intelligence(北京智源人工智能研究院);Hong Kong Polytechnic University(香港理工大学)
LensWalk: Agentic Video Understanding by Planning How You See in Videos
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Peng Cheng Laboratory(鹏城实验室);College of Computer Science and Electronic Engineering, Hunan University(湖南大学计算机科学与电子工程学院);University of Chinese Academy of Sciences(中国科学院大学)
MUPA: Towards Multi-Path Agentic Reasoning for Grounded Video Question Answering
Lanzhou University(兰州大学);National University of Singapore(新加坡国立大学);Sun Yat-sen University(中山大学);Jinan University(暨南大学);Nanyang Technological University(南洋理工大学);Peking University(北京大学);University of Science and Technology of China(中国科学技术大学);Hefei University of Technology(合肥工业大学)
VideoExplorer: Think With Videos For Agentic Long-Video Understanding
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Beijing University of Posts and Telecommunications(北京邮电大学);Hong Kong Polytechnic University(香港理工大学);Peking University(北京大学);University of Trento(特伦托大学)
StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding
The Hong Kong University of Science and Technology(香港科技大学);Xiaohongshu Inc.(小红书公司);The University of Hong Kong(香港大学);The Chinese University of Hong Kong(香港中文大学)
VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understanding
Alibaba Group(阿里巴巴集团);University of Science and Technology of China(中国科学技术大学);Shanghai Jiao Tong University(上海交通大学);University of Chinese Academy of Sciences(中国科学院大学);Beihang University(北京航空航天大学)
EventMemAgent: Hierarchical Event-Centric Memory for Online Video Understanding with Adaptive Tool Use
Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, School of Artificial Intelligence, Beihang University(北京未来区块链与隐私计算先进创新中心,人工智能学院,北京航空航天大学);Hangzhou International Innovation Institute, Beihang University(杭州国际创新研究院,北京航空航天大学);Paradigm Inc.(4Paradigm公司)
UniVA: Universal Video Agent towards Open-Source Next-Generation Video Generalist
Singapore Management University(新加坡管理大学);University of Rochester(罗切斯特大学);University College London(伦敦大学学院);National University of Singapore(新加坡国立大学);The Chinese University of Hong Kong(香港中文大学);Stanford University(斯坦福大学)