The autonomous evolution of networked AI systems relies heavily on robust environmental perception. However, physical understanding remains brittle in current models because key physical signals are visually ambiguous and sparsely represented in web-scale data. To bridge the gap between data-centric learning and knowledge-based physical rules, we present OmniFysics, a compact omni-modal network that unifies signal processing and understanding across images, audio, video, and text. To enable autonomous optimization and inject explicit physical knowledge, we construct a dynamic physical data engine. Within this engine, FysicsAny acts as an adaptive mechanism that produces physics-grounded supervision by mapping salient objects to verified physical attributes via hierarchical retrieval and physics-law-constrained signal verification. Concurrently, FysicsOmniCap distills web videos utilizing advanced audio-visual cross-modal signal processing, generating high-fidelity data pairs that emphasize dynamic physical cues. We optimize the OmniFysics network through staged multimodal alignment and evolutive instruction tuning, integrating latent-space flow matching for generation and an adaptive intent router for efficient execution. Experiments demonstrate that this evolutive optimization paradigm not only achieves competitive performance on standard multimodal benchmarks but also significantly advances physics-oriented evaluations.
OmniHallu: Unified Hallucination Detection for Cross-Modal Comprehension and Generation in Multimodal Large Language Models
The University of Manchester(曼彻斯特大学);The University of Hong Kong(香港大学);Huazhong University of Science and Technology(华中科技大学);Shanghai Academy of Educational Sciences(上海市教育科学研究院);National University of Singapore(新加坡国立大学)
NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matching
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);NExT++ Research Center(NExT++研究中心);National University of Singapore(新加坡国立大学)
ReID5o: Achieving Omni Multi-modal Person Re-identification in a Single Model
National Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(多谱信息智能处理技术国家实验室,人工智能与自动化学院,华中科技大学);Shanghai AI Laboratory(上海人工智能实验室)
Omni-Reward: Towards Generalist Omni-Modal Reward Modeling with Free-Form Preferences
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models
School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences(中国科学院大学先进交叉科学学院);Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所中文信息处理实验室);University of Limerick(利默里克大学);CUHK, Shenzhen(香港中文大学(深圳))
MorphoQuant: Modality-Aware Quantization for Omni-modal Large Language Models
institutetext: MorphoQuant: Modality-Aware Quantization for Omni-modal Large Language Models Yue Wu Changyuan Wang Zixuan Wang Shilin Ma Yansong Tang(机构文本:MorphoQuant:多模态大语言模型的模态感知量化 Yue Wu 王昌元 王梓轩 马世林 唐彦松)
OmniCompass: A Holistic Benchmark for Omni-Modal Video Grounding and Understanding
The Hong Kong Polytechnic University(香港理工大学);OPPO Research Institute(OPPO研究院);Colorado School of Mines(科罗拉多矿业学院);Nanyang Technological University(南洋理工大学);Shanghai Jiao Tong University(上海交通大学)
Learning Generalized and Flexible Trajectory Models from Omni-Semantic Supervision
Southern University of Science and Technology(南方科技大学);City University of Hong Kong(香港城市大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳))
LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos
Southern University of Science and Technology(南方科技大学);University of Birmingham(伯明翰大学);University of Electronic Science and Technology of China(电子科技大学);The University of Hong Kong(香港大学);University of Manchester(曼彻斯特大学)
OmniBench: Towards The Future of Universal Omni-Language Models
University of Manchester(曼彻斯特大学);Queen Mary University of London(伦敦大学玛丽女王学院);Hongkong University of Science and Technology(香港科学与技术大学);Nanjing University(南京大学);Dartmouth College(达特茅斯学院)