FlowInOne:Unifying Multimodal Generation as Image-in, Image-out Flow Matching
University of Electronic Science and Technology of China(电子科技大学);Central South University(中南大学);National University of Singapore(新加坡国立大学);University of Science and Technology of China(中国科学技术大学);Microsoft(微软)
Junchao Yi, Rui Zhao, Jiahao Tang, Weixian Lei, Linjie Li, Qisheng Su, Zhengyuan Yang, Lijuan Wang, Xiaofeng Zhu, Alex Jinpeng Wang
备注:
Accepted by ECCV 2026. 38 Pages, 21 Figures, 12 Tables
Multimodal generation has long been dominated by text-driven pipelines where language dictates vision but cannot reason or create within it. We challenge this paradigm by asking whether all modalities, including textual descriptions, spatial layouts, and editing instructions, can be unified into a single visual representation. We present FlowInOne, a framework that reformulates multimodal generation as a purely visual flow, converting all inputs into visual prompts and enabling a clean image-in, image-out pipeline governed by a single flow matching model. This vision-centric formulation naturally eliminates cross-modal alignment bottlenecks, noise scheduling, and task-specific architectural branches, unifying text-to-image generation, layout-guided editing, and visual instruction following under one coherent paradigm. To support this, we introduce VisPrompt-5M, a large-scale dataset of 5 million visual prompt pairs spanning diverse tasks including physics-aware force dynamics and trajectory prediction, alongside VP-Bench, a rigorously curated benchmark assessing instruction faithfulness, spatial precision, visual realism, and content consistency. Extensive experiments demonstrate that FlowInOne achieves state-of-the-art performance among open-source models across all unified generation tasks while remaining competitive with leading commercial systems, thereby establishing a new foundation for fully vision-centric generative modeling, in which perception and creation coexist within a unified continuous visual space. Our code and models are released on https://csu-jpg.github.io/FlowInOne.github.io/
DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers
Centre for Artificial Intelligence and Robotics, HKISI, CAS(中国科学院香港中文大学信息工程中心人工智能与机器人中心);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
One Framework to Rule Them All: Unifying Multimodal Tasks with LLM Neural-Tuning
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);College of Information Science and Engineering, Ritsumeikan University(立命馆大学信息科学与工程学院)
TIGeR: Unifying Text-to-Image Generation and Retrieval with Large Multimodal Models
National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学);University of Science and Technology of China(中国科学技术大学);Hong Kong Polytechnic University(香港理工大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
Harmonizing Visual Representations for Unified Multimodal Understanding and Generation
S-Lab, Nanyang Technological University(南洋理工大学S实验室);Shanghai AI Laboratory Research(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);SenseTime Research and Tetras.AI(SenseTime研究部和Tetras.AI);SenseTime Research(商汤科技研究院)
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Maryland(马里兰大学);Nvidia(英伟达);Salesforce AI Research(Salesforce AI研究);Intuit AI Research(Intuit AI研究)
CLIP-GS: Unifying Vision-Language Representation with 3D Gaussian Splatting
Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学学院);National University of Singapore(新加坡国立大学);Meituan(美团);Georgia Institute of Technology(佐治亚理工学院);Picsart AI Research (PAIR)(Picsart AI研究(PAIR))
MEDBind: Unifying Language and Multimodal Medical Data Embeddings
Peter Munk Cardiac Centre(彼得·芒克心脏中心);University Health Network (UHN)(大学网络健康中心);University of Toronto (U of T)(多伦多大学);Ted Rogers Centre for Heart Research(泰德·罗杰斯心脏研究中心);Vector Institute(向量研究所);Toronto General Hospital Research Institute(多伦多总医院研究所);Toronto General Hospital(多伦多总医院);Department of Medical Imaging(医学影像系)
Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究所);Xingchen AGI Lab, China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd(星辰通用人工智能实验室,中国电信人工智能技术(北京)有限公司);University of Science and Technology Beijing(北京科技大学);Beijing University of Posts and Telecommunications(北京邮电大学);Shanghai Jiao Tong University(上海交通大学)
University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);University of Michigan(密歇根大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Dolby Laboratories(杜比实验室)
UniMedVL: Unifying Medical Multimodal Understanding and Generation through Observation-Knowledge-Analysis
Shanghai Artificial Intelligence Laboratory;Shanghai Innovation Institute;Shanghai Jiao Tong University;Shanghai Institute of Optics;Fudan University;University of Cambridge;Monash University;DAMO Academy, Alibaba Group;Imperial College London;The University of Hong Kong;The Hong Kong University of Science;Hupan Lab;The Chinese University of Hong Kong
BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Dataset
Salesforce Research(Salesforce 研究院);University of Maryland(马里兰大学);Virginia Tech(弗吉尼亚理工大学);New York University(纽约大学);University of Washington(华盛顿大学);UC Davis(加州大学戴维斯分校)
UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs
University of Science and Technology of China(中国科学技术大学);Tsinghua University(清华大学);National University of Singapore(新加坡国立大学);Zhongguancun Academy(中关村学院)
ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation
University of Maryland, College Park(马里兰大学学院公园分校);University of Pennsylvania(宾夕法尼亚大学);The Hong Kong University of Science and Technology(香港科学与技术大学);University of Michigan(密歇根大学);University of Southern California(南加州大学)
UniAct: Unified Motion Generation and Action Streaming for Humanoid Robots
Institute for AI, Peking University(人工智能研究院,北京大学);Beijing Institute for General Artificial Intelligence (BIGAI)(北京通用人工智能研究院);School of Psychological and Cognitive Sciences, Peking University(心理学与认知科学学院,北京大学);School of Computer Science, Peking University(计算机科学学院,北京大学);Yuanpei College, Peking University(元培学院,北京大学);School of Foreign Languages, Peking University(外语学院,北京大学);School of EECS, Peking University(电子工程与科学学院,北京大学);Huazhong University of Science and Technology(华中科技大学);State Key Lab of General AI(通用人工智能国家重点实验室);Nat’l Eng. Research Center of Visual Technology(视觉技术国家工程研究中心);Beijing Key Laboratory of Behavior and Mental Health, Peking University(北京行为与心理健康重点实验室,北京大学);Embodied Intelligence Lab, PKU-Wuhan Institute for Artificial Intelligence(具身智能实验室,北京大学-武汉人工智能研究院)
UltraDub: Towards Authentic Dubbing by Unifying Visually-Steered Flow Learning and Trajectory Guidance
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Hangzhou Dianzi University(杭州电子科技大学);ByteDance(字节跳动);University of Science and Technology of China(中国科学技术大学)